К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Applied Natural Language Processing in Engineering Part 2 · LearnSpace
Назад в каталог
courseraАнализ данных

Applied Natural Language Processing in Engineering Part 2

Курс от Northeastern University
Уровень не указан≈ 33.6 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

This course is best suited for software engineers, data scientists, and graduate students in computer science or engineering fields who wish to develop expertise in building and deploying natural language processing systems to solve real-world language understanding challenges. You will master core NLP tasks such as Part-of-Speech tagging, Named Entity Recognition, sentiment analysis, and Neural Machine Translation while implementing various neural architectures from Recurrent Neural Networks and bidirectional RNNs to Conditional Random Fields and state-of-the-art transformer models. The course emphasizes practical application through extensive laboratory work and projects, where you will develop complete NLP pipelines using frameworks like PyTorch and Hugging Face, learning to preprocess data, train models, and evaluate performance using industry-standard metrics. By the end of the course, you will be equipped with both theoretical understanding and practical skills to design, implement, and optimize NLP solutions for real-world engineering applications, from chatbots and translation systems to information extraction and text analysis tools. The curriculum culminates in a comprehensive capstone project where you will apply multiple techniques learned throughout the course to solve a complex language processing challenge. You will be equipped with both theoretical knowledge to tackle complex language processing problems in industry settings, enabling you to build production-ready NLP applications that can understand, interpret, and generate human language effectively.

Навыки, которые вы освоите

Natural Language ProcessingRecurrent Neural Networks (RNNs)Large Language ModelingMarkov ModelArtificial Neural NetworksData PreprocessingMachine Learning MethodsDeep LearningTransfer LearningGenerative Model ArchitecturesPyTorch (Machine Learning Library)Model TrainingHugging FaceModel Optimization

Программа курса

7 модулей · 168 учебных материалов

01Tokenization17 материалов

Getting Started

Course IntroductionЧтениеMeet Your FacultyВидеоSyllabus - Applied Natural Language Processing in Engineering Part 2ЧтениеAcademic IntegrityЧтение

Lesson 1: Tokenization

Учитесь у экспертов

Ramin Mohammadi

Преподаватель курса

Applied Natural Language Processing in Engineering Part 2
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 33.6 ч

7 модулей

Язык: Английский

Субтитры: Арабский, Французский, Итальянский, Бразильский португальский, Корейский, Немецкий, Испанский, Японский, Венгерский

Часть программы вашего университета
Week 8 OverviewЧтение
IntroductionЧтение
Pre-TokenizationЧтение
Character-based TokenizationЧтение
Word-level TokenizationЧтение
Byte Pair Encoding (BPE)Чтение
WordPiece TokenizationЧтение
Unigram TokenizationЧтение
The Viterbi Algorithm for TokenizationВнешний инструмент
Vocabulary Pruning in Unigram TokenizationЧтение
Summary and Final ThoughtsЧтение
Assess Your Learning: TokenizationЗадание

Module 8 Assessment

Module 8 QuizЗадание
02Language Models25 материалов

Lesson 1: What is a Language Model?

Week 9 OverviewЧтениеIntroduction to Language ModelsЧтениеProbability Assignment in Language ModelЧтениеEvolution of Language ModelsЧтениеState-of-the-Art ModelsЧтениеLanguage ModelsВидеоN-GramЧтениеProbabilities in Language ModelsЧтениеExample: The Cat Sat on the MatЧтениеLimitations of N-Gram ModelsЧтениеAssess Your Learning: Language ModelsЗадание

Lesson 2: Feedforward Neural Network Models (FFNNs)

FFNN in Language ModelingЧтениеPros and Cons of FFNNsЧтениеAssess Your Learning: FFNNsЗадание

Lesson 3: Hidden Markov Model (HMM)

Introduction to HMMЧтениеHidden Markov ModelsЧтениеHidden Markov ModelsВидеоMathematical Representation of HMMsЧтениеLikelihood Problem: Forward AlgorithmЧтениеDecoding Problem: Viterbi AlgorithmЧтение

Module 9 Assessment

Module 9 QuizЗадание
03Recurrent Neural Networks - RNNs27 материалов

Lesson 1: Recurrent Neural Networks (RNNs)

Week 10 OverviewЧтениеRecurrent Neural Networks (RNNs)ЧтениеRecurrent Neural NetworksВидеоChallenges & Applications in RNNЧтениеParameter Sharing in RNNЧтениеDynamic SystemsЧтениеDynamic Systems to RNNЧтениеComputing Gradient in RNNЧтениеRNN Advantages and DisadvantagesЧтениеTraining an RNN Language ModelЧтениеThe RNN ProcessВидеоProblems with RNNЧтениеHow to Solve these Issues?ЧтениеIntroduction to LSTM, GRU, and Residual NetworksВнешний инструментGated RNNЧтениеLSTM EquationsЧтениеGated Recurrent Unit (GRU)ЧтениеResidual Neural NetworksЧтениеSkip Connection: The Key to Learning ResidualsЧтениеAssess Your Learning: RNNsЗадание

Lesson 2: RNN Example

Conventions UsedЧтениеStep-by-Step Breakdown 1 - 2ЧтениеStep-by-Step Breakdown 3 A - GЧтениеStep-by-Step Breakdown 3 H - NЧтениеStep-by-Step Breakdown 4 - 6ЧтениеPerplexity CalculationЧтение

Module 10 Assessment

Module 10 QuizЗадание
04PoS Tagging, Bidirectional RNNs & Sentiment Analysis20 материалов

Lesson 1: Parts of Speech (PoS) Tagging

Week 11 OverviewЧтениеIntroduction to PoS Tagging, Bidirectional RNNs, and Sentiment AnalysisВидеоIntroduction to PoS TaggingЧтениеHow does PoS Tagging Works?ЧтениеChallenges in & Advantages of PoS TaggingЧтениеUsing Recurrent Neural Networks (RNNs) for PoS TaggingЧтениеSteps in PoS Tagging with RNNЧтениеUsing LSTM or GRU in Place of Simple RNNsЧтениеConclusionЧтениеAssess Your Learning: PoSЗадание

Lesson 2: Bidirectional and Multi-layer RNNs

MotivationЧтениеBidirectional RNNsЧтениеMulti-layer RNNsЧтениеAssess Your Learning: Bidirectional RNNsЗадание

Lesson 3: Sentiment Analysis

IntroductionЧтениеApproaches with RNNsЧтениеOther Approaches for Sentiment AnalysisЧтениеConclusionЧтениеAssess Your Learning: Sentiment AnalysisЗадание

Module 11 Assessment

Module 11 Quiz Задание
05CRF, NER and, NMT25 материалов

Lesson 1: Conditional Random Fields (CRF)

Week 12 OverviewЧтениеIntroduction to CRFВидеоDefinition of CRFЧтениеCRF Model with LSTMЧтениеCombining LSTM with CRFЧтениеCalculating the Probability of a Sequence, Log-Probability & Training ObjectiveЧтениеDecoding: Finding the Best Label SequenceЧтениеDetails on LSTM-CRF ComponentsЧтениеSummary of the Transition Matrix in CRFЧтениеAssess Your Learning: CRFsЗадание

Lesson 2: Named Entity Recognition (NER)

Introduction to NER and NMTВидеоNamed Entity Recognition (NER)ЧтениеNER Using RNNs/LSTMsЧтениеBiLSTM for NERЧтениеCRF Layer for Sequencing LabelingЧтениеAttention in NERЧтениеTable: Alphabetical List of PoS Tags used in the Penn Treebank Project

Lesson 3: Neural Machine Translation (NMT)

Machine Translation OverviewЧтениеSequence-to-Sequence Model for NMTЧтениеVisualization of the NMT Process ВидеоLearning in NMT: Optimization and Loss FunctionЧтениеByte Pair Encoding (BPE) for Handling Rare WordsЧтениеAssess Your Learning: NMTsЗадание

Module 12 Assessment

Module 12 QuizЗадание
06Attention & Transformers32 материалов

Lesson 1: Attention

Week 13 OverviewЧтениеIntroduction and MotivationЧтениеSequence-to-Sequence ModelsЧтениеChallenges of Seq2Seq ModelsЧтениеAttention MechanismsВидеоAttention MechanismsЧтениеGeneral Seq2Seq ModelsЧтениеDetailed Attention Process in Seq2SeqЧтениеAssess Your Learning: AttentionЗадание

Lesson 2: Transformers

Introduction and Transformer ArchitectureЧтениеApplications of Transformer ArchitecturesЧтениеKey, Query, ValueЧтениеSelf-AttentionЧтениеSelf-Attention as RoutingЧтениеComputing and Weighting ValuesЧтениеSelf-Attention in Matrix Form

Module 13 Assessment

Module 13 QuizЗадание
07Pre-training22 материалов

Lesson 1: Pre-Training

Week 14 OverviewЧтениеIntroduction to Pre-TrainingЧтениеPre-TrainingВидеоPretrained Word EmbeddingsЧтениеLearning from Reconstructing InputЧтениеPretraining Through Language ModelingЧтениеPretraining for Three Types of ArchitecturesЧтениеBERT: Bidirectional Encoder Representations from TransformersЧтениеBERT Pre-training ЧтениеFine-tuningЧтениеFull fine-tuning vs Parameter-Efficient Fine-tuningЧтениеLimitations of Pre-trained Encoders and Extensions of BERTЧтениеPretraining DecodersЧтениеGenerative Pretrained Transformer (GPT)ЧтениеScaling LawsЧтениеWhat kinds of things does pretraining teach?ЧтениеPretraining encoder-decoders: What pretraining objective to use?ЧтениеSpan Corruption: T5 modelЧтениеTransfer Learning to Downstream TasksЧтениеAssess Your Learning: Pre-trainingЗадание

Module 14 Assessment

Module 14 QuizЗадание

Course Wrap-Up

Congratulations! Чтение
Learning Problem: Baum-Welch AlgorithmЧтение
Example of HMMЧтение
HMMs in Speech RecognitionЧтение
Assess Your Learning: HMMsЗадание
Чтение
Assess Your Learning: NERsЗадание
Чтение
Position Representations Чтение
The IntuitionЧтение
Elementwise NonlinearityЧтение
Multi-head AttentionЧтение
Multi-Head VisualizationВнешний инструмент
Sequence-Tensor FormЧтение
TransformersЧтение
TransformersВидео
Types of TransformersЧтение
Cross-AttentionЧтение
Decoder Process with Cross-AttentionЧтение
Encoder-Decoder ExampleВнешний инструмент
Drawbacks of TransformersЧтение
ConclusionЧтение
Assess Your Learning: TransformerЗадание