К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Foundations of Transformer Architectures for Natural Language Processing · LearnSpace
Назад в каталог
courseraПрограммирование

Foundations of Transformer Architectures for Natural Language Processing

Курс от Packt
Средний≈ 7.5 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

Explore the core principles and foundational architectures of transformers, focusing on their revolutionary impact on natural language processing. Gain a deep understanding of how transformer models work and the tasks they enable. This course introduces the fundamental concepts behind transformer models, tracing their evolution and examining their architecture in detail. Learners will discover how transformers have transformed natural language processing, from basic input representations to advanced tasks such as reading comprehension and translation. By the end of the course, you will be equipped to understand and evaluate transformer-based models and their applications in NLP. Through a blend of clear explanations, real-world examples, and guided explorations, this course builds your understanding of transformer models step by step. You will progress from foundational concepts to practical applications, ensuring a solid grasp of both theory and practice. This course is part one of a three-course Specialization designed to build a complete and cohesive understanding of the subject. While it offers valuable skills on its own, you'll gain the most benefit by progressing through all three courses as a structured learning journey. This course is based on Transformers for Natural Language Processing and Computer Vision, by Denis Rothman. Packt is one of the world's most prolific publishers of cutting-edge technical content. For over two decades we've made it our mission to curate and publish the knowledge of only the very best technical experts. We focus on real-world courses that help our customers get the job done, with coverage that extends across a wide range of established and cutting-edge technical topics. If you're an individual or an organisation that embraces learning by doing, Packt is the perfect fit for you.

Навыки, которые вы освоите

Model EvaluationNatural Language ProcessingEmbeddingsTransfer LearningHugging FaceAI WorkflowsFine-tuningGeminiModel TrainingLarge Language ModelingArchitectural EngineeringData PreprocessingToken OptimizationChatGPTArtificial Intelligence and Machine Learning (AI/ML)Generative AI

Программа курса

6 модулей · 57 учебных материалов

01What are Transformers?10 материалов

Unveiling the Power and Potential of Transformer Models

OverviewВидеоIntroductionЧтениеFoundation ModelsЧтениеA Brief History of How Transformers Were BornЧтение

Учитесь у экспертов

Packt - Course Instructors

Преподаватель курса

Foundations of Transformer Architectures for Natural Language Processing
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 7.5 ч

6 модулей

Язык: Английский

Часть программы вашего университета
Explaining Transformer Models to a Non-Technical StakeholderDIALOGUE
From One Token to an AI RevolutionЧтение
The New Role of AI ProfessionalsЧтение
What Resources Should We Use?Чтение
Choosing Ready-to-Use API-Driven LibrariesЧтение
Transformers and Their Impact on AI DevelopmentЗадание
02Getting Started with the Architecture of the Transformer Model10 материалов

Demystifying Self-Attention: Building Blocks of the Transformer

OverviewВидеоIntroductionЧтениеInput EmbeddingЧтениеPositional EncodingЧтениеExplaining Transformer Input Embedding and Positional EncodingDIALOGUEAdding Positional Encoding to the Embedding VectorЧтениеStep 1: Represent the inputЧтениеStep 6: The final attention representationsЧтениеPost-layer NormalizationЧтениеExploring the Transformer Model ArchitectureЗадание
03Emergent vs Downstream Tasks: The Unseen Depths of Transformers8 материалов

Unraveling Transformer Intelligence: From Benchmarks to Real-World NLU Challenges

OverviewВидеоIntroductionЧтениеExploring Emergence with ChatGPTЧтениеExplaining Transformer Performance on Downstream NLU TasksDIALOGUEIntroducing Higher Human Baselines StandardsЧтениеMulti-Sentence Reading Comprehension (MultiRC)ЧтениеThe Winograd Schema Challenge (WSC)ЧтениеExploring Transformer Capabilities and NLP ChallengesЗадание
04Advancements in Translations with Google Trax, Google Translate, and Gemini9 материалов

Mastering Machine Translation: From Data Preparation to BLEU Evaluation

OverviewВидеоIntroductionЧтениеEvaluating Machine TranslationsЧтениеFinalizing the Preprocessing of the DatasetsЧтениеExplaining BLEU Scores and Dataset Preprocessing in Machine TranslationDIALOGUEGeometric EvaluationsЧтениеTranslations with Google TraxЧтениеTranslation with Google TranslateЧтениеAdvancements in Machine TranslationЗадание
05Diving into Fine-Tuning through BERT9 материалов

Mastering BERT Fine-Tuning: From Tokenization to Prediction

OverviewВидеоIntroductionЧтениеNext-sentence PredictionЧтениеFine-tuning BERTЧтениеRecommending a BERT Fine-Tuning Approach for a Client NLP ProjectDIALOGUECreating Sentences, Label Lists, and Adding BERT TokensЧтениеOptimizer Grouped ParametersЧтениеExploring the Prediction ProcessЧтениеExploring BERT and Its ApplicationsЗадание
06Pretraining a Transformer from Scratch through RoBERTa11 материалов

From Tokenizer Training to Custom Transformer Pretraining

OverviewВидеоIntroductionЧтениеTraining a Tokenizer and Pretraining a TransformerЧтениеStep 4: Saving the files to diskЧтениеPretraining a Transformer and Tokenizer with RoBERTaDIALOGUEExploring the ParametersЧтениеStep 10: Building the datasetЧтениеPretraining a Generative AI Customer Support Model on X DataЧтениеStep 7: Initializing the trainerЧтениеTransformer Model Fundamentals and PretrainingЗаданиеFoundations of Transformer Architectures for Natural Language Processing Final AssessmentЗадание