К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Advanced Techniques and Interpretability in LLMs · LearnSpace
Назад в каталог
courseraПрограммирование

Advanced Techniques and Interpretability in LLMs

Курс от Packt
Средний≈ 11.1 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

Delve into advanced transformer techniques, including generative AI, fine-tuning, interpretability, and the critical role of tokenization. Learn how to leverage and interpret large language models for a variety of sophisticated NLP tasks. This course covers the next level of transformer applications, focusing on generative AI with models like ChatGPT, advanced fine-tuning strategies, and the interpretability of model outputs. Learners will explore how tokenization shapes model performance, how embeddings can be used for search and transfer learning, and how to apply transformers to tasks such as semantic role labeling and summarization. By completing this course, you will be able to implement, fine-tune, and interpret large language models for complex NLP challenges. The course combines in-depth conceptual discussions with practical demonstrations, guiding learners through the intricacies of advanced transformer techniques and interpretability tools. Each topic is presented with clarity to ensure learners can apply these methods confidently. This course is part two of a three-course Specialization designed to build a complete and cohesive understanding of the subject. While it offers valuable skills on its own, you'll gain the most benefit by progressing through all three courses as a structured learning journey. This course is based on Transformers for Natural Language Processing and Computer Vision, by Denis Rothman. Packt is one of the world's most prolific publishers of cutting-edge technical content. For over two decades we've made it our mission to curate and publish the knowledge of only the very best technical experts. We focus on real-world courses that help our customers get the job done, with coverage that extends across a wide range of established and cutting-edge technical topics. If you're an individual or an organisation that embraces learning by doing, Packt is the perfect fit for you.

Навыки, которые вы освоите

Token OptimizationEmbeddingsFine-tuningArtificial Intelligence and Machine Learning (AI/ML)OpenAIGenerative AI AgentsOpenAI APILarge Language ModelingRetrieval-Augmented GenerationLLM ApplicationNatural Language ProcessingChatGPTModel EvaluationResponsible AIData EthicsComputer VisionGenerative AIAI WorkflowsAI SecurityGenerative Model Architectures

Программа курса

9 модулей · 78 учебных материалов

01The Generative AI Revolution with ChatGPT10 материалов

Harnessing GPT-4: From Model Architecture to Real-World Applications

OverviewВидеоIntroductionЧтениеPervasivenessЧтениеContext Size and Maximum Path LengthЧтение

Учитесь у экспертов

Packt - Course Instructors

Преподаватель курса

Advanced Techniques and Interpretability in LLMs
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 11.1 ч

9 модулей

Язык: Английский

Часть программы вашего университета
Stacking Decoder LayersЧтение
Explaining GPT Model Capabilities to a Non-Technical ExecutiveDIALOGUE
OpenAI Models as AssistantsЧтение
Getting Started with ChatGPT GPT-4 as an AssistantЧтение
Getting Started with the GPT-4 APIЧтение
Retrieval Augmented Generation (RAG) with GPT-4Чтение
02Fine-Tuning OpenAI GPT Models4 материалов

Customizing GPT: From Data Preparation to Model Enhancement

OverviewВидеоFine-Tuning OpenAI GPT Models - The ReadingЧтениеExplaining Fine-Tuning and Dataset Preparation for GPT ModelsDIALOGUEMastering Model Adaptation TechniquesЗадание
03Shattering the Black Box with Interpretable Tools9 материалов

Demystifying Transformers: Visualizing and Interpreting Model Decisions

OverviewВидеоIntroductionЧтениеStreaming the Output of the Attention HeadsЧтениеInterpreting Hugging Face Transformers with SHAPЧтениеExplaining Transformer Interpretability Tools to a StakeholderDIALOGUETransformer Visualization via Dictionary LearningЧтениеOther Interpretable AI ToolsЧтениеOpenAI LLMs Explain Neurons in TransformersЧтениеDecoding Transformer TransparencyЗадание
04Investigating the Role of Tokenizers in Shaping Transformer Models9 материалов

Unpacking Tokenization: Foundations and Impact on Transformers

OverviewВидеоIntroductionЧтениеWord2Vec TokenizationЧтениеCase 1: Words not in the dataset or the dictionaryЧтениеExplaining Tokenizer Roles in Transformer ModelsDIALOGUECase 3: Words in a Text but Not in the DictionaryЧтениеRegular Expression TokenizationЧтениеSentencePieceЧтениеTokenization in Modern Language ModelsЗадание
05Leveraging LLM Embeddings as an Alternative to Fine-Tuning7 материалов

Harnessing Embeddings for Smarter Search and Clustering

OverviewВидеоIntroductionЧтениеImplementing Question-Answering Systems with Embedding-Based Search TechniquesЧтениеRecommending Embedding-Based Search for a QA SystemDIALOGUE2.3 Evaluating the model without a knowledge base: GPT cannot answer questionsЧтениеTransfer Learning with Ada EmbeddingsЧтениеExploring Embeddings and Their Role in Machine LearningЗадание
06Toward Syntax-Free Semantic Role Labeling with ChatGPT and GPT-47 материалов

Unleashing Transformers: Semantic Role Labeling Beyond Syntax

OverviewВидеоIntroductionЧтениеDifficult SampleЧтениеExplaining Syntax-Free Semantic Role Labeling with GPT-4DIALOGUERedefining SRLЧтениеSample 3 (basic)ЧтениеSemantic Role Labeling and Language Model CapabilitiesЗадание
07Summarization with T5 and ChatGPT8 материалов

Mastering Text Summarization: Comparing T5 and ChatGPT in Practice

OverviewВидеоIntroductionЧтениеExploring the Architecture of the T5 ModelЧтениеRecommending a Summarization Approach for Legal DocumentsDIALOGUECreating a Summarization FunctionЧтениеThe Bill of Rights SampleЧтениеFrom Text-to-Text to New Word Predictions with OpenAI ChatGPTЧтениеExploring T5 and ChatGPT in Text SummarizationЗадание
08Exploring Cutting-Edge LLMs with Vertex AI and PaLM 211 материалов

Harnessing Next-Generation Language Models with Google Vertex AI

OverviewВидеоIntroductionЧтениеSwiGLU Activations Improve Model QualityЧтениеGoogle WorkspaceЧтениеVertex AI PaLM 2 InterfaceЧтениеUnderstanding SwiGLU Activations and Vertex AI PaLM 2 ArchitectureDIALOGUEVertex AI PaLM 2 AssistantЧтениеSentiment AnalysisЧтениеMulti-choice ProblemsЧтениеCodeЧтениеExploring Modern AI TechnologiesЗадание
09Guarding the Giants: Mitigating Risks in Large Language Models13 материалов

Navigating Ethical Challenges and Security in AI Language Models

OverviewВидеоIntroductionЧтениеAuto-BIG-BenchЧтениеWandBЧтениеRisk ManagementЧтениеAdvising on LLM Risk Mitigation StrategiesDIALOGUEMemorizationЧтениеInfluence OperationsЧтениеHarmful ContentЧтениеCybersecurityЧтениеAdding KeywordsЧтениеGuarding the Giants: Risk Management in AIЗаданиеAdvanced Techniques and Interpretability in Large Language Models Final AssessmentЗадание