К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Training, Evaluating, and Monitoring Machine Learning Models · LearnSpace
Назад в каталог
courseraАнализ данных

Training, Evaluating, and Monitoring Machine Learning Models

Курс от Coursera
Средний≈ 11.6 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

Building machine learning models is only the first step. To create reliable ML systems, engineers must evaluate model performance, diagnose prediction errors, and monitor deployed models over time. In this course, you'll learn how to train, evaluate, and monitor machine learning models using practical engineering techniques. You’ll begin by exploring model training strategies that improve convergence and performance. You’ll analyze training logs, loss curves, and class imbalance effects to understand how models learn and where they struggle. Next, you’ll learn how to evaluate machine learning models using appropriate performance metrics. You’ll analyze confusion matrices and residual patterns to identify systematic prediction errors and assess the statistical significance of model improvements. Finally, you’ll focus on monitoring machine learning models in production environments. You’ll apply validation techniques, analyze A/B testing results, and monitor model behavior over time to detect performance drift and trigger retraining workflows. Through a hands-on project, you'll design a model evaluation and monitoring framework that helps ensure machine learning systems remain accurate and reliable after deployment.

Навыки, которые вы освоите

Model EvaluationModel TrainingA/B TestingContinuous MonitoringStatistical Hypothesis TestingSystem MonitoringPerformance MetricVerification And ValidationFailure AnalysisModel DeploymentApplied Machine LearningBenchmarkingStatistical AnalysisScikit Learn (Machine Learning Library)

Программа курса

10 модулей · 51 учебных материалов

01Model Training & Evaluation: Mini-Batch Training for Better Model Convergence 6 материалов

Mini-Batch Training for Better Model Convergence

Your Training Workflow MindsetDIALOGUEIntroduction and WelcomeВидеоWhy Mini-Batches Improve Training StabilityВидеоBatch vs Mini-Batch: What Changes in PracticeЧтение

Учитесь у экспертов

Professionals from the Industry

Преподаватель курса

Training, Evaluating, and Monitoring Machine Learning Models
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 11.6 ч

10 модулей

Язык: Английский

Субтитры: Арабский, Французский, Итальянский, Бразильский португальский, Корейский, Немецкий, Испанский, Японский

Часть программы вашего университета
How Schedulers Influence ConvergenceВидео
Hands-On Activity: Train a PyTorch Model with Mini-Batches and SchedulerЗадание
02Model Training & Evaluation: Diagnosing Training Issues with Logs and Loss Curves 5 материалов

Diagnosing Training Issues with Logs and Loss Curves

Reflection on Diagnosing Training IssuesDIALOGUEReading Loss Curves Like an AnalystВидеоCommon Training Issues and How Logs Reveal ThemЧтениеSpotting Instability Using Training LogsВидеоFix Overfitting by Analyzing Divergence PatternsЛабораторная
03Model Training & Evaluation: Comparing Class-Imbalance Techniques in Model Evaluation 5 материалов

Comparing Class-Imbalance Techniques in Model Evaluation

Choosing Class-Imbalance Methods with ConfidenceВидеоHow Balanced Data Shapes Your Model’s F1 ScoreЧтениеHands-On Activity: Compare F1 Scores Using Class-Weights and SMOTEЗаданиеReflect on Your Evaluation ApproachDIALOGUEGraded Quiz: Assessing Training, Diagnostics, and Imbalance MethodsЗадание
04Evaluate, Analyze, and Model Performance: Choosing the Right Performance Metrics 5 материалов
Why Metrics Matter in Model Evaluation?ВидеоReflecting on Model Performance MetricsDIALOGUERMSE vs. MAE for Regression ModelsВидеоReflecting on Model Performance Metrics ЧтениеHands-On Activity: Metric Matching ExerciseЗадание
05Evaluate, Analyze, and Model Performance: Diagnosing Model Failures with Error Analysis5 материалов
Looking Inside the Confusion MatrixВидеоReflecting on Systematic Model ErrorsDIALOGUEResidual Plots for Regression DiagnosticsВидеоDiagnosing Systematic Model Errors with Confusion Matrices and Residual Plots ЧтениеHands-On Activity: Spam Filter Failure AnalysisЗадание
06Evaluate, Analyze, and Model Performance: Testing Whether Performance Differences Are Significant 6 материалов
Why Statistical Significance Matters in Model ComparisonВидеоReflecting on Statistical Significance in Model ComparisonsDIALOGUEBootstrapping Metrics Step by StepВидеоEvaluating Statistical Significance in Automated Model Monitoring ЧтениеEnd-to-End Model Evaluation PracticeЛабораторнаяGraded Quiz: Interpreting Metrics and Model ImprovementsЗадание
07Validate, Analyze, and Monitor ML Models: Validating Models on Unseen Data 5 материалов
Why Validation Is a Release GateВидеоValidation Mindset and Common PitfallsDIALOGUEHold-Out Sets and Evaluation Metrics in PracticeВидеоDesigning a Validation Checklist for Release CandidatesЧтениеHands-On Activity: Validate a Release Candidate ModelЗадание
08Validate, Analyze, and Monitor ML Models: Analyzing Online Experiments and Shadow Deployments 5 материалов
From Offline Metrics to Online ImpactВидеоReading Experiment Results with ConfidenceDIALOGUEA/B Tests vs. Shadow Deployments ExplainedВидеоComparing Models Using A/B Testing and Shadow Deployments ЧтениеHands-On Activity: Analyze Shadow Deployment ResultsЗадание
09Validate, Analyze, and Monitor ML Models: Monitoring Model Drift and Triggering Retraining 6 материалов
Why Models Drift in ProductionВидеоSetting Practical Drift ThresholdsDIALOGUEUsing PSI for Ongoing MonitoringВидео Automating Monitoring and Retraining TriggersЧтениеBuild a Drift Monitoring WorkflowЛабораторнаяGraded Quiz: Validate, Analyze, and Monitor ML ModelsЗадание
10Project: End-to-End Model Evaluation & Monitoring Framework 3 материалов
Why Model Evaluation and Monitoring Matter in Production ML Systems ЧтениеProject RequirementsЧтениеEnd-to-End Model Evaluation & Monitoring Framework Задание