К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
A Complete Reinforcement Learning System (Capstone) · LearnSpace
Назад в каталог
courseraАнализ данных

A Complete Reinforcement Learning System (Capstone)

Курс от University of Alberta, Alberta Machine Intelligence Institute
Средний≈ 15.8 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

In this final course, you will put together your knowledge from Courses 1, 2 and 3 to implement a complete RL solution to a problem. This capstone will let you see how each component---problem formulation, algorithm selection, parameter selection and representation design---fits together into a complete solution, and how to make appropriate choices when deploying RL in the real world. This project will require you to implement both the environment to stimulate your problem, and a control agent with Neural Network function approximation. In addition, you will conduct a scientific study of your learning system to develop your ability to assess the robustness of RL agents. To use RL in the real world, it is critical to (a) appropriately formalize the problem as an MDP, (b) select appropriate algorithms, (c ) identify what choices in your implementation will have large impacts on performance and (d) validate the expected behaviour of your algorithms. This capstone is valuable for anyone who is planning on using RL to solve real problems. To be successful in this course, you will need to have completed Courses 1, 2, and 3 of this Specialization or the equivalent. By the end of this course, you will be able to: Complete an RL solution to a problem, starting from problem formulation, appropriate algorithm selection and implementation and empirical study into the effectiveness of the solution.

Навыки, которые вы освоите

Reinforcement LearningAlgorithmsArtificial Neural NetworksMachine Learning AlgorithmsPerformance TuningMachine LearningModel OptimizationAgentic systemsSolution ArchitectureMachine Learning MethodsFeature EngineeringModel EvaluationMarkov ModelSystems DevelopmentModel Training

Программа курса

6 модулей · 37 учебных материалов

01Welcome to the Final Capstone Course! 5 материалов

Course Introduction

Course 4 IntroductionВидеоMeet your instructors!ВидеоReinforcement Learning TextbookЧтениеPre-requisites and Learning ObjectivesЧтение

Учитесь у экспертов

Martha White

Assistant Professor

Adam White

Assistant Professor

A Complete Reinforcement Learning System (Capstone)
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 15.8 ч

6 модулей

Язык: Английский

Субтитры: Арабский, Французский, Бенгальский, Узбекский, Украинский, Китайский (Китай), Греческий, Итальянский, Бразильский португальский, Вьетнамский, Нидерландский, Корейский, Немецкий, Пушту, Урду, Русский, Тайский, Индонезийский, Шведский, Турецкий, Азербайджанский, Испанский, Дари, Хинди, Японский, Казахский, Венгерский, Польский

Часть программы вашего университета
Meet and GreetОбсуждение
02Milestone 1: Formalize Word Problem as MDP5 материалов

Final Project: Milestone 1

Initial Project Meeting with Martha: Formalizing the ProblemВидеоAndy Barto on What are Eligibility Traces and Why are they so named?Видео

Project Resources

Let's Review: Markov Decision ProcessesВидеоLet's Review: Examples of Episodic and Continuing TasksВидеоMoonShot TechnologiesПрограммирование
03Milestone 2: Choosing The Right Algorithm8 материалов

Weekly Learning Goals

Meeting with Niko: Choosing the Learning AlgorithmВидео

Project Resources

Let's Review: Expected SarsaВидеоLet's Review: What is Q-learning?ВидеоLet's Review: Average Reward- A New Way of Formulating Control ProblemsВидеоLet's Review: Actor-Critic AlgorithmВидеоCsaba Szepesvari on Problem LandscapeВидеоAndy and Rich: Advice for StudentsВидеоChoosing the Right AlgorithmЗадание
04Milestone 3: Identify Key Performance Parameters5 материалов

Weekly Learning Goals

Agent Architecture Meeting with Martha: Overview of Design ChoicesВидео

Project Resources

Let's Review: Non-linear Approximation with Neural NetworksВидеоDrew Bagnell on System ID + Optimal ControlВидеоSusan Murphy on RL in Mobile HealthВидеоImpact of Parameter Choices in RL Задание
05Milestone 4: Implement Your Agent 7 материалов

Weekly Learning Goals

Meeting with Adam: Getting the Agent Details RightВидео

Project Resources

Let's Review: Optimization Strategies for NNsВидеоLet's Review: Expected Sarsa with Function ApproximationВидеоLet's Review: Dyna & Q-learning in a Simple MazeВидеоMeeting with Martha: In-depth on Experience ReplayВидеоMartin Riedmiller on The 'Collect and Infer' framework for data-efficient RLВидеоImplement Your AgentПрограммирование
06Milestone 5: Submit Your Parameter Study!7 материалов

Weekly Learning Goals

Meeting with Adam: Parameter Studies in RLВидео

Project Resources

Let's Review: Comparing TD and Monte CarloВидеоJoelle Pineau about RL that MattersВидеоCompleting the parameter studyПрограммирование

Congratulations!

Meeting with Martha: Discussing Your ResultsВидеоCourse Wrap-upВидеоSpecialization Wrap-upВидео