К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Information Theory · LearnSpace
Назад в каталог
courseraМатематика

Information Theory

Курс от The Chinese University of Hong Kong
Уровень не указан≈ 38.1 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

The lectures of this course are based on the first 11 chapters of Prof. Raymond Yeung’s textbook entitled Information Theory and Network Coding (Springer 2008). This book and its predecessor, A First Course in Information Theory (Kluwer 2002, essentially the first edition of the 2008 book), have been adopted by over 60 universities around the world as either a textbook or reference text. At the completion of this course, the student should be able to: 1) Demonstrate knowledge and understanding of the fundamentals of information theory. 2) Appreciate the notion of fundamental limits in communication systems and more generally all systems. 3) Develop deeper understanding of communication systems. 4) Apply the concepts of information theory to various disciplines in information science.

Навыки, которые вы освоите

Probability DistributionCommunication SystemsTelecommunicationsInformaticsProbabilityDigital CommunicationsAlgorithmsTheoretical Computer Science

Программа курса

21 модулей · 136 учебных материалов

01Course Preliminaries2 материалов

Welcome

About this courseВидеоGrading SchemeЧтение
02Chapter 1 Information Measures2 материалов

Week 1 Introduction

Week 1 IntroductionВидео

Chapter 1 The Science of Information

Учитесь у экспертов

Prof. Raymond W. Yeung

Choh-Ming Li Professor of Information Engineering, and Co-Director, Institute of Network Coding

Information Theory
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 38.1 ч

21 модулей

Язык: Английский

Субтитры: Арабский, Французский, Украинский, Китайский (Китай), Греческий, Итальянский, Бразильский португальский, Нидерландский, Корейский, Немецкий, Русский, Тайский, Индонезийский, Шведский, Турецкий, Испанский, Хинди, Японский, Казахский, Польский

Часть программы вашего университета
Chapter 1Видео
03Chapter 2 Information Measures - Part 18 материалов

2.1 Independence and Markov Chain

Chapter 2 - Section 2.1 AВидеоChapter 2 - Section 2.1 BВидеоChapter 2 - Section 2.1 CВидео

2.2 Shannon’s Information Measures

Chapter 2 - Section 2.2Видео

2.3 Continuity of Shannon’s Information Measures for Fixed Finite Alphabets

Chapter 2 - Section 2.3Видео

Week 1 Homework Assignment

Assignment 1 Video PreviewВидеоHomework Assignment 1 SubmissionВзаимная проверкаHomework Assignment 1 SolutionЧтение
04Chapter 2 Information Measures - Part 210 материалов

Week 2 Introduction

Week 2 IntroductionВидео

2.4 Chain Rules

Chapter 2 - Section 2.4Видео

2.5 Informational Divergence

Chapter 2 - Section 2.5Видео

2.6 The Basic Inequalities

Chapter 2 - Section 2.6Видео

2.7 Some Useful Information Inequalities

Chapter 2 - Section 2.7Видео

2.8 Fano's Inequality

Chapter 2 - Section 2.8Видео

2.10 Entropy Rate of a Stationary Source

Chapter 2 - Section 2.10Видео

Week 2 Homework Assignment

Assignment 2 Video PreviewВидеоHomework Assignment 2 SubmissionВзаимная проверкаHomework Assignment 2 SolutionЧтение
05Chapter 3 The I-Measure - Part 19 материалов

Week 3 Introduction

Week 3 IntroductionВидео

3.1 Preliminaries & 3.2 The I-Measure for Two Random Variables

Chapter 3 - Section 3.1Видео

3.3 Construction of the I-Measure μ*

Chapter 3 - Section 3.3 AВидеоChapter 3 - Section 3.3 BВидео

3.4 μ* can be Negative

Chapter 3 - Section 3.4Видео

3.5 Information Diagrams

Chapter 3 - Section 3.5 AВидео

Week 3 Homework Assignment

Assignment 3 Video PreviewВидеоHomework Assignment 3 SubmissionВзаимная проверкаHomework Assignment 3 SolutionЧтение
06Chapter 3 The I-Measure - Part 24 материалов

Week 4 Introduction

Week 4 IntroductionВидео

3.5 Information Diagrams

Chapter 3 - Section 3.5 BВидео

3.6 Examples of Applications

Chapter 3 - Section 3.6 AВидеоChapter 3 - Section 3.6 BВидео
07Chapter 4 Zero-Error Data Compression - Part 15 материалов

4.1 The Entropy Bound

Chapter 4 - Section 4.1Видео

4.2 Prefix Codes

Chapter 4 - Section 4.2 AВидео

Week 4 Homework Assignment

Assignment 4 Video PreviewВидеоHomework Assignment 4 SubmissionВзаимная проверкаHomework Assignment 4 SolutionЧтение
08Chapter 4 Zero-Error Data Compression - Part 24 материалов

Week 5 Introduction

Week 5 IntroductionВидео

4.2 Prefix Codes

Chapter 4 - Section 4.2 BВидеоChapter 4 - Section 4.2 CВидео

4.3 Redundancy of Prefix Codes

Chapter 4 - Section 4.3Видео
09Chapter 5 Weak Typicality5 материалов

5.1 The Weak AEP

Chapter 5 - Section 5.1Видео

5.2 The Source Coding Theorem

Chapter 5 -Section 5.2Видео

Week 5 Homework Assignment

Assignment 5 Video PreviewВидеоHomework Assignment 5 SubmissionВзаимная проверкаHomework Assignment 5 SolutionЧтение
10Chapter 6 Strong Typicality10 материалов

Week 6 Introduction

Week 6 - IntroductionВидео

6.1 Strong AEP

Chapter 6 - Section 6.1 AВидеоChapter 6 - Section 6.1 BВидео

6.2 Strong Typicality vs Weak Typicality

Chapter 6 - Section 6.2Видео

6.3 Joint Typicality

Chapter 6 - Section 6.3 AВидеоChapter 6 - Section 6.3 BВидео

6.4 An Interpretation of the Basic Inequalities

Chapter 6 - Section 6.4Видео

Week 6 Homework Assignment

Assignment 6 Video PreviewВидеоHomework Assignment 6 SubmissionВзаимная проверкаHomework Assignment 6 SolutionЧтение
11Chapter 7 Discrete Memoryless Channels - Part 19 материалов

Week 7 Introduction

Week 7 IntroductionВидео

7.1 Definition and Capacity

Chapter 7 - Section 7.1 AВидеоChapter 7 - Section 7.1 BВидео

7.2 The Channel Coding Theorem

Chapter 7 - Section 7.2Видео

7.3 The Converse

Chapter 7 - Section 7.3 AВидеоChapter 7 - Section 7.3 BВидео

Week 7 Homework Assignment

Assignment 7 Video PreviewВидеоHomework Assignment 7 SubmissionВзаимная проверкаHomework Assignment 7 SolutionЧтение
12Chapter 7 Discrete Memoryless Channels - Part 29 материалов

Week 8 Introduction

Week 8 IntroductionВидео

7.4 Achievability

Chapter 7 - Section 7.4 AВидеоChapter 7 - Section 7.4 BВидео

7.5 A Discussion

Chapter 7 - Section 7.5Видео

7.6 Feedback Capacity

Chapter 7 - Section 7.6Видео

7.7 Separation of Source and Channel Coding

Chapter 7 - Section 7.7Видео

Week 8 Homework Assignment

Assignment 8 Video PreviewВидеоHomework Assignment 8 SubmissionВзаимная проверкаHomework Assignment 8 SolutionЧтение
13Chapter 8 Rate-Distortion Theory - Part 19 материалов

Week 9 Introduction

Week 9 IntroductionВидео

8.1 Single-Letter Distortion Measure

Chapter 8 - Section 8.1Видео

8.2 The Rate-Distortion Function

Chapter 8 - Section 8.2Видео

8.3 The Rate Distortion Theorem

Chapter 8 - Section 8.3 AВидеоChapter 8 - Section 8.3 BВидео

8.4 The Converse

Chapter 8 - Section 8.4Видео

Week 9 Homework Assignment

Assignment 9 Video PreviewВидеоHomework Assignment 9 SubmissionВзаимная проверкаHomework Assignment 9 SolutionЧтение
14Chapter 8 Rate-Distortion Theory - Part 23 материалов

Week 10 Introduction

Week 10 IntroductionВидео

8.5 Achievability of RI(D)

Chapter 8 - Section 8.5 AВидеоChapter 8 - Section 8.5 BВидео
15Chapter 9 The Blahut-Arimoto Algorithms - Part 16 материалов

9.1 Alternating Optimization

Chapter 9 - Section 9.1Видео

9.2 The Algorithms

Chapter 9 - Section 9.2 AВидеоChapter 9 - Section 9.2 BВидео

Week 10 Homework Assignment

Assignment 10 Video PreviewВидеоHomework Assignment 10 SubmissionВзаимная проверкаHomework Assignment 10 SolutionЧтение
16Chapter 9 The Blahut-Arimoto Algorithms - Part 23 материалов

Week 11 Introduction

Week 11 IntroductionВидео

9.2 The Algorithms

Chapter 9 - Section 9.2 CВидео

9.3 Convergence

Chapter 9 - Section 9.3Видео
17Chapter 10 Differential Entropy - Part 15 материалов

10.1 Preliminaries

Chapter 10 - Section 10.1 AВидеоChapter 10 - Section 10.1 BВидео

Week 11 Homework Assignment

Assignment 11 Video PreviewВидеоHomework Assignment 11 SubmissionВзаимная проверкаHomework Assignment 11 SolutionЧтение
18Chapter 10 Differential Entropy - Part 210 материалов

Week 12 Introduction

Week 12 IntroductionВидео

10.2 Definition

Chapter 10 - Section 10.2Видео

10.3 Joint Differential Entropy, Conditional (Differential) Entropy, and Mutual Information

Chapter 10 - Section 10.3 AВидеоChapter 10 - Section 10.3 BВидео

10.4 AEP for Continuous Random Variables

Chapter 10 - Section 10.4Видео

10.5 Informational Divergence

Chapter 10 - Section 10.5Видео

10.6 Maximum Differential Entropy Distributions

Chapter 10 - Section 10.6Видео

Week 12 Homework Assignment

Assignment 12 Video PreviewВидеоHomework Assignment 12 SubmissionВзаимная проверкаHomework Assignment 12 SolutionЧтение
19Chapter 11 Continuous-Valued Channels - Part 18 материалов

Week 13 Introduction

Week 13 IntroductionВидео

11.1 Discrete-Time Channels

Chapter 11 - Section 11.1Видео

11.2 The Channel Coding Theorem

Chapter 11 - Section 11.2Видео

11.3 Proof of the Channel Coding Theorem

Chapter 11 - Section 11.3 AВидеоChapter 11 - Section 11.3 BВидео

Week 13 Homework Assignment

Assignment 13 Video PreviewВидеоHomework Assignment 13 SubmissionВзаимная проверкаHomework Assignment 13 SolutionЧтение
20Chapter 11 Continuous-Valued Channels - Part 27 материалов

Week 14 Introduction

Week 14 IntroductionВидео

11.4 Memoryless Gaussian Channels

Chapter 11 - Section 11.4Видео

11.5 Parallel Gaussian Channels

Chapter 11 - Section 11.5Видео

11.6 Correlated Gaussian Channels

Chapter 11 - Section 11.6Видео

Week 14 Homework Assignment

Assignment 14 Video PreviewВидеоHomework Assignment 14 SubmissionВзаимная проверкаHomework Assignment 14 SolutionЧтение
21Chapter 11 Continuous-Valued Channels - Part 3 8 материалов

Week 15 Introduction

Week 15 IntroductionВидео

11.7 The Bandlimited White Gaussian Channel

Chapter 11 - Section 11.7 AВидеоChapter 11 - Section 11.7 BВидео

11.8 The Bandlimited Colored Gaussian Channel

Chapter 11 - Section 11.8Видео

11.9 Zero-Mean Gaussian Noise Is the Worst Additive Noise

Chapter 11 - Section 11.9Видео

Week 15 Homework Assignment

Assignment 15 Video PreviewВидеоHomework Assignment 15 SubmissionВзаимная проверкаHomework Assignment 15 SolutionЧтение