К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Cloud Data Engineering · LearnSpace
Назад в каталог
courseraIT и технологии

Cloud Data Engineering

Курс от Duke University
Средний≈ 41.2 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

Welcome to the third course in the Building Cloud Computing Solutions at Scale Specialization! In this course, you will learn how to apply Data Engineering to real-world projects using the Cloud computing concepts introduced in the first two courses of this series. By the end of this course, you will be able to develop Data Engineering applications and use software development best practices to create data engineering applications. These will include continuous deployment, code quality tools, logging, instrumentation and monitoring. Finally, you will use Cloud-native technologies to tackle complex data engineering solutions. This course is ideal for beginners as well as intermediate students interested in applying Cloud computing to data science, machine learning and data engineering. Students should have beginner level Linux and intermediate level Python skills. For your project in this course, you will build a serverless data engineering pipeline in a Cloud platform: Amazon Web Services (AWS), Azure or Google Cloud Platform (GCP).

Навыки, которые вы освоите

Serverless ComputingSoftware EngineeringCommand-Line InterfaceBig DataDistributed ComputingExtract, Transform, LoadCloud ComputingCloud StorageData InfrastructureSoftware Engineering ToolsCloud SolutionsCloud ServicesData PipelinesGoogle Cloud PlatformCloud-Native ComputingSoftware DevelopmentCloud TechnologiesEngineering SoftwareCloud DevelopmentCloud Engineering

Программа курса

4 модулей · 174 учебных материалов

01Getting Started with Cloud Data Engineering60 материалов

Welcome to the Course!

Instructor IntroductionВидеоGetting Started and Course GotchasЧтениеCourse IntroductionВидеоLab OnboardingВидео

Учитесь у экспертов

Noah Gift

Executive in Residence and Founder of Pragmatic AI Labs

Cloud Data Engineering
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 41.2 ч

4 модулей

Язык: Английский

Субтитры: Арабский, Французский, Украинский, Китайский (Китай), Греческий, Итальянский, Бразильский португальский, Нидерландский, Корейский, Ория, Немецкий, Русский, Тайский, Индонезийский, Шведский, Турецкий, Испанский, Хинди, Японский, Казахский, Польский

Часть программы вашего университета
Specialization Project Roadmap: Course 3 Чтение
Course 3 Project OverviewВидео
Course Structure and Discussion EtiquetteЧтение
IntroductionsОбсуждение
Report a problem with the courseЧтение

The End of Moore's Law

Key TermsЧтениеIntroduction to the End of Moore's LawВидеоThe Problem with Concurrency in PythonВидеоExploring the End of Moore's LawВидеоThe End of Moore's LawЧтениеThreads and ProcessesЛабораторнаяUsing CUDA and NumbaВидеоNumba User GuideЧтениеWhat is an ASIC?ВидеоCustom SiliconЧтениеTaking Advantage of Colab ProВидеоExploring Colab AIВидеоLesson ReflectionЧтениеQuiz-The End of Moore's LawЗаданиеImplications of the End of Moore's LawОбсуждение

Build Distributed Systems

Key TermsЧтениеIntroduction to Distributed SystemsВидеоLogging and Instrumentation Distributed SystemsВидеоCAP TheoremВидеоAmdahl's LawВидеоElasticityВидеоHighly Available Nine Nine'sВидеоPython DebuggerЧтениеPython LoggingЧтениеDebugging Python CodeВидеоDebug with Python PDBЛабораторнаяImplementing elasticity, high availability, and monitoring in the AWS cloudЧтениеMonitoring and Logging In Distributed SystemsОбсуждениеLesson ReflectionЧтениеQuiz-Build Distributed SystemsЗадание

Understand Big Data and Data Processing Platforms

Key TermsЧтениеIntroduction to Cloud Data PlatformsЧтениеExploring Google BigQueryВидеоWhat is Big Data?ВидеоData LakesВидеоBig Data ProcessingВидеоIntroduction to AWS Data Engineering Design PrinciplesВидеоProcessing Big Data with AWSВидеоWhat is a Lakehouse PlatformЧтениеTransform Data with Databricks Spark SQLВидеоSnowpark MLЧтениеUnderstanding Map ReduceЛабораторнаяQuiz-Understand Big Data and Data Processing PlatformsЗаданиеLesson ReflectionЧтениеChallenges to Big Data PlatformsОбсуждение

Applied Practice: Creating High-Performance Code

Key TermsЧтениеTurbocharging Python with Command Line Tools ЧтениеCreating high-performance codeЧтениеQuiz-High-Performance CodeЗаданиеLesson ReflectionЧтение

Graded Quiz

QuizЗадание
02Examining Principles of Data Engineering37 материалов

What is Data Engineering?

Key TermsЧтениеIntroduction to Data EngineeringВидеоData Driven OrganizationsВидеоWhat is Data Engineering?ВидеоBatch vs. Streaming vs. EventsВидеоIngesting by Batch or StreamВидеоPython GeneratorsЧтениеStreaming Data with Python GeneratorsЛабораторнаяThe Power of EventsОбсуждениеLesson ReflectionЧтениеQuiz-What is Data Engineering?Задание

Using Command-line tools in Rust and Python

Key TermsЧтениеBuilding CLI Tools with ClickВидеоBuilding Containerized Command-line ToolsВидеоBuild a Click Command-Line ToolЛабораторнаяPython and RustЧтениеRust and PythonВидео

Advanced Code Testing and AI Enhanced Development Techniques

Key TermsЧтениеAdvanced Testing with Amazon CodeGuruВидеоAdvanced Testing with AWS CodeBuildВидеоMapping Functions to CLI: Part 1ВидеоMapping Functions to CLI: Part 2ВидеоUsing Advanced Code Analysis ToolsОбсуждение

Applied Practice: Extending Command-Line Data Processing Tool

Extending Command-Line Data Processing ToolЧтение

Graded Assessment

QuizЗадание
03Building Data Engineering Pipelines35 материалов

Build a Serverless Data Engineering System

Key TermsЧтениеIntroduction to Serverless Data EngineeringВидеоLambda Console GotchasЧтениеAutomating PipelinesВидеоWhat is Serverless?ВидеоServerless Concepts: Service ModelВидеоServerless Concepts: FunctionsВидеоServerless Concepts: EcosystemВидеоAWS Lambda: OverviewВидеоIntroduction to AWS Cloud9ВидеоAWS Lambda: Event HandlingВидеоAWS Lambda: Hello WorldВидеоAWS Lambda: Deploy TestingВидеоAWS Lambda: Wikipedia ExampleВидеоBuild a Serverless Data PipelineВидеоServerless Cookbook with AWSВидеоServerless Cookbook with GCPВидеоUsing Amazon EFS for AWS LambdaЧтениеServerless Tools that use a CLIОбсуждениеLesson ReflectionЧтениеQuiz-Build a Serverless Data Engineering SystemЗадание

Effective Data Governance

Key TermsЧтениеIntroduction to Data GovernanceВидеоWhat is Data Governance?ВидеоThe Principle of Least PrivilegeВидеоCloud Security with IAM on AWSВидеоAWS Shared Security ModelВидеоAWS IAM Service

Applied Practice: Building Computer Vision Label Trigger for S3

Building Computer Vision Label Trigger for S3Чтение

Graded Assignment

QuizЗадание
04Applying Key Data Engineering Tasks42 материалов

Effective ETL

Key TermsЧтениеIntroduction to Extract, Transform, Load (ETL)ВидеоWhat is ETL?ВидеоIngesting and Preparing Data on AWSВидеоUsing Amazon Athena with AWS GlueВидеоReal-World Problems in ETLВидеоWhy spend four minutes when you can spend four days?ОбсуждениеLesson ReflectionЧтениеQuiz-Effective ETLЗадание

Cloud Databases

Key TermsЧтениеIntroduction to Cloud DatabasesВидеоOne Size Does Not Fit All in the Cloud?ВидеоCloud DatabasesЧтениеRelational Database ConundrumОбсуждениеMySQL OverviewВидеоMySQL from Terminal

Cloud Storage

Key TermsЧтениеIntroduction to Cloud StorageВидеоWhy Cloud Storage?ВидеоCloud Storage SolutionsЧтениеCloud Storage Deep DiveВидеоUsing Amazon S3ВидеоDisaster Recovery and Amazon S3

Graded Assignment

QuizЗадание

Putting it all Together: Final Course Project

Create a serverless Data Engineering PipelineЧтениеNext StepsЧтениеRust Data Engineering SandboxЛабораторнаяJupyter SandboxЛабораторнаяVS Code SandboxЛабораторнаяShare your learning experienceЧтение
Python Calculator CLIВидео
Caesar Cipher CLIВидео
Rust CLI ToolЛабораторная
Quiz-Using Command-line tools in Rust and PythonЗадание
Lesson ReflectionЧтение
Why is a Containerized CLI so Useful?Обсуждение
Building Command-Line Data Processing ToolЛабораторная
AWS CodeWhisperer for Data EngineeringЧтение
AWS CodeWhisperer CLIВидео
AWS CodeWhisperer SDKВидео
Lesson ReflectionЧтение
Quiz-Advanced Code Testing and AI Enhanced Development TechniquesЗадание
Видео
AWS Cloud Security OperationsВидео
Encrypt at Rest and TransitВидео
Startup Founder Wants To "Move Fast and Break Things"Обсуждение
Lesson ReflectionЧтение
Quiz-Effective Data GovernanceЗадание
Видео
Archive and Drop DatabaseВидео
Import external database SakilaВидео
Modify database SakilaВидео
Bash pipelines with MySQLВидео
MySQL to Python Standard Library Web ServerВидео
MySQL for Data EngineeringЛабораторная
Big Query with Prompt EngineeringВидео
Big Query Colab PipelineВидео
Quiz-Cloud DatabasesЗадание
Lesson ReflectionЧтение
Обсуждение
Lesson ReflectionЧтение
Quiz-Cloud StorageЗадание