К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Data Engineering with Rust · LearnSpace
Назад в каталог
courseraАнализ данных

Data Engineering with Rust

Курс от Duke University
Средний≈ 63.7 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

Are you a data engineer, software developer, or a tech enthusiast with a basic understanding of Rust, seeking to enhance your skills and dive deep into the realm of data engineering with Rust? Or are you a professional from another programming language background, aiming to explore the efficiency, safety, and concurrency features of Rust for data engineering tasks? If so, this course is designed for you. While a fundamental knowledge of Rust is expected, you should ideally be comfortable with the basics of data structures and algorithms, and have a working understanding of databases and data processing. Familiarity with SQL, the command line, and version control with git is advantageous. This four-week course focuses on leveraging Rust to create efficient, safe, and concurrent data processing systems. The journey begins with a deep dive into Rust's data structures and collections, followed by exploring Rust's safety and security features in the context of data engineering. In the subsequent week, you'll explore libraries and tools specific to data engineering like Diesel, async, Polars, and Apache Arrow, and learn to interface with data processing systems, REST, gRPC protocols, and AWS SDK for cloud-based data operations. The final week focuses on designing and implementing full-fledged data processing systems using Rust. By the end of this course, you will be well-equipped to use Rust for handling large-scale data engineering tasks, solving real-world problems with efficiency and speed. The hands-on labs and projects throughout this course will ensure you gain practical experience, putting your knowledge into action. This course is your gateway to mastering data engineering with Rust, preparing you for the next level in your data engineering journey.

Навыки, которые вы освоите

Rust (Programming Language)Data StructuresData ManipulationSystem ProgrammingRestful APIData PipelinesEncryptionCloud DeploymentCommand-Line InterfacePython ProgrammingSecure CodingAmazon Web ServicesCloud-Based IntegrationSoftware TestingData ProcessingApplication Programming Interface (API)

Программа курса

4 модулей · 198 учебных материалов

01 Rust Data Structures: Collections 61 материалов

Getting Started With The Modern Rust Development Ecosystem

Meet Instructor and Course OverviewВидеоPrerequisites and Getting StartedЧтениеKey TermsЧтениеIntroduction to the AI Coding Paradigm ShiftВидео

Учитесь у экспертов

Noah Gift

Executive in Residence and Founder of Pragmatic AI Labs

Alfredo Deza

Adjunct Assistant Professor in the Pratt School of Engineering

Data Engineering with Rust
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 63.7 ч

4 модулей

Язык: Английский

Субтитры: Арабский, Французский, Украинский, Китайский (Китай), Греческий, Итальянский, Бразильский португальский, Нидерландский, Корейский, Немецкий, Русский, Тайский, Индонезийский, Шведский, Турецкий, Испанский, Хинди, Японский, Венгерский, Польский

Часть программы вашего университета
Introduction to cloud-based development environmentsВидео
Introduction to GitHub Copilot Ecosystem for RustВидео
Prompt Engineering with GCP BigQuery SQLВидео
Using Google Bard to Enhance ProductivityВидео
Continuous Integration with Rust and GitHub ActionsВидео
Using VS Code, Copilot, and Codespaces to Level Up to Rust from PythonЧтение
Harness the power of generative AI for software developmentЧтение
The case for using Rust in MLOpsЧтение
Transitioning from CodeWhisperer to Amazon Q DeveloperЧтение
Data Engineering with Rust SandboxЛабораторная
Lesson ReflectionЧтение
Quiz-Getting Started With The Modern Rust Development EcosystemЗадание
Report a problem with the courseЧтение

Rust Sequences and Maps

Key TermsЧтениеIntroducing Rust Sequences and MapsВидеоPrint Rust data structures demoВидеоVector Fruit Salad demoВидеоVecDeque Fruit Salad demoВидеоLinkedin List Fruit Salad demoВидеоFruit Salad CLI demoВидеоHashMap frequency counter demoВидеоHashMap language comparisoВидеоExploring Rust Data StructuresЛабораторнаяExternal Lab: Creating a Fruit Salad with Rust Vectors in GitHub CodespacesЧтениеExternal Lab: Fruit Salad Creation with VecDeque in GitHub CodespacesЧтениеExternal Lab: Fruit Salad Creation with LinkedList in GitHub CodespacesЧтениеExternal Lab: Command Line Fruit Salad Creator in GitHub CodespacesЧтениеRust Collections DocsЧтениеCounting Frequency with Rust HashMapsЛабораторнаяWeighting Programming Languages with Rust HashMapsЛабораторнаяLesson ReflectionЧтениеQuiz-Rust Sequences and MapsЗадание

Rust Sets, Graphs and Miscellaneous Data Structures

Key TermsЧтениеAnalyzing UFC Fighter Network Using Graph Centrality in RustВидеоStoring Unique Fruits Using HashSet in RustВидеоMaintaining Sorted and Unique Fruits Using BTreeSet in RustВидеоCreating a Fig Priority Fruit Salad Using Binary Heap in RustВидеоPageRank algorithm for sports dataВидеоShowing shortest path with dijkstraВидеоDetecting Strongly Connected Components: A Deep Dive into Kosaraju's AlgorithmВидеоSimple Charting of Data Structures in RustВидеоRussian Troll Tweet DatasetsЧтениеWhen to use a Rust SetЧтениеRust iteratorsЧтениеNeo4J Graph Data Science Library ManualЧтениеCalculating Centrality in a UFC Fighter Graph with RustЧтениеExternal GitHub Lab: Generating Unique Fruits with Rust and HashSetЧтениеExternal GitHub Lab: Generating Unique Fruits with Rust and BTreeSetЧтениеExternal GitHub Lab: Generating Fruit Salad with Rust and BinaryHeapЧтениеExternal GitHub Lab: PageRank Algorithm in RustЧтениеExternal GitHub Lab: Shortest Path Algorithm in RustЧтениеExternal GitHub Lab: Community Detection in RustЧтениеExternal GitHub Lab: Graph Visualization in RustЧтениеRust CollectionsЗаданиеLesson ReflectionЧтение

Final Week Reflection and Challenge

Final Week-ReflectionЧтениеCollections Week ChallengeЛабораторная
02Safety, Security and Concurrency with Rust50 материалов

Rust Safety and Security Features

Key TermsЧтениеMulti-Factor AuthenticationВидеоNetwork SegmentationВидеоLeast Privilege AccessВидеоEncryptionВидеоMutable fruit saladВидеоCustomize fruit salad with a CLIВидеоData Race exampleВидеоMutable fruit saladЛабораторнаяCustomize fruit salad with a CLIЧтениеData RaceЛабораторнаяMeet Safe and UnsafeЧтениеOwnership and LifetimesЧтениеThe Perils Of Ownership-Based Resource Management (OBRM)ЧтениеLesson ReflectionЧтениеQuiz-Rust Safety and Security FeaturesЗадание

Security Programming with Rust

Key TermsЧтениеHigh AvailabilityВидеоUnderstanding the Homophonic Cipher: A Cryptographic TechniqueВидеоDecoding the Secrets of the Caesar CipherВидеоCreating a Decoder Ring: A Practical GuideВидеоDetecting Duplicates with SHA-3: A Data Integrity ToolВидео

Concurrency with Rust

Key TermsЧтениеCore Concepts in ConcurrencyВидеоDining PhilosophersВидеоWeb Crawl Wikipedia with RayonВидеоIntelligent Chatbot with TokioВидеоMulti-threaded deduplication with RustВидеоEnergy Efficiency Python vs Rust

Week 2 Challenge-Safety, Security and Concurrency with Rust

Quiz-Rust ConcurrencyЗаданиеRust Playground Rayon ChallengeЧтение
03Rust Data Engineering Libraries and Tools41 материалов

Using Rust to Manage Data, Files and Network Storage

Key TermsЧтениеProcess CSV files in RustВидеоWrite CSV FilesЛабораторнаяUsing Cargo Lambda with RustВидеоList files on AWS EFS with RustВидеоUse AWS S3 StorageВидеоUse AWS S3 Storage from RustВидеоWrite encrypted data to tables or Parquet filesВидеоRust CSV CookbookЧтениеApache Parquet Official Native Rust ImplementationЧтениеLesson ReflectionЧтениеQuiz-Using Rust to Manage Data, Files and Network StorageЗадание

DataFrames with Rust, Python and Notebooks

Key TermsЧтениеWhat is Colab?ВидеоRunning Rust in Jupyter NotebookЧтениеExploring Notebooks with Python Pandas and JupyterЛабораторнаяUsing Bard to enhance notebook developmentВидеоExploring Life Expectency in a NotebookВидео

Using Rust with Cloud SDKs and CLIs for Data Engineering

Key TermsЧтениеCloud Developer Workspace AdvantageВидеоOnboarding to GCP with Python and RustВидеоUsing GCP Cloud Shell with RustВидеоLearn AWS CloudShellВидеоPrototyping AI APIs with AWS CloudShellВидео
04Designing Data Processing Systems in Rust46 материалов

Getting Started with Rust Data Pipelines (Including ETL)

Key TermsЧтениеJack and the Beanstalk Data PipelinesВидеоOpen Source Data Engineering - Pros and ConsВидеоCore Components of Data Engineering PipelinesВидеоRust AWS Step Functions PipelineВидеоRust AWS Lambda Async S3 Size CalculatorВидеоWhat is Distroless?ВидеоDemo Deploying Rust Microservices on GCPВидеоArchitectural Patterns to Build End-to-End Data Driven Applications on AWSЧтениеData Preparation and Feature Engineering in MLЧтение"Distroless" Container ImagesЧтениеETLЛабораторнаяLesson ReflectionЧтениеQuiz-Getting Started with Rust Data Pipelines (Including ETL)Задание

Using Rust and Python for LLMs, ONNX, Hugging Face, and PyTorch Pipelines

Key TermsЧтениеIntroduction to Hugging Face HubВидеоRust GPU Hugging Face TranslatorВидеоRust PyTorch High-Performance OptionsВидеоEFS ONNX Rust Inference with AWS LambdaВидеоTheory behind model fine-tuningВидео

Building SQL Solutions with Rust, Generative AI and Cloud

Key TermsЧтениеSelecting the correct database on GCPВидеоRust SQLite Hugging Face Zero Shot ClassifierВидеоPrompt Engineering for BigQuery ВидеоBig Query to Colab PipelineВидеоExploring Data with Big QueryВидео

Course Project (Final Graded Assessment)

Final Course QuizЗаданиеNext StepsЧтениеRust SandboxЛабораторнаяShare your learning experienceЧтение
Incident ResponseВидео
ComplianceВидео
RustCrypto: HashesЧтение
Rust Software Security: A Current State AssessmentЧтение
External GitHub Lab: Creating a Decoder Ring: A Practical GuideЧтение
Lesson ReflectionЧтение
Quiz-Security Programming with RustЗадание
Видео
Concurrency Stress test with a GPUВидео
Host Efficiency Serverless Optimization problemВидео
Concurrency and ParallelismЧтение
Data Races and Race ConditionsЧтение
Send and SyncЧтение
AtomicsЧтение
Distributed Computing and ConcurrencyЧтение
Challenges and Opportunities in DistributedЧтение
Lab: Dining PhilosophersЛабораторная
Final Week-ReflectionЧтение
Safety, Security and Concurrency with RustЗадание
Lesson ReflectionЧтение
Load a DataFrame with sensitive dataВидео
Using MLFlow with Databricks NotebooksВидео
End to End ML with MLFlow and DatabricksВидео
Exploring global life expectancy with PolarsВидео
External GitHub Lab: Using Polars DataFrame CLIЧтение
Polars is a highly performant DataFrame library for manipulating structured dataЧтение
Lesson ReflectionЧтение
Quiz-DataFrames with Rust, Python and NotebooksЗадание
Cloud9 with CodeWhispererВидео
Demo GCP App Engine Rust DeployВидео
Containerized Rust Actix Microservice on AWSВидео
Axum Greedy Coin MicroserviceЛабораторная
Chapter 2-Week 2 (Up and Running with Cloud Computing)Чтение
Chapter 3 - Week 3: Virtualization and ContainersЧтение
What is the AWS SDK for Rust?Чтение
Quiz3: Rust Data Engineering Libraries and ToolsЗадание
Final Week-ReflectionЧтение
Doing Fine TuningВидео
Introduction to ONNXЧтение
Ready-to-use NLP pipelines and Transformer-based modelsЧтение
Hugging Face NLP Course documentationЧтение
Hugging Face Fine-Tuning a pretrained modelЧтение
Lesson ReflectionЧтение
Quiz-Using Rust and Python for LLMs, ONNX, Hugging Face, and PyTorch PipelinesЗадание
Using Public Datasets for Data ScienceВидео
Querying Log files with BigQueryВидео
There is no one size databaseВидео
About SQLiteЧтение
Appropriate Uses For SQLiteЧтение
What is BigQuery?Чтение
Designing Data Processing Systems in RustЗадание
Course ConclusionВидео
Final Week- ReflectionЧтение