К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Scripting with Python and SQL for Data Engineering · LearnSpace
Назад в каталог
courseraАнализ данных

Scripting with Python and SQL for Data Engineering

Курс от Duke University
Средний≈ 24 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

In this third course of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will explore techniques to work effectively with Python and SQL. We will go through useful data structures in Python scripting and connect to databases like MySQL. Additionally, you will learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. Finally, you will use extracted data from websites using scraping techniques. These skills will allow you to work effectively when data is not readily available, or when spatial queries are required to extract useful information from databases.

Навыки, которые вы освоите

SQLData StructuresFile I/OScriptingData Import/ExportJSONMySQLData ManipulationData PersistencePython ProgrammingWeb ScrapingData CaptureSpatial Data AnalysisDatabasesQuery LanguagesDatabase ManagementScripting LanguagesOperational Databases

Программа курса

4 модулей · 116 учебных материалов

01Working with Data in Python33 материалов

About the Course

Welcome to Scripting with Python and SQL for Data EngineeringВидеоMeet your Course Instructor: Alfredo DezaВидеоConnect with your instructorЧтениеMeet your Supporting Instructors: Kennedy Behrman and Noah GiftЧтение

Учитесь у экспертов

Alfredo Deza

Adjunct Assistant Professor in the Pratt School of Engineering

Kennedy Behrman

Senior Data Engineer

Noah Gift

Executive in Residence and Founder of Pragmatic AI Labs

Scripting with Python and SQL for Data Engineering
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 24 ч

4 модулей

Язык: Английский

Субтитры: Арабский, Французский, Украинский, Китайский (Китай), Греческий, Итальянский, Бразильский португальский, Нидерландский, Корейский, Немецкий, Русский, Тайский, Индонезийский, Шведский, Турецкий, Испанский, Хинди, Японский, Казахский, Польский

Часть программы вашего университета
Course Structure and Discussion EtiquetteЧтение
Overview of Key ConceptsВидео
Meet and Greet (optional)Обсуждение
Report a problem with the courseЧтение

Exploring Data Structures in Python

Key TermsЧтениеIntroduction to Working with Data in PythonВидеоIntroduction to Python Data StructuresВидеоUsing Lists to Save and Retrieve Data in PythonВидеоUsing Dictionaries to Save and Retrieve Data in PythonВидеоOverview of Less Common Data Structures in PythonВидеоPython Lists and DictionariesЧтениеRecap of Data Structures in PythonВидеоUsing Data Structures in PythonЗадание

Mapping Data Structures in Python

Key TermsЧтениеIntroduction to Choosing Data Structures in PythonВидеоIterating Over Lists and Dictionaries in PythonВидеоIterating Over Other Data Structures in PythonВидеоStoring Data Between Data Structures in PythonВидеоLooping Over Lists and Dictionaries in PythonЛабораторнаяRecap of Mapping Data Structures in PythonВидео

Persisting and Loading Data in Python

Key TermsЧтениеIntroduction to Data Sources and Formats in PythonВидеоLoading Data from Files and File Paths in PythonВидеоWorking with JSON in PythonВидеоSaving Data from Python to DiskВидеоLoading and Saving JSON FilesЛабораторнаяRecap of Persisting and Loading Data in PythonВидео

Putting it all Together: JSON Formatting Jupyter Notebook

Build a notebook that reformats data into JSONЧтениеWorking with Data in PythonЗадание
02Python Scripting and SQL26 материалов

Python Scripting Basics

Key TermsЧтениеIntroduction to Python Scripting and SQLВидеоIntroduction to Scripting in PythonВидеоCreating a Script as a Module in PythonВидеоTraversing the File System with a Script in PythonВидеоMinimal Python, Chapter 2: Learn to Store DataЧтениеBuild a Script to Find Large FilesЛабораторнаяRecap of Python Scripting BasicsВидео

SQLite and Python

Key TermsЧтениеExample GitHub Repository ЧтениеIntroduction to Embedded DatabasesВидеоWhat is SQLite?ВидеоCreating and Connecting to a SQLite Database in PythonВидеоSaving and Querying from a SQLite Database in PythonВидео

Querying Databases with SQL

Key TermsЧтениеIntroduction to Querying with SQL in PythonВидеоBasic SQL Commands in PythonВидеоExtracting Distinct Data using SQL in PythonВидеоSearching with SQL in PythonВидеоQuerying a SQLite DatabaseЛабораторная

Putting it all Together: Create a Reporting Script for File Sizes

Create a Reporting Script for File SizesЧтениеPython Scripting and SQLЗадание
03Web Scraping using Python25 материалов

Introduction to Web Scraping

Key TermsЧтениеIntroduction to Web Scraping using PythonВидеоIntroduction to Extracting Data from Unstructured HTMLВидеоChallenges with Web DataВидеоParsing Techniques with HTMLParserЧтениеParsing HTML with HTMLParser in PythonВидеоParse HTML with HTMLParserЛабораторнаяRecap of Web Scraping Techniques in PythonВидео

Using Scrapy and XPath

Key TermsЧтениеIntroduction to Scrapy and XPath in PythonВидеоCreating a Web Scraping Project with Scrapy in PythonВидеоParsing Data with XPath and Scrapy ShellВидеоUsing Scrapy Spider for Web ScrapingВидеоCodespaces Lab: Parse HTML with Scrapy and XPathЧтение

Persistence and Efficiency with Scraping

Key TermsЧтениеOverview of Challenges with Web ScrapingВидеоScraping LocallyВидеоPersisting Data in CSV and JSON FormatsВидеоPersisting Data to a SQLite DatabaseВидеоEfficient Scraping TechniquesЧтение

Putting it all Together: Build a Web Scraping Tool

Build a Web Scraping ToolЧтениеWeb Scraping using PythonЗадание
04Working with MySQL32 материалов

Using VSCode and MySQL

Key termsЧтениеIntroduction to Working with MySQLВидеоIntroduction to VSCode with MySQLВидеоConnecting to a MySQL ServerВидеоConnect to a Running MySQL ServerЛабораторнаяRecap of VSCode with MySQLВидео

Running SQL Queries from VSCode

Key termsЧтениеChallenges of Running MySQL QueriesВидеоUsing VSCode to Execute MySQL QueriesВидеоWorking with VSCode and MySQLЧтениеRunning Queries RepositoryЛабораторнаяRecap of Running MySQL QueriesВидео

Importing and Exporting Data in MySQL

Key TermsЧтениеChallenges with Importing to DatabasesВидеоImporting CSV Data into MySQLВидеоExporting Data from MySQLВидеоExport and Import Data in MySQLЛабораторнаяRecap of Importing and Exporting Data in MySQLВидео

Putting it all Together: Loading and Exporting Data using MySQL

Loading and Exporting Data using MySQLЧтениеWorking with MySQLЗаданиеNext StepsЧтениеMySQL SandboxЛабораторнаяShare your learning experienceЧтение
Create a SQLite Database and Store DataЛабораторная
Recap of SQLite and PythonВидео
Recap of Querying with SQL in PythonВидео
Example GitHub RepositoryЧтение
Recap of Scrapy and XPath in PythonВидео
Parse HTML and Persist it to a SQLite DatabaseЛабораторная
Recap of Persistence and Efficacy with Web ScrapingВидео
MySQL Hacking OverviewВидео
MySQL from TerminalВидео
Archive and Drop DatabaseВидео
Import external database SakilaВидео
Modify database SakilaВидео
Bash pipelines with MySQLВидео
MySQL to Python Standard Library Web ServerВидео
Linux Hacking with MySQLЛабораторная
Lesson ReflectionЧтение