К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Unstructured Data Engineering for AI · LearnSpace
Назад в каталог
courseraАнализ данных

Unstructured Data Engineering for AI

Курс от IBM
Средний≈ 23.9 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

This course prepares learners to engineer governed unstructured data pipelines for AI training, semantic search, and RAG systems. Learners design ingestion workflows for documents and multimodal content, apply extraction and OCR-aware processing, normalize text while preserving useful structure, detect sensitive information, create chunking strategies, and enrich corpora with metadata for citation, filtering, lineage, and governance. By the end of the course, learners can build or specify unstructured ingestion workflows, evaluate extraction quality, prepare corpora for embedding or training, and apply safety and quality gates for PII, bias, source trust, and licensing risk. The course emphasizes corpus quality and governance so learners can produce reliable data assets for downstream AI systems.

Навыки, которые вы освоите

Data GovernanceUnstructured DataMetadata ManagementRelease ManagementPersonally Identifiable InformationTaxonomyData CleansingData QualityDocument ManagementRetrieval-Augmented GenerationData CollectionData LakesText MiningInformation ArchitectureData ArchitectureData CaptureResponsible AIData ProcessingAI WorkflowsData Engineering

Программа курса

9 модулей · 95 учебных материалов

01Welcome to the Course3 материалов

Course Introduction

Welcome VideoВидеоCourse OverviewPLUGINGeneral InformationPLUGIN
02Unstructured Ingestion and Object Storage Architecture14 материалов

Storage Foundations for Unstructured AI Corpora

Учитесь у экспертов

Antonio Cangiano

Engineering Manager and AI Specialist

Ruslan Podgaets

Преподаватель курса

Unstructured Data Engineering for AI
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 23.9 ч

9 модулей

Язык: Английский

Часть программы вашего университета
Why Ingestion Architecture Matters for AI-Ready CorporaВидео
Unstructured Corpus Zones and Storage ResponsibilitiesPLUGIN
Designing Object Layouts, Prefixes, and Naming ConventionsВидео
Lab - Design an Object Storage Layout for an Unstructured CorpusВнешний инструмент
Practice Quiz — Storage Foundations for Unstructured AI CorporaЗадание

Manifest-Driven Ingestion and File Quality Controls

Building Manifest-Driven Ingestion WorkflowsВидеоManifest Schema Design for Source, Lineage, and GovernancePLUGINDetecting Corrupted, Duplicate, and Low-Quality FilesВидеоLifecycle, Rejection, and Review Policies for Unstructured FilesPLUGINLab - Build a Manifest and File Quality PolicyВнешний инструментPractice Quiz — Manifest-Driven Ingestion and File Quality ControlsЗадание

Case Study

Case Study — HarborCare Stops Trusting Its CorpusPLUGINCase Study QuizЗадание

Module Quiz

Quiz QuestionsЗадание
03 Content Extraction: Documents, HTML, OCR, and Structure15 материалов

Choosing Extraction Approaches for AI-Ready Corpora

Why Extraction Quality Determines AI Corpus QualityВидеоExtraction Decision Matrix for Common Document TypesPLUGINExtracting Native Text and Structure from PDFs, Word, HTML, and MarkdownВидеоLab - Build a Multi-Format Extraction WorkflowВнешний инструментPractice Quiz — Choosing Extraction Approaches for AI-Ready CorporaЗадание

Preserving Structure and Handling OCR-Aware Workflows

Structure Preservation Patterns: Headings, Tables, Lists, and Source ReferencesPLUGINOCR-Aware Processing for Scanned and Low-Quality DocumentsВидеоLab - Add OCR Routing and Extraction-Quality ChecksВнешний инструментExtraction Quality Checklist and Audit NotesPLUGINPractice Quiz — Preserving Structure and Handling OCR-Aware WorkflowsЗадание

Packaging Extraction Outputs for Downstream Use

Packaging Extraction Outputs for Cleaning, Chunking, and GovernanceВидеоPractice Quiz — Packaging Extraction Outputs for Downstream UseЗадание

Case Study

Case Study — Page 14 Vanished Before LaunchPLUGINCase Study QuizЗадание

Module Quiz

Quiz QuestionsЗадание
04 Text Cleaning, Normalization, and Sensitive Data Handling15 материалов

Inspect and Normalize Extracted Text

Why Cleaning and Sensitive Data Handling Matter for AI CorporaВидеоInspecting Text Quality Issues After ExtractionВидеоText Quality Issue Catalog for Unstructured CorporaPLUGINLab - Build a Structure-Aware Text Normalization PipelineВнешний инструментPractice Quiz — Inspect and Normalize Extracted TextЗадание

Remove Boilerplate While Preserving Meaning

Boilerplate Removal Without Destroying MeaningВидеоNormalization Rules and Boilerplate Decision PatternsPLUGINPractice Quiz — Remove Boilerplate While Preserving MeaningЗадание

Detect, Redact, Audit, and Validate Sensitive Data

PII Detection, Redaction, and Sensitive Data AuditabilityВидеоDesigning Redaction Logs and Sensitive Data Audit ArtifactsPLUGINLab - Detect, Redact, and Audit Sensitive Data in a Corpus SampleВнешний инструментPractice Quiz — Detect, Redact, Audit, and Validate Sensitive DataЗадание

Case Study

Case Study — Northstar Claims Search Almost Shipped GarbagePLUGINCase Study QuizЗадание

Module Quiz

Quiz QuestionsЗадание
05 Chunking and Metadata Enrichment14 материалов

Chunking Strategy Foundations

Why Chunking and Metadata Determine AI Corpus ReadinessВидеоChunking Strategy Decision GuidePLUGINFixed, Semantic, and Hybrid Chunking PatternsВидеоLab - Design and Generate Chunks for an AI CorpusВнешний инструментPractice Quiz — Chunking Strategy FoundationsЗадание

Chunk Schemas, Metadata, and Quality Gates

Designing Chunk Schemas for Lineage and Citation ReadinessВидеоMetadata Fields for Filtering, Lineage, Governance, and AuditPLUGINEvaluating Chunk Quality Before Embedding or RetrievalВидеоChunk Quality Gates and Review ChecklistPLUGINLab - Build Metadata-Enriched Chunks and Quality ChecksВнешний инструментPractice Quiz — Chunk Schemas, Metadata, and Quality GatesЗадание

Case Study

Case Study — HarborSure Failed the CEO DemoPLUGINCase Study QuizЗадание

Module Quiz

Quiz QuestionsЗадание
06Annotation, Labeling, and Corpus Governance15 материалов

Taxonomies and Annotation Foundations

Why Annotation Governance Matters for AI CorporaВидеоDesigning Taxonomies for Unstructured DataВидеоTaxonomy Design Patterns and Anti-PatternsPLUGINLab - Build an Annotation Taxonomy and GuidelinesВнешний инструментPractice Quiz — Taxonomies and Annotation FoundationsЗадание

Human Review and Label Quality

Human Review, Agreement, and Label QualityВидеоInter-Annotator Agreement and Adjudication WorkflowsPLUGINPractice Quiz — Human Review and Label QualityЗадание

AI-Assisted Labeling, Versioning, and Governance Metadata

AI-Assisted Labels, Versioning, and Governance MetadataВидеоLabel Provenance and Governance Metadata FieldsPLUGINLab - Design a Governed Labeling Workflow and Metadata UpdateВнешний инструментPractice Quiz — AI-Assisted Labeling, Versioning, and Governance MetadataЗадание

Case Study

Case Study — MarketFlow Labeling Freeze Before LaunchPLUGINCase Study QuizЗадание

Module Quiz

Quiz QuestionsЗадание
07 Safety Gates, Quality Gates, and Course Project13 материалов

Define Release Gates for an AI-Ready Corpus

From Prepared Corpus to Governed ReleaseВидеоDesigning Safety and Quality Gates for Unstructured CorporaВидеоCorpus Gate Catalog: Quality, Safety, Licensing, and Trust ChecksPLUGINPractice Quiz — Define Release Gates for an AI-Ready CorpusЗадание

Evaluate Licensing, Source Trust, and Release Readiness

Licensing, Source Trust, and Audit EvidenceВидеоRelease Decision Framework for Corpus ReadinessPLUGINPractice Quiz — Evaluate Licensing, Source Trust, and Release ReadinessЗадание

Package and Submit the Governed Corpus Release

Packaging the Final Governed Corpus ProjectВидеоFinal Project Release Package GuidePLUGINPractice Quiz — Package and Submit the Governed Corpus ReleaseЗадание

Case Study

Case Study — CourierHub Corpus Gate ShowdownPLUGINCase Study QuizЗадание

Module Quiz

Quiz QuestionsЗадание
08Course Summary3 материалов

Course Wrap-Up and Next Steps

Wrap upВидеоSummary of CoursePLUGINCreditsPLUGIN
09Final Exam3 материалов

Case Study

HarborHelp Corpus Release on HoldPLUGINCase Study QuizЗадание

Assessment

Quiz QuestionsЗадание