К содержимому
learnspaceYOUR NEXT CHAPTER
ПРОСТРАНСТВО ОБУЧЕНИЯ
ГлавнаяКаталог курсовМоё обучениеCoursera

Знания без границ

Учитесь у лучших университетов и компаний мира.

Открыть Coursera
Интеграция
Пространство университета
Моё пространствоСтраница курса
↵
ЯЛичный кабинетСтудент
© 2026 LearnSpaceКаждый день — возможность узнать больше.Помощь
Generative AI for Audio and Images: Models and Applications · LearnSpace
Назад в каталог
courseraПрограммирование

Generative AI for Audio and Images: Models and Applications

Курс от Alberta Machine Intelligence Institute
Уровень не указан≈ 29.3 чАнглийский
О курсеНавыкиПрограммаПреподаватели

О курсе

Generative AI for Audio and Images: Models and Applications offers an in-depth exploration of how modern generative models such as Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), Transformers, and Diffusion models are used to create, manipulate, and enhance audio, image, and video content. Learners examine the architectures, training processes, and use cases of these models across different modalities, gaining both conceptual understanding and practical insights through hands-on activities. The course also highlights the ethical and societal implications of generative AI, including bias, transparency, intellectual property, and the challenges of deepfake technologies. By covering foundational theory as well as state-of-the-art approaches and applications, this course prepares learners to apply and develop generative AI creatively and responsibly for the audio and image modalities. By the end of this course, learners will be able to: Outline core concepts, challenges, and the history of AI-generated audio. Analyze important foundational audio generation models, such as variational and vector quantized autoencoders (VAE and VQ-VAE) Examine how these models integrate with the latest GenAI technologies to form hybrid, state-of-the-art transformer and diffusion-based audio generation systems, Study the architecture and functionality of Generative Adversarial Networks (GANs), and their variations. Implement and train GAN models for creating and enhancing visual content, Explore cutting-edge techniques such as diffusion models and transformers for image and video creation. Discuss the ethical considerations regarding generative AI for audio and images.

Навыки, которые вы освоите

Generative Model ArchitecturesGenerative AIGenerative Adversarial Networks (GANs)Responsible AIData ProcessingMusicAutoencodersVision Transformer (ViT)Digital Signal ProcessingAI powered creativityComputer VisionConvolutional Neural NetworksModel Training

Программа курса

4 модулей · 123 учебных материалов

01The Fundamentals of AI-generated audio30 материалов

Getting Started

Course IntroductionВидеоLearning GoalОбсуждениеMeet your instructor: Anahita DoostiВидеоMeet your instructor: Nasimeh AsgarianВидео

Introduction to AI for Audio and Music Generation

Учитесь у экспертов

Anahita Doosti

Machine Learning Educator

Generative AI for Audio and Images: Models and Applications
В каталоге вашей программы

Инвестируйте в себя

Новые знания — в удобное для вас время.

Начать на Coursera

Обучение откроется на Coursera
в новой вкладке

Обучение на Coursera

≈ 29.3 ч

4 модулей

Язык: Английский

Субтитры: Арабский, Французский, Узбекский, Итальянский, Бразильский португальский, Корейский, Немецкий, Пушту, Испанский, Дари, Японский, Казахский, Венгерский

Часть программы вашего университета
Overview of AI for Audio and Music GenerationВидео
TerminologyЧтение
Is AI even capable of achieving true creativity?Обсуждение
Why Is Audio Generation Difficult?Видео
Data representation: Waveform vs SymbolicВидео
Data FormatsВидео
Python Libraries for Audio DataЧтение
Evaluation (part 1)Видео
Evaluation (part 2)Видео
Practice Quiz 1Задание

Understanding the Audio Generation Landscape

Categorizing Audio Generation ApproachesВидеоThe Many Forms of Audio GenerationВидеоAudio FunctionalityВидеоHuman-AI Collaboration ВидеоPutting It into PracticeВидеоPractice Quiz 2Задание

The history of AI-generated audio

An Overview of the Progress Throughout the YearsВидеоPre-ML Approaches: Algorithmic, Rule-BasedВидеоEarly ML Approaches: HMMs, FF Neural NetworksВидеоModern Approaches 1: RNNs and CNNsВидеоModern Approaches 2: Autoencoders/VAEs and GANsВидеоModern Approaches 3: Transformers and DiffusionВидеоModule 1 RecapВидеоPractice Quiz 3Задание

Module 1 Quiz

Module 1 QuizЗаданиеWaveNet Implementation (Hands-on Lab)Чтение
02Advanced audio generation with Generative AI37 материалов

Variational Autoencoders

Introduction to Variational AutoencodersВидеоAutoencodersВидеоLatent SpaceВидеоInside the Encoder-Decoder BlocksВидеоTraining VAEs (Part 1)ВидеоTraining VAEs (Part 2)ВидеоVector Quantized Variational Autoencoders (Part 1)ВидеоVector Quantized Variational Autoencoders (Part 2)ВидеоPractice QuizЗадание

VAE-based Audio Generation

Using VAE to Generate MelodiesВидеоHow to Condition VAEs with Additional Musical Information Such as Chord, Scale?ВидеоExample: MusicVAEВидеоAttribute Vector Arithmetic for Melodies ВидеоExample: JukeboxВидеоExample: Speech SynthesisВидео

Transformer-based Audio Generation

Transformer PrimerВидеоTransformers for Audio GenerationВидеоExample: Music TransformerВидеоRevisiting JukeBox: How Transformers Can Generate Waveform Audio! (Part 1)ВидеоRevisiting JukeBox: How Transformers Can Generate Waveform Audio! (Part 2)ВидеоA New Paradigm: Audio Codec + Language Model (Part 1)Видео

Diffusion-based Audio Generation

What Are Diffusion Models, and How Can They Generate Audio?ВидеоExample: Stable AudioВидеоExample: DiffWaveВидеоStrengths and Limitations of Diffusion-Based ApproachesВидеоHow Do the Recent Models Compare to Each Other?ВидеоResource GuideЧтение

Module 2 Quiz

Module 2 QuizЗаданиеAudio Generation Models Inference and Comparison (Hands-on Lab)Чтение
03Introduction to Generative Image Models30 материалов

Introduction and application of generative image and video models

Overview of AI for Image and Video GenerationВидеоApplications of Image and Video GenerationВидеоDALL-E and MidJourney ExamplesВидеоSora ExamplesВидеоA Short History of Image GenerationВидеоPractice Quiz 1Задание

Foundations of generative image model

Revisit VAEВидеоIntroducing GANВидеоDiscriminatorВидеоGeneratorВидеоGAN TrainingВидеоChallenges and Best Practices for GAN TrainingВидеоPractice Quiz 2

GAN Variations

Progressive GANВидеоConditional GANsВидеоApplications, Advantages and Limitations of cGANsВидеоImage-to-Image TranslationВидеоChallenges and Applications of Image-to-Image TranslationВидеоText to Image GANВидео

Practical use cases

Creative designВидеоCommercial Use CasesВидеоData AugmentationВидеоData synthesisЧтениеModule 3 RecapВидеоPractice Quiz 4Задание

Module 3 Quiz

DCGAN from Scratch (Hands-on Lab)ЧтениеModule 3 QuizЗадание
04Advanced Image and Video Generation with Generative AI26 материалов

Vision Transformer

Overview on Key Models and ArchitecturesВидеоHigh-Level Overview of Vision TransformerВидеоEncoder-Decoder Design PatternВидеоConvolutional EncodersВидеоSelf AttentionВидеоSpatial vs. Channel vs. Temporal AttentionВидеоPractice Quiz 1Задание

Diffusion model

Diffusion Model Architecture High-Level OverviewВидеоForward / Diffusion ProcessВидеоReverse ProcessВидеоDiffusion Model TrainingВидеоExamples of Diffusion ModelВидеоPractice Quiz 2Задание

Advance Ethical Consideration

Bias in Training DataВидеоTransparencyВидеоIntellectual PropertyВидеоData PrivacyВидеоDeepfake IntroВидеоDeep Fake - Face SwapВидеоVoice Cloning

Module 4 Quiz

Module 4 QuizЗаданиеViT vs. Diffusion (Hands-on Lab)Чтение

Course Wrap Up

Course Wrap UpВидео
Strengths and limitations of VAE-based approachesВидео
A New Paradigm: Audio Codec + Language Model (Part 2)Видео
Example: FastSpeechВидео
Strengths and Limitations of Transformer-Based ApproachesВидео
Practice QuizЗадание
What Is on the Horizon? Where Are We Headed?Видео
Module 2 RecapВидео
Practice QuizЗадание
Задание
Other GAN Variations: Cycle GAN, DCGAN, StyleGANВидео
Style GANЧтение
Practice Quiz 3Задание
Видео
Video Deep FakeВидео
Module 4 RecapВидео
Practice Quiz 3Задание