courseraIT и технологии

Hadoop and Spark Fundamentals: Managing Clusters and Data Pipelines

Курс от Pearson

Средний≈ 7.5 чАнглийский

О курсе

This course is for those who want to become data engineers or analysts. It covers the key skills needed to manage, process, and analyze large datasets using common industry tools. You will learn how to import data into Hadoop HDFS, Hive tables, and use Spark for direct HDFS imports. The course also covers handling streaming data with Apache Flume and connecting relational databases to Hadoop with Apache Sqoop. You will use Apache Zeppelin for developing Spark applications and learn how to install, monitor, and manage Hadoop clusters with Ambari. The course also introduces advanced HDFS features for data management. By the end, you will be able to use Hadoop and Spark in practical settings.

Навыки, которые вы освоите

Apache Spark Apache Hive Apache Hadoop Data Import/Export Relational Databases Software Installation Big Data File Systems Command-Line Interface Data Pipelines

Программа курса

1 модулей · 21 учебных материалов

01Hadoop and Spark Fundamentals: Unit 321 материалов

Getting Data into Hadoop HDFS

Learning objectivesВидео Import data into Hive tablesВидео Use Spark to import data into HDFSВидео Demonstrate a Flume Example—Part 1Видео Demonstrate a Flume Example—Part 2

Учитесь у экспертов

Pearson

Преподаватель курса

Douglas Eadline, PhD

Principle Scientist at Limulus Computing