Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Apache Spark, Hadoop Project with Kafka and Python - End to End Development

Start learning Write review

Details

Provider

YouTube
Pricing

Free Video
Languages

English
Duration & workload

1 hour 30 minutes
Sessions

On-Demand
Level

Advanced

Found in

Coursera

Save 40% on 3 months of Coursera Plus

Scrimba

Our career paths help you become job ready faster

Overview

Coursera Flash Sale

40% Off Coursera Plus for 3 Months!

Dive into a comprehensive 90-minute tutorial on building an end-to-end data processing system using Apache Spark, Hadoop, and Kafka with Python. Explore the architecture and code walkthrough of each component, including Kafka Producer, Spark Structured Streaming as Kafka Consumer, and data processing with Hive and Presto. Develop a REST API using Flask and Flask-RESTPlus, and create a dashboard or web application with Python Dash. Learn how to integrate these technologies to create a robust, scalable data pipeline for real-time processing and analysis.

Syllabus

End to End Project using Spark/Hadoop | Code Walkthrough | Architecture | Part 1 | DM | DataMaking.
End to End Project using Spark/Hadoop | Code Walkthrough | Kafka Producer | Part 2 | DM | DataMaking.
End to End Project using Spark/Hadoop | Code Walkthrough |Spark Streaming|Part 3.1| DM | DataMaking.
End to End Project using Spark/Hadoop | Code Walkthrough |Spark Streaming|Part 3.2| DM | DataMaking.
End to End Project using Spark/Hadoop|Code Walkthrough|Hive | Part 4 | DM | DataMaking | Data Making.
End to End Project using Spark/Hadoop | Code Walkthrough | Presto Module | Part 5 | DM | DataMaking.
Spark Project with Kafka | REST API Module using Flask, Flast-RESTPlus | Part 6 | DM | DataMaking.
Spark Project with Kafka | Dashboard Module using Python Dash | Part 7 | DM | DataMaking.

Taught by

DataMaking

Reviews

Start your review of Apache Spark, Hadoop Project with Kafka and Python - End to End Development