Start speaking a new language. It’s just 3 weeks away.
UC San Diego Product Management Certificate — AI-Powered PM Training
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Embark on a comprehensive data engineering journey with this full course that combines Apache Airflow, Docker, Spark Clusters, Scala, Python, and Java. Create an end-to-end project, developing basic jobs in multiple programming languages, submitting them to a Spark cluster for processing, and observing live results. Learn to set up a Spark Cluster and Airflow on Docker, create Spark jobs using Python, Scala, and Java, build and compile Scala and Java jobs, and analyze cluster computation results. Gain hands-on experience in workflow automation, big data analytics, and data processing techniques essential for aspiring data engineers.
Syllabus
Introduction
Creating The Spark Cluster and Airflow on Docker
Creating Spark Job with Python
Creating Spark Job with Scala
Building and Compiling Scala Jobs
Creating Spark Job with Java
Building and Compiling Java Jobs
Cluster computation results
Taught by
CodeWithYu