ETL at Scale - Optimizing PySpark and Airflow Workflows

ETL at Scale - Optimizing PySpark and Airflow Workflows

Conf42 via YouTube Direct link

16:50 Key Takeaways and Conclusion

8 of 8

8 of 8

16:50 Key Takeaways and Conclusion

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

ETL at Scale - Optimizing PySpark and Airflow Workflows

Automatically move to the next video in the Classroom when playback concludes

  1. 1 00:00 Introduction to Cloud Native ETL
  2. 2 01:40 ETL Scaling Challenges
  3. 3 03:08 Building a Stable Foundation
  4. 4 04:45 Optimizing Spark Performance
  5. 5 07:32 Airflow Orchestration Techniques
  6. 6 11:50 Monitoring and Observability
  7. 7 13:08 Implementation Roadmap
  8. 8 16:50 Key Takeaways and Conclusion

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.