Completed
Introduction
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Apache Spark? If Only It Worked
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 My experience with Spark
- 3 Outline of the talk
- 4 What is Spark
- 5 RDD
- 6 Pipelines
- 7 Execution Unit
- 8 Executor
- 9 executor size
- 10 small executors
- 11 Spark memory model
- 12 Memory overhead
- 13 Shuffle
- 14 In practice
- 15 Spark UI
- 16 Execution Plan
- 17 Skew Data
- 18 Locality
- 19 Check locality
- 20 RDD lazily evaluated
- 21 RDD calculation twice
- 22 Spark caching
- 23 Spark optimization
- 24 Map volumes
- 25 Improve shuffle
- 26 Recap
- 27 Debugging tools
- 28 Challenge
- 29 Use Case
- 30 Summary
- 31 Questions
