Future-Proof Your Career: AI Manager Masterclass
Most AI Pilots Fail to Scale. MIT Sloan Teaches You Why — and How to Fix It
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore techniques for optimizing Apache Spark and SQL performance in this 30-minute conference talk from Conf42 ML 2024. Delve into the evolution of Apache Spark and examine whether SQL alone is sufficient for modern data processing needs. Learn through practical case studies that demonstrate optimization strategies, covering topics such as data processing efficiency, query optimization, and performance tuning. Gain insights into improving your data processing workflows and enhancing the overall performance of your Apache Spark and SQL implementations.
Syllabus
intro
preamble
why care?
about me
short history of apache spark
is sql enough now?
case #1
case #2
case #3 & 4
summary
thank you!
Taught by
Conf42