Scala and the JVM as a Big Data Platform - Lessons from Apache Spark
Scala Days Conferences via YouTube
Python, Prompt Engineering, Data Science — Build the Skills Employers Want Now
UC San Diego Product Management Certificate — AI-Powered PM Training
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore the advantages and challenges of using Scala and the JVM for Big Data applications, with a focus on Apache Spark. Learn how Scala's features, such as its pragmatic balance of object-oriented and functional programming, interpreter mode, rich Collections library, and pattern matching, contribute to its effectiveness in Big Data processing. Discover the strengths of the JVM as a scalable computing platform and understand its limitations in high-performance data crunching. Examine the Tungsten project's efforts to optimize Spark's performance through custom data layouts, manual memory management, and code generation. Gain insights into the future improvements that could enhance both Scala and the JVM for Big Data applications.
Syllabus
Scala and the JVM as a Big Data Platform Lessons from Apache Spark by Dean Wampler
Taught by
Scala Days Conferences