Learn Backend Development Part-Time, Online
Start speaking a new language. It’s just 3 weeks away.
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore a new ML data pre-processing framework called Cruise.Data in this 31-minute conference talk from Anyscale. Learn how Cruise addresses the challenges of custom data pre-processing for machine learning models in the autonomous vehicle industry. Discover the unique features of Cruise.Data, which combines the best properties of tf.data, the PyTorch ecosystem, and large-scale data processing frameworks. Understand how this innovative system tackles issues such as performance, reliability, and memory usage, particularly when dealing with high-resolution sensor data from autonomous vehicles. Gain insights into how Ray helps scale the Cruise.Data framework and how it enables ML engineers to seamlessly move logic between training and offline batch data processing jobs. Delve into the progress made in building this novel system and its potential impact on improving GPU utilization and overall efficiency in ML model training for autonomous driving applications.
Syllabus
Cruise.data - A new dataset processing pipeline for Cruise ML
Taught by
Anyscale