Coursera Plus Annual is 40% Off — Ends July 13.

Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Automatically Scaling Foundation Models Workflows: Ray with CodeFlare and Red Hat OpenShift

Anyscale via YouTube

Start learning Write review
Boot.dev Ad

Stuck in Tutorial Hell? Learn Backend Dev the Right Way

Learn More → Train in Data Ad

Master Production-Ready Machine Learning, Step by Step

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore the integration of Ray with CodeFlare and Red Hat OpenShift Data Science Pipelines for automatically scaling end-to-end workflows in foundation model development. Learn how this combination addresses the compute-intensive nature of preprocessing steps, tokenization, and model fine-tuning. Discover how CodeFlare enables parallel task execution using Ray clusters on OpenShift Container Platform, overcoming the limitations of RHODS Pipelines and Tekton in auto-scaling. Examine use cases that demonstrate the benefits of this integrated approach, allowing developers to easily specify workflow DAGs, manage tasks independently, and automatically scale operations. Gain insights into leveraging this toolset for effective parallel execution of foundation model workflows on OpenShift, with a focus on simplifying parameter input and DAG specification in RHODS Pipelines.

Syllabus

Automatically scaling the execution of Foundation Models workflows: Ray with CodeFlare and Red Hat

Taught by

Anyscale

Reviews

Start your review of Automatically Scaling Foundation Models Workflows: Ray with CodeFlare and Red Hat OpenShift

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.