Fusion of Brilliant Technologies: RHELAI and RHOAI Integration

This 34-minute conference talk from DevConf.IN 2025, presented by Amita Sharma and Abhijeet Dhumal, explores the powerful integration between InstructLab and Red Hat OpenShift AI (RHOAI). Discover how to fine-tune open-source models using InstructLab and deploy them in an OpenShift (Kubernetes) environment through RHOAI. Learn about leveraging ilab and distributed workloads with RHOAI simultaneously to enable faster, more efficient training for demanding AI models. Follow an end-to-end training journey that includes generating synthetic data on ilab, fine-tuning IBM's open-source Granite model on OpenShift AI using a phased approach, and evaluating results with Mistral-Eval and MTBench. Begin your MLOps journey with RHELAI (ilab) and seamlessly scale it on RHOAI, gaining practical knowledge to tackle real-world AI challenges with confidence and creativity.