Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Streamline Evaluation, Monitoring, and Optimization of AI Data Flywheel with NVIDIA and Weights & Biases

Weights & Biases via YouTube

Overview

Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Learn to streamline the evaluation, monitoring, and optimization of AI data flywheels using NVIDIA and Weights & Biases technologies in this 17-minute webinar. Discover how the NVIDIA Data Flywheel Blueprint provides a systematic, automated solution for refining and redeploying optimized models that maintain accuracy targets while reducing resource demands and addressing the significant challenges of deploying AI agents at scale, including high compute costs and latency bottlenecks. Explore how this blueprint establishes a self-reinforcing data flywheel that uses production traffic logs and institutional knowledge to continuously improve model efficiency and accuracy. Understand how Weights & Biases enhances the NVIDIA AI Blueprint by providing advanced traceability for continuous model optimization with real-world data and user feedback, including native traceability, robust experiment tracking, version management, and visualization capabilities. Master the framework that enables monitoring, automated retraining, and rapid iteration cycles to accelerate the transition from experimentation to production. Examine what defines an AI agent, identify common failure patterns in AI agent deployments, and understand the critical role of fine-tuning in addressing these challenges. Learn the complete process of creating fine-tuning datasets, implementing data filtering and annotation techniques, executing fine-tuning procedures, and conducting comparative evaluations to optimize model performance while balancing accuracy with efficiency requirements.

Syllabus

0:00 Introduction
1:01 What is an AI Agent?
2:33 Common Failures in AI Agents
3:25 The Role of Fine-Tuning
5:32 Creating Fine-Tuning Datasets
7:13 Data Filtering & Annotation
9:07 Fine-Tuning Execution
11:14 Comparative Evaluation
13:04 Complete Fine-Tuning Pipeline Recap
16:46 Final Takeaways & Closing

Taught by

Weights & Biases

Reviews

Start your review of Streamline Evaluation, Monitoring, and Optimization of AI Data Flywheel with NVIDIA and Weights & Biases

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.