Creating Synthetic Datasets for Instruction Finetuning with LLaMA and Nemotron
Learn Backend Development Part-Time, Online
Build with Azure OpenAI, Copilot Studio & Agentic Frameworks — Microsoft Certified
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Learn how to create synthetic datasets for instruction fine-tuning using LLaMA 3.1 and Nemotron 4 in this comprehensive tutorial video. Discover techniques for generating subtopics, creating questions, producing high-quality responses, and filtering content using AI models. Follow step-by-step instructions to set up the necessary tools, write and run Python scripts, and upload your custom dataset to Hugging Face. Gain insights into enhancing AI model performance with diverse training data and automating the dataset creation process. Perfect for AI developers and enthusiasts looking to optimize their models effectively.
Syllabus
Introduction and Overview
LLaMA 3.1 & Nemotron 4 Overview
Step 1: Generating Subtopics
Step 2: Creating Questions
Step 3: Generating Responses
Step 4: Filtering Responses with Reward Model
Uploading Dataset to Hugging Face
Final Thoughts and Next Steps
Taught by
Mervin Praison