Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

LLMs vs SLMs - A Developer's Guide with NVIDIA Insights

Google Cloud Tech via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Discover the key differences between Large Language Models (LLMs) and Small Language Models (SLMs) in this 11-minute technical video featuring insights from NVIDIA expert Jay Rodge. Learn to identify appropriate use cases for each model type, starting with defining your specific AI application needs before selecting the right approach. Explore open-source tools and frameworks including NVIDIA's NeMo Framework, Hugging Face, and TensorRT-LLM that enable local AI development. Understand the advantages of SLMs, particularly their ability to run locally with reduced latency, while recognizing when accuracy requirements may necessitate larger models instead. Examine the critical role of guardrails in AI applications and the trade-offs between model size, performance, and resource requirements. Dive into optimization techniques including quantization methods that improve model efficiency. Get introduced to the latest NVIDIA GeForce RTX 50 Series hardware and its impact on local AI development capabilities. Conclude with practical applications of AI-powered coding assistance tools that can enhance developer productivity.

Syllabus

0:00 - Introduction: Real Terms with AI & NVIDIA
0:31 - Adding AI - What is the Use Case?
1:20 - Starting with the use case
1:41 - Open Source tools
2:06 - NVIDIA’s NeMo Framework & Hugging Face
2:20 - Small Language Models SLMs explained
3:35 - Advantages of SLMs: local runnability & latency
4:18 - When NOT to Use an SLM: accuracy considerations
5:33 - What guardrails are?
6:50 - Trade-offs & the key factors
7:10 - Optimization basics
7:30 - Good Open Source Tools
8:58 - New NVIDIA RTX GeForce 50 Series hardware and its impact
10:08 - Al powered coding assistance

Taught by

Google Cloud Tech

Reviews

Start your review of LLMs vs SLMs - A Developer's Guide with NVIDIA Insights

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.