Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Incorporating Tools in Large Language Model Inference - Lecture 10

Graham Neubig via YouTube

Overview

Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Learn how to enhance large language models with external tools in this 53-minute lecture from CMU's Advanced NLP course. Explore the definition and taxonomy of tools, understand the basic tool use paradigm, and examine key approaches including PAL, Toolformer, Gorilla, and WebGPT. Discover methods for tool creation through TroVE and Large Language Models as Tool Makers, while addressing tool robustness challenges and benchmarking failures in tool-augmented language models. Master standardized function calling using JSON Schema, implement parallel function calling, and work with the Model Context Protocol (MCP) and MCP registries. Gain hands-on experience with the FastMCP framework for rapid MCP development and learn about sandboxed code execution for secure tool use. Analyze various tool use scenarios and their trade-offs, while understanding evaluation challenges and best practices for implementing tool-augmented language model systems.

Syllabus

CMU LLM Inference (10): Incorporating Tools

Taught by

Graham Neubig

Reviews

Start your review of Incorporating Tools in Large Language Model Inference - Lecture 10

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.