Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Advanced Natural Language Processing - Fall 2024

Graham Neubig via YouTube

Overview

Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore advanced natural language processing concepts through this comprehensive video lecture series from Carnegie Mellon University's CS 11-711 course taught by Graham Neubig. Master fundamental and cutting-edge NLP techniques starting with word representation and language modeling, then progress through transformer architectures, attention mechanisms, and pre-trained models. Delve into modern approaches including instruction tuning, prompting strategies, complex reasoning, and reinforcement learning from human feedback. Learn practical implementation skills through topics covering retrieval-augmented generation (RAG), model distillation, quantization, and pruning techniques. Examine specialized applications in code and mathematical modeling, long sequence processing, and ensemble methods including mixture of experts. Discover how to build and deploy LLM agents for software development and web browsing, while understanding proper evaluation methodologies and multimodal integration. Gain insights into computational linguistics principles, knowledge base integration, and multilingual NLP systems. Address critical considerations around safety, ethics, and bias in NLP systems, and explore advanced inference-time algorithms including meta-generation and methods for long-context language models through 23 detailed lectures totaling over 27 hours of instruction.

Syllabus

CMU Advanced NLP Fall 2024 (1): Introduction to NLP
CMU Advanced NLP Fall 2024 (2): Representing Words
CMU Advanced NLP Fall 2024 (3): Language and Sequence Modeling
CMU Advanced NLP Fall 2024 (4): Attention and Transformers
CMU Advanced NLP Fall 2024 (5): Pre-training and Pre-trained Models
CMU Advanced NLP Fall 2024 (6): Instruction Tuning
CMU Advanced NLP Fall 2024 (7): Prompting and Complex Reasoning
CMU Advanced NLP Fall 2024 (8): Reinforcement Learning and Human Feedback
CMU Advanced NLP Fall 2024 (9): Experimental Design and Data Annotation
CMU Advanced NLP Fall 2024 (10): Retrieval and RAG
CMU Advanced NLP Fall 2024 (11): Distillation, Quantization, and Pruning
CMU Advanced NLP Fall 2024 (12): Domain Specific Modeling: Code and Math
CMU Advanced NLP Fall 2024 (13): Long Sequence Models
CMU Advanced NLP Fall 2024 (14): Ensembling and Mixture of Experts
CMU Advanced NLP Fall 2024 (15): Tool Use and LLM Agent Basics
CMU Advanced NLP Fall 2024 (16): Agents for Software Development and Web Browsing
CMU Advanced NLP Fall 2024 (17): Evaluation and Multimodal
CMU Advanced NLP Fall 2024 (18): Linguistics and Computational Linguistics
CMU Advanced NLP Fall 2024 (19): Learning From/For Knowledge Bases
CMU Advanced NLP Fall 2024 (20): Multilingual NLP
CMU Advanced NLP Fall 2024 (21): Safety, Ethics, and Biase in NLP Systems
CMU Advanced NLP Fall 2024 (22): From Decoding to Meta Generation Inference Time Algorithms for LMs
CMU Advanced NLP Fall 2024 (23): MagicPIG & Factor - Methods for Long Context LMs

Taught by

Graham Neubig

Reviews

Start your review of Advanced Natural Language Processing - Fall 2024

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.