CMU Advanced Natural Language Processing Spring 2024

This advanced course surveys modern natural language processing, covering language modeling, transformers, generation, prompting, fine-tuning, retrieval-augmented generation, model efficiency, agents, reasoning, computational linguistics, and multilingual NLP.

Syllabus

CMU Advanced NLP 2024 (1): Introduction to NLP
CMU Advanced NLP 2024 (2): Word Representation and Text Classification
CMU Advanced NLP 2024 (3): Language Modeling
CMU Advanced NLP 2024 (4): Sequence Modeling
CMU Advanced NLP 2024 (5): Transformers
CMU Advanced NLP 2024 (6): Generation Algorithms
CMU Advanced NLP 2024 (7): Prompting
CMU Advanced NLP 2024 (8): Fine-tuning and Instruction Tuning
CMU Advanced NLP 2024 (9): Experimental Design and Human Annotation
CMU Advanced NLP 2024 (10): Retrieval and RAG
CMU Advanced NLP 2024 (11): Distillation, Quantization, and Pruning
CMU Advanced NLP 2024 (12): Reinforcement Learning
CMU Advanced NLP 2024 (13): Debugging and Interpretation
CMU Advanced NLP 2024 (14): Ensembling and Mixture of Experts
CMU Advanced NLP 2024 (15): A Tour of Modern Large Language Models
CMU Advanced NLP 2024 (17): Code Generation
CMU Advanced NLP 2024 (18): Knowledge and Language Models
CMU Advanced NLP 2024 (20): Tool Use and Language Agents
CMU Advanced NLP 2024 (21): Complex Reasoning
CMU Advanced NLP 2024 (22): Linguistics and Computational Linguistics
CMU Advanced NLP 2024 (23): Multilingual NLP