Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Stanford University

Natural Language Understanding I - Spring 2023

Stanford University via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the theoretical foundations and practical applications of natural language understanding through this comprehensive Stanford University course taught by Professor Christopher Potts. Master key concepts from linguistics, natural language processing, and machine learning while diving deep into contextual word representations including Transformers, GPT, BERT, RoBERTa, and ELECTRA architectures. Learn about information retrieval systems, from classical IR approaches to modern neural methods, and discover evaluation metrics for assessing retrieval performance. Examine in-context learning techniques and their evolution from origins to current state-of-the-art methods. Develop skills in behavioral evaluation of NLU models through compositionality testing, adversarial evaluation, and specialized datasets like COGS and DynaSent. Gain expertise in analysis methods including probing techniques, feature attribution, causal abstraction, and Distributed Alignment Search (DAS). Study essential NLP methods and metrics covering classifier evaluation, generation metrics, dataset construction, and model assessment protocols. Learn professional research skills including literature review techniques, experimental protocol design, academic paper writing, conference submission processes, and effective presentation strategies for research talks. Apply domain adaptation techniques for supervised sentiment analysis and explore retrieval-augmented learning approaches through hands-on homework assignments and bake-off competitions that reinforce theoretical concepts with practical implementation experience.

Syllabus

Stanford XCS224U: NLU I Intro & Evolution of Natural Language Understanding, Pt. 1 I Spring 2023
Stanford XCS224U: Natural Language Understanding I Course Overview, Part 2 I Spring 2023
Stanford XCS224U: Natural Language Understanding I Homework 1 I Overview: Bake Off
Stanford XCS224U: NLU I Contextual Word Representations, Part 1: Guiding Ideas I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 2: Transformer I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 3: Positional Encoding I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 4: GPT I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 5: BERT I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 6: RoBERTa I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 7: ELECTRA I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 8: Seq2seq Architectures I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 9: Distillation I Spring 2023
Stanford XCS224U: NLU I Contextual Word Representations, Part 10: Wrap-up I Spring 2023
Stanford XCS224U: Natural Language Understanding I Homework 2 I Spring 2023
Stanford XCS224U: NLU I Information Retrieval, Part 1: Guiding Ideas I Spring 2023
Stanford XCS224U: NLU I Information Retrieval, Part 2: Classical IR I Spring 2023
Stanford XCS224U: NLU I Information Retrieval, Part 3: IR metrics I Spring 2023
Stanford XCS224U: NLU I Information Retrieval, Part 4: Neural IR I Spring 2023
Stanford XCS224U: NLU I Information Retrieval, Part 5: Datasets and Conclusion I Spring 2023
Stanford XCS224U: Natural Language Understanding I In-context Learning, Pt 1: Origins I Spring 2023
Stanford XCS224U: NLU I In-context Learning, Part 2: Core Concepts I Spring 2023
Stanford XCS224U: NLU I In-context Learning, Part 3: Current Moment I Spring 2023
Stanford XCS224U: NLU I In-context Learning, Part 4: Techniques and Suggested Methods I Spring 2023
Stanford XCS224U: Natural Language Understanding I Homework 3 I Spring 2023
Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Part 1: Overview I Spring 2023
Stanford XCS224U I Behavioral Eval of NLU Models, Pt 2: Analytical Considerations I Spring 2023
Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Part 3: Compositionality I Spring 2023
Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Part 4: COGS and ReCOGS I Spring 2023
Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Pt 5: Adversarial Testing I Spring 2023
Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Part 6: Adversarial NLI I Spring 2023
Stanford XCS224U: NLU I Behavioral Eval of NLU Models, Pt 7: DynaSent and Conclusion I Spring 2023
Stanford XCS224U: Natural Language Understanding I Lit Review Overview I Spring 2023
Stanford XCS224U: NLU I Analysis Methods for NLU, Part 1: Overview I Spring 2023
Stanford XCS224U: NLU I Analysis Methods for NLU, Part 2: Probing I Spring 2023
Stanford XCS224U: NLU I Analysis Methods for NLU, Part 3: Feature Attribution I Spring 2023
Stanford XCS224U I Analysis NLU, Pt 4: Casual Abstraction & Interchange Intervention Training (IIT)
Stanford XCS224U: Analysis NLU, Part 5: Distributed Alignment Search (DAS) & Conclusion I Spring 23
Stanford XCS224U: Natural Language Understanding I Experiment Protocol Overview I Spring 2023
Stanford XCS224U: NLU I NLP Methods and Metrics, Part 1: Overview I Spring 2023
Stanford XCS224U: NLU I NLP Methods and Metrics, Part 2: Classifier Metrics I Spring 2023
Stanford XCS224U: NLU I NLP Methods and Metrics, Part 3: Generation Metrics I Spring 2023
Stanford XCS224U: NLU I NLP Methods and Metrics, Part 4: Datasets I Spring 2023
Stanford XCS224U: NLU I NLP Methods and Metrics, Part 5: Data Organization I Spring 2023
Stanford XCS224U: NLU I NLP Methods and Metrics, Part 6: Model Evaluation & Conclusion I Spring 2023
Stanford XCS224U: NLU I Presenting Your Research, Part 1: Your Papers I Spring 2023
Stanford XCS224U: NLU I Presenting Your Research, Part 2: Writing NLP Papers I Spring 2023
Stanford XCS224U: NLU I Presenting Your Research, Part 3: NLP Conference Submission I Spring 2023
Stanford XCS224U: NLU I Presenting Your Research, Part 4: Giving Talks I Spring 2023
Stanford XCS224U: NLU I Fantastic Language Models and How to Build Them, Part 1 I Spring 2023
Stanford XCS224U: NLU I Fantastic Language Models and How to Build Them, Part 2 I Spring 2023

Taught by

Stanford Online

Reviews

Start your review of Natural Language Understanding I - Spring 2023

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.