Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Natural Language Processing - Fall 2024

UofU Data Science via YouTube

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course surveys natural language processing from foundational methods such as tokenization, embeddings, tagging, parsing, and language modeling to modern transformer and LLM techniques. It also covers machine translation, summarization, question answering, retrieval-augmented generation, fine-tuning, and evaluation.

Syllabus

Final overview
SRL; Coreference resolution
Dependency parsing
Constituency parsing; CKY algorithm
HMM: Parameter estimation & inference; Viterbi
Part of Speech Tagging; Named Entity Recognition; Hidden Markov Model
Vision-and-Language LLMs
Multilingual LLMs
Abstractive summarization; Text generation evaluation
Guest lecture by Niloofar Mireshghallah: Can LLMs Keep a Secret?
Retrieval augmented generation; Extractive summarization
QA: Retrieval & Answer extraction
Parameter-efficient finetuning: (Q)LoRA
Question Answering Landscape
Guest Lecture by Tianyi Zhang: Faster & Cheaper LLMs with Weight and Key-value Cache Quantization
RLHF
Transformer types & Practical considerations
Prompting
Finetuning DeBERTa in (demo); Midterm review
Transformer
Guest Lecture by Kylo Lo: Demystifying data curation for pretrained language models
Pretraining & Finetuning
Machine translation: Seq2seq
Machine translation: BLEU, Decoding, Attention
Language modeling
Neural classification with word embeddings; Pytorch tutorial
Vector semantics & embeddings
Neural networks foundations: Feedforward neural networks
Tokenization; Morphology
Machine learning foundations: Logistic regression

Taught by

UofU Data Science

Reviews

Start your review of Natural Language Processing - Fall 2024

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.