Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Natural Language Processing - Fall 2024

UofU Data Science via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn the fundamentals and advanced concepts of natural language processing in this comprehensive course covering both traditional and modern approaches to NLP. Master foundational machine learning techniques including logistic regression and feedforward neural networks before progressing to neural classification with word embeddings and vector semantics. Explore essential NLP tasks such as tokenization, morphology, part-of-speech tagging, named entity recognition, and dependency parsing using Hidden Markov Models and the CKY algorithm. Dive deep into language modeling, machine translation with sequence-to-sequence models, attention mechanisms, and BLEU evaluation metrics. Study the Transformer architecture and its practical applications, including pretraining and finetuning strategies for models like DeBERTa. Examine advanced topics in large language models including prompting techniques, parameter-efficient finetuning with LoRA and QLoRA, reinforcement learning from human feedback (RLHF), and retrieval-augmented generation. Investigate specialized applications such as question answering systems, abstractive and extractive summarization, multilingual LLMs, and vision-and-language models. Benefit from guest lectures by industry experts covering cutting-edge topics like data curation for pretrained language models, LLM quantization techniques for improved efficiency, and privacy considerations in large language models. Gain hands-on experience through practical demonstrations and tutorials using PyTorch, preparing you to tackle real-world NLP challenges with both traditional and state-of-the-art deep learning approaches.

Syllabus

Final overview
SRL; Coreference resolution
Dependency parsing
Constituency parsing; CKY algorithm
HMM: Parameter estimation & inference; Viterbi
Part of Speech Tagging; Named Entity Recognition; Hidden Markov Model
Vision-and-Language LLMs
Multilingual LLMs
Abstractive summarization; Text generation evaluation
Guest lecture by Niloofar Mireshghallah: Can LLMs Keep a Secret?
Retrieval augmented generation; Extractive summarization
QA: Retrieval & Answer extraction
Parameter-efficient finetuning: (Q)LoRA
Question Answering Landscape
Guest Lecture by Tianyi Zhang: Faster & Cheaper LLMs with Weight and Key-value Cache Quantization
RLHF
Transformer types & Practical considerations
Prompting
Finetuning DeBERTa in (demo); Midterm review
Transformer
Guest Lecture by Kylo Lo: Demystifying data curation for pretrained language models
Pretraining & Finetuning
Machine translation: Seq2seq
Machine translation: BLEU, Decoding, Attention
Language modeling
Neural classification with word embeddings; Pytorch tutorial
Vector semantics & embeddings
Neural networks foundations: Feedforward neural networks
Tokenization; Morphology
Machine learning foundations: Logistic regression

Taught by

UofU Data Science

Reviews

Start your review of Natural Language Processing - Fall 2024

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.