Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Natural Language Processing - Spring 2024

UofU Data Science via YouTube

Overview

Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Learn fundamental and advanced concepts in natural language processing through this comprehensive university course covering machine learning foundations, neural networks, transformers, and modern language models. Master essential NLP techniques including tokenization, vector semantics, embeddings, and language modeling while exploring neural machine translation and attention mechanisms. Dive deep into transformer architectures for both encoding and decoding, understanding pretraining and fine-tuning processes with hands-on demonstrations using DeBERTa and sequence-to-sequence models. Examine reinforcement learning from human feedback (RLHF) and instruction fine-tuning approaches alongside taskification and benchmarking methodologies. Study traditional NLP tasks such as part-of-speech tagging, named entity recognition, and hidden Markov models with parameter estimation and efficient inference techniques. Explore syntactic analysis through constituency and dependency parsing, semantic parsing, and semantic role labeling. Investigate coreference resolution, probing techniques, and question answering systems while addressing multilingual and multimodal large language models. Conclude with critical topics in responsible AI, summarization techniques, and comprehensive review sessions to solidify understanding of the complete NLP landscape.

Syllabus

Intro to NLP; Course logistics
Machine learning basics; Perceptron
Logistic regression; Tokenization
Vector semantics; Embeddings
Neural network basics
Language modeling
Neural machine translation
Attention; Transformer (Encoder)
Transformer (Decoder); Pretraining & Finetuning
Finetuning DeBERTa in (demo); Instruction FT
Finetuning a seq2seq model in (demo); RLHF
“Taskification” and Valid Benchmarks
Midterm overview
POS Tagging; Named Entity Recognition; Hidden Markov Model
Hidden Markov Model: Parameter Estimation & Efficient Inference
Constituency parsing
Dependency parsing
Semantic parsing; SRL
Coreference resolution
Probing
Question Answering
Multilingual and multimodal LLMs
Topics in Responsible AI
Final overview
Summarization

Taught by

UofU Data Science

Reviews

Start your review of Natural Language Processing - Spring 2024

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.