Overview
Syllabus
Intro to NLP; Course logistics
Machine learning basics; Perceptron
Logistic regression; Tokenization
Vector semantics; Embeddings
Neural network basics
Language modeling
Neural machine translation
Attention; Transformer (Encoder)
Transformer (Decoder); Pretraining & Finetuning
Finetuning DeBERTa in (demo); Instruction FT
Finetuning a seq2seq model in (demo); RLHF
“Taskification” and Valid Benchmarks
Midterm overview
POS Tagging; Named Entity Recognition; Hidden Markov Model
Hidden Markov Model: Parameter Estimation & Efficient Inference
Constituency parsing
Dependency parsing
Semantic parsing; SRL
Coreference resolution
Probing
Question Answering
Multilingual and multimodal LLMs
Topics in Responsible AI
Final overview
Summarization
Taught by
UofU Data Science