CMU Advanced NLP 2021 - Latent Variable Models

Introduction
Discriminative vs generative models
Types of variables
Loss function
Two tasks
Bias and variance
Evidence lower bound
Procedural training
Questions
Learning the VAE
Generating Sentences
Problems
kl divergence annealing
Free bits
Weaken the decoder
Aggressive inference network learning
Standard variational autoencoder
What are discrete latent variables
Method 1 Sampling
Method 2 Sampling
Method 2 Reparameterization