Successes and Challenges in Neural Models for Speech and Language - Michael Collins
Institute for Advanced Study via YouTube
Learn the Skills Netflix, Meta, and Capital One Actually Hire For
Stuck in Tutorial Hell? Learn Backend Dev the Right Way
Overview
Syllabus
Intro
Problems in Speech and Natural Language
The First (Statistical) Revolution
The Second (Neural) Revolution
A Personal View: the Parsing Problem
Kernel Methods
Word Embeddings
Natural Language Syntax, and the Parsing Problem
Shift Actions
Predicting Actions
The Natural Questions Data
Transformers (continued)
Multi-Head Transformers
This Talk: Three Problems, Three Architectures
Taught by
Institute for Advanced Study