Information Theory: Defining Entropy and Information - Lecture 1

Explore fundamental concepts of Information Theory in this Oxford Mathematics third-year undergraduate lecture focusing on measuring information content in random variables through entropy. Delve into Sam Cohen's detailed explanation of how to quantify the amount of information gained from observing random variable outcomes, introducing key concepts of entropy and related mathematical quantities. Learn through this 54-minute lecture, which is part of an eight-lecture series, and gain insights into advanced mathematical principles taught at the University of Oxford. Part of the comprehensive Oxford Mathematics curriculum where students typically follow up lectures with small-group tutorial sessions to deepen their understanding through problem-solving and mathematical discussions.