Information Theory Courses and Certifications

Information Theory

166 ratings at Coursera

Explore fundamental concepts of information theory, including data compression, channel coding, and rate-distortion theory. Gain insights into communication systems and their limits.

• Coursera
• 33 hours
• On-Demand
• Paid Course

The Science of Information: From Language to Black Holes

63 ratings at The Great Courses Plus

Explore the exciting concepts, history, and applications of information theory in 24 challenging and eye-opening half-hour lectures taught by a world-renowned physicist.

• The Great Courses Plus
• 12 hours 26 minutes
• On-Demand
• Free Trial Available

Complexity Explorer

Maximum Entropy Methods Tutorial

Discover maximum entropy methods for understanding probability distributions through practical examples including taxicab problems and real-world modeling applications.

• YouTube
• 1 hour 46 minutes
• On-Demand
• Free Video

Data Compression I - Lecture 2: Prefix Free Codes

1 review

Explore prefix-free codes in data compression, covering theory and applications. Gain insights from Stanford experts on efficient information encoding techniques.

• YouTube
• 1 hour 17 minutes
• On-Demand
• Free Video

Data Compression I - Course Introduction and Lossless Compression Basics - Lecture 1

Introduction to lossless data compression fundamentals, covering key concepts and techniques for efficient information storage and transmission.

• YouTube
• 1 hour 3 minutes
• On-Demand
• Free Video

Data Compression I - Lecture 5: Asymptotic Equipartition Property

Explore the Asymptotic Equipartition Property in data compression, a fundamental concept for understanding information theory and efficient coding techniques.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Video

Context-based Arithmetic Coding and LLM Compression - Stanford EE274 Lecture 9

Explore context-based arithmetic coding and compression techniques for large language models in this advanced lecture on data compression theory and applications.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Video

Data Compression I - Lecture 4: Huffman Codes

Explore Huffman coding, a fundamental data compression technique, in this Stanford lecture. Learn its principles, implementation, and applications in information theory.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

Data Compression I - Lecture 3: Kraft Inequality, Entropy, and Introduction to SCL

Explore Kraft Inequality, entropy, and Source Coding Limit in data compression. Gain insights into fundamental concepts and their applications in information theory and coding.

• YouTube
• 1 hour 17 minutes
• On-Demand
• Free Video

Stanford EE274: Data Compression - Beyond IID Distributions: Conditional Entropy - Lecture 8

Explore conditional entropy and advanced data compression techniques beyond IID distributions in this Stanford lecture, enhancing understanding of complex information theory concepts.

• YouTube
• 1 hour 16 minutes
• On-Demand
• Free Video

LZ and Universal Compression - Lecture 10

Explore Lempel-Ziv algorithms and universal compression techniques in this Stanford lecture, delving into advanced data compression theory and applications.

• YouTube
• 1 hour 25 minutes
• On-Demand
• Free Video

Arithmetic Coding - Stanford EE274 Data Compression I Lecture 6

Explore arithmetic coding in data compression, covering theory and applications. Learn from Stanford experts about this advanced technique for efficient information encoding.

• YouTube
• 1 hour 18 minutes
• On-Demand
• Free Video

Lossy Compression Basics and Quantization - Lecture 11

Explore lossy compression fundamentals and quantization techniques in this Stanford lecture, covering essential concepts for efficient data reduction in various applications.

• YouTube
• 1 hour 24 minutes
• On-Demand
• Free Video

Asymmetric Numeral Systems (ANS) - Data Compression Lecture 7

Explore Asymmetric Numeral Systems (ANS), an advanced data compression technique, in this Stanford lecture. Gain insights into its principles, applications, and advantages in modern compression algorithms.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Video

3Blue1Brown

Solving Wordle Using Information Theory

Explore information theory and entropy through the lens of solving Wordle, learning strategies to optimize guesses and improve game performance.

• YouTube
• 31 minutes
• On-Demand
• Free Video