Mutual Information Courses and Certifications

IIT Kanpur;  NPTEL

An Introduction to Information Theory

Explore fundamental concepts of information theory, including entropy, source compression, channel capacity, and coding techniques for efficient data transmission and storage.

• Swayam
• 8 weeks
• On-Demand
• Free Online Course

Feature Engineering

Better features make better models. Discover how to get the most out of your data.

• Kaggle
• 5 hours
• On-Demand
• Free Certificate

Center for Science of Information NSF STC

Information Theory and Network Coding

Master fundamental limits in communication systems through comprehensive information theory principles, from entropy and data compression to channel capacity and rate-distortion theory.

• YouTube
• 15 hours 21 minutes
• On-Demand
• Free Video

Complexity Explorer

Introduction to Information Theory Tutorial

Discover the fundamentals of information theory, from measuring bits and entropy to Shannon's coding theorem and communication capacity in this comprehensive tutorial.

• YouTube
• 2 hours 6 minutes
• On-Demand
• Free Video

IEEE Signal Processing Society

Geometric Deep Learning for Drug Discovery

2 reviews

Explore geometric deep learning techniques for drug discovery, covering graph neural networks, molecule generation, and retrosynthetic prediction. Gain insights into cutting-edge research and applications in pharmaceutical development.

• YouTube
• 58 minutes
• On-Demand
• Free Video

Rational Ignorance - Optimal Learning from Complex Mechanistic Models

Explore optimal Bayesian learning from complex models, challenging traditional approaches and proposing a new method to maximize expected information while avoiding bias in multiparameter systems.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

Edan Meyer

Learning Fast with No Goals - VISR Explained

Explore rapid generalization in Reinforcement Learning with VISR, focusing on successor features and goal-conditioned policies for efficient task adaptation without rewards.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Uncertainty in Artificial Intelligence

Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning - Session 2

Explore critical analysis of uncertainty quantification in machine learning, examining conditional entropy and mutual information as measures for aleatoric and epistemic uncertainty.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Blessings of Dimensionality for Gaussian Latent Factor Models

Explore how high-dimensional data analysis can benefit from restricted latent factor overlaps, with applications in brain fMRI and financial markets.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video

The Information Knot - Tying Sensing and Action; Emergence Theory of Representation Learning

Explore information theory, representation learning, and AI concepts with NYU's Stefano Soatto. Delve into information bottlenecks, mutual information, and disentangling in this advanced seminar on modern AI.

• YouTube
• 55 minutes
• On-Demand
• Free Video

BIMSA

Reverse Engineering Structural Connectivity in Brain Networks

Explore the relationship between causal and structural connectivity in brain networks. Learn techniques for reconstructing neural circuitry using pulse outputs and various causality measures.

• YouTube
• 1 hour 3 minutes
• On-Demand
• Free Video

Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC)

Information-Theoretic Metrics of Higher-Order Interactions on Graphs

Explore information-theoretic metrics for analyzing higher-order interactions in complex networks, focusing on graph theory applications and advanced analytical techniques.

• YouTube
• 19 minutes
• On-Demand
• Free Video

Centrum Fizyki Teoretycznej PAN

Distinguishing Between Redundancy and Consensus in Quantifying Quantum Objectivity

Explore rigorous definitions of "redundancy" and "consensus" in quantum objectivity, examining their distinct roles in the quantum-to-classical transition and implications for quantum Darwinism.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video

Simons Institute

An Area Law for the Maximally-Mixed Ground State in Arbitrarily Degenerate Systems with Good AGSP

Discover how area laws apply to maximally-mixed ground states in highly-degenerate quantum systems using good AGSP approximations, with applications to 1D and 2D systems.

• YouTube
• 47 minutes
• On-Demand
• Free Video

Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC)

Introducing Infomeasure: A Comprehensive Python Package for Information Theory Measures

Discover a comprehensive Python package for information theory measures with this introduction to infomeasure from IFISC.

• YouTube
• 38 minutes
• On-Demand
• Free Video