Learn fundamental probability concepts through this comprehensive video course that rapidly progresses from basic principles to advanced topics essential for statistics, data analysis, and machine learning. Master counting methods using combinatorics and factorials, explore set theory applications in sample spaces and events, and solve classic problems like the birthday paradox. Dive deep into conditional probabilities, the law of total probability, and Bayes' theorem with practical examples including drug testing scenarios. Study various probability distributions including Bernoulli, binomial, normal, Poisson, geometric, exponential, gamma, and chi-squared distributions, understanding their properties and real-world applications. Explore random variables and their functions, joint probability distributions with marginal and conditional densities, and learn to compute expected values, variance, and standard deviation. Investigate important inequalities like Markov's and Chebyshev's, understand the law of large numbers and central limit theorem, and work with moment generating functions. Examine covariance and correlation concepts, particularly with Gaussian distributions, and conclude with advanced topics including the Lebesgue measure and a formal proof of the central limit theorem, providing a solid mathematical foundation for further study in statistics and data science.

Syllabus

Probability and Statistics: Overview
Gentle Introduction to Probability: Counting Coin Flips and Dice
Counting Probabilities with Combinatorics and the Factorial
Set Theory in Probability: Sample Spaces and Events
The Birthday Problem in Probability: P(A) = 1 - P(not A)
Quality Control, Non-Destructive Inspection, and the Multinomial Distribution
The Binomial Distribution and the Multinomial Distribution
Conditional Probabilities
The Law of Total Probability
Bayes' Theorem (with Example!)
Bayes' Theorem Example: Drug Testing
Independence in Probability
Random Variables and Probability Distributions
Bernoulli and Binomial Random Variables
The Normal Distribution: The Limit of Binomial Distribution for Large "n"
The Standard Unit Normal and Probability Computations
The Poisson Distribution: The Rare Event Limit of a Binomial Distribution
The Geometric Distribution: The First Success of a Bernoulli Distribution
The Exponential Distribution: Time Between Poisson Events
The Hazard Rate and Memoryless Property of the Exponential Distribution
The Connection Between the Exponential Distribution and the Poisson Process
The Gamma Distribution
Functions of a Random Variable
Rescaling the Normal Distribution to Mean Zero and Variance One
The Chi Squared Distribution: The Square of the Normal Distribution
Joint Probability Distributions
Joint Probability Distributions: Marginal and Conditional Densities
The Expected Value (Mean) of a Probability Distribution
Properties of the Expected Value
Variance and Standard Deviation
Example of Computing the Expectation and Variance of an Exponential Distribution
Two Examples of Expected Values & Functions: Temperature in C vs F, and the Kinetic Theory of Gases
Markov's Inequality in Probability: First Order Estimates
Chebyshev's Inequality in Probability: Second Order Estimates
The Law of Large Numbers
The Central Limit Theorem
The Moment Generating Function
Example of The Moment Generating Function
The Lebesque Measure in Probability
Additive Property of the Moment Generating Function
Covariance and Correlation in Probability
Covariance and Correlation: Example with Gaussian Distributions
The Tail Sum Formula in Probability
Proof of the Central Limit Theorem