Research Methods Courses

Black Hat

Attack on Titan M, Reloaded - Vulnerability Research on a Modern Security Chip

Explore vulnerability research on Google's Titan M security chip, including fuzzing techniques, impact analysis, and mitigation strategies for modern device protection.

• YouTube
• 34 minutes
• Self-Paced
• Conference Talk

Black Hat

Thinking Outside the JIT Compiler - Understanding and Bypassing StructureID Randomization with Generic and Old-School Methods

Explore generic methods to bypass StructureID Randomization, gaining arbitrary Read/Write ability without relying on JIT compiler-related techniques. Learn innovative approaches to inspire better security mitigations.

• YouTube
• 22 minutes
• Self-Paced
• Conference Talk

Black Hat

Death by a Thousand Abstracts - How -Not- to Get Your Research into Black Hat

Discover key insights on crafting compelling research submissions for Black Hat and other industry events. Learn from common mistakes and best practices to increase your chances of being selected as a speaker.

• YouTube
• 20 minutes
• Self-Paced
• Conference Talk

David Shapiro ~ AI

Alignment Research- GPT-3 vs GPT-NeoX - Which One Understands AGI Alignment Better?

Explore the potential risks and unintended consequences of various AI objective functions, including minimizing suffering, maximizing freedom, and pursuing economic growth, in the context of AGI development.

• YouTube
• 48 minutes
• Self-Paced
• Free Video

Bioinformagician

Bioinformatics and Computational Biology - The Present Gateway to Research

Comprehensive overview of bioinformatics and computational biology, covering research fields, career paths, applications, job prospects, and educational opportunities for aspiring professionals in this cutting-edge domain.

• YouTube
• 1 hour 2 minutes
• Self-Paced
• Free Video

Nicholas Renotte

Automate Stocks and Crypto Research with Python and Deep Learning - Full Python Project

Learn to automate stock and crypto research using Python, web scraping, and deep learning. Build a pipeline to gather, summarize, and analyze financial news for various assets.

• YouTube
• 1 hour 30 minutes
• Self-Paced
• Free Video

Yannic Kilcher

Transformer Memory as a Differentiable Search Index - Machine Learning Research Paper Explained

Explore a novel approach to information retrieval using a single Transformer model that encodes corpus information in its parameters, enabling direct query-to-document mapping without external indices.

• YouTube
• 52 minutes
• Self-Paced
• Free Video

Yannic Kilcher

Sparse Is Enough in Scaling Transformers - ML Research Paper Explained

Detailed explanation of Scaling Transformers and Terraformer architecture, focusing on leveraging sparsity to improve efficiency and speed in large language models while maintaining accuracy.

• YouTube
• 57 minutes
• Self-Paced
• Free Video

Yannic Kilcher

Learning Rate Grafting: Transferability of Optimizer Tuning - Machine Learning Research Paper Review

Explore grafting technique for transferring learning rate schedules between optimizers, improving deep learning model performance and reducing computational costs in hyperparameter tuning.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

Yannic Kilcher

Gradients Are Not All You Need - Machine Learning Research Paper Explained

Explores limitations of differentiable programming in machine learning, focusing on chaos-based failures in various systems. Discusses alternatives to backpropagation for gradient estimation in complex, stochastic environments.

• YouTube
• 49 minutes
• Self-Paced
• Free Video

Yannic Kilcher

Autoregressive Diffusion Models - Machine Learning Research Paper Explained

Explore Autoregressive Diffusion Models, a novel approach combining autoregressive and diffusion models for efficient, order-agnostic generation and compression of text and image data.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

Yannic Kilcher

Topographic VAEs Learn Equivariant Capsules - Machine Learning Research Paper Explained

Explore Topographic VAEs: a novel approach to deep generative models with organized latent variables, bridging topographic organization and equivariance in neural networks for improved feature learning and transformation handling.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Yannic Kilcher

Infinite Memory Transformer - Research Paper Explained

Explores innovative Transformer model with unbounded memory, enabling processing of arbitrarily long sequences. Discusses continuous attention mechanisms, sticky memories, and potential applications in language modeling.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

Yannic Kilcher

PonderNet - Learning to Ponder - Machine Learning Research Paper Explained

Explore DeepMind's PonderNet, a novel approach to adaptive computation in neural networks. Learn how it dynamically allocates computational steps based on problem complexity, improving efficiency and performance.

• YouTube
• 44 minutes
• Self-Paced
• Free Video

Yannic Kilcher

The Dimpled Manifold Model of Adversarial Examples in Machine Learning - Research Paper Explained

Explores the Dimpled Manifold Model to explain adversarial examples in machine learning, challenging existing theories and providing experimental evidence for a new perspective on neural network vulnerabilities.

• YouTube
• 1 hour 14 minutes
• Self-Paced
• Free Video