Machine Learning Inference Courses and Certifications

Scalable Parallel Computing Lab, SPCL @ ETH Zurich

AI Engine Architecture: Data Movement, Synchronization, Reconfiguration and Application Mapping

Explore AMD/Xilinx AI Engine architecture: vector processors, data movement, synchronization, and application mapping for machine learning and 5G acceleration.

• YouTube
• 54 minutes
• On-Demand
• Free Video

MLOps.community

Challenges in Providing Large Language Models as a Service

Explore challenges in scaling LLMs as a service, including optimization, cost-effectiveness, and data privacy. Gain insights from an expert in ML inference and deployment.

• YouTube
• 12 minutes
• On-Demand
• Free Video

MLOps World: Machine Learning in Production

Running Multiple Models on the Same GPU on Spot Instances

Optimize ML inference costs through GPU fractionalization and Spot instances. Increase GenAI application throughput while reducing expenses.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Trelis Research

Faster Inference Using Output Predictions with OpenAI and vLLM

Master advanced inference techniques for faster AI model outputs using OpenAI predictions and vLLM speculative decoding, with practical demonstrations and cost optimization strategies.

• YouTube
• 24 minutes
• On-Demand
• Free Video

AI Engineer

Hacking the Inference Pareto Frontier

Explore advanced techniques to optimize LLM inference systems, balancing cost, latency, and quality using NVIDIA's Dynamo framework and cutting-edge methods like disaggregation and speculation.

• YouTube
• 20 minutes
• On-Demand
• Free Video

SNIAVideo

How New Memories Will Accelerate Both Inference and General Purpose Compute

Discover how magnetic RAM, resistive RAM, and ferroelectric RAM technologies will revolutionize computing by enabling compute-in-memory engines and bringing cost-effective persistence closer to processors.

• YouTube
• 50 minutes
• On-Demand
• Free Video

Using BigQuery Machine Learning for inference

Master BigQuery ML for inference through hands-on training in creating, managing, and implementing machine learning models for data analysis within the BigQuery environment.

• Coursera
• 4 hours
• On-Demand
• Paid Course

Machine Learning and AI Foundations: Prediction, Causation, and Statistical Inference

292 ratings at LinkedIn Learning

Gain insights to help improve your machine learning models and statistical analyses.

• LinkedIn Learning
• 2 hours 3 minutes
• On-Demand
• Free Trial Available

Machine Learning and AI Foundations: Causal Inference and Modeling

136 ratings at LinkedIn Learning

Learn about the modeling techniques and experimental designs that allow you to establish causal inference, and how to use them.

• LinkedIn Learning
• 2 hours 51 minutes
• On-Demand
• Free Trial Available

Using BigQuery Machine Learning for inference

Explore BigQuery ML for inference, create and manage ML models, and learn practical applications like movie poster analysis and wildlife image classification.

• Google Skills
• 3 hours
• On-Demand
• Paid Course

IEEE

Membership Inference Attacks against Machine Learning Models

Explore membership inference attacks on machine learning models, focusing on techniques to determine if specific data was used in training, with implications for privacy and security in ML applications.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Prebuilt Docker Images for Inference in Azure Machine Learning

Explore prebuilt Docker images for inference in Azure Machine Learning, featuring a demo on deploying PyTorch models and insights on overcoming common challenges in ML workflows.

• YouTube
• 2 hours 3 minutes
• On-Demand
• Free Video

Hardware.ai

Machine Learning Inference on Raspberry Pi Pico 2040 via Edge Impulse

Learn to implement machine learning inference on Raspberry Pico 2040 using Edge Impulse, covering environment setup, sample data inference, sensor data processing, and porting details.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Serverless Machine Learning Inference with KFServing

Explore serverless ML inference with KFServing, addressing deployment challenges, auto-scaling, and GPU utilization. Learn about real-world applications and future prospects in machine learning production environments.

• YouTube
• 24 minutes
• On-Demand
• Conference Talk

Paul G. Allen School

Causal Inference in Single-cell Genomics - Machine Learning in Computational Biology

Explore causal inference in single-cell genomics, focusing on differential expression analysis and integrating bulk data for high-resolution insights into complex disease mechanisms.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video