Deep Learning Inference Courses and Certifications

Association for Computing Machinery (ACM)

SIGCOMM 2020 - Server-Driven Video Streaming for Deep Learning Inference

Explore server-driven video streaming for deep learning inference, including real-time camera set heuristics, object detection, and experimental results.

• YouTube
• 22 minutes
• On-Demand
• Free Video

tinyML

Acceleration of Deep Learning Inference on Raspberry Pi's VideoCore GPU

Explore techniques for accelerating deep learning inference on Raspberry Pi's VideoCore GPU, including optimized tools, libraries, and compilers for enhanced performance without compromising accuracy.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Accelerate and Autoscale Deep Learning Inference on GPUs with KFServing

Explore KFServing for efficient GPU-based deep learning inference, focusing on BERT models. Learn about scalability, performance optimization, and real-world applications in financial data processing.

• YouTube
• 37 minutes
• On-Demand
• Conference Talk

Python Simplified

Inference with Torch-TensorRT Deep Learning Prediction for Beginners - CPU vs CUDA vs TensorRT

Accelerate deep learning inference using Torch-TensorRT. Compare CPU, CUDA, and TensorRT performance with ResNet50 for image classification. Hands-on tutorial covers setup, implementation, and benchmarking.

• YouTube
• 36 minutes
• On-Demand
• Free Video

IEEE

Membership Inference Attacks against Adversarially Robust Deep Learning Models

Explore membership inference attacks on adversarially robust deep learning models, examining the interplay between security defenses and privacy vulnerabilities in AI systems.

• YouTube
• 27 minutes
• On-Demand
• Free Video

ADC - Audio Developer Conference

Parameter Inference of Music Synthesizers with Deep Learning

Explore deep learning techniques for parameter inference in music synthesizers, enhancing sound design efficiency and creativity for producers and audio professionals.

• YouTube
• 39 minutes
• On-Demand
• Free Video

Inference Methods for Deep Learning - Lecture 24

Explore advanced inference techniques beyond simple forward passes, including beam search, chain-of-thought reasoning, in-context learning, and test-time training methods.

• YouTube
• 1 hour 23 minutes
• On-Demand
• Free Video

Bringing the Power of ONNX to Apache Spark - Integrating Deep Learning Inference

Explore integrating ONNX with Spark for efficient deep learning inference pipelines. Learn about Ascend Hardware Platform's ONNX contributions and Spark community's simplified API for DL inferencing.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Embedded Deep Learning Super Resolution on GStreamer Using ONNX Inference Runtime

Explore embedded deep learning super-resolution techniques using ONNX Inference Runtime and GStreamer, covering problem-solving, implementation, and performance analysis.

• YouTube
• 27 minutes
• On-Demand
• Free Video

tinyML

The Model Efficiency Pipeline: Enabling Deep Learning Inference at the Edge

Explore optimizing deep learning for edge devices through model efficiency techniques, including neural architecture search, pruning, quantization, and conditional processing.

• YouTube
• 50 minutes
• On-Demand
• Free Video

Applied Singularity

Deploying Deep Learning Models for Inference at Production Scale

Optimize and deploy AI models at scale using NVIDIA TensorRT and Triton Inference Server. Learn production-ready techniques for efficient inference across various platforms and infrastructures.

• YouTube
• 1 hour 40 minutes
• On-Demand
• Free Video

Anyscale

Zero-Copy Model Loading with Ray and PyTorch for Efficient Deep Learning Inference

Optimize deep learning model loading for production using PyTorch and Ray. Implement zero-copy techniques to reduce costs and improve performance in NLP model deployments.

• YouTube
• 33 minutes
• On-Demand
• Free Video

EDGE AI FOUNDATION

muRISCV-NN: Deep-Learning Inference Kernels for Embedded Platforms Using RISC-V Vector and Packed Extensions

Discover how muRISCV-NN optimizes deep learning workloads on RISC-V platforms, exploring its open-source compute library features and integration with TensorFlow Lite and microTVM for enhanced edge computing performance.

• YouTube
• 18 minutes
• On-Demand
• Free Video

Computational Genomics Summer Institute CGSI

Deep Learning for Statistical Inference in Imaging Genetics

Explore deep learning methods for statistical inference in imaging genetics, covering transferGWAS techniques and two-sample testing approaches for genomic image analysis.

• YouTube
• 35 minutes
• On-Demand
• Free Video

USENIX

More is Different: Prototyping and Analyzing a New Form of Edge Server with Massive Mobile SoCs

Innovative edge server design using mobile SoCs for improved energy efficiency in cloud gaming, video transcoding, and deep learning inference, with insights on performance and cost-effectiveness.

• YouTube
• 20 minutes
• On-Demand
• Free Video