TensorRT Courses and Certifications

AI Engineer

From Model Weights to API Endpoint with TensorRT LLM

Master TensorRT-LLM for high-performance model serving, from selecting models to building engines, setting batch sizes, and deploying on cloud GPUs in this hands-on workshop.

• YouTube
• 1 hour 40 minutes
• Self-Paced
• Free Video

The Machine Learning Engineer

LLMOps: Using Nvidia TensorRT SDK for GPU Inference

Optimize GPU inference using Nvidia TensorRT SDK. Convert models, compare throughput, and explore batch sizes, data precision, and runtime options for enhanced performance.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

Nvidia

Supercharge AI on RTX AI PCs with TensorRT

Unlock TensorRT for RTX to deploy AI models in under 30s across 100M+ RTX devices with peak performance and cross-platform compatibility for gaming and productivity apps.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Coursera

Optimize TensorFlow Models For Deployment with TensorRT

77 ratings at Coursera

Learn to optimize TensorFlow models using NVIDIA's TensorRT for improved inference performance. Explore FP32, FP16, and INT8 precision optimizations and their impact on throughput.

• Coursera
• 2 hours 29 minutes
• Self-Paced
• Paid Course

The Machine Learning Engineer

LLMOps: Como usar Nvidia TensorRT SDK para Inferencia en GPU

Optimiza la inferencia en GPU con Nvidia TensorRT SDK, convirtiendo modelos y comparando tiempos de ejecución en diferentes precisiones de datos.

• YouTube
• 40 minutes
• Self-Paced
• Free Video

Nvidia

Jetson AGX Xavier: Architecture and Applications for Autonomous Machines

Explore Jetson AGX Xavier's architecture and develop cutting-edge autonomous applications using the Developer Kit and JetPack SDK. Discover advances in robotics and intelligent devices.

• YouTube
• 1 hour 3 minutes
• Self-Paced
• Free Video

USENIX

MonoNN: Enabling a New Monolithic Optimization Space for Neural Network Inference

Innovative compiler optimizing neural network inference on GPUs, reducing overhead and improving performance through monolithic kernel design and resource management strategies.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

Applied Singularity

Deploying Deep Learning Models for Inference at Production Scale

Optimize and deploy AI models at scale using NVIDIA TensorRT and Triton Inference Server. Learn production-ready techniques for efficient inference across various platforms and infrastructures.

• YouTube
• 1 hour 40 minutes
• Self-Paced
• Free Video

The Machine Learning Engineer

LLMOps: Comparison of OpenVino, ONNX, TensorRT, and PyTorch Inference

Explore model conversion to ONNX, OpenVino, and Tensor-RT formats for optimized CPU and GPU inference, comparing performance against native PyTorch.

• YouTube
• 40 minutes
• Self-Paced
• Free Video

Generative AI on AWS

AI Agent Inference Performance Optimizations - vLLM vs SGLang vs TensorRT

Explore LLM inference engine optimizations comparing vLLM, SGLang, and TensorRT for high-performance AI agent deployments with expert insights from Modal and AWS practitioners.

• YouTube
• 1 hour 23 minutes
• Self-Paced
• Free Video

Software Engineering Courses - SE Courses

Doubling Stable Diffusion Inference Speed with RTX Acceleration and TensorRT - A Comprehensive Guide

Comprehensive guide on boosting Stable Diffusion performance with RTX Acceleration TensorRT, covering installation, optimization, and troubleshooting for various models and extensions.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Nvidia

Introduction to TensorRT-LLM Engineering Baseline Work - Making TensorRT-LLM Developer More Efficient

Discover TensorRT-LLM's CI infrastructure, conditional test triggers, and model accuracy testing methodology to boost developer efficiency in this 54-minute technical deep dive.

• YouTube
• 54 minutes
• Self-Paced
• Free Video

Nvidia

Introduction to Disaggregated Serving in TensorRT-LLM

Discover disaggregated serving in TensorRT-LLM, exploring benefits, implementation methods, and performance metrics for popular models with Nvidia experts.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

Nvidia

The Practice of Doing Performance Analysis and Optimization with TensorRT-LLM

Master TensorRT-LLM performance analysis and optimization techniques using expert tools, profiling methods, and bottleneck identification strategies.

• YouTube
• 54 minutes
• Self-Paced
• Free Video

Whizlabs

NVIDIA: LLM Experimentation, Deployment, and Ethical AI

Master advanced LLM experimentation techniques, deployment strategies, and ethical AI principles using NVIDIA tools. Optimize AI workflows with BioNeMo, Triton, and TensorRT while ensuring responsible development practices.

• Coursera
• 4 hours 35 minutes
• Self-Paced
• Paid Course