TensorRT Courses and Certifications

Full Course on TensorRT, ONNX for Development and Profuction

90 ratings at Udemy

Full Complete TensorRT Vs ONNX Course. Secrets of Detection and Segmentation. Get Hired with Advance Unique Knowledge

• Udemy
• 23 hours 30 minutes
• On-Demand
• Paid Course

AI Engineer

From Model Weights to API Endpoint with TensorRT LLM

Master TensorRT-LLM for high-performance model serving, from selecting models to building engines, setting batch sizes, and deploying on cloud GPUs in this hands-on workshop.

• YouTube
• 1 hour 40 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps: Using Nvidia TensorRT SDK for GPU Inference

Optimize GPU inference using Nvidia TensorRT SDK. Convert models, compare throughput, and explore batch sizes, data precision, and runtime options for enhanced performance.

• YouTube
• 34 minutes
• On-Demand
• Free Video

Nvidia

Supercharge AI on RTX AI PCs with TensorRT

Unlock TensorRT for RTX to deploy AI models in under 30s across 100M+ RTX devices with peak performance and cross-platform compatibility for gaming and productivity apps.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Coursera

Optimize TensorFlow Models For Deployment with TensorRT

76 ratings at Coursera

Learn to optimize TensorFlow models using NVIDIA's TensorRT for improved inference performance. Explore FP32, FP16, and INT8 precision optimizations and their impact on throughput.

• Coursera
• 2 hours 29 minutes
• On-Demand
• Paid Course

The Machine Learning Engineer

LLMOps: Como usar Nvidia TensorRT SDK para Inferencia en GPU

Optimiza la inferencia en GPU con Nvidia TensorRT SDK, convirtiendo modelos y comparando tiempos de ejecución en diferentes precisiones de datos.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Nvidia

Jetson AGX Xavier: Architecture and Applications for Autonomous Machines

Explore Jetson AGX Xavier's architecture and develop cutting-edge autonomous applications using the Developer Kit and JetPack SDK. Discover advances in robotics and intelligent devices.

• YouTube
• 1 hour 3 minutes
• On-Demand
• Free Video

Applied Singularity

Deploying Deep Learning Models for Inference at Production Scale

Optimize and deploy AI models at scale using NVIDIA TensorRT and Triton Inference Server. Learn production-ready techniques for efficient inference across various platforms and infrastructures.

• YouTube
• 1 hour 40 minutes
• On-Demand
• Free Video

USENIX

MonoNN: Enabling a New Monolithic Optimization Space for Neural Network Inference

Innovative compiler optimizing neural network inference on GPUs, reducing overhead and improving performance through monolithic kernel design and resource management strategies.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Efficient Architectural Design and Hardware Acceleration

Explore efficient AI model architectures and hardware acceleration techniques for mobile and edge deployment, culminating in a medical diagnostics optimization project.

• Udacity
• 11 hours
• On-Demand
• Paid Course

Microcredential

Machine Learning Model Optimization

Master advanced techniques for optimizing ML models through quantization, pruning, compression, and hardware acceleration to deploy efficient, scalable solutions.

• Udacity
• 48 hours
• On-Demand
• Paid Course

Software Engineering Courses - SE Courses

Doubling Stable Diffusion Inference Speed with RTX Acceleration and TensorRT - A Comprehensive Guide

Comprehensive guide on boosting Stable Diffusion performance with RTX Acceleration TensorRT, covering installation, optimization, and troubleshooting for various models and extensions.

• YouTube
• 42 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps: Comparison of OpenVino, ONNX, TensorRT, and PyTorch Inference

Explore model conversion to ONNX, OpenVino, and Tensor-RT formats for optimized CPU and GPU inference, comparing performance against native PyTorch.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Generative AI on AWS

AI Agent Inference Performance Optimizations - vLLM vs SGLang vs TensorRT

Explore LLM inference engine optimizations comparing vLLM, SGLang, and TensorRT for high-performance AI agent deployments with expert insights from Modal and AWS practitioners.

• YouTube
• 1 hour 23 minutes
• On-Demand
• Free Video

Nvidia

Introduction to TensorRT-LLM Engineering Baseline Work - Making TensorRT-LLM Developer More Efficient

Discover TensorRT-LLM's CI infrastructure, conditional test triggers, and model accuracy testing methodology to boost developer efficiency in this 54-minute technical deep dive.

• YouTube
• 54 minutes
• On-Demand
• Free Video