ONNX Runtime Courses and Certifications

LLMs Fine Tuning and Inferencing Using ONNX Runtime - Workshop

Explore fine-tuning and inferencing of Large Language Models using ONNX Runtime, with hands-on examples and insights into accelerating machine learning across platforms.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

AI Engineer

Foundry Local - Cutting-Edge AI Experiences on Device with ONNX Runtime and Olive

Discover how to deploy cutting-edge AI models locally using ONNX Runtime and Olive for optimized on-device experiences and enhanced performance.

• YouTube
• 23 minutes
• On-Demand
• Free Video

Efficient Architectural Design and Hardware Acceleration

Explore efficient AI model architectures and hardware acceleration techniques for mobile and edge deployment, culminating in a medical diagnostics optimization project.

• Udacity
• 11 hours
• On-Demand
• Paid Course

Learning Machine Learning with .NET, PyTorch and the ONNX Runtime

Explore machine learning with .NET, PyTorch, and ONNX Runtime. Learn model training, accuracy assessment, and cross-framework interoperability for efficient ML development and deployment.

• YouTube
• 28 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps: Quantization Models and Inference with ONNX Generative Runtime

Explore ONNX runtime GPU support for inference with generative models, including Phi3-mini quantization and conversion techniques.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Embedded Deep Learning Super Resolution on GStreamer Using ONNX Inference Runtime

Explore embedded deep learning super-resolution techniques using ONNX Inference Runtime and GStreamer, covering problem-solving, implementation, and performance analysis.

• YouTube
• 27 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps: Quantizing Models and Inference with ONNX Generative Runtime

Aprende a instalar ONNX Runtime con soporte GPU, cuantizar modelos Phi3-mini y realizar inferencia eficiente con Modelos Generativos utilizando técnicas avanzadas de LLMOps.

• YouTube
• 39 minutes
• On-Demand
• Free Video

ADC - Audio Developer Conference

Real-Time Inference of Neural Networks: A Guide for DSP Engineers

Explore real-time neural network inference for DSP engineers. Learn practical steps, compare inference engines, and balance latency, performance, and stability in audio plugin development.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Java

Writing GPU-Ready AI Models in Pure Java with Babylon

Discover how to build and run AI models directly in Java using Project Babylon, eliminating Python dependencies while leveraging GPU acceleration for high-performance computing.

• YouTube
• 59 minutes
• On-Demand
• Free Video

Using Apache OpenNLP with OpenSearch K-NN Vector Search

Explore Apache OpenNLP and OpenSearch k-NN vector search integration for powerful NLP-driven search capabilities. Learn to generate, index, and query vectors using open-source tools.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Accelerating High-Performance Machine Learning at Scale in Kubernetes

Hands-on guide for deploying optimized machine learning models in cloud native ecosystems, focusing on GPT-2 NLP model deployment in Kubernetes using ONNX Runtime and Seldon Core Triton server.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Arm Software Developers

Mobile AI Just Got Faster - What's Coming for Developers on Arm

Discover SME2, Arm's next-gen CPU instruction set delivering 6x faster GenAI performance for mobile devices with real-time audio generation and smart assistant demos.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Qdrant - Vector Database & Search Engine

FastEmbed - Fast and Lightweight Embedding Generation

Discover how to generate fast, efficient embeddings using FastEmbed library, exploring quantized models and ONNX Runtime for improved throughput and latency in Python applications.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Deploy Local AI Models in Enterprise with Windows ML

Master Windows ML for secure, on-device AI deployment across CPU, GPU, and NPU without cloud infrastructure, featuring live demos and enterprise implementation strategies.

• YouTube
• 44 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

MLOPS: Inferencia ViVIT ONNX Model en Azure ML Managed EndPoint (AKS)

Implementa inferencia de ViViT en Azure ML usando ONNX y AKS para optimizar el rendimiento de modelos de visión por computadora.

• YouTube
• 1 hour
• On-Demand
• Free Video