ONNX Runtime Courses and Certifications

LLMs Fine Tuning and Inferencing Using ONNX Runtime - Workshop

Explore fine-tuning and inferencing of Large Language Models using ONNX Runtime, with hands-on examples and insights into accelerating machine learning across platforms.

• YouTube
• 1 hour 2 minutes
• Self-Paced
• Free Video

AI Engineer

Foundry Local - Cutting-Edge AI Experiences on Device with ONNX Runtime and Olive

Discover how to deploy cutting-edge AI models locally using ONNX Runtime and Olive for optimized on-device experiences and enhanced performance.

• YouTube
• 23 minutes
• Self-Paced
• Free Video

Embedded Deep Learning Super Resolution on GStreamer Using ONNX Inference Runtime

Explore embedded deep learning super-resolution techniques using ONNX Inference Runtime and GStreamer, covering problem-solving, implementation, and performance analysis.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

Open Source LLMOps Solutions

31 ratings at Coursera

Run open source LLMs locally and in the cloud: use HuggingFace Transformers and llamafile, fine-tune Mistral or LLaMA, and deploy models with ONNX and vLLM.

• Coursera
• 4 weeks, 9 hours a week
• Self-Paced
• Paid Course

Career Certificate

Microsoft Deep Learning Engineering with Azure

Engineer the full deep learning lifecycle on Azure: implement CNNs, RNNs, and Transformers; fine-tune models with LoRA and QLoRA; scale training with DeepSpeed ZeRO; deploy containerized models.

• Coursera
• Self-Paced
• Paid Course
• 3 courses

Pragmatic AI Labs

Rust for Large Language Model Operations (LLMOps)

Develop efficient Large Language Model solutions using Rust.

• edX
• 4 weeks, 3-6 hours a week
• Self-Paced
• Free Online Course (Audit)

AI Show Live - Azure Form Recognizer, Deep Learning Container with PyTorch and AzureML

Explores Azure Form Recognizer, PyTorch environments, and ONNX Runtime Olive optimizations through product overviews, demos, and Q&A.

• YouTube
• 2 hours 4 minutes
• Self-Paced
• Free Video

ADC - Audio Developer Conference

Real-Time Inference of Neural Networks: A Guide for DSP Engineers

Explore real-time neural network inference for DSP engineers. Learn practical steps, compare inference engines, and balance latency, performance, and stability in audio plugin development.

• YouTube
• 41 minutes
• Self-Paced
• Free Video

Java

Writing GPU-Ready AI Models in Pure Java with Babylon

Discover how to build and run AI models directly in Java using Project Babylon, eliminating Python dependencies while leveraging GPU acceleration for high-performance computing.

• YouTube
• 59 minutes
• Self-Paced
• Free Video

Using Apache OpenNLP with OpenSearch K-NN Vector Search

Explore Apache OpenNLP and OpenSearch k-NN vector search integration for powerful NLP-driven search capabilities. Learn to generate, index, and query vectors using open-source tools.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Accelerating High-Performance Machine Learning at Scale in Kubernetes

Hands-on guide for deploying optimized machine learning models in cloud native ecosystems, focusing on GPT-2 NLP model deployment in Kubernetes using ONNX Runtime and Seldon Core Triton server.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Qdrant - Vector Database & Search Engine

FastEmbed - Fast and Lightweight Embedding Generation

Discover how to generate fast, efficient embeddings using FastEmbed library, exploring quantized models and ONNX Runtime for improved throughput and latency in Python applications.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Arm Software Developers

Mobile AI Just Got Faster - What's Coming for Developers on Arm

Discover SME2, Arm's next-gen CPU instruction set delivering 6x faster GenAI performance for mobile devices with real-time audio generation and smart assistant demos.

• YouTube
• 28 minutes
• Self-Paced
• Free Video