Trelis Research Courses

How to Quantize a Large Language Model with GGUF or AWQ

1 review

Learn to quantize large language models using GGUF and AWQ. Explore techniques, compare methods, and gain practical skills for efficient model compression and deployment.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Test Time Compute: Verifiers and Parallel Sampling - Part 2

Explore advanced inference techniques using verifiers, parallel sampling, and prompt optimization to enhance language model performance and accuracy.

• YouTube
• 1 hour
• On-Demand
• Free Video

Powering Gigawatt Data Centers: Comparing Wind, Solar, and Gas Options

Explore powering gigawatt data centers using wind, solar, and gas. Analyze demand curves, cost models, and hybrid solutions to optimize energy efficiency and sustainability in large-scale computing facilities.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Full Fine-tuning LLMs with Lower VRAM: Optimizers, GaLore, and Advanced Techniques

Explore advanced techniques for full fine-tuning LLMs with limited GPU resources, including optimizer tricks, Galore, and Adafactor. Enhance model performance and efficiency.

• YouTube
• 1 hour 4 minutes
• On-Demand
• Free Video

Automated Prompt Engineering with DSPy - A Comprehensive Tutorial

Explore automated prompt engineering using DSPy, covering installation, benchmarking, chain of thought, vector search, few-shot examples, multi-hop queries, and result comparisons.

• YouTube
• 46 minutes
• On-Demand
• Free Video

Fine-Tuning a Diffusion Model with Your Photos

Learn to fine-tune a diffusion model using your own photos. Explore Flux Schnell, set up GPU environments, create datasets, and understand the intricacies of diffusion models and their architectures.

• YouTube
• 52 minutes
• On-Demand
• Free Video

How to Use LLMs for Fact Checking - Advanced Techniques and Comparisons

Explore advanced techniques for fact-checking using LLMs, including citation verification, structured responses, and context focusing. Compare long-context and retrieval approaches for optimal accuracy.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Context Caching for Faster and Cheaper LLM Inference

Explore context caching techniques for LLMs to enhance inference speed and reduce costs. Learn implementation methods for Claude, Google Gemini, and SGLang, with cost comparisons and practical resources.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Running Speech-to-Speech Models on Mac or GPU

Explore speech-to-speech AI models, including GPT-4o and Llama 3. Learn implementation techniques on Mac and GPU, with tips for reducing latency using UDP ports.

• YouTube
• 37 minutes
• On-Demand
• Free Video

LLM Security 101 - Risks, Attacks, and Mitigation Strategies

Explore LLM security risks, jailbreak attacks, prompt injections, and malicious code. Learn detection techniques, custom guards, and performance impacts for safer AI implementations.

• YouTube
• 1 hour 27 minutes
• On-Demand
• Free Video

RAG with Verified Citations - Advanced Inference Techniques

Explore advanced RAG techniques with verified citations, including BM25 and cosine similarity methods. Learn to implement and leverage one-click document RAG for improved accuracy.

• YouTube
• 34 minutes
• On-Demand
• Free Video

How to Pick a GPU and Inference Engine for Large Language Models

Explore GPU selection and inference engine optimization for large language models. Compare quantization effects, software options, and cost-efficiency across various GPUs and model sizes.

• YouTube
• 1 hour 4 minutes
• On-Demand
• Free Video

LLM Tool Use - GPT4o-mini, Groq, and Llama.cpp

Explore advanced LLM tool use techniques with GPT4o-mini, Groq, and Llama.cpp. Learn function calling, zero-shot prompting, and local inference for efficient AI development.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Video

Text-to-Speech Fine-tuning Tutorial - StyleTTS2 Voice Cloning and Model Adaptation

Master text-to-speech fine-tuning techniques, from dataset preparation to model training. Explore voice cloning, StyleTTS2, and performance optimization for advanced speech synthesis projects.

• YouTube
• 1 hour 16 minutes
• On-Demand
• Free Video

Mastering Retrieval for LLMs - BM25, Fine-tuned Embeddings, and Re-Rankers

Enhance LLM retrieval with advanced techniques: BM25, fine-tuned embeddings, and re-rankers. Learn document chunking, semantic search, and performance optimization for improved AI-powered information retrieval.

• YouTube
• 1 hour 50 minutes
• On-Demand
• Free Video