LTX 2 and Z Image Base Complete Tutorial - Audio to Video Lip Sync with ComfyUI and SwarmUI on Windows and Cloud
Software Engineering Courses - SE Courses via YouTube
Overview
Syllabus
Intro: ComfyUI + SwarmUI presets, Z-Image, model downloader, cloud installs
Free prompt enhancement with Google AI Studio prepared prompt file
Demo: 45s audio-driven lip-sync image→video LTX 2
Quick demos: ComfyUI image→video, text→video, Z-Image base
Quick demos: SwarmUI LTX 2 image→video + Z-Image base
Install/update presets zip v78+: extract & overwrite everything
Upgrade to CUDA 13 safely: delete venv then run ComfyUI update/install
Windows prereqs + the always-updated setup guide referenced in description
Install required node bundles: 1 SwarmUI extra nodes + 100 LTX audio
VRAM-optimized launcher: no-VRAM / cache / smart-memory / precision choices
Share one model library: configure extra_model_paths.yaml no duplicates
Model Downloader overview: set base path + one-click bundles for SwarmUI/ComfyUI
Download LTX 2 core bundle: multi-connection download + merge + hash verify
Low-VRAM path: GGUF distilled models vs recommended FP8-scaled defaults
URL Downloader: Civitai/HF links, folder targeting, and optional API keys
ComfyUI preset pack tour: LTX2 I2V/T2V/audio + Z-Image base/2× upscale
ComfyUI audio lip-sync preset: image + resolution + audio setup
Frames & prompting: 24fps math, run/stop frame count, lyrics/subtitles prompts
Quality/perf knobs: CRF, VRAM monitoring, and low-VRAM args recap
Review result + move to LTX 2 image→video preset workflow
Prompt enhancer workflow: drag prompt file into AI Studio optionally add image
Z-Image troubleshooting: disable Sage Attention and restart
Z-Image base + 2× upscale preset: when to use it and what to expect
Outputs & reproducibility: where renders save + drag PNG to reload metadata
Update SwarmUI via zip: get latest presets + utilities
SwarmUI setup: ComfyUI backend, passing args, and pointing to model folders
SwarmUI image→video: direct apply + init image workflow
Fix model load/caching issues: add --use-cache-none when needed
SwarmUI text→video + upscale: duration/frames, half-res then upscale rules
SwarmUI outputs: output_local/raw + metadata saved with generations
SwarmUI Z-Image: base vs 2× upscale comparison + speed notes
Image comparison slider tool: quick before/after inspection
RunPod start: template choice, CUDA/driver constraints, optional storage volume
RunPod Jupyter: upload ComfyUI zip, extract, install bundles 1+100
RunPod: run Model Downloader, start ComfyUI, connect via exposed port
RunPod: switch to SwarmUI, map folders case-sensitive, import presets
RunPod: download outputs as archive + stop vs terminate cost control
SimplePod: cheaper/faster alternative + persistent volume setup highlights
Massed Compute: deploy with coupon + connect via ThinLinc shared folder setup
Massed Compute: install bundles + download models disk speed advantage
Massed Compute: start ComfyUI, connect from PC, run lip-sync preset
Massed Compute: hook SwarmUI to ComfyUI backend + text→video demo
Wrap-up: recap providers + next steps
Taught by
Software Engineering Courses - SE Courses