Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the critical security and governance challenges facing organizations adopting open source AI models in this 59-minute MLOps podcast episode featuring Hudson Buzby, Solutions Architect at JFrog. Examine how machine learning has traditionally operated outside conventional DevOps practices and security standards, and discover the new security vulnerabilities introduced by open source model catalogs like HuggingFace and Ollama. Learn about enterprise-scale approaches to addressing security, governance, and legal challenges while enabling developers to safely build and deploy ML/AI applications. Understand the evolution from traditional MLOps to modern platform approaches, analyze the differences between ML and generative AI adoption patterns, and investigate strategies for managing AI tool sprawl within organizations. Gain insights into model trust and safety considerations, organizational debt comparisons, and the value of centralized gateways for AI governance. Discover practical solutions for establishing secure development environments that balance innovation with enterprise security requirements, while exploring the current state of AI adoption failure statistics and their implications for organizational strategy.
Syllabus
[00:00] Value of Centralized Gateway
[00:35] Point Break vs Big Lebowski
[01:47] AI adoption failure stats
[05:12] ML vs Generative AI
[12:04] LLM adoption in enterprise
[18:08] MLOps Community alternative
[23:43] AI governance challenges
[27:39] Organizational debt comparison
[31:41] AI tool sprawl
[35:59] MLOps to platform evolution
[40:56] MLOps then vs now
[49:48] Model trust and safety
[52:19] AI model effectiveness
[55:54] Product discovery process
[58:38] Wrap up
Taught by
MLOps.community