The Most Addictive Python and SQL Courses
2,000+ Free Courses with Certificates: Coding, AI, SQL, and More
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore a 24-minute conference talk from Conf42 Chaos Engineering 2025 where Muddassar Sharif delves into the critical aspects of creating reliable alert systems for AI models in production. Learn about essential model monitoring techniques, key performance indicators, and how to detect data and concept drift that can impact model performance. Discover various tools for effectively monitoring AI systems, with practical examples of different drift types and their implications. Understand why tracking both input and output is crucial for maintaining model reliability, and gain insights into industry best practices and tools that can help implement robust monitoring solutions. The presentation provides a comprehensive overview from introduction to conclusion, making it valuable for engineers and data scientists working with AI systems in production environments.
Syllabus
00:00 Introduction to AI Systems in Production
01:41 Understanding Model Monitoring
02:00 Key Performance Indicators KPIs
03:31 Data and Concept Drift
05:10 Tools for Monitoring AI Systems
08:06 Examples of Data Drift
10:58 Concept Drift Explained
13:33 Importance of Tracking Input and Output
18:30 Tools and Best Practices
20:00 Conclusion and Final Thoughts
Taught by
Conf42