Building a Cloud Native Data Pipeline for Your Real-Time ML and AI Apps

Learn to construct a cloud-native data pipeline specifically designed for real-time machine learning and AI applications in this 28-minute conference talk. Explore the critical data management systems required for AI applications, focusing on seamless collection, storage, processing, and analysis of data in real-time environments. Begin with real-time data ingestion challenges and discover how to overcome them using Apache Pulsar, a powerful cloud-native event streaming platform. Move downstream to perform analysis using online machine learning techniques and stateful cloud-native stream processing engines such as Bytewax or RisingWave. Gain comprehensive insights into the data management landscape and understand the rationale behind implementing each component for effective real-time ML and AI application support through practical demonstrations and detailed explanations of modern cloud-native architectures.