Oxia for Data Streaming - Striking the Perfect Balance of Scalability, Latency, and Cost

Discover how to leverage Oxia beyond its traditional role as a metadata system by exploring its capabilities as an index storage engine for streaming infrastructures in this 28-minute conference talk. Learn practical strategies for maintaining high throughput in data pipelines while optimizing both latency and cost efficiency through Oxia's flexible, sharding-based architecture. Explore how Oxia's intelligent data categorization into hot, warm, and cold storage tiers can significantly reduce operational costs without sacrificing performance, and understand its advanced query capabilities including range scans and secondary indexes that enable versatile data retrieval. Gain insights into seamless integration patterns with streaming platforms like Apache Pulsar, automated load balancing, and shard management processes that optimize resource utilization. Through real-world examples and practical demonstrations, understand how this metadata-driven approach can unlock new performance possibilities in your streaming workflows, whether you're already using Oxia or looking to enhance your existing data streaming operations with a scalable solution that distributes data across multiple nodes for improved availability and throughput compared to traditional systems.