Challenges of Managing Real-Time Financial Market Data Storage

Explore the intricacies of managing real-time financial market data storage in this 42-minute conference talk from SREcon23 Asia/Pacific. Join Kiran Kasichayanula and Nishith Nedungadi from Bloomberg LP as they share their journey from local disk to cloud storage, detailing how they handle an impressive 300 billion unique events daily. Discover the motivations behind their transition and learn about their custom data scraping and chunk streaming solution for publishing data to the cloud. Gain valuable insights into the challenges and lessons learned while migrating a complex production environment to leverage cloud storage. This talk is ideal for professionals interested in large-scale data management, cloud migration, and real-time financial data processing.