Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Building an Asynchronous Application Framework with Python and Pulsar

StreamNative via YouTube

Overview

Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Learn how Klaviyo built a robust asynchronous application framework using Python and Apache Pulsar in this conference talk from Pulsar Summit SF 2022. Explore the development of an internal messaging system that provides essential tools for managing business-critical asynchronous data flows in unreliable environments. Discover key components including a Pulsar ORM, schema migrator for topic configuration, retry/replay functionality, versioned schema registry, and a consumer framework designed to prevent message loss while maximizing observability. Gain valuable insights from the speaker's experience transitioning from various datastores like RabbitMQ and Kafka, and frameworks such as Celery, Spark, and Flink. Understand the challenges and solutions encountered during the process of unifying a heterogeneous async-computing environment onto Pulsar, including the implementation of experimental "online schema change" capabilities for topics.

Syllabus

Intro
Overview
Aboutclavio
Current infrastructure
Chariot
Schema
Production
Reliability
Challenges
Teasers

Taught by

StreamNative

Reviews

Start your review of Building an Asynchronous Application Framework with Python and Pulsar

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.