Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Learn how Zapier, the leading workflow automation platform, builds and scales AI products using Braintrust's evaluation and observability infrastructure in this 15-minute conference talk. Discover the development process behind two major AI initiatives - AI Zap Builder and Zapier Copilot - from initial conception through production deployment at scale. Explore how Zapier implemented evaluation-driven development practices to systematically improve AI performance while serving millions of users across 7,000+ integrated applications. Gain insights into the technical challenges of operating AI features at enterprise scale, including strategies for maintaining reliability and accuracy in production environments. Understand the role of comprehensive evaluation frameworks and observability tools in building robust AI products that can handle real-world complexity. Walk away with practical learnings from Zapier's experience as one of the first companies to successfully integrate AI capabilities into core business automation workflows, including specific methodologies for scaling LLM usage to production loads and fostering a culture of systematic AI improvement.
