Unlocking A/B Testing for B2B - Advanced Techniques for Small Sample Experimentation

Learn advanced A/B testing techniques specifically designed for B2B companies in this 45-minute conference talk from the Data Science Festival. Explore how B2B experimentation differs from traditional B2C testing, addressing unique statistical challenges including small sample sizes, skewed distributions, heterogeneous effects, complex metric selection, and ID mapping issues. Discover practical solutions through advanced techniques such as stratified sampling, winsorization, and unit ID resolution that help overcome these obstacles. Examine real-world examples from B2B companies like Notion and Atlassian to understand how experimentation drives impact in business-to-business environments. Gain insights into statistical methods that apply not only to B2B testing but also to B2C testing scenarios with limited data or edge cases. Master techniques for making more reliable decisions with A/B testing regardless of your dataset size, whether you're working with millions of users or smaller, more constrained sample sizes.