Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore a comprehensive empirical study examining the effectiveness of property-based testing (PBT) in Python through analysis of 426 programs using the Hypothesis library. Learn about the researchers' formal definitions for 12 categories of property-based tests and their intraprocedural static analysis implementation for test categorization. Discover key findings from mutation testing evaluation of 40 projects, revealing that property-based tests find approximately 50 times more mutations than average unit tests. Examine which test categories prove most effective, including exception-checking tests, collection inclusion tests, and type-checking tests that demonstrate over 19 times greater mutation detection capability. Understand the parameter sweep study results showing that 76% of mutations are discovered within the first 20 random inputs, providing insights into optimal test configuration. Gain access to the methodology for evaluating testing effectiveness in Python codebases and understand the practical implications for software quality assurance. The presentation includes detailed analysis of the corpus study methodology, formal categorization framework, and empirical evidence supporting property-based testing adoption in Python development workflows.
Syllabus
[OOPSLA'25] An Empirical Evaluation of Property-Based Testing in Python
Taught by
ACM SIGPLAN