Experimentation

Discover the power of experimentation and A/B testing in this insightful conference talk by Colin McFarland, Head of Experimentation at Skyscanner. Learn how to scale experimentation from a niche practice to a pervasive, company-wide strategy. Gain practical insights on augmenting experimentation within your business, understand the importance of causality, and avoid common pitfalls. Explore how tooling and education can drive a data-focused culture, essential for gaining a competitive edge. Delve into topics such as false detection rates, sample selection, overlapping experiments, and peer review standards. Understand the philosophy behind successful experimentation and learn about the Hypothesis Kit for building effective experiments. This talk, delivered at the WeAreDevelopers Conference 2017, offers valuable lessons for businesses of all sizes looking to harness the power of data-driven decision-making.

Intro
A/B testing in a slide
Case for A/B in a slide
Experiments at scale
Over 30 autonomous teams run experiments
Our philosophy
False detection rates
Sample selection
Overlapping experiments
Peer review Standard helps peer review and sharing leaming
Correcting for human nature
Hypothesis Kit
Building for experiments
Pinned tweet @MCFRL