Addressing Cultural and Technical Challenges in Product Experimentation - Beyond the Tool

Explore key cultural elements and technical challenges in product experimentation through a 41-minute conference talk from the Data Science Festival. Delve into YouView's journey with hypothesis testing and causal inference, learning how to initiate an experimentation program and address scenarios where randomized control testing is not feasible. Gain insights on UX testing approaches and advanced data science techniques that go beyond traditional chi-square tests. Discover practical lessons on experiment design, external validity, user experience, and the importance of maintaining an experiment backlog. Understand the process of building an experimentation program, from SD to HD redirection to regression analysis, and explore new applications for these methodologies.

Intro
Background
SD to HD redirection
Difference and differences
Assumptions
Regression equation
Results
Lessons learned
Time to build
Experiment design
External validity
User experience
What is a guide
What did we learn
Need for a backlog
New applications
Questions