Testing in Production

Explore lessons learned from testing directly in production in this conference talk. Discover how to increase release cadence, implement faster deployments, and commit directly to the master branch. Learn about synchronous and asynchronous deployment strategies, various testing flavors, and the importance of timing. Delve into running functional and load tests against production environments, handling special cases, and managing users in the wild. Examine rolling back techniques, event overlaying, and the concept of Monitoring Driven Development. Gain insights on effective alerting practices, creating feedback loops for production testing, and building "full cycle" developer teams. Understand how these strategies contribute to developer happiness and overall team success in the context of modern software development practices.

Intro
Conventional deploy systems
Hello. My name is...
Agile and XP
Ad tech 101
Our goals
Ingredients to increase release cadence
Faster deploys
Commit to your master
Commit == Deploy
Welcome to the menagerie
Taking the shortest route
Synchronous or async deploy?
Feedback loops
Flavours of testing
Timing is everything
Testing against production!
Running functional tests... against production
Special casing
Users in the wild
Load testing... in production
Load patterns
Sharks and waves
Rolling back
Overlaying events
Too many metrics!
Monitoring Driven Development
Alerting
What to alert on?
Feedback loop for testing in prod
"Full cycle" developers
Building great teams
Developer happiness
Do try this at home...
Thank you!