The Art & Joy of Testing in Production

Explore the benefits and practical implementation of testing in production in this conference talk from NDC Oslo 2020. Discover why traditional staging environments may provide a false sense of security and learn how to leverage cloud technologies, DevOps practices, and agile methodologies to improve software quality. Gain insights into techniques such as canary releases, feature flags, and ring-based deployments to ensure safer and more efficient releases. Understand the importance of early feedback, faster release cycles, and maintaining better control over applications in production environments. Learn how to verify production readiness, conduct integration testing, perform load testing, and focus on resilience to enhance overall software quality and user experience.

Intro
IS YOUR PRODUCTION ENVIRONMENT WORKING RIGHT NOW? DO YOU KNOW?
WHEN WAS THE LAST TIME YOU RELEASED TO PRODUCTION? HOW DID YOU CHECK IT WAS SAFE?
STAGING ENVIRONMENTS FALSE SENSE OF TRUST
STAGING ENVIRONMENTS - FALSE SENSE OF TRUST FOCUS ON TRUSTING PRODUCTION
STAGING ENVIRONMENTS EXPENSIVE
STAGING ENVIRONMENTS NATURAL HANDOVER POINT
STAGING ENVIRONMENTS BOTTLENECK
VERIFY IN PRODUCTION
USER SYNC SERVICE
E-COMMERCE
NEW VIEW ON TESTING
TESTING IN PRODUCTION SPLIT DEPLOY & RELEASE
INTEGRATION TESTING
TAP COMPARE
LOAD TESTING
CONFIG TESTING
CANARY RELEASES
FOCUSSED CANARIES
RING BASED RELEASES
FEATURE FLAGS
IMPACTED USERS?
FOCUS ON RESILIENCY
RECAP