Testing at Scale - How to Test When You Go Globally With a Fleet of Thousands of Machines

Explore comprehensive strategies for testing at scale in this conference talk from NDC Oslo 2022. Learn how to organize and execute various test types, including unit, end-to-end, manual, and A/B tests, for optimal speed and reliability. Discover solutions for handling GDPR-protected data and managing tests across thousands of machines. Gain insights into building a real-life end-to-end testing pipeline used by major global companies, covering unit tests, correctness tests, regression tests, performance tests, security tests, and A/B tests. Drawing from experience in desktop, mobile, service, and machine learning domains, delve into topics such as mocking, infrastructure as code, ETL, user interface hardware tests, cold hygiene, comparison tests, feature toggles, metrics, backups, and rollback strategies. Acquire practical knowledge to enhance your testing processes and ensure both code correctness and improved customer experience.

Introduction
Do we need tests
Reality is contradictory
What should we do
Mocking
Keep it maintainable
In action
Mocks
Infrastructure as code
ETL
User Interface Hardware Tests
Cold Hygiene
Comparison Tests
Feature Toggles
Metrics
Backups
Rollback
Summary