There's No Place Like Production - Lessons from Incident Management

Explore a conference talk from Conf42 Incident Management 2023 featuring Paige Cruz discussing the realities of production environments. Delve into Cruz's career journey, the importance of structured logs, and the intricacies of incident management. Learn about a real-world incident involving Traefik, following the speaker through the planning, execution, and aftermath of a significant change. Gain insights from the incident review process, key learnings, and the universal truth that all testing ultimately happens in production. This 23-minute presentation offers valuable lessons for IT professionals, emphasizing the importance of preparedness, communication, and continuous improvement in managing production environments.

intro
preamble
career start
unstructured logs
need for structured logs
about traefik
the stack - pre/post incident
#justsrethings
foolproof plan
the incident
#hugops
the next day
incident review
learnings
we all test in prod
thanks!