Practical Kubernetes Monitoring with Prometheus

Explore practical Kubernetes monitoring with Prometheus in this informative conference talk. Learn about microservices, distributed workloads, and the complexities of Kubernetes as a container orchestrator. Discover best practices for implementing Prometheus, Grafana, and the Prometheus Operator. Gain insights into instrumenting applications with metrics, deploying to Kubernetes, and leveraging service discovery, long-term storage with Thanos/Cortex, and alerting. Delve into the iterative process of cloud-native monitoring, including handling new workloads and changes. Prepare for various monitoring scenarios, including silencing alerts proactively. Get a glimpse into observability with logs, traces, and SLOs, and explore monitoring use cases on GitLab.com SaaS. Cover topics such as Prometheus architecture, terminology, kube-prometheus installation, Grafana dashboards, custom monitoring, golden signals, alert rules, SLAs, SLOs, SLIs, profiling, infrastructure as code, GitOps, Kubernetes security monitoring, RBAC, and policies.

Intro
Microservices and classic host/services models
Thoughts and tips
Prometheus inside Kubernetes?
Prometheus: Architecture
Prometheus Terminology: Service Discovery
Overview: kube-prometheus
Install kube-prometheus & Prometheus Operator
Familiarize yourself with the deployment
Alert Manager UI
Grafana dashboards
Deploy the demo app prometheus_demo_service
Monitor the Demo Service
Verify Prometheus Service Monitor targets
kube-state-metrics
Customize kube-prometheus
Golden Signals
Alert Rules in Prometheus Operator
SLA, SLO, SLI
SLOs as code
SLOs with Prometheus
Profiling
Infrastructure as Code, GitOps and Monitoring
Kubernetes Security Monitoring
RBAC & Policies
Resources: Workshops and Trainings