Turn It Up to a Million - Ingesting Millions of Metrics with Thanos Receive

Explore a conference talk on creating a multi-tenant, horizontally scalable metrics ingestion system using Thanos Receive. Dive into the motivations behind building a system capable of ingesting metrics from thousands of clusters, focusing on multi-cluster monitoring and cluster telemetry. Learn how Thanos Receive satisfies these requirements and how its hash ring design enables scalability and maintains ingestion availability during upgrades. Discover the practical aspects of running an automatically scalable hash ring by leveraging the Thanos Receive Controller, Horizontal Pod Autoscaler, and the Prometheus Adapter. Gain insights into the open-source CNCF Sandbox project Thanos, which builds upon Prometheus components to create a global-scale and highly available monitoring system.

Turn It Up to a Million: Ingesting Millions of Metrics with Thanos Receive - Lucas Servén Marín