Distributing PromQL for Fast and Efficient Kubernetes Fleet Monitoring

Explore a conference talk on optimizing Kubernetes fleet monitoring through distributed PromQL techniques. Dive into the challenges of efficiently processing large volumes of data in scaled Prometheus storage systems like Thanos and Cortex. Learn about the Thanos community's efforts to enhance read path performance using query pushdown and query sharding, and compare these approaches with existing Cortex methods. Discover how Thanos deployments leverage stores and queriers to provide a consistent Prometheus-compliant read API for timeseries retrieval and PromQL expression evaluation. Gain insights into the benefits of pre-evaluating expressions closer to the data and breaking down queries into distinct datasets for concurrent computation in Kubernetes environments.

Distributing PromQL for Fast and Efficient Kubernetes Fleet Monitor... Moad Zardab & Filip Petkovski