ServiceRouter - Hyperscale and Minimal Cost Service Mesh at Meta

Explore a conference talk from OSDI '23 that delves into Meta's global service mesh, ServiceRouter (SR). Learn about the unique features that set SR apart from other publicly known service meshes, including its hyperscale design capable of routing tens of billions of requests per second across thousands of services using millions of L7 routers. Discover how SR achieves significant hardware cost savings by employing a routing library directly linked to service executables for 99% of RPC requests. Understand SR's built-in support for sharded services and its innovative concept of locality rings, which optimizes RPC latency while balancing load across geo-distributed datacenter regions. Gain insights into the architecture and benefits of this large-scale service mesh implementation that has been in production at Meta since 2012.

OSDI '23 - ServiceRouter: Hyperscale and Minimal Cost Service Mesh at Meta