Building a Distributed Data Ingestion System with RabbitMQ

Explore the construction of a distributed data ingestion system using RabbitMQ in this 19-minute conference talk from JSConf.ar 2014. Learn how to tackle the challenge of processing data from globally distributed servers in a centralized location, handling input from diverse technology stacks and sources including web servers and sensors. Discover how RabbitMQ can be leveraged to create a robust solution, utilizing Federation for data replication across AWS regions and supporting multiple protocols for data production and consumption. Gain insights into enhancing scalability through the implementation of sharded queues using the Consistent Hash Exchange. Delve into advanced RabbitMQ capabilities beyond basic messaging and queueing, making this talk invaluable for those seeking to expand their knowledge of distributed systems and data processing.

Alvaro Videla: Building a Distributed Data Ingestion System with RabbitMQ | JSConf.ar 2014