Evolution of Streaming Pipeline at Lyft - Real-Time Optimization Platform
Offered By: Confluent via YouTube
Course Description
Overview
Explore the evolution of Lyft's streaming pipeline in this 36-minute conference talk from Confluent. Discover how Lyft, a ride-sharing company, built a real-time optimization platform to balance supply and demand efficiently. Learn about the complex system that makes real-time decisions using various data sources, machine learning models, and a streaming infrastructure designed for low latency, reliability, and scalability. Gain insights into how Lyft organically evolved and scaled its streaming platform to provide a consistent view of the marketplace, enabling individual teams to run optimizations independently. Understand the platform's capabilities for online and offline feature access, which aids in back-testing models. Delve into topics such as Lyft's streaming platform for dynamic decision-making, Kafka's role in the streaming tech stack, the productionization of the first pipeline, and tools that simplified pipeline creation for data scientists. Discover valuable lessons learned and get a glimpse of Lyft's roadmap for their next-generation streaming platform and smarter tools development.
Syllabus
Evolution of Streaming Pipeline at Lyft
Taught by
Confluent
Related Courses
Financial Sustainability: The Numbers side of Social Enterprise+Acumen via NovoEd Cloud Computing Concepts: Part 2
University of Illinois at Urbana-Champaign via Coursera Developing Repeatable ModelsĀ® to Scale Your Impact
+Acumen via Independent Managing Microsoft Windows Server Active Directory Domain Services
Microsoft via edX Introduction aux conteneurs
Microsoft Virtual Academy via OpenClassrooms