YoVDO

Evolution of Streaming Pipeline at Lyft - Real-Time Optimization Platform

Offered By: Confluent via YouTube

Tags

Apache Kafka Courses Machine Learning Courses Scalability Courses Data Pipelines Courses Streaming Data Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the evolution of Lyft's streaming pipeline in this 36-minute conference talk from Confluent. Discover how Lyft, a ride-sharing company, built a real-time optimization platform to balance supply and demand efficiently. Learn about the complex system that makes real-time decisions using various data sources, machine learning models, and a streaming infrastructure designed for low latency, reliability, and scalability. Gain insights into how Lyft organically evolved and scaled its streaming platform to provide a consistent view of the marketplace, enabling individual teams to run optimizations independently. Understand the platform's capabilities for online and offline feature access, which aids in back-testing models. Delve into topics such as Lyft's streaming platform for dynamic decision-making, Kafka's role in the streaming tech stack, the productionization of the first pipeline, and tools that simplified pipeline creation for data scientists. Discover valuable lessons learned and get a glimpse of Lyft's roadmap for their next-generation streaming platform and smarter tools development.

Syllabus

Evolution of Streaming Pipeline at Lyft


Taught by

Confluent

Related Courses

Financial Sustainability: The Numbers side of Social Enterprise
+Acumen via NovoEd
Cloud Computing Concepts: Part 2
University of Illinois at Urbana-Champaign via Coursera
Developing Repeatable ModelsĀ® to Scale Your Impact
+Acumen via Independent
Managing Microsoft Windows Server Active Directory Domain Services
Microsoft via edX
Introduction aux conteneurs
Microsoft Virtual Academy via OpenClassrooms