The Data Pipelines Behind Forest Carbon Credits - Why Pachama Uses Flyte to Orchestrate Workflows
Offered By: CNCF [Cloud Native Computing Foundation] via YouTube
Course Description
Overview
Explore the intricacies of data pipelines in forest carbon credit projects through this informative conference talk. Discover how Pachama leverages Flyte, a Kubernetes-native workflow orchestrator, to manage complex data and machine learning pipelines. Learn about the importance of transparency and data lineage in carbon credit computation, especially in the context of forest-based initiatives. Gain insights into Flyte's workload management in Kubernetes, Pachama's specific Flyte configuration, and valuable lessons learned from implementation. Compare Flyte to other orchestrators like Argo and Kubeflow, and understand why Pachama chose this solution for their workflow orchestration needs. Delve into the technical aspects of establishing trust in carbon credit projects through clear data tracing from earth observations to credit generation.
Syllabus
The Data Pipelines Behind Forest Carbon Credits – Why Pachama Uses Flyte to Orchestrate Workflows
Taught by
CNCF [Cloud Native Computing Foundation]
Related Courses
Observability in the MLOps Lifecycle with PrometheusUSENIX via YouTube Building Robust ML Production Systems Using OSS Tools for Continuous Delivery for ML
Linux Foundation via YouTube Self-serve Feature Engineering Platform Using Flyte and Feast
Linux Foundation via YouTube Enforcing Data Quality in Data Processing and ML Pipelines with Flyte and Pandera
Linux Foundation via YouTube Efficient Data Parallel Distributed Training with Flyte, Spark and Horovod
Linux Foundation via YouTube