Modern Data Science in a Cloud Native World

Explore a 19-minute conference talk on modern data science in a cloud-native environment. Discover how to leverage Kubernetes and other cloud-native technologies, along with the open-source project Pachyderm, to create scalable and easily manageable data science pipelines. Learn about data versioning techniques for tracking changes and ensuring GDPR compliance. Gain insights into developing, testing, and deploying data pipelines, as well as scaling them to production-level workloads with automatic deployment of changes. Understand the basic concepts of data pipelines and versioning, and see a demonstration of creating and testing a simple model.

Modern Data Science in a Cloud Native World - Samuel Kreter, Microsoft