Building a Data Infrastructure for AI/ML

Explore a comprehensive reference architecture for building an AI/ML data infrastructure in this 31-minute talk by Keith Pijanowski from MinIO. Discover how Open Table Formats (OTFs) developed by Netflix, Uber, and Databricks enable the creation of a cloud-native data infrastructure that meets all AI/ML requirements. Learn how this infrastructure can store data for various model types and scale according to capacity needs. Gain insights into how the presented architecture supports MLOps, distributed training, and advanced data manipulation techniques facilitated by OTF-based data storage. Additionally, understand how this data platform can accommodate the specialized tools required for Generative AI.

Building a Data Infrastructure for AI/ML - Keith Pijanowski, MinIO