Preparing Data for LLMs and Generative AI Workflows

Explore the critical importance of data preparation for maximizing the effectiveness of Large Language Models (LLMs) and Generative AI workflows in this 31-minute video presentation by Craig Wiley, Sr. Director of Product - AI/ML at Databricks. Delve into topics such as competing in an AI-driven world, Gen AI on Databricks, Lakehouse AI, and the challenges associated with machine learning data. Gain insights into vectors, models, and building your own solutions, with a focus on the ML Flow AI Gateway. Learn how to leverage these concepts to enhance your AI and machine learning projects, concluding with a comprehensive summary of key takeaways for implementing effective data preparation strategies in LLM and Gen-AI applications.

Introduction
Databricks and Pinecone
How Can I Compete In An AI World?
Gen AI on Databricks
Lakehouse AI
Models And Data
Challenges With ML Data
Vectors
Models
Build Your Own Solutions
ML Flow AI Gateway
Summary
Conclusion