Deploying LLMs on Structured Data Tasks - Lessons from the Trenches

Explore NSQL, a new family of open-source foundation models designed for SQL generation tasks, in this 31-minute talk by Laurel Orr. Discover how NSQL addresses the limitations of existing foundation models for enterprise use, including customization, quality, and privacy concerns. Learn about NSQL's specialized training for SQL tasks, its range of model sizes, and its data generation process and GPU training approach. Understand how NSQL outperforms other open-source models and even competes with closed-source models for SQL generation. Gain insights into applying generative AI to data tasks and the intersection of artificial intelligence, foundation models, and data management.

Deploying LLMs on Structured Data Tasks: Lessons from the Trenches // Laurel Orr // LLMs III Talk