Deep Dive on How Google Cloud Built Duet AI

Dive deep into the process of building Duet AI in this 46-minute conference talk from Google Cloud Tech. Explore the stack powering Duet AI chat assistance, key feature implementation, challenges faced, and lessons learned. Gain insights into incorporating generative AI into products, covering topics such as enterprise context, model selection, tuning, middleware, preamble optimization, guardrails, grounding, postprocessing, user experience design, and evaluation techniques. Learn from Google Cloud's product teams as they share their experience developing a large language model-powered product using accessible technology.

Intro
Overview
Enterprise context
Model selection
Tuning
Middleware
Preamble
Preamble optimization
Basic guardrails
Specialized guardrails
Grounding
Postprocessing
User Experience Design
Evaluation Techniques
Recap
Challenges