YoVDO

Observing a Large Language Model in Production

Offered By: CNCF [Cloud Native Computing Foundation] via YouTube

Tags

Observability Courses Prompt Engineering Courses API Management Courses Service-Level Objectives Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the challenges and solutions of implementing and monitoring a Large Language Model (LLM) in production through this insightful conference talk. Discover how Honeycomb tackled the unique obstacles presented by non-deterministic and inherently unreliable LLM APIs. Learn about effective instrumentation techniques, key performance indicators, and the establishment of Service Level Objectives (SLOs) for LLM-powered features. Gain valuable insights into measuring and iterating on improvements, blending prompt engineering with observability practices to enhance product quality. Acquire practical knowledge on how to effectively monitor and optimize LLM-based features in a production environment, enabling you to build more robust and reliable AI-powered applications.

Syllabus

Observing a Large Language Model in Production - Phillip Carter, Honeycomb


Taught by

CNCF [Cloud Native Computing Foundation]

Related Courses

Discover, Validate & Launch New Business Ideas with ChatGPT
Udemy
150 Digital Marketing Growth Hacks for Businesses
Udemy
AI: Executive Briefing
Pluralsight
The Complete Digital Marketing Guide - 25 Courses in 1
Udemy
Learn to build a voice assistant with Alexa
Udemy