AI and LLM Observability with Dynatrace - Tutorial and Demo

Dive into a 15-minute tutorial on AI and LLM Observability using Dynatrace's OpenTelemetry-based solution. Explore the challenges companies face when adopting AI and understand the benefits of observing AI and LLM. Watch a comprehensive demo analyzing typical AI challenges, including slow requests, performance issues, and response accuracy. Learn how to optimize performance, understand costs, and ensure accurate responses across all layers of the AI Stack: Infrastructure, Model, Semantic, Orchestration, and Application. Access sample dashboards, deploy a GenAI demo app using GitHub Codespace, and implement AI observability in your environments with detailed documentation. The tutorial covers AI market observations, adoption challenges, observability overview, demo architecture, and in-depth analysis of slow AI requests, usage costs, model performance, and AI accuracy.

- Introduction
- AI Market Observations
- AI Adoption Challenges
- AI Observability Overview
- Demo Architecture
- Demo begins
- Analyzing Slow AI Requests
- Analyzing Costs of AI Usage
- Analyzing the Performance of Models
- Analyzing AI Accuracy
- Wrap Up