Build and Orchestrate Serverless Generative AI Applications

Explore the process of building and orchestrating serverless generative AI applications in this conference talk from Conf42 CN 2024. Dive into the world of generative AI, learning about its applications in drug discovery, investment strategies, medical imaging, and product listing creation. Gain insights into the generative AI stack and Amazon Bedrock, understanding how to access and integrate with foundation models. Discover the power of AWS Step Functions for sequencing and composing applications from over 220 AWS services. Examine optimized integrations for Amazon Bedrock and learn how to access foundation models outside AWS through public APIs. Follow along with practical demonstrations, exploring requirements such as generating titles and descriptions, implementing human feedback loops, and creating avatars. Master techniques like prompt chaining and understand the architecture behind serverless generative AI applications. Conclude with valuable resources to further your knowledge in this cutting-edge field.

intro
preamble
genai is the answer. what was the question?
accelerate drug discovery
tailor investment strategies
enhance medical images
create product listings
genai stack
amazon bedrock
how do i access foundation models?
integrating with amazon bedrock
sequencing is hard
aws step functions
directly compose apps from over 220 aws services and 10k api actions
control service integrations with call patterns
why direct integration is powerful
machine learning and genai
building a genai application
optimized integration for amazon bedrock
demo
requirement 1: generate title and description
amazon states language asl for amazon bedrock
building a genai application
how do i access foundation models outside aws?
accessing a public api
public https api integration
asl for https endpoint
requirement 1: generate multiple titles
what if something goes wrong...
how do you handle hard failures?
redrive
execution event history for easy observability
building a genai application
wait for callback - human / external process
requirement 2: human feedback loop
building a genai application
requirement 3: generate avatar
prompt chaining
architecture
demo
resources
thank you