Concerto for Java and AI - Building Production-Ready LLM Applications

Explore the intersection of Java, AI, and music composition in this 51-minute conference talk from Spring I/O. Discover how to build production-ready Large Language Model (LLM) applications using Spring Boot and AI orchestrators like LangChain4J and Spring AI. Learn about core architectural patterns for integrating AI capabilities into existing software systems, including templated prompts, agent tools, and external knowledge integration. Examine the readiness of the Java ecosystem for AI applications and address potential gaps. Follow along as a "composer assistant" application is built, demonstrating how to make LLM applications production-ready. Delve into topics such as developer experience when working locally with language models, observability considerations for tokens, ensuring resilience across AI-orchestrated integrations, and strategies for deploying LLM applications. Witness a live demonstration where AI assists in composing and performing music for a movie scene chosen by the audience, showcasing the practical applications of Java and Generative AI in real-world scenarios.

Concerto for Java and AI - Building Production-Ready LLM Applications by Thomas Vitale @ Spring I/O