Future of Intelligent Cluster Ops - LLM-Powered Kubernetes Controllers

Explore the future of intelligent cluster operations in this 37-minute conference talk from the Cloud Native Computing Foundation (CNCF). Discover how AI and Large Language Models (LLMs) can revolutionize Kubernetes controllers, enabling automated cluster management and troubleshooting. Learn about the stages of data processing, fine-tuning LLMs, and integrating them with Kubernetes controllers and Custom Resource Definitions (CRDs). Witness a live demonstration showcasing the ability to "talk" to Kubernetes controllers powered by LLMs for auditing and upgrading clusters, simulating chaos scenarios, scanning for Common Vulnerabilities and Exposures (CVEs), and monitoring cluster health. Gain insights into how domain knowledge enhances AI model accuracy while adhering to data ethics and security principles. Understand the potential of speech recognition in Kubernetes controllers for more intuitive cluster operations.

Future of Intelligent Cluster Ops: LLM-Azing Kubernetes Controllers - Rajas Kakodkar & Amine Hilaly