YoVDO

Kafka on Kubernetes - From Evaluation to Production at Intuit

Offered By: USENIX via YouTube

Tags

LISA (Large Installation System Administration) Conference Courses Kubernetes Courses Splunk Courses ConfigMaps Courses

Course Description

Overview

Explore the journey of implementing Kafka on Kubernetes at Intuit in this 30-minute conference talk from USENIX LISA18. Dive into the experimentation and data-driven approach used to evaluate Kafka on Kubernetes in AWS. Learn about the requirements, experimental setup, and various tests conducted, including functional tests for message production and consumption, network isolation, cross-region operations, and performance and scale assessments. Discover the challenges encountered and solutions implemented during the process. Gain insights into the Kubernetes cluster configuration running Kafka, including kafka and zookeeper statefulsets, configmaps for server properties, service objects for broker access, and integration with Splunk and Wavefront for logging and monitoring. Understand the potential of running stateful applications like Kafka on Kubernetes and the considerations involved in moving from evaluation to production in a cloud environment.

Syllabus

LISA18 - Kafka on Kubernetes: From Evaluation to Production at Intuit


Taught by

USENIX

Related Courses

Named Data Networking
USENIX via YouTube
Release Engineering Best Practices at Google
USENIX via YouTube
Efficiently Backing Up Terabytes of Data with PgBackRest
USENIX via YouTube
SRE in the Small and in the Large
USENIX via YouTube
Network-Based LUKS Volume Decryption with Tang
USENIX via YouTube