Operating Elasticsearch with Ease at Scale

Explore the intricacies of operating Elasticsearch at scale in this 56-minute conference talk from SREcon19 Asia/Pacific. Dive into the challenges and solutions for managing massive Elasticsearch deployments that handle billions of ingests and millions of searches daily. Learn how PayPal's SRE team leverages Elasticsearch to turn data into actionable insights, covering topics such as handling dark queries, optimizing performance, and effective monitoring. Gain valuable insights on common issues, mitigation strategies, and best practices for making Elasticsearch truly elastic. Watch demonstrations of Elasticsearch in action and discover how to do more with less in large-scale implementations. Whether you're new to Elasticsearch or an experienced user, this talk offers practical knowledge for operating Elasticsearch with ease at scale.

Introduction
Agenda
Introductions
Overview of Elasticsearch
What is Elasticsearch
Use cases for Elasticsearch
Why is Elasticsearch famous
Terminology
Sample Use Case
Indexing Request
Indexing Example
Search Request
Search Request Example
Installation
Sample Cluster
Scalability
Mapping explosion and sparse fields
Expensive or suboptimal queries
Group by based on ID field
Retrieve all documents from Elasticsearch
Multiple levels of aggregation
Wildcard queries
Recap
Query Logging
Gatekeeper
Query Optimizer
Query Optimizer Example
Why is shard important
Summary
Overview
Elastic Availability
Alerts
Security
Overhaul
Demo
Correlation
Out of Memory
Poaching Data