Elasticsearch 7 and the Elastic Stack: Hands On
Offered By: Skillshare
Course Description
Overview
New for 2019! Elasticsearch 7 is a powerful tool not only for powering search on big websites, but also for analyzing big data sets in a matter of milliseconds! It's an increasingly popular technology, and a valuable skill to have in today's job market. This comprehensive course covers it all, from installation to operations, with over 90 lectures including 8 hours of video.
We'll cover setting up search indices on an Elasticsearch 7 cluster (if you need Elasticsearch 5 or 6 - we have other courses on that), and querying that data in many different ways. Fuzzy searches, partial matches, search-as-you-type, pagination, sorting - you name it. And it's not just theory, every lesson has hands-on examples where you'll practice each skill using a virtual machine running Elasticsearch on your own PC.
We'll explore what's new in Elasticsearch 7 - including index lifecycle management, the deprecation of types and type mappings, and a hands-on activity with Elasticsearch SQL. We've also added much more depth on managing security with the Elastic Stack, and how backpressure works with Beats.
We cover, in depth, the often-overlooked problem of importing data into an Elasticsearch index. Whether it's via raw RESTful queries, scripts using Elasticsearch API's, or integration with other "big data" systems like Spark and Kafka - you'll see many ways to get Elasticsearch started from large, existing data sets at scale. We'll also stream data into Elasticsearch using Logstash and Filebeat - commonly referred to as the "ELK Stack" (Elasticsearch / Logstash / Kibana) or the "Elastic Stack".
Elasticsearch isn't just for search anymore - it has powerful aggregation capabilities for structured data. We'll bucket and analyze data using Elasticsearch, and visualize it using the Elastic Stack's web UI, Kibana.
You'll learn how to manage operations on your Elastic Stack, using X-Pack to monitor your cluster's health, and how to perform operational tasks like scaling up your cluster, and doing rolling restarts. We'll also spin up Elasticsearch clusters in the cloud using Amazon Elasticsearch Service and the Elastic Cloud.
Elasticsearch is positioning itself to be a much faster alternative to Hadoop, Spark, and Flink for many common data analysis requirements. It's an important tool to understand, and it's easy to use! Dive in with me and I'll show you what it's all about.
Syllabus
- Introduction
- Section Introduction: Getting Set Up
- Installing Elasticsearch [Step by Step]
- Intro to HTTP and RESTful API's
- Elasticsearch Basics: Logical Concepts
- Elasticsearch Overview
- Term Frequency / Inverse Document Frequency (TF/IDF)
- Using Elasticsearch
- What's New in Elasticsearch 7
- How Elasticsearch Scales
- Quiz: Elasticsearch Concepts and Architecture
- Section 1 Wrapup
- Intro: Mapping and Indexing Data
- Connecting to your Cluster
- Introducing the MovieLens Data Set
- Analyzers
- Import a Single Movie via JSON / REST
- Insert Many Movies at Once with the Bulk API
- Updating Data in Elasticsearch
- Deleting Data in Elasticsearch
- [Exercise] Insert, Update and Delete a Movie
- Dealing with Concurrency
- Using Analyzers and Tokenizers
- Data Modeling and Parent/Child Relationships, Part 1
- Data Modeling and Parent/Child Relationships, Part 2
- Section 2 Wrapup
- Intro: Searching with Elasticsearch
- "Query Lite" interface
- JSON Search In-Depth
- Phrase Matching
- [Exercise] Querying in Different Ways
- Pagination
- Sorting
- More with Filters
- [Exercise] Using Filters
- Fuzzy Queries
- Partial Matching
- Query-time Search As You Type
- N-Grams, Part 1
- N-Grams, Part 2
- Section 3 Wrapup
- Intro: Importing Data
- Importing Data with a Script
- Importing with Client Libraries
- [Exercise] Importing with a Script
- Introducing Logstash
- Installing Logstash
- Running Logstash
- Logstash and MySQL, Part 1
- Logstash and MySQL, Part 2
- Logstash and S3
- Elasticsearch and Kafka, Part 1
- Elasticsearch and Kafka, Part 2
- Elasticsearch and Apache Spark, Part 1
- Elasticsearch and Apache Spark, Part 2
- [Exercise] Importing Data with Spark
- Section 4 Wrapup
- Intro: Aggregation
- Aggregations, Buckets, and Metrics
- Histograms
- Time Series
- [Exercise] Generating Histogram Data
- Nested Aggregations, Part 1
- Nested Aggregations, Part 2
- Section 5 Wrapup
- Intro: Using Kibana
- Installing Kibana
- Playing with Kibana
- [Exercise] Log analysis with Kibana
- Section 6 Wrapup
- Intro: Analyzing Log Data with the Elastic Stack
- FileBeat and the Elastic Stack Architecture
- X-Pack Security
- Installing FileBeat
- Analyzing Logs with Kibana Dashboards
- [Exercise] Log analysis with Kibana
- Section 7 Wrapup
- Intro: Elasticsearch Operations and SQL Support
- Choosing the Right Number of Shards
- Adding Indices as a Scaling Strategy
- Index Alias Rotation
- Index Lifecycle Management
- Choosing your Cluster's Hardware
- Heap Sizing
- Monitoring
- Elasticsearch SQL
- Failover in Action, Part 1
- Failover in Action, Part 2
- Snapshots
- Rolling Restarts
- Section 8 Wrapup
- Intro: Elasticsearch in the Cloud
- Amazon Elasticsearch Service, Part 1
- Amazon Elasticsearch Service, Part 2
- The Elastic Cloud
- Section 9 Wrapup
- Wrapping Up
Taught by
Frank Kane
Related Courses
MBA Core CurriculumUniversity System of Maryland via edX حدث كايزن في شرائح جوجل
Coursera Project Network via Coursera A Organização Centrada na Jornada do Cliente
Fundação Instituto de Administração via Coursera Accounting Data Analytics
University of Illinois at Urbana-Champaign via Coursera Data Analytics in Accounting Capstone
University of Illinois at Urbana-Champaign via Coursera