Big Data Analyst -using Sqoop and Advance Hive (CCA159)
Offered By: Udemy
Course Description
Overview
What you'll learn:
- Students will learn Advance Hive and Sqoop for Big Data Analytics and Ingestion.
You will start by learning what is Hadoop & Hadoop distributed file system and most common hadoop commands required to work with Hadoop File system
Then you will be introduced to Sqoop Import
Understand lifecycle of sqoop command.
Use sqoop import command to migrate data from Mysql to HDFS.
Use sqoop import command to migrate data from Mysql to Hive.
Use various file formats, compressions, file delimeter,where clause and queries while importing the data.
Understand split-by and boundary queries.
Use incremental mode to migrate the data from Mysql to HDFS.
Further, you will learn Sqoop Export to migrate data.
What is sqoop export
Using sqoop export, migrate data from HDFS to Mysql.
Using sqoop export, migrate data from Hive to Mysql.
Finally, we will start with Apache Hive [Advance]
Hive Intro
External &Managed Tables
Insert & Multi Insert
Data Types & Complex Data Types
Collection Function
Conditional Function
Hive String Functions
Hive Date Functions
Mathematical Function
Hive Analysis
Alter Command
Joins, Multi Joins &Map Joins
Working with Different Files - Parquet,Avro
Compressions
Partitioning
Bucketing
Views
Lateral Views/Explode
Windowing Functions - Rank/Dense Rank/lead/lag/min/max
Window Specification
Taught by
Navdeep Kaur
Related Courses
80043368 - Strategies to Improve Human Papillomavirus (HPV) Vaccination Rates Among College StudentsJohns Hopkins University via Independent MBA Core Curriculum
University System of Maryland via edX A Beginner’s Guide to Data Analytics
Boxplay via FutureLearn A Beginner’s Guide to Data Handling and Management in Excel
Packt via FutureLearn A Day in the Life of a Data Engineer (Korean)
Amazon Web Services via AWS Skill Builder