Big Data Analyst -using Sqoop and Advance Hive (CCA159)
Offered By: Udemy
Course Description
Overview
What you'll learn:
- Students will learn Advance Hive and Sqoop for Big Data Analytics and Ingestion.
You will start by learning what is Hadoop & Hadoop distributed file system and most common hadoop commands required to work with Hadoop File system
Then you will be introduced to Sqoop Import
Understand lifecycle of sqoop command.
Use sqoop import command to migrate data from Mysql to HDFS.
Use sqoop import command to migrate data from Mysql to Hive.
Use various file formats, compressions, file delimeter,where clause and queries while importing the data.
Understand split-by and boundary queries.
Use incremental mode to migrate the data from Mysql to HDFS.
Further, you will learn Sqoop Export to migrate data.
What is sqoop export
Using sqoop export, migrate data from HDFS to Mysql.
Using sqoop export, migrate data from Hive to Mysql.
Finally, we will start with Apache Hive [Advance]
Hive Intro
External &Managed Tables
Insert & Multi Insert
Data Types & Complex Data Types
Collection Function
Conditional Function
Hive String Functions
Hive Date Functions
Mathematical Function
Hive Analysis
Alter Command
Joins, Multi Joins &Map Joins
Working with Different Files - Parquet,Avro
Compressions
Partitioning
Bucketing
Views
Lateral Views/Explode
Windowing Functions - Rank/Dense Rank/lead/lag/min/max
Window Specification
Taught by
Navdeep Kaur
Related Courses
Social Network AnalysisUniversity of Michigan via Coursera Intro to Algorithms
Udacity Data Analysis
Johns Hopkins University via Coursera Computing for Data Analysis
Johns Hopkins University via Coursera Health in Numbers: Quantitative Methods in Clinical & Public Health Research
Harvard University via edX