YoVDO

Automated Data Quality Checks for Big Datasets Using Machine Learning

Offered By: Data Science Festival via YouTube

Tags

Big Data Courses Machine Learning Courses Apache Spark Courses Statistical Methods Courses Data Validation Courses Data Profiling Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore automated data quality checks for large-scale datasets in this 32-minute conference talk from the Data Science Festival. Discover how major organizations implement real-time data reliability checks using data profiling and machine learning techniques. Learn about the open-source library Deequ, Spark framework, and reporting & notification tools for proactive data issue enforcement. Gain insights into a framework developed at Amazon and Visa for validating customer-facing data and its integration with notification tools based on statistical methods. Suitable for technical practitioners, this talk by Akshay Dineshkumar Jain from Innovate UK offers valuable knowledge on maintaining data quality in big data environments.

Syllabus

Data quality for big datasets


Taught by

Data Science Festival

Related Courses

Web Intelligence and Big Data
Indian Institute of Technology Delhi via Coursera
Big Data for Better Performance
Open2Study
Big Data and Education
Columbia University via edX
Big Data Analytics in Healthcare
Georgia Institute of Technology via Udacity
Data Mining with Weka
University of Waikato via Independent