Big Data Applications: Real-Time Streaming

There is a significant number of tasks when we need not just to process an enormous volume of data but to process it as quickly as possible. Delays in tsunami prediction can cost people’s lives. Delays in traffic jam prediction cost extra time. Advertisements based on the recent users’ activity are ten times more popular.

However, stream processing techniques alone are not enough to create a complete real-time system. For example to create a recommendation system we need to have a storage that allows to store and fetch data for a user with minimal latency. These databases should be able to store hundreds of terabytes of data, handle billions of requests per day and have a 100% uptime. NoSQL databases are commonly used to solve this challenging problem.

After you finish this course, you will master stream processing systems and NoSQL databases. You will also learn how to use such popular and powerful systems as Kafka, Cassandra and Redis.

To get the most out of this course, you need to know Hadoop and SQL. You should also have a working knowledge of bash, Python and Spark.

Do you want to learn how to build Big Data applications that can withstand modern challenges? Jump right in!

Welcome to the course "Big Data Applications: Real-Time Streaming"

Basics of real-time data processing

Spark Streaming

NoSQL. Cassandra

NoSQL. Redis