Fink on Kubernetes - Efficient Management of Massive Alert Streams for Astronomical Object Identification
Offered By: CNCF [Cloud Native Computing Foundation] via YouTube
Course Description
Overview
Explore how Kubernetes facilitates efficient management of massive alert streams for astronomical object identification in this conference talk. Learn about the Fink broker project's role in handling real-time streams of millions of alerts produced nightly by modern astronomical facilities like the Rubin Observatory. Discover the cloud-based infrastructure of Fink, which utilizes state-of-the-art distributed computing frameworks such as Apache Spark and integrates with Kubernetes for real-time decision-making. Gain insights into Fink's complex software stack, rigorously tested in a self-hosted CI/CD environment on Kubernetes and OpenStack. Understand the modern challenges in astronomy and how Kubernetes contributes to advancing scientific frontiers through the efficient processing of large-scale astronomical data.
Syllabus
Fink on Kubernetes: Efficient Management of Massive Alert Streams for Astronomical Objects Identific
Taught by
CNCF [Cloud Native Computing Foundation]
Related Courses
CS115x: Advanced Apache Spark for Data Science and Data EngineeringUniversity of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera