YoVDO

Easy and Featureful Parallelism with Dagger.jl - JuliaCon 2021

Offered By: The Julia Programming Language via YouTube

Tags

Julia Courses Fault Tolerance Courses Parallel Computing Courses Distributed Computing Courses GPU Programming Courses

Course Description

Overview

Explore advanced parallelism techniques using Dagger.jl in this JuliaCon2021 talk. Learn why Dagger.jl surpasses Distributed.jl for complex problems and large-scale parallelization, offering GPU execution and fault tolerance. Follow along as the speaker builds a real-world application, demonstrating Dagger's powerful scheduler and resource utilization. Discover key features like distributed arrays, checkpointing, and GPU programming with DaggerGPU.jl. Gain insights into Dagger's architecture, its relationship with Distributed.jl, and upcoming features such as distributed tables, task and data scopes, and mutable chunks. Perfect for Julia developers looking to enhance their parallel computing skills and leverage Dagger.jl's full potential in their projects.

Syllabus

- Introduction.
- Overview.
- When and why use Dagger instead of Distributed?.
- Coding example.
- A note on Dagger.delayed.
- How does Dagger scheduler work?.
- How is Dagger different from what Distributed.pmap and friends do?.
- Dagger vs Distributed - Dagger is built on top of Distributed.
- Real application demo built on Dagger - security camera monitoring system.
- Dagger feature: distributed arrays.
- Dagger feature: checkpointing.
- Dagger feature: GPU programming with DaggerGPU.jl.
- Future Dagger feature: Distributed tables.
- Future Dagger feature: Task and data scopes.
- Future Dagger feature: Mutable chunks.
- Check the Issues on the Dagger repository for more.


Taught by

The Julia Programming Language

Related Courses

Cloud Computing Concepts, Part 1
University of Illinois at Urbana-Champaign via Coursera
Cloud Computing Concepts: Part 2
University of Illinois at Urbana-Champaign via Coursera
Reliable Distributed Algorithms - Part 1
KTH Royal Institute of Technology via edX
Introduction to Apache Spark and AWS
University of London International Programmes via Coursera
Réalisez des calculs distribués sur des données massives
CentraleSupélec via OpenClassrooms