DRew: Dynamically Rewired Message Passing with Delay
Offered By: Valence Labs via YouTube
Course Description
Overview
Explore a conference talk on DRew (Dynamically Rewired Message Passing with Delay), a novel framework for improving Message Passing Neural Networks (MPNNs) in long-range interaction tasks. Delve into the challenges faced by MPNNs, including over-squashing, and discover how the proposed framework addresses these issues through layer-dependent rewiring and a delay mechanism. Learn about DRew instantiations of common MPNNs, understand why vDRew helps with over-smoothing, and examine experimental results on real-world datasets. Gain insights into future research directions and participate in a Q&A session to deepen your understanding of this innovative approach to graph neural networks.
Syllabus
- Intro
- Challenges with Message-Passing Neural Networks MPNNs
- Framework Proposal
- Dynamic Rewiring
- Introducing Delay
- DRew Instantiations of Common MPNNs
- Why Does vDRew Help with Over-Smoothing?
- Experiments
- Performance on Real-World Datasets
- Future Work
- Q+A
Taught by
Valence Labs
Related Courses
Aplicaciones de la teoría de grafos a la vida realMiríadax Aplicaciones de la Teoría de Grafos a la vida real
Universitat Politècnica de València via UPV [X] Introduction to Computational Thinking and Data Science
Massachusetts Institute of Technology via edX Genome Sequencing (Bioinformatics II)
University of California, San Diego via Coursera Algorithmic Information Dynamics: From Networks to Cells
Santa Fe Institute via Complexity Explorer