HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution
Offered By: Valence Labs via YouTube
Course Description
Overview
Explore the groundbreaking HyenaDNA genomic foundation model in this comprehensive talk by Eric Nguyen from Valence Labs. Delve into the challenges of modeling long-range genomic sequences at single nucleotide resolution and discover how HyenaDNA overcomes limitations of previous Transformer-based models. Learn about the innovative use of implicit convolutions to achieve context lengths of up to 1 million tokens, enabling more effective modeling of long-range interactions in DNA. Understand the model's sub-quadratic scaling, single nucleotide tokenization, and full global context capabilities. Examine the potential applications of in-context learning in genomics and review HyenaDNA's state-of-the-art performance on various benchmarks. The presentation covers motivation, background, model design, experimental results, and includes an extensive Q&A session, providing a thorough understanding of this cutting-edge approach to genomic sequence modeling.
Syllabus
- Intro
- Motivation
- Background
- Designing Hyena
- Experiments
- Q+A
Taught by
Valence Labs
Related Courses
The Yang-Baxter Equation and Long-Range InteractionsKavli Institute for Theoretical Physics via YouTube Critical Geometry Approach to Phase Transitions - Andrea Trombettoni
Kavli Institute for Theoretical Physics via YouTube Bosons in Unconventional Geometries - Fabio Cinti
Kavli Institute for Theoretical Physics via YouTube Quantum Reservoir Engineering for Fast and Scalable Entanglement Stabilization - Archana Kamal
Kavli Institute for Theoretical Physics via YouTube Engineering of Many-Body States in a Driven-Dissipative Cavity QED System - Tobias Donner
Kavli Institute for Theoretical Physics via YouTube