YoVDO

HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution

Offered By: Valence Labs via YouTube

Tags

Bioinformatics Courses Protein Synthesis Courses Gene Regulation Courses Foundation Models Courses Long-range Interactions Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the groundbreaking HyenaDNA genomic foundation model in this comprehensive talk by Eric Nguyen from Valence Labs. Delve into the challenges of modeling long-range genomic sequences at single nucleotide resolution and discover how HyenaDNA overcomes limitations of previous Transformer-based models. Learn about the innovative use of implicit convolutions to achieve context lengths of up to 1 million tokens, enabling more effective modeling of long-range interactions in DNA. Understand the model's sub-quadratic scaling, single nucleotide tokenization, and full global context capabilities. Examine the potential applications of in-context learning in genomics and review HyenaDNA's state-of-the-art performance on various benchmarks. The presentation covers motivation, background, model design, experimental results, and includes an extensive Q&A session, providing a thorough understanding of this cutting-edge approach to genomic sequence modeling.

Syllabus

- Intro
- Motivation
- Background
- Designing Hyena
- Experiments
- Q+A


Taught by

Valence Labs

Related Courses

The Yang-Baxter Equation and Long-Range Interactions
Kavli Institute for Theoretical Physics via YouTube
Critical Geometry Approach to Phase Transitions - Andrea Trombettoni
Kavli Institute for Theoretical Physics via YouTube
Bosons in Unconventional Geometries - Fabio Cinti
Kavli Institute for Theoretical Physics via YouTube
Quantum Reservoir Engineering for Fast and Scalable Entanglement Stabilization - Archana Kamal
Kavli Institute for Theoretical Physics via YouTube
Engineering of Many-Body States in a Driven-Dissipative Cavity QED System - Tobias Donner
Kavli Institute for Theoretical Physics via YouTube