HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution
Offered By: Valence Labs via YouTube
Course Description
Overview
Explore the groundbreaking HyenaDNA genomic foundation model in this comprehensive talk by Eric Nguyen from Valence Labs. Delve into the challenges of modeling long-range genomic sequences at single nucleotide resolution and discover how HyenaDNA overcomes limitations of previous Transformer-based models. Learn about the innovative use of implicit convolutions to achieve context lengths of up to 1 million tokens, enabling more effective modeling of long-range interactions in DNA. Understand the model's sub-quadratic scaling, single nucleotide tokenization, and full global context capabilities. Examine the potential applications of in-context learning in genomics and review HyenaDNA's state-of-the-art performance on various benchmarks. The presentation covers motivation, background, model design, experimental results, and includes an extensive Q&A session, providing a thorough understanding of this cutting-edge approach to genomic sequence modeling.
Syllabus
- Intro
- Motivation
- Background
- Designing Hyena
- Experiments
- Q+A
Taught by
Valence Labs
Related Courses
Soil Structure InteractionIndian Institute of Technology, Kharagpur via Swayam Fundamentals of Machine Learning for Healthcare
Stanford University via Coursera Artificial Intelligence Foundations: Thinking Machines
LinkedIn Learning Could a Purely Self-Supervised Foundation Model Achieve Grounded Language Understanding?
Santa Fe Institute via YouTube Foundation Models - FSDL 2022
The Full Stack via YouTube