HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution
Offered By: Valence Labs via YouTube
Course Description
Overview
Explore the groundbreaking HyenaDNA genomic foundation model in this comprehensive talk by Eric Nguyen from Valence Labs. Delve into the challenges of modeling long-range genomic sequences at single nucleotide resolution and discover how HyenaDNA overcomes limitations of previous Transformer-based models. Learn about the innovative use of implicit convolutions to achieve context lengths of up to 1 million tokens, enabling more effective modeling of long-range interactions in DNA. Understand the model's sub-quadratic scaling, single nucleotide tokenization, and full global context capabilities. Examine the potential applications of in-context learning in genomics and review HyenaDNA's state-of-the-art performance on various benchmarks. The presentation covers motivation, background, model design, experimental results, and includes an extensive Q&A session, providing a thorough understanding of this cutting-edge approach to genomic sequence modeling.
Syllabus
- Intro
- Motivation
- Background
- Designing Hyena
- Experiments
- Q+A
Taught by
Valence Labs
Related Courses
Network Analysis in Systems BiologyIcahn School of Medicine at Mount Sinai via Coursera Molecular Dynamics for Computational Discoveries in Science
University of Massachusetts Boston via Independent Biology Meets Programming: Bioinformatics for Beginners
University of California, San Diego via Coursera Python for Informatics: Exploring Information
Open Education by Blackboard Genomic Medicine Gets Personal
Georgetown University via edX