YoVDO

HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution

Offered By: Valence Labs via YouTube

Tags

Bioinformatics Courses Protein Synthesis Courses Gene Regulation Courses Foundation Models Courses Long-range Interactions Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the groundbreaking HyenaDNA genomic foundation model in this comprehensive talk by Eric Nguyen from Valence Labs. Delve into the challenges of modeling long-range genomic sequences at single nucleotide resolution and discover how HyenaDNA overcomes limitations of previous Transformer-based models. Learn about the innovative use of implicit convolutions to achieve context lengths of up to 1 million tokens, enabling more effective modeling of long-range interactions in DNA. Understand the model's sub-quadratic scaling, single nucleotide tokenization, and full global context capabilities. Examine the potential applications of in-context learning in genomics and review HyenaDNA's state-of-the-art performance on various benchmarks. The presentation covers motivation, background, model design, experimental results, and includes an extensive Q&A session, providing a thorough understanding of this cutting-edge approach to genomic sequence modeling.

Syllabus

- Intro
- Motivation
- Background
- Designing Hyena
- Experiments
- Q+A


Taught by

Valence Labs

Related Courses

Network Analysis in Systems Biology
Icahn School of Medicine at Mount Sinai via Coursera
Molecular Dynamics for Computational Discoveries in Science
University of Massachusetts Boston via Independent
Biology Meets Programming: Bioinformatics for Beginners
University of California, San Diego via Coursera
Python for Informatics: Exploring Information
Open Education by Blackboard
Genomic Medicine Gets Personal
Georgetown University via edX