YoVDO

HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution

Offered By: Valence Labs via YouTube

Tags

Bioinformatics Courses Protein Synthesis Courses Gene Regulation Courses Foundation Models Courses Long-range Interactions Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the groundbreaking HyenaDNA genomic foundation model in this comprehensive talk by Eric Nguyen from Valence Labs. Delve into the challenges of modeling long-range genomic sequences at single nucleotide resolution and discover how HyenaDNA overcomes limitations of previous Transformer-based models. Learn about the innovative use of implicit convolutions to achieve context lengths of up to 1 million tokens, enabling more effective modeling of long-range interactions in DNA. Understand the model's sub-quadratic scaling, single nucleotide tokenization, and full global context capabilities. Examine the potential applications of in-context learning in genomics and review HyenaDNA's state-of-the-art performance on various benchmarks. The presentation covers motivation, background, model design, experimental results, and includes an extensive Q&A session, providing a thorough understanding of this cutting-edge approach to genomic sequence modeling.

Syllabus

- Intro
- Motivation
- Background
- Designing Hyena
- Experiments
- Q+A


Taught by

Valence Labs

Related Courses

Soil Structure Interaction
Indian Institute of Technology, Kharagpur via Swayam
Fundamentals of Machine Learning for Healthcare
Stanford University via Coursera
Artificial Intelligence Foundations: Thinking Machines
LinkedIn Learning
Could a Purely Self-Supervised Foundation Model Achieve Grounded Language Understanding?
Santa Fe Institute via YouTube
Foundation Models - FSDL 2022
The Full Stack via YouTube