YoVDO

Toward Length Extrapolatable Transformers

Offered By: Center for Language & Speech Processing(CLSP), JHU via YouTube

Tags

Transformers Courses Machine Learning Courses Neural Networks Courses Computational Linguistics Courses Attention Mechanisms Courses Language Models Courses Sequence Modeling Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore cutting-edge research on length extrapolation in Transformer models in this hour-long lecture by Ta-Chung Chi from Carnegie Mellon University. Delve into innovative approaches for improving the ability of Transformer architectures to handle sequences of varying lengths, a crucial challenge in natural language processing and machine learning. Gain insights into the latest techniques and methodologies aimed at enhancing the scalability and adaptability of these powerful models across different input sizes.

Syllabus

Toward Length Extrapolatable Transformers -- Ta-Chung Chi (CMU)


Taught by

Center for Language & Speech Processing(CLSP), JHU

Related Courses

Deep Learning for Natural Language Processing
University of Oxford via Independent Sequence Models
DeepLearning.AI via Coursera Deep Learning Part 1 (IITM)
Indian Institute of Technology Madras via Swayam Deep Learning - Part 1
Indian Institute of Technology, Ropar via Swayam Deep Learning - IIT Ropar
Indian Institute of Technology, Ropar via Swayam