YoVDO

Attention Is All You Need

Offered By: Yannic Kilcher via YouTube

Tags

Attention Mechanisms Courses Neural Network Architecture Courses Positional Encoding Courses

Course Description

Overview

Explore a 27-minute video analyzing the groundbreaking paper "Attention Is All You Need" by Vaswani et al. Dive into the revolutionary Transformer architecture, which relies solely on attention mechanisms, eliminating the need for recurrent and convolutional neural networks. Learn how this innovative approach achieves superior performance in machine translation tasks while significantly reducing training time. Discover the key components of the Transformer, including positional encoding and the attention mechanism. Understand how this architecture generalizes well to other tasks, such as English constituency parsing. Gain insights into the paper's impact on the field of natural language processing and its potential applications in various domains.

Syllabus

Introduction
Traditional Language Processing
Attention
Longrange dependencies
Attention mechanism
Encoding
Positional Encoding
Tension
Top Right
Attention Computed
Conclusion


Taught by

Yannic Kilcher

Related Courses

الشبكات العصبية والتعلم العميق
DeepLearning.AI via Coursera
Machine Learning: Create a Neural Network that Predicts whether an Image is a Car or Airplane.
Coursera Project Network via Coursera
Neural Network Programming - Deep Learning with PyTorch
YouTube
Computer Vision with GluonCV (Traditional Chinese)
Amazon Web Services via AWS Skill Builder
Neuronales Netz von Scratch
Coursera Project Network via Coursera