YoVDO

The Complete Guide to Transformer Neural Networks

Offered By: CodeEmporium via YouTube

Tags

Neural Networks Courses Embeddings Courses Positional Encoding Courses

Course Description

Overview

Dive deep into the Transformer Neural Network Architecture for language translation in this comprehensive 28-minute video. Explore key concepts including batch data processing, fixed-length sequences, embeddings, positional encodings, query/key/value vectors, masked multi-head self-attention, residual connections, layer normalization, decoder architecture, cross-attention mechanisms, tokenization, and word generation. Gain practical insights through a Transformer inference example and access additional resources for further learning on neural networks, machine learning, and related mathematical concepts.

Syllabus

Introduction
Transformer at a high level
Why Batch Data? Why Fixed Length Sequence?
Embeddings
Positional Encodings
Query, Key and Value vectors
Masked Multi Head Self Attention
Residual Connections
Layer Normalization
Decoder
Masked Multi Head Cross Attention

Tokenization & Generating the next translated word
Transformer Inference Example


Taught by

CodeEmporium

Related Courses

TensorFlow on Google Cloud
Google Cloud via Coursera
Art and Science of Machine Learning 日本語版
Google Cloud via Coursera
Art and Science of Machine Learning auf Deutsch
Google Cloud via Coursera
Art and Science of Machine Learning em Português Brasileiro
Google Cloud via Coursera
Art and Science of Machine Learning en Español
Google Cloud via Coursera