The Complete Guide to Transformer Neural Networks

Dive deep into the Transformer Neural Network Architecture for language translation in this comprehensive 28-minute video. Explore key concepts including batch data processing, fixed-length sequences, embeddings, positional encodings, query/key/value vectors, masked multi-head self-attention, residual connections, layer normalization, decoder architecture, cross-attention mechanisms, tokenization, and word generation. Gain practical insights through a Transformer inference example and access additional resources for further learning on neural networks, machine learning, and related mathematical concepts.

Introduction
Transformer at a high level
Why Batch Data? Why Fixed Length Sequence?
Embeddings
Positional Encodings
Query, Key and Value vectors
Masked Multi Head Self Attention
Residual Connections
Layer Normalization
Decoder
Masked Multi Head Cross Attention

Tokenization & Generating the next translated word
Transformer Inference Example