The Complete Guide to Transformer Neural Networks
Offered By: CodeEmporium via YouTube
Course Description
Overview
Dive deep into the Transformer Neural Network Architecture for language translation in this comprehensive 28-minute video. Explore key concepts including batch data processing, fixed-length sequences, embeddings, positional encodings, query/key/value vectors, masked multi-head self-attention, residual connections, layer normalization, decoder architecture, cross-attention mechanisms, tokenization, and word generation. Gain practical insights through a Transformer inference example and access additional resources for further learning on neural networks, machine learning, and related mathematical concepts.
Syllabus
Introduction
Transformer at a high level
Why Batch Data? Why Fixed Length Sequence?
Embeddings
Positional Encodings
Query, Key and Value vectors
Masked Multi Head Self Attention
Residual Connections
Layer Normalization
Decoder
Masked Multi Head Cross Attention
Tokenization & Generating the next translated word
Transformer Inference Example
Taught by
CodeEmporium
Related Courses
TensorFlow on Google CloudGoogle Cloud via Coursera Art and Science of Machine Learning 日本語版
Google Cloud via Coursera Art and Science of Machine Learning auf Deutsch
Google Cloud via Coursera Art and Science of Machine Learning em Português Brasileiro
Google Cloud via Coursera Art and Science of Machine Learning en Español
Google Cloud via Coursera