Hello Deep Learning

Explore the fundamentals of deep learning and generative AI in this 44-minute conference talk from GOTO Amsterdam 2023. Dive into a "Hello Deep Learning" project that builds an OCR solution for handwritten letters from scratch. Learn about attention mechanisms, loss functions, neural network layers, auto-gradient, and gradient descent with momentum. Gain insights into the fascinating basics of machine learning that many deep learning users overlook. Discover practical tips and rules for implementing AI models, and leave with a solid foundation to navigate the rapidly evolving world of artificial intelligence.

Intro
Deep learning from scratch
Hello deep learning project
Attention is all you need
Weirdly impressive
That can't possibly work
This really is magic
The loss function
Layers
Auto-gradient
Gradient descent with momentum
Percentage of digits classified correctly
The rules
Parting thoughts
Useful links
Outro