Generative AI: Working with Large Language Models

Explore a user-friendly approach to working with transformers and large language models for natural language processing.

Introduction

• Learning about Large Language Models

1. Transformers in NLP

• What are large language models?
• Transformers in production
• Transformers: History

2. Training Transformers and Their Architecture

• Transfer learning
• Transformer: Architecture overview
• Self-attention
• Multi-head attention and Feed Forward Network

3. Large Language Models

• GPT-3
• GPT-3 use cases
• Challenges and shortcomings of GPT-3
• GLaM
• Megatron-Turing NLG Model
• Gopher
• Scaling laws
• Chinchilla
• BIG-bench
• PaLM
• OPT and BLOOM

Conclusion

• Going further with Transformers