Introduction to Large Language Models

Learn about large language models—what they are, what they can do, and how they work.

Introduction

• The impact and functionality of large language models

1. Transformers in NLP

• What are large language models?
• How are large language models trained? Pre-training
• Making large language models follow instructions

2. Large Language Model Components

• Transformer architecture
• What are parameters
• What are tokens?
• What are context lengths?

3. Large Language Models

• BERT
• Scaling laws
• GPT-3
• Chinchilla
• PaLM and PaLM 2
• ChatGPT and GPT-4
• Open LLMs
• Comparing large language models

Conclusion

• Going further with large language models