TensorFlow: Working with NLP

Learn about using transformers in natural language processing with TensorFlow.

Introduction

• Why TensorFlow?
• What you should know
• What is TensorFlow?

1. NLP and Transformers

• What is NLP?
• Transformers, their use, and history
• Transformers for NLP
• Challenge: NLP model size
• Solution: NLP model size

2. BERT and Transfer Learning

• Bias in BERT and GPT
• How was BERT trained?
• Transfer learning

3. Transformers and BERT

• Transformer: Architecture overview
• BERT model and tokenization
• Tokenizers
• Self-attention
• Multi-head attention and feedforward network
• Fine-tuning BERT

Conclusion

• Next steps