Transformers: Text Classification for NLP Using BERT

Offered By: LinkedIn Learning

Tags

BERT Courses Machine Learning Courses Deep Learning Courses Transfer Learning Courses Transformers Courses Text Classification Courses Transformer Architecture Courses Self-Attention Courses

Course Description

Overview

Learn about transformers, the go-to architecture for NLP and computer vision tasks.

Syllabus

Introduction

Natural language processing with transformers
How to use the exercise files

1. NLP and Transformers

How transformers are used in NLP
Transformers in production
Transformers history
Challenge: BERT model sizes
Solution: BERT model sizes

2. BERT and Transfer Learning

Bias in BERT
How was BERT trained?
Transfer learning

3. Transformer Architecture and BERT

Transformer: Architecture overview
BERT model and tokenization
Positional encodings and segment embeddings
Tokenizers
Self-attention
Multi-head attention and feedforward network

4. Text Classification

BERT and text classification
The Datasets library
Overview of IMDb dataset
Using a tokenizer
Tiny IMDb
A training run

Conclusion

Additional training runs

Taught by

Jonathan Fernandes

Related Courses

Neural Networks for Machine Learning
University of Toronto via Coursera 機器學習技法 (Machine Learning Techniques)
National Taiwan University via Coursera Machine Learning Capstone: An Intelligent Application with Deep Learning
University of Washington via Coursera Прикладные задачи анализа данных
Moscow Institute of Physics and Technology via Coursera Leading Ambitious Teaching and Learning
Microsoft via edX