YoVDO

Training BERT - Train With Masked-Language Modeling

Offered By: James Briggs via YouTube

Tags

BERT Courses Machine Learning Courses PyTorch Courses Data Masking Courses

Course Description

Overview

Learn how to fine-tune BERT models using Masked Language Modeling (MLM) in PyTorch. Explore the process of further training BERT for domain-specific language understanding, moving beyond its general-purpose capabilities. Dive into the practical implementation of MLM training, including setup, data masking, creating custom datasets, and the training process itself. Gain insights into adapting BERT for specialized language tasks and improving its performance in specific domains through hands-on examples and code demonstrations.

Syllabus

Intro
Setup
Masking
Data Loader
Dataset Object
Training


Taught by

James Briggs

Related Courses

Sentiment Analysis with Deep Learning using BERT
Coursera Project Network via Coursera Natural Language Processing with Attention Models
DeepLearning.AI via Coursera Fine Tune BERT for Text Classification with TensorFlow
Coursera Project Network via Coursera Deploy a BERT question answering bot on Django
Coursera Project Network via Coursera Generating discrete sequences: language and music
Ural Federal University via edX