YoVDO

Neural Nets for NLP 2021 - Structured Prediction with Local Independence Assumptions

Offered By: Graham Neubig via YouTube

Tags

Neural Networks Courses Natural Language Processing (NLP) Courses Dynamic programming Courses Sequence Labeling Courses

Course Description

Overview

Explore structured prediction with local independence assumptions in this lecture from CMU's Neural Networks for NLP course. Delve into the fundamentals of structured prediction, understand the importance of local independence assumptions, and learn about Conditional Random Fields (CRFs). Discover how to model interactions in output for consistency, examine sequence labeling with recurrent decoders, and understand the concepts of teacher forcing and exposure bias. Investigate models with local dependencies, comparing local and global normalization. Gain insights into BILSTM-CRF for sequence labeling, CRF training and decoding, and the intricacies of forward calculation. Examine the partition function, training details, and generalized dynamic programming models, including decomposition structures and featurization techniques.

Syllabus

CS11-747 Neural Networks for NLP
A Prediction Problem
Types of Prediction
Why Call it "Structured" Prediction?
Many Varieties of Structured Prediction!
Why Model Interactions in Output? . Consistency is important! time flies like an arrow
Sequence Labeling w
Recurrent Decoder
Teacher Forcing and Exposure Bias
An Example of Exposure Bias
Models w/ Local Dependencies
Local Normalization vs. Global Normalization
Conditional Random Fields
Potential Functions
BILSTM-CRF for Sequence Labeling
CRF Training & Decoding
Forward Calculation Middle Parts
Forward Calculation: Final Part • Finish up the sentence with the sentence final symbol
Revisiting the Partition Function
Training Details
Generalized Dynamic Programming Models • Decomposition Structure: What structure to use, and thus also what dynamic programming to perform? . Featurization: How do we calculate local scores?


Taught by

Graham Neubig

Related Courses

Building a unique NLP project: 1984 book vs 1984 album
Coursera Project Network via Coursera
Exam Prep AI-102: Microsoft Azure AI Engineer Associate
Whizlabs via Coursera
Amazon Echo Reviews Sentiment Analysis Using NLP
Coursera Project Network via Coursera
Amazon Translate: Translate documents with batch translation
Coursera Project Network via Coursera
Analyze Text Data with Yellowbrick
Coursera Project Network via Coursera