YoVDO

Neural Nets for NLP 2018 - Learning from-for Knowledge Graphs

Offered By: Graham Neubig via YouTube

Tags

Neural Networks Courses Natural Language Processing (NLP) Courses Knowledge Graphs Courses Tensor Decomposition Courses

Course Description

Overview

Explore the intricacies of knowledge graphs and their applications in natural language processing in this 52-minute lecture from CMU's Neural Nets for NLP 2018 series. Delve into topics such as knowledge bases, structured databases, and WordNet. Examine the challenges of knowledge base incompleteness and learn about various relation extraction techniques, including Neural Tensor Networks and Hyperplane Translation. Discover the Decomposable Relation Model and methods for modeling distant supervision noise in neural models. Compare approaches for modeling word embeddings versus modeling relations, and investigate tensor decomposition. Conclude with an exploration of retrofitting embeddings to existing lexicons, gaining valuable insights into the intersection of knowledge representation and neural network technologies.

Syllabus

Knowledge Bases . Structured databases of knowledge usually containing
WordNet (Miller 1995)
Knowledge Base Incompleteness
Relation Extraction w/ Neural Tensor Networks (Socher et al. 2013)
Relation Extraction w/ Hyperplane Translation (Wang et al. 2014) • Motivation it is not realistic to assume that al dimensions are relevant to a particular relation • Solution project the word vectors on a hyperplane specifically for that relation, then verily relation
Decomposable Relation Model (Xie et al. 2017)
Modeling Distant Supervision Noise in Neural Models (Luo et al. 2017)
Modeling Word Embeddings vs. Modeling Relations
Tensor Decomposition (Sutskever et al. 2009)
Retrofitting of Embeddings to Existing Lexicons (Faruqui et al. 2015)


Taught by

Graham Neubig

Related Courses

Natural Language Processing
Columbia University via Coursera
Natural Language Processing
Stanford University via Coursera
Introduction to Natural Language Processing
University of Michigan via Coursera
moocTLH: Nuevos retos en las tecnologías del lenguaje humano
Universidad de Alicante via Miríadax
Natural Language Processing
Indian Institute of Technology, Kharagpur via Swayam