An Introduction to Natural Language Generation

Explore the fundamentals of Natural Language Generation (NLG) in this 49-minute conference talk from MLCon. Dive into various NLG applications, including weather reports, finance, summarization, language modeling, translation, and chatbots. Learn about deep learning-based NLG techniques, word embeddings, and the BERT structure. Understand the GPT architecture, its training process, and how to generate text using GPT models. Examine the pros of deep learning in NLG and discover ways to combine rule-based and deep learning approaches for effective natural language generation.

Intro
NLG EXAMPLES: WEATHER REPORTS
NLG EXAMPLES: FINANCE
NLG EXAMPLES: SUMMARIZATION
NLG EXAMPLES: LANGUAGE MODELLIN
NLG EXAMPLES: TRANSLATION
NLG EXAMPLES: CHATBOTS
DEEP LEARNING BASED NLG
EXPRESSING WORDS AS TENSORS
WORD (TOKEN) EMBEDDINGS
LEARNING EMBEDDINGS
BERT STRUCTURE - TRANSFORMER BLOCK
LANGUAGE MODELLING WITH TRANSFORMERS
GPT ARCHITECTURE & TRAINING
WHAT IS THE DIFFERENCE
HOW TO CREATE TEXT WITH GPT?
NLG WITH DEEP LEARNING: PROS
COMBINING RULES AND DL