CMU Advanced NLP: Prompting + Sequence-to-Sequence Pre-Training

Explore advanced natural language processing techniques in this comprehensive lecture from CMU's CS 11-711 course. Delve into prompting methods, sequence-to-sequence pre-training, and prompt engineering. Learn about answer engineering, multi-prompt learning, and prompt-aware training methods. Discover the intricacies of feature, architecture, and objective engineering. Examine various prompting techniques, including prompt templates, mining, and paraphrasing. Gain insights into pretraining model choices and methods, as well as autoprompt and prefix prompt tuning. Enhance your understanding of cutting-edge NLP concepts and their practical applications in this in-depth, 77-minute presentation by Graham Neubig.

Introduction
Feature Engineering
Architecture Engineering
Objective Engineering
Prompt Engineering
Prompt Addition
Answer Prediction
Prompts
Prompt vs Objective Engineering
Pretraining Model Choice
Pretraining Methods
Pretraining Examples
Prompting Methods
Prompt Templates
Prompt Mining
Prompt Paraphrase
Autoprompt
Prefix Prompt Tuning
Answer Engineering