CMU Advanced NLP: NLP Experimentation

Explore advanced Natural Language Processing concepts in this comprehensive lecture from CMU's CS 11-711 course. Delve into the scientific method, learn how to formulate research questions, conduct literature surveys, and develop hypotheses. Gain insights on designing and executing experiments, including data acquisition, annotation techniques, and performance evaluation. Discover the differences between application-driven and curiosity-driven research, and understand how to generate innovative ideas in the field of NLP. Enhance your understanding of experimental design, power analysis, and the importance of establishing robust annotation guidelines.

Intro
Scientific Method
Good Research Directions
Application Driven Research
Curiosity Driven Research
How do we get research ideas
Incremental
Research Survey
Google Scholar
Research
Form Hypothesis
Curiosity Driven Questions
Application Driven Questions
Research Questions
Running Experiments
Obtaining Test Data
Finding Datasets
Annotation
References
Power Analysis
Sample Data
Annotation Guidelines
Annotation Options
Human Performance