YoVDO

Language Generation in the Limit - Transformers as a Computational Model

Offered By: Simons Institute via YouTube

Tags

Computational Models Courses Language Learning Courses Machine Learning Courses Theoretical Computer Science Courses Formal Languages Courses Transformers Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore language generation fundamentals in this 52-minute lecture by Jon Kleinberg from Cornell University. Delve into the core specifications of language generation problems, examining how to produce valid new strings from an unknown language using only finite training samples. Investigate models where an adversary enumerates strings from an unknown target language, and discover the non-trivial guarantees possible in this setting. Compare these findings with Gold and Angluin's negative results in language learning, highlighting the fundamental differences between language identification and generation. Gain insights into Transformers as a computational model and the implications for current large language models.

Syllabus

Language Generation in the Limit


Taught by

Simons Institute

Related Courses

Science, Technology, and Society in China I: Basic Concepts
The Hong Kong University of Science and Technology via Coursera
Spanish Basics
Independent
Improving Your Spanish Pronunciation
Canvas Network
Alemán para hispanohablantes: nociones fundamentales
Miríadax
Empieza con el inglés: aprende las mil palabras más usadas y sus posibilidades comunicativas
Miríadax