YoVDO

Modularity, Attention and Credit Assignment Computations - Anirudh Goyal

Offered By: Institute for Advanced Study via YouTube

Tags

Computational Models Courses Artificial Intelligence Courses Cognitive Sciences Courses Attention Mechanisms Courses

Course Description

Overview

Explore the concepts of modularity, attention, and credit assignment in computational systems through this lecture by Anirudh Goyal from the Institute for Advanced Study. Delve into topics such as the Stroop Effect, complex generalization, independent mechanisms, and decomposition of knowledge. Examine variant representations, type argument functions, and selective activation of frames. Investigate the role of attention, indirection, and belief in computational models. Learn about independent representations and partial word models through illustrative examples and audience questions. Gain insights into the architecture of complex systems and their applications in cognitive science and artificial intelligence.

Syllabus

Introduction
Stroop Effect
Complex generalization
Data generating distribution
Independent mechanisms
Decomposition of knowledge
Example
Variant Representation
Desertrata
By Example
Audience Question
Type Argument Functions
Attention
Indirection
Assignment
Summary
Two tasks
Architecture
Selective activation of frames
Communication sharing
An illustrative example
Why such a model
Belief and Attention
Distractions
Independent representations
Partial word models
References


Taught by

Institute for Advanced Study

Related Courses

Deep Learning for Natural Language Processing
University of Oxford via Independent
Sequence Models
DeepLearning.AI via Coursera
Deep Learning Part 1 (IITM)
Indian Institute of Technology Madras via Swayam
Deep Learning - Part 1
Indian Institute of Technology, Ropar via Swayam
Deep Learning - IIT Ropar
Indian Institute of Technology, Ropar via Swayam