Robotics - Gaze Mechanisms for Situated Interaction with Embodied Agents

Explore gaze mechanisms for situated interaction with embodied agents in this comprehensive lecture by Sean Andrist. Delve into the importance of social gaze in nonverbal communication for virtual agents and physical robots. Learn about various projects designed to test gaze behavior models in different contexts, including targeted gaze shifts, effective use of gaze aversions, gaze coordination during physical tasks, and personality-adaptive gaze behaviors for rehabilitation. Discover current research directions in situated interaction with robots at Microsoft Research. Gain insights into the methodology, implementation, and results of studies on gaze aversion timing, direction, and interactive gaze heuristics. Understand the applications of these concepts in virtual reality and human-robot interaction.

Intro
Embodied agents
Social robots and agents
Human-robot interaction
Research question
Outline
Methodology
Gaze aversion timing
Gaze aversion direction
Building (virtual agents)
Building (social robots)
Reference-action sequence
Gaze sequences
Gaze alignment
Gaze triggers
Interactive gaze heuristics
Results (subjective)
Applications in virtual reality
Understanding
Task breakdown
Average fixation length (s)
Implementation
Study Design
Thank You! Questions?