Towards Multimodal Affective Feedback - Interaction between Visual and Haptic Modalities

Explore the interaction between visual and haptic modalities in multimodal affective feedback through this 22-minute conference talk from the CHI '15 ACM Conference on Human Factors in Computing Systems. Delve into the construction of an affective haptic dataset and the use of emotional visual stimuli from the International Affective Picture System (IAPS). Examine how participants rated visual, haptic, and visual-haptic stimuli, and analyze the results showing the impact of haptic stimulus on visual arousal. Investigate the interaction in terms of intensity, frequency, waveform, and rhythm of haptic stimuli. Gain insights into visual-haptic interaction guidelines for designing multimodal affective feedback, covering topics such as multi-sensory integration, valence and arousal, and the validity of IAPS with Indian participants.

Introduction
Research Question
Multi-sensory Integration is complex
Multimodal Feedback
Multimodal Affective Feedback
How do we integrate multimodal affective information?
Approach
Background: Valence and Arousal
Affective visual dataset
Validity of IAPS with Indian Participants
Haptic Dataset
Affective Haptic Ratings
Valence - Supporting
Valence - Conflicting
Arousal - Conflicting
Summary
Experiment
Frequency
Waveform & Rhythm
Guidelines