The Modulatory Effect of Exogenous Orienting on Audiovisual Emotional Integration: An ERP Study

Background: In this study, we explored the interplay between exogenous orienting attention and emotional audiovisual integration (AVI) via electroencephalography (EEG). Methods: We designed a 2 (cue validity: va...

Full description

Bibliographic Details
Published in:Journal of Integrative Neuroscience
Main Authors: Shengnan Li, Yueying Li, Ruizhi Li, Yan Li, Jinglong Wu, Weiping Yang, Zhilin Zhang
Format: Article
Language:English
Published: IMR Press 2024-11-01
Subjects:
Online Access:https://www.imrpress.com/journal/JIN/23/11/10.31083/j.jin2311210
_version_ 1849886317069991936
author Shengnan Li
Yueying Li
Ruizhi Li
Yan Li
Jinglong Wu
Weiping Yang
Zhilin Zhang
author_facet Shengnan Li
Yueying Li
Ruizhi Li
Yan Li
Jinglong Wu
Weiping Yang
Zhilin Zhang
author_sort Shengnan Li
collection DOAJ
container_title Journal of Integrative Neuroscience
description Background: In this study, we explored the interplay between exogenous orienting attention and emotional audiovisual integration (AVI) via electroencephalography (EEG). Methods: We designed a 2 (cue validity: valid, invalid) × 3 (emotion types: happiness, neutral and sadness) × 3 (modality: visual, auditory, audiovisual) discrimination task on the basis of the cue–target paradigm. Twenty-two participants (average age: 21.71 ± 1.84 years; 13 females, 9 males) were enrolled in this experiment. Participants were asked to respond to three emotional stimuli presented in different modalities by pressing a corresponding key. Results: The results indicated faster responses to multisensory stimuli than to unisensory stimuli and to the valid cue condition than to the invalid cue condition, which indicated multisensory advantage and cueing effect occurred. In addition, happiness stimuli induced the fastest response compared with neutral and sadness emotion stimuli. EEG findings indicated a reduction in audiovisual integration induced by valid exogenous orienting in the frontal, central and parietal lobe regions. Moreover, neutral emotional stimuli elicited greater audiovisual integration than stimuli expressing happiness and sadness did. Conclusions: Overall, valid exogenous cues and emotional processing decreased audiovisual integration. The present study sheds light on how exogenous attention modulates emotional audiovisual integration and highlights the complex interactions among attention, sensory processing, and the emotional context in multisensory perception.
format Article
id doaj-art-2fd0b0fdaae246e796cbd701d48fb3f9
institution Directory of Open Access Journals
issn 0219-6352
language English
publishDate 2024-11-01
publisher IMR Press
record_format Article
spelling doaj-art-2fd0b0fdaae246e796cbd701d48fb3f92025-08-20T01:06:40ZengIMR PressJournal of Integrative Neuroscience0219-63522024-11-01231121010.31083/j.jin2311210S0219-6352(24)00831-3The Modulatory Effect of Exogenous Orienting on Audiovisual Emotional Integration: An ERP StudyShengnan Li0Yueying Li1Ruizhi Li2Yan Li3Jinglong Wu4Weiping Yang5Zhilin Zhang6Department of Psychology, Faculty of Education, Hubei University, 430062 Wuhan, Hubei, ChinaDepartment of Psychology, Faculty of Education, Hubei University, 430062 Wuhan, Hubei, ChinaDepartment of Psychology, Faculty of Education, Hubei University, 430062 Wuhan, Hubei, ChinaDepartment of Psychology, College of Humanities and Management, Guizhou University of Traditional Chinese Medicine, 550025 Guiyang, Guizhou, ChinaResearch Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, 518055 Shenzhen, Guangdong, ChinaDepartment of Psychology, Faculty of Education, Hubei University, 430062 Wuhan, Hubei, ChinaResearch Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, 518055 Shenzhen, Guangdong, ChinaBackground: In this study, we explored the interplay between exogenous orienting attention and emotional audiovisual integration (AVI) via electroencephalography (EEG). Methods: We designed a 2 (cue validity: valid, invalid) × 3 (emotion types: happiness, neutral and sadness) × 3 (modality: visual, auditory, audiovisual) discrimination task on the basis of the cue–target paradigm. Twenty-two participants (average age: 21.71 ± 1.84 years; 13 females, 9 males) were enrolled in this experiment. Participants were asked to respond to three emotional stimuli presented in different modalities by pressing a corresponding key. Results: The results indicated faster responses to multisensory stimuli than to unisensory stimuli and to the valid cue condition than to the invalid cue condition, which indicated multisensory advantage and cueing effect occurred. In addition, happiness stimuli induced the fastest response compared with neutral and sadness emotion stimuli. EEG findings indicated a reduction in audiovisual integration induced by valid exogenous orienting in the frontal, central and parietal lobe regions. Moreover, neutral emotional stimuli elicited greater audiovisual integration than stimuli expressing happiness and sadness did. Conclusions: Overall, valid exogenous cues and emotional processing decreased audiovisual integration. The present study sheds light on how exogenous attention modulates emotional audiovisual integration and highlights the complex interactions among attention, sensory processing, and the emotional context in multisensory perception.https://www.imrpress.com/journal/JIN/23/11/10.31083/j.jin2311210audiovisual integrationexogenous attentionemotioncue–target paradigmevent-related potential (erp)
spellingShingle Shengnan Li
Yueying Li
Ruizhi Li
Yan Li
Jinglong Wu
Weiping Yang
Zhilin Zhang
The Modulatory Effect of Exogenous Orienting on Audiovisual Emotional Integration: An ERP Study
audiovisual integration
exogenous attention
emotion
cue–target paradigm
event-related potential (erp)
title The Modulatory Effect of Exogenous Orienting on Audiovisual Emotional Integration: An ERP Study
title_full The Modulatory Effect of Exogenous Orienting on Audiovisual Emotional Integration: An ERP Study
title_fullStr The Modulatory Effect of Exogenous Orienting on Audiovisual Emotional Integration: An ERP Study
title_full_unstemmed The Modulatory Effect of Exogenous Orienting on Audiovisual Emotional Integration: An ERP Study
title_short The Modulatory Effect of Exogenous Orienting on Audiovisual Emotional Integration: An ERP Study
title_sort modulatory effect of exogenous orienting on audiovisual emotional integration an erp study
topic audiovisual integration
exogenous attention
emotion
cue–target paradigm
event-related potential (erp)
url https://www.imrpress.com/journal/JIN/23/11/10.31083/j.jin2311210
work_keys_str_mv AT shengnanli themodulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT yueyingli themodulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT ruizhili themodulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT yanli themodulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT jinglongwu themodulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT weipingyang themodulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT zhilinzhang themodulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT shengnanli modulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT yueyingli modulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT ruizhili modulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT yanli modulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT jinglongwu modulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT weipingyang modulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy
AT zhilinzhang modulatoryeffectofexogenousorientingonaudiovisualemotionalintegrationanerpstudy