Crossmodal Modulation as a Basis for Visual Enhancement of Auditory Performance
The human sensory system processes many modalities simultaneously. It was believed that each modality would be processed individually first, and their combination deferred to higher-level cortical areas. Recent neurophysiological investigations indicate interconnections between early visual and audi...
Main Author: | |
---|---|
Other Authors: | |
Language: | en_ca |
Published: |
2009
|
Subjects: | |
Online Access: | http://hdl.handle.net/1807/18831 |
id |
ndltd-TORONTO-oai-tspace.library.utoronto.ca-1807-18831 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-TORONTO-oai-tspace.library.utoronto.ca-1807-188312013-04-19T19:59:53ZCrossmodal Modulation as a Basis for Visual Enhancement of Auditory PerformanceQian, Chengcrossmodalaudio-visualmultisensoryauditory detectionvisual enhancementsensory modelling054103170544The human sensory system processes many modalities simultaneously. It was believed that each modality would be processed individually first, and their combination deferred to higher-level cortical areas. Recent neurophysiological investigations indicate interconnections between early visual and auditory cortices, areas putatively considered unimodal, but the function remains unclear. The present work explores how this cross-modality might contribute to a visual enhancement of auditory performance, using a combined theoretical and experimental approach. The enhancement of sensory performance was studied through a signal detection framework. A model was constructed using principles from signal detection theory and neurophysiology, demonstrating enhancements of roughly 1.8dB both analytically and through simulation. Several experiments were conducted to observe e ects of visual cues on a 2-alternative-forced-choice detection task of an auditory tone in noise. Results of the main experiment showed an enhancement of 1.6dB. Better enhancement also tended to occur for more realistic relationships between audio to visual stimuli.Wong, Willy2009-112010-02-15T14:40:27ZNO_RESTRICTION2010-02-15T14:40:27Z2010-02-15T14:40:27ZThesishttp://hdl.handle.net/1807/18831en_ca |
collection |
NDLTD |
language |
en_ca |
sources |
NDLTD |
topic |
crossmodal audio-visual multisensory auditory detection visual enhancement sensory modelling 0541 0317 0544 |
spellingShingle |
crossmodal audio-visual multisensory auditory detection visual enhancement sensory modelling 0541 0317 0544 Qian, Cheng Crossmodal Modulation as a Basis for Visual Enhancement of Auditory Performance |
description |
The human sensory system processes many modalities simultaneously. It was believed that each modality would be processed individually first, and their combination deferred to higher-level cortical areas. Recent neurophysiological investigations indicate interconnections between early visual and auditory cortices, areas putatively considered unimodal, but the function remains unclear. The present work explores how this cross-modality might contribute to a visual enhancement of auditory performance, using a combined theoretical and experimental approach. The enhancement of sensory performance was studied through a signal detection framework. A model was constructed using principles from signal detection theory and neurophysiology, demonstrating enhancements of roughly 1.8dB both analytically and through simulation. Several experiments were conducted to observe e ects of visual cues on a 2-alternative-forced-choice detection task of an auditory tone in noise. Results of the main experiment showed an enhancement of 1.6dB. Better enhancement also tended to occur for more realistic relationships between audio to visual stimuli. |
author2 |
Wong, Willy |
author_facet |
Wong, Willy Qian, Cheng |
author |
Qian, Cheng |
author_sort |
Qian, Cheng |
title |
Crossmodal Modulation as a Basis for Visual Enhancement of Auditory Performance |
title_short |
Crossmodal Modulation as a Basis for Visual Enhancement of Auditory Performance |
title_full |
Crossmodal Modulation as a Basis for Visual Enhancement of Auditory Performance |
title_fullStr |
Crossmodal Modulation as a Basis for Visual Enhancement of Auditory Performance |
title_full_unstemmed |
Crossmodal Modulation as a Basis for Visual Enhancement of Auditory Performance |
title_sort |
crossmodal modulation as a basis for visual enhancement of auditory performance |
publishDate |
2009 |
url |
http://hdl.handle.net/1807/18831 |
work_keys_str_mv |
AT qiancheng crossmodalmodulationasabasisforvisualenhancementofauditoryperformance |
_version_ |
1716581989367152640 |