Semantic-Based Crossmodal Processing During Visual Suppression

• Main Authors: Dustin eCox, Sang Wook eHong
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2015-06-01
• Series: Frontiers in Psychology
• Subjects: Visual awareness; multisensory integration; semantic priming; Semantic Processing; Continuous Flash Suppression (CFS)
• Online Access: http://journal.frontiersin.org/Journal/10.3389/fpsyg.2015.00722/full

To reveal the mechanisms underpinning the influence of auditory input on visual awareness, we examine, 1) whether purely semantic-based multisensory integration facilitates the access to visual awareness for familiar visual events, and 2) whether crossmodal semantic priming is the mechanism responsible for the semantic auditory influence on visual awareness. Using continuous flash suppression (CFS), we rendered dynamic and familiar visual events (e.g., a video clip of an approaching train) inaccessible to visual awareness. We manipulated the semantic auditory context of the videos by concurrently pairing them with a semantically matching soundtrack (congruent audiovisual condition), a semantically non-matching soundtrack (incongruent audiovisual condition), or with no soundtrack (neutral video-only condition). We found that participants identified the suppressed visual events significantly faster (an earlier breakup of suppression) in the congruent audiovisual condition compared to the incongruent audiovisual condition and video-only condition. However, this facilitatory influence of semantic auditory input was only observed when audiovisual stimulation co-occurred. Our results suggest that the enhanced visual processing with a semantically congruent auditory input occurs due to audiovisual crossmodal processing rather than semantic priming, which may occur even when visual information is not available to visual awareness.