A Transformer-Based Multimodal Fusion Network for Emotion Recognition Using EEG and Facial Expressions in Hearing-Impaired Subjects

Hearing-impaired people face challenges in expressing and perceiving emotions, and traditional single-modal emotion recognition methods demonstrate limited effectiveness in complex environments. To enhance recognition performance, this paper proposes a multimodal fusion neural network based on a mul...

Full description

Bibliographic Details

Published in:	Sensors
Main Authors:	Shuni Feng, Qingzhou Wu, Kailin Zhang, Yu Song
Format:	Article
Language:	English
Published:	MDPI AG 2025-10-01
Subjects:	emotion recognition electroencephalogram (EEG) facial expression multimodal fusion multi-head attention mechanism
Online Access:	https://www.mdpi.com/1424-8220/25/20/6278