GBV-Net: Hierarchical Fusion of Facial Expressions and Physiological Signals for Multimodal Emotion Recognition

A core challenge in multimodal emotion recognition lies in the precise capture of the inherent multimodal interactive nature of human emotions. Addressing the limitation of existing methods, which often process visual signals (facial expressions) and physiological signals (EEG, ECG, EOG, and GSR) in...

Full description

Bibliographic Details
Published in:	Sensors
Main Authors:	Jiling Yu, Yandong Ru, Bangjun Lei, Hongming Chen
Format:	Article
Language:	English
Published:	MDPI AG 2025-10-01
Subjects:	GBV-Net facial expressions physiological signals multimodal fusion emotion recognition
Online Access:	https://www.mdpi.com/1424-8220/25/20/6397

Similar Items

GBV data collection and sharing
by: Kristy Crabtree
Published: (2011-08-01)

GBV-C/HGV and HIV-1 coinfection
by: Maria Teresa Maidana, et al.

HIV-1 and GBV-C co-infection in Venezuela
by: Anny Karely Rodriguez, et al.
Published: (2014-07-01)

Hidden GBV: Women and substance use
by: Eilidh Moir, et al.
Published: (2022-08-01)

Detection of GBV-C/HGV RNA in cervico-vaginal smears from healthy individuals
by: Maria Angelica Ehara Watanabe, et al.
Published: (2008-10-01)

Evaluation of GBV-C / HVG viremia in HIV-infected women
by: Synara Araújo Silva, et al.
Published: (2012-02-01)

Undocumented Latina GBV Survivors: Using Social Capital as a Form of Resistance
by: Carolyn Stauffer
Published: (2021-11-01)

Long-term persistent GBV-B infection and development of a chronic and progressive hepatitis C-like disease in marmosets
by: Yuki eIwasaki, et al.
Published: (2011-12-01)

HEV, TTV and GBV-C/HGV markers in patients with acute viral hepatitis
by: A.C. Lyra, et al.
Published: (2005-05-01)

Gender based violence (GBV) coordination in a complex, multi-crisis context: a qualitative case study of Lebanon’s compounded crises (2019–2023)
by: Philomena Raftery, et al.
Published: (2023-10-01)

Tracing individual experiences to systemic challenges: the (re)production of GBV in migrant women’s experiences in Canada
by: Busra Yalcinoz-Ucan, et al.
Published: (2025-03-01)

Government responses to COVID-19 and impact on GBV services and programmes: comparative analysis of the situation in South Africa, Kenya, Uganda, and Nigeria
by: Neetu A. John, et al.
Published: (2023-12-01)

Triple Nexus: leveraging development supply chains for humanitarian aid and peace in Southeast Asia – a GBV focus
by: Christina Plesner Volkdal
Published: (2025-07-01)

Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG
by: Jiahui Pan, et al.
Published: (2024-01-01)

Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis
by: Leire Bastida, et al.
Published: (2024-06-01)

Multimodal Emotion Detection via Attention-Based Fusion of Extracted Facial and Speech Features
by: Dilnoza Mamieva, et al.
Published: (2023-06-01)

MLS-Net: An Automatic Sleep Stage Classifier Utilizing Multimodal Physiological Signals in Mice
by: Chengyong Jiang, et al.
Published: (2024-08-01)

Multimodal Emotion Recognition From EEG Signals and Facial Expressions
by: Shuai Wang, et al.
Published: (2023-01-01)

Multimodal and Multiscale Facial Expression Recognition Analysis for Learning Emotions
by: JI Lixia, et al.
Published: (2026-05-01)

Facial expression recognition via ResNet-50
by: Bin Li, et al.
Published: (2021-06-01)

Hyper-Dense_Lung_Seg: Multimodal-Fusion-Based Modified U-Net for Lung Tumour Segmentation Using Multimodality of CT-PET Scans
by: Goram Mufarah Alshmrani, et al.
Published: (2023-11-01)

Gender-Based Violence (GBV) in South Africa: An Interdisciplinary Discourse Analysis of One Selected isiZulu and One Selected isiXhosa Literary Text
by: Mlamli Diko
Published: (2023-07-01)

Facial Gestures in Social Interaction
by: Alexandra Groß, et al.
Published: (2024-02-01)

A Transformer-Based Multimodal Fusion Network for Emotion Recognition Using EEG and Facial Expressions in Hearing-Impaired Subjects
by: Shuni Feng, et al.
Published: (2025-10-01)

Educating a woman is a way towards gender-based violence among women in Tanzania: A case of Kawe Ward in Kinondoni Municipal Council
by: Rose Mbwete, et al.
Published: (2025-03-01)

Facial Signals and Social Actions in Multimodal Face-to-Face Interaction
by: Naomi Nota, et al.
Published: (2021-07-01)

Multimodal imaging fusion technology-assisted resection of facial nerve schwannoma via trans-temporal middle-cranial-fossa approach
by: Kan Wang, et al.
Published: (2025-07-01)

Gaussian membership-self-attention encoder fusion network (GMSAEF-Net) for the multimodal biometric recognition
by: V. Gurunathan, et al.
Published: (2025-12-01)

IFF-Net: Irregular Feature Fusion Network for Multimodal Remote Sensing Image Classification
by: Huiqing Wang, et al.
Published: (2024-06-01)

FacialNet: facial emotion recognition for mental health analysis using UNet segmentation with transfer learning model
by: In-seop Na, et al.
Published: (2024-12-01)

MFSleepNet: An Interactive Multimodal Fusion Framework for Automatic Sleep Staging
by: Ranran Gui, et al.
Published: (2026-05-01)

Efficient Net-XGBoost: An Implementation for Facial Emotion Recognition Using Transfer Learning
by: Sudheer Babu Punuri, et al.
Published: (2023-02-01)

GENDER BASED VIOLENCE IN KWARA STATE, NIGERIA: A QUALITATIVE ANALYSIS
by: Olushola Idris-Iyekolo, et al.
Published: (2025-09-01)

Prevalence of GB virus C/hepatitis G virus infection in pediatric patients receiving multiple transfusions in Southern Turkey
by: Emine Kocabaş, et al.
Published: (1999-01-01)

Tackling Gender-Based Violence
by: لووُ کاسا
Published: (2024-09-01)

Evidence generation for sustained impact in the response to gender-based violence: lessons from the SRHR Africa Trust Zimbabwe
by: Raymond Mazhambe, et al.
Published: (2023-09-01)

EmoRecog-Net: A Multimodal Framework for Emotion Recognition From fMRI and Physiological Signals
by: Hsiang-Chin Chien, et al.
Published: (2026-01-01)

Attach-SwiNet: Multimodal Attachment Style Classification Model Based on Non-Verbal Signals
by: Tusty Nadia Maghfira, et al.
Published: (2024-01-01)

Affect Recognition in Immersive Room-Scale Environments: A Large-Scale VR Study With Custom Facial Sensing at the Science Museum in London
by: Ifigeneia Mavridou, et al.
Published: (2025-01-01)

MGRF-Net: Situation Awareness Prediction for Remote Tower Controllers Based on Multimodal Physiological Data
by: Qinghai Zuo, et al.
Published: (2026-05-01)