GSR-Fusion: A Deep Multimodal Fusion Architecture for Robust Sign Language Recognition Using RGB, Skeleton, and Graph-Based Modalities
Sign Language Recognition (SLR) plays a critical role in bridging communication gaps between the deaf and hearing communities. This research introduces GSR-Fusion, a deep multimodal fusion architecture that combines RGB-based, skeleton-based, and graph-based modalities to enhance gesture recognition...
| Published in: | IEEE Access |
|---|---|
| Main Authors: | Wuttichai Vijitkunsawat, Teeradaj Racharak |
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11045351/ |
Similar Items
A Comprehensive Benchmark and Evaluation of Thai Finger Spelling in Multi-Modal Deep Learning Models
by: Wuttichai Vijitkunsawat, et al.
Published: (2024-01-01)
by: Wuttichai Vijitkunsawat, et al.
Published: (2024-01-01)
UAlpha40: A comprehensive dataset of Urdu alphabet for Pakistan sign languageMendeley Data
by: Sameena Javaid, et al.
Published: (2025-04-01)
by: Sameena Javaid, et al.
Published: (2025-04-01)
SIGN CHARACTER OF THE EXPONENTS OF MODALITY IN A LEGAL TEXT
by: Maria Teresa LIZISOWA
Published: (2017-02-01)
by: Maria Teresa LIZISOWA
Published: (2017-02-01)
Single-Stage Extensive Semantic Fusion for multi-modal sarcasm detection
by: Hong Fang, et al.
Published: (2024-07-01)
by: Hong Fang, et al.
Published: (2024-07-01)
Gated Fusion Network With Progressive Modality Enhancement for Sentiment Analysis
by: Feng Xin, et al.
Published: (2024-01-01)
by: Feng Xin, et al.
Published: (2024-01-01)
Video anomaly detection via cross-modal fusion and hyperbolic graph attention mechanism
by: JIANG Di, et al.
Published: (2025-06-01)
by: JIANG Di, et al.
Published: (2025-06-01)
Integrating Vision Transformer-Based Bilinear Pooling and Attention Network Fusion of RGB and Skeleton Features for Human Action Recognition
by: Yaohui Sun, et al.
Published: (2023-07-01)
by: Yaohui Sun, et al.
Published: (2023-07-01)
CFANet: The Cross-Modal Fusion Attention Network for Indoor RGB-D Semantic Segmentation
by: Long-Fei Wu, et al.
Published: (2025-05-01)
by: Long-Fei Wu, et al.
Published: (2025-05-01)
Vehicle Detection Based on Adaptive Multimodal Feature Fusion and Cross-Modal Vehicle Index Using RGB-T Images
by: Yuanfeng Wu, et al.
Published: (2023-01-01)
by: Yuanfeng Wu, et al.
Published: (2023-01-01)
Gated Fusion Networks for Multi-Modal Violence Detection
by: Bilal Ahmad, et al.
Published: (2025-10-01)
by: Bilal Ahmad, et al.
Published: (2025-10-01)
CMBF: Cross-Modal-Based Fusion Recommendation Algorithm
by: Xi Chen, et al.
Published: (2021-08-01)
by: Xi Chen, et al.
Published: (2021-08-01)
Improving compound-protein interaction prediction by focusing on intra-modality and inter-modality dynamics with a multimodal tensor fusion strategy
by: Meng Wang, et al.
Published: (2024-12-01)
by: Meng Wang, et al.
Published: (2024-12-01)
Redefining Multimodality
by: Wendy Sandler
Published: (2022-05-01)
by: Wendy Sandler
Published: (2022-05-01)
Cross-Modal Feature Fusion for Field Weed Mapping Using RGB and Near-Infrared Imagery
by: Xijian Fan, et al.
Published: (2024-12-01)
by: Xijian Fan, et al.
Published: (2024-12-01)
Regulating Modality Utilization within Multimodal Fusion Networks
by: Saurav Singh, et al.
Published: (2024-09-01)
by: Saurav Singh, et al.
Published: (2024-09-01)
Dual-branch skeleton–RGB fusion for human action recognition with spatio-temporal attention
by: Xiaoping Lan, et al.
Published: (2025-10-01)
by: Xiaoping Lan, et al.
Published: (2025-10-01)
Multistage Training and Fusion Method for Imbalanced Multimodal UAV Remote Sensing Classification
by: Shihao Wang, et al.
Published: (2025-01-01)
by: Shihao Wang, et al.
Published: (2025-01-01)
Transformer-Based Multi-Modal Data Fusion Method for COPD Classification and Physiological and Biochemical Indicators Identification
by: Weidong Xie, et al.
Published: (2023-09-01)
by: Weidong Xie, et al.
Published: (2023-09-01)
A Cross-Modal Feature Fusion Model Based on ConvNeXt for RGB-D Semantic Segmentation
by: Xiaojiang Tang, et al.
Published: (2023-04-01)
by: Xiaojiang Tang, et al.
Published: (2023-04-01)
Acquisition of turn-taking in sign language conversations: An overview of language modality and turn structure
by: Laura Horton, et al.
Published: (2022-08-01)
by: Laura Horton, et al.
Published: (2022-08-01)
Multi-modal Fusion Method Based on Dual Encoders
by: HUANG Xiaofei, GUO Weibin
Published: (2024-09-01)
by: HUANG Xiaofei, GUO Weibin
Published: (2024-09-01)
Communication, Language, and Modality in the Education of Deaf Students
by: Connie C. Mayer, et al.
Published: (2023-10-01)
by: Connie C. Mayer, et al.
Published: (2023-10-01)
MLSFF: Multi-level structural features fusion for multi-modal knowledge graph completion
by: Hanming Zhai, et al.
Published: (2023-06-01)
by: Hanming Zhai, et al.
Published: (2023-06-01)
Iconicity in Signed and Spoken Vocabulary: A Comparison Between American Sign Language, British Sign Language, English, and Spanish
by: Marcus Perlman, et al.
Published: (2018-08-01)
by: Marcus Perlman, et al.
Published: (2018-08-01)
Handling Sign Language Data: The Impact of Modality
by: Josep Quer, et al.
Published: (2019-03-01)
by: Josep Quer, et al.
Published: (2019-03-01)
Second language learning of depiction in a different modality: The case of sign language acquisition
by: Kim B. Kurz, et al.
Published: (2023-01-01)
by: Kim B. Kurz, et al.
Published: (2023-01-01)
Beyond Spurious Cues: Adaptive Multi-Modal Fusion via Mixture-of-Experts for Robust Sarcasm Detection
by: Guilong Zhao, et al.
Published: (2025-10-01)
by: Guilong Zhao, et al.
Published: (2025-10-01)
Generalization of Bangla Sign Language Recognition Using Angular Loss Functions
by: Samiya Kabir Youme, et al.
Published: (2021-01-01)
by: Samiya Kabir Youme, et al.
Published: (2021-01-01)
Dual-Layer Fusion Knowledge Reasoning with Enhanced Multi-modal Features
by: JING Boxiang, WANG Hairong, WANG Tong, YANG Zhenye
Published: (2025-02-01)
by: JING Boxiang, WANG Hairong, WANG Tong, YANG Zhenye
Published: (2025-02-01)
Epistemic Modality in Georgian
by: Nino Sharashenidze
Published: (2015-02-01)
by: Nino Sharashenidze
Published: (2015-02-01)
CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalities
by: Konstantinos Kontras, et al.
Published: (2024-01-01)
by: Konstantinos Kontras, et al.
Published: (2024-01-01)
A Fusion of RGB Features and Local Descriptors for Object Detection in Road Scene
by: Vinh Dinh Nguyen
Published: (2024-01-01)
by: Vinh Dinh Nguyen
Published: (2024-01-01)
Multi-Modal Fusion of Routine Care Electronic Health Records (EHR): A Scoping Review
by: Zina Ben-Miled, et al.
Published: (2025-01-01)
by: Zina Ben-Miled, et al.
Published: (2025-01-01)
Drug–Target Affinity Prediction Based on Cross-Modal Fusion of Text and Graph
by: Jucheng Yang, et al.
Published: (2025-03-01)
by: Jucheng Yang, et al.
Published: (2025-03-01)
The count-mass distinction in Hong Kong Sign Language: an intra- and cross-modal comparison
by: Koenders Emily
Published: (2025-05-01)
by: Koenders Emily
Published: (2025-05-01)
Traffic Flow Prediction Based on Two-Channel Multi-Modal Fusion of MCB and Attention
by: Xiaoan Qin
Published: (2023-01-01)
by: Xiaoan Qin
Published: (2023-01-01)
Survey of Research on Multimodal Fusion Technology for Deep Learning
by: HE Jun, ZHANG Caiqing, LI Xiaozhen, ZHANG Dehai
Published: (2020-05-01)
by: HE Jun, ZHANG Caiqing, LI Xiaozhen, ZHANG Dehai
Published: (2020-05-01)
Whole-Body Keypoint and Skeleton Augmented RGB Networks for Video Action Recognition
by: Zizhao Guo, et al.
Published: (2022-06-01)
by: Zizhao Guo, et al.
Published: (2022-06-01)
Hierarchical in-out fusion for incomplete multimodal brain tumor segmentation
by: Fang Liu, et al.
Published: (2025-07-01)
by: Fang Liu, et al.
Published: (2025-07-01)
Grammaticalization, polysemy and iterated modality: the case of should.
by: Viviane Arigne
Published: (2007-06-01)
by: Viviane Arigne
Published: (2007-06-01)
Similar Items
-
A Comprehensive Benchmark and Evaluation of Thai Finger Spelling in Multi-Modal Deep Learning Models
by: Wuttichai Vijitkunsawat, et al.
Published: (2024-01-01) -
UAlpha40: A comprehensive dataset of Urdu alphabet for Pakistan sign languageMendeley Data
by: Sameena Javaid, et al.
Published: (2025-04-01) -
SIGN CHARACTER OF THE EXPONENTS OF MODALITY IN A LEGAL TEXT
by: Maria Teresa LIZISOWA
Published: (2017-02-01) -
Single-Stage Extensive Semantic Fusion for multi-modal sarcasm detection
by: Hong Fang, et al.
Published: (2024-07-01) -
Gated Fusion Network With Progressive Modality Enhancement for Sentiment Analysis
by: Feng Xin, et al.
Published: (2024-01-01)
