Multi-Source Co-adaptation for EEG-Based Emotion Recognition by Mining Correlation Information

• Main Authors: Jianwen Tao, Yufang Dan
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2021-05-01
• Series: Frontiers in Neuroscience
• Subjects: electroencephalogram; emotion recognition; multi-source adaptation; feature selection; maximum mean discrepancy
• Online Access: https://www.frontiersin.org/articles/10.3389/fnins.2021.677106/full

Since each individual subject may present completely different encephalogram (EEG) patterns with respect to other subjects, existing subject-independent emotion classifiers trained on data sampled from cross-subjects or cross-dataset generally fail to achieve sound accuracy. In this scenario, the domain adaptation technique could be employed to address this problem, which has recently got extensive attention due to its effectiveness on cross-distribution learning. Focusing on cross-subject or cross-dataset automated emotion recognition with EEG features, we propose in this article a robust multi-source co-adaptation framework by mining diverse correlation information (MACI) among domains and features with l2,1−norm as well as correlation metric regularization. Specifically, by minimizing the statistical and semantic distribution differences between source and target domains, multiple subject-invariant classifiers can be learned together in a joint framework, which can make MACI use relevant knowledge from multiple sources by exploiting the developed correlation metric function. Comprehensive experimental evidence on DEAP and SEED datasets verifies the better performance of MACI in EEG-based emotion recognition.