{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,4]],"date-time":"2026-11-04T17:58:52Z","timestamp":1793815132269,"version":"4.6.1"},"reference-count":57,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,10,31]],"date-time":"2024-10-31T00:00:00Z","timestamp":1730332800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Hum. Neurosci."],"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>Electroencephalogram (EEG) is widely used in emotion recognition due to its precision and reliability. However, the nonstationarity of EEG signals causes significant differences between individuals or sessions, making it challenging to construct a robust model. Recently, domain adaptation (DA) methods have shown excellent results in cross-subject EEG emotion recognition by aligning marginal distributions. Nevertheless, these methods do not consider emotion category labels, which can lead to label confusion during alignment. Our study aims to alleviate this problem by promoting conditional distribution alignment during domain adaptation to improve cross-subject and cross-session emotion recognition performance.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>This study introduces a multi-source domain adaptation common-branch network for EEG emotion recognition and proposes a novel sample hybridization method. This method enables the introduction of target domain data information by directionally hybridizing source and target domain samples without increasing the overall sample size, thereby enhancing the effectiveness of conditional distribution alignment in domain adaptation. Cross-subject and cross-session experiments were conducted on two publicly available datasets, SEED and SEED-IV, to validate the proposed model.<\/jats:p><\/jats:sec><jats:sec><jats:title>Result<\/jats:title><jats:p>In cross-subject emotion recognition, our method achieved an average accuracy of 90.27% on the SEED dataset, with eight out of 15 subjects attaining a recognition accuracy higher than 90%. For the SEED-IV dataset, the recognition accuracy also reached 73.21%. Additionally, in the cross-session experiment, we sequentially used two out of the three session data as source domains and the remaining session as the target domain for emotion recognition. The proposed model yielded average accuracies of 94.16 and 75.05% on the two datasets, respectively.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Our proposed method aims to alleviate the difficulties of emotion recognition from the limited generalization ability of EEG features across subjects and sessions. Though adapting the multi-source domain adaptation and the sample hybridization method, the proposed method can effectively transfer the emotion-related knowledge of known subjects and achieve accurate emotion recognition on unlabeled subjects.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fnhum.2024.1464431","type":"journal-article","created":{"date-parts":[[2024,10,31]],"date-time":"2024-10-31T04:50:43Z","timestamp":1730350243000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Multi-source domain adaptation for EEG emotion recognition based on inter-domain sample hybridization"],"prefix":"10.3389","volume":"18","author":[{"given":"Xu","family":"Wu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangyu","family":"Ju","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheng","family":"Dai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyu","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,10,31]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1109\/TAFFC.2017.2714671","article-title":"Emotions recognition using EEG signals: a survey","volume":"10","author":"Alarcao","year":"2017","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B2","doi-asserted-by":"crossref","DOI":"10.1109\/econf51404.2020.9385468","article-title":"\u201cThe effects of emotional stress on learning and memory cognitive functions: An EEG review study in education,\u201d","volume-title":"2020 Sixth International Conference on e-Learning (econf)","author":"AlShorman","year":"2020"},{"key":"B3","doi-asserted-by":"publisher","first-page":"e49","DOI":"10.1093\/bioinformatics\/btl242","article-title":"Integrating structured biological data by kernel maximum mean discrepancy","volume":"22","author":"Borgwardt","year":"2006","journal-title":"Bioinformatics"},{"key":"B4","doi-asserted-by":"publisher","first-page":"809459","DOI":"10.3389\/fpsyg.2021.809459","article-title":"Multi-source and multi-representation adaptation for cross-domain electroencephalography emotion recognition","volume":"12","author":"Cao","year":"2022","journal-title":"Front. Psychol"},{"key":"B5","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/j.compbiomed.2016.10.019","article-title":"Unsupervised domain adaptation techniques based on auto-encoder for non-stationary EEG-based emotion recognition","volume":"79","author":"Chai","year":"2016","journal-title":"Comput. Biol. Med"},{"key":"B6","doi-asserted-by":"publisher","first-page":"778488","DOI":"10.3389\/fnins.2021.778488","article-title":"MS-MDA: multisource marginal distribution adaptation for cross-subject and cross-session eeg emotion recognition","volume":"15","author":"Chen","year":"2021","journal-title":"Front. Neurosci"},{"key":"B7","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1037\/h0030377","article-title":"Constants across cultures in the face and emotion","volume":"17","author":"Ekman","year":"1971","journal-title":"J. Pers. Soc. Psychol"},{"key":"B8","doi-asserted-by":"publisher","first-page":"105217","DOI":"10.1016\/j.knosys.2019.105217","article-title":"Unsupervised emotional state classification through physiological parameters for social robotics applications","volume":"190","author":"Fiorini","year":"2020","journal-title":"Knowl. Based Syst"},{"key":"B9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.48550\/arXiv.1505.07818","article-title":"Domain-adversarial training of neural networks","volume":"17","author":"Ganin","year":"2016","journal-title":"J. Mach. Learn. Res"},{"key":"B10","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1186\/s40359-024-01581-4","article-title":"Development and application of emotion recognition technology\u2014a systematic literature review","volume":"12","author":"Guo","year":"2024","journal-title":"BMC. Psychol"},{"key":"B11","first-page":"2765","article-title":"\u201cAssociative domain adaptation,\u201d","volume-title":"International Conference on Computer Vision (ICCV)","author":"Haeusser","year":"2017"},{"key":"B12","doi-asserted-by":"publisher","first-page":"427","DOI":"10.3390\/bios12060427","article-title":"Wearable flexible electronics based cardiac electrode for researcher mental stress detection system using machine learning models on single lead electrocardiogram signal","volume":"12","author":"Heyat","year":"2022","journal-title":"Biosensors"},{"key":"B13","doi-asserted-by":"publisher","first-page":"105138","DOI":"10.1016\/j.bspc.2023.105138","article-title":"Learning a robust unified domain adaptation framework for cross-subject eeg-based emotion recognition","volume":"86","author":"Jim\u00e9nez-Guarneros","year":"2023","journal-title":"Biomed. Signal Process. Control"},{"key":"B14","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1007\/s11571-023-10004-w","article-title":"EEG-based emotion recognition using a temporal-difference minimizing neural network","volume":"18","author":"Ju","year":"2024","journal-title":"Cogn. Neurodyn"},{"key":"B15","doi-asserted-by":"publisher","first-page":"102019","DOI":"10.1016\/j.inffus.2023.102019","article-title":"Emotion recognition and artificial intelligence: a systematic review (2014-2023) and research recommendations","volume":"102","author":"Khare","year":"2024","journal-title":"Inf. Fusion"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1412.6980","article-title":"Adam: a method for stochastic optimization","author":"Kingma","year":"2014","journal-title":"arXiv"},{"key":"B17","first-page":"403","article-title":"\u201cCross-subject emotion recognition using deep adaptation networks,\u201d","author":"Li","year":"2018"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1169949","DOI":"10.3389\/fnhum.2023.1169949","article-title":"STGATE: spatial-temporal graph attention network with a transformer encoder for EEG-based emotion recognition","volume":"17","author":"Li","year":"2023","journal-title":"Front. Hum. Neurosci"},{"key":"B19","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1109\/TCDS.2019.2949306","article-title":"Domain adaptation for EEG emotion recognition based on latent representation similarity","volume":"12","author":"Li","year":"2019","journal-title":"Cogn. Syst. Res"},{"key":"B20","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1109\/TCDS.2021.3098842","article-title":"Can emotion be transferred?\u2014a review on transfer learning for eeg-based emotion recognition","volume":"14","author":"Li","year":"2021","journal-title":"IEEE Trans. Cogn. Dev. Syst"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2512","DOI":"10.1109\/TAFFC.2022.3170428","article-title":"GMSS: graph-based multi-task self-supervised learning for EEG emotion recognition","volume":"14","author":"Li","year":"2022","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B22","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1016\/j.neucom.2021.02.048","article-title":"A novel transferability attention neural network model for eeg emotion recognition","volume":"447","author":"Li","year":"","journal-title":"Neurocomputing"},{"key":"B23","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1109\/TCDS.2020.2999337","article-title":"A novel bi-hemispheric discrepancy model for EEG emotion recognition","volume":"13","author":"Li","year":"","journal-title":"IEEE Trans. COGN. DEV. SYST"},{"key":"B24","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1109\/TAFFC.2019.2922912","article-title":"From regional to global brain: a novel hierarchical spatial-temporal neural network model for EEG emotion recognition","volume":"13","author":"Li","year":"2019","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B25","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1109\/TAFFC.2018.2885474","article-title":"A bi-hemisphere domain adversarial neural network model for EEG emotion recognition","volume":"12","author":"Li","year":"","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B26","doi-asserted-by":"publisher","first-page":"5964","DOI":"10.1109\/JBHI.2022.3210158","article-title":"Dynamic domain adaptation for class-aware cross-subject and cross-session EEG emotion recognition","volume":"26","author":"Li","year":"2022","journal-title":"IEEE J. Biomed. Health"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1913","DOI":"10.1109\/TNSRE.2021.3111689","article-title":"EEGFUseNet: hybrid unsupervised deep feature characterization and fusion for high-dimensional EEG with an application to emotion recognition","volume":"29","author":"Liang","year":"2021","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng"},{"key":"B28","doi-asserted-by":"publisher","first-page":"550","DOI":"10.1109\/TAFFC.2017.2660485","article-title":"Real-time movie-induced discrete emotion recognition from EEG signals","volume":"9","author":"Liu","year":"2017","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1280241","DOI":"10.3389\/fnhum.2023.1280241","article-title":"Hybrid transfer learning strategy for cross-subject EEG emotion recognition","volume":"17","author":"Lu","year":"2023","journal-title":"Front. Hum. Neurosci"},{"key":"B30","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1002\/ejp.1003","article-title":"Brain changes associated with cognitive and emotional factors in chronic pain: a systematic review","volume":"21","author":"Malfliet","year":"2017","journal-title":"Eur. J. Pain"},{"key":"B31","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/BF02686918","article-title":"Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament","volume":"14","author":"Mehrabian","year":"1996","journal-title":"Curr. Psychol"},{"key":"B32","doi-asserted-by":"publisher","first-page":"917","DOI":"10.1109\/TNSRE.2023.3236434","article-title":"A brain network analysis-based double way deep neural network for emotion recognition","volume":"31","author":"Niu","year":"2023","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng"},{"key":"B33","doi-asserted-by":"publisher","first-page":"793","DOI":"10.3390\/bioengineering9120793","article-title":"A novel smart belt for anxiety detection, classification, and reduction using iiomt on students' cardiac signal and msy","volume":"9","author":"Pal","year":"2022","journal-title":"Bioengineering"},{"key":"B34","doi-asserted-by":"publisher","first-page":"3245","DOI":"10.1109\/TNSRE.2023.3304660","article-title":"MSFR-GCN: a multi-scale feature reconstruction graph convolutional network for eeg emotion and cognition recognition","volume":"31","author":"Pan","year":"2023","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng"},{"key":"B35","first-page":"1","article-title":"\u201cInterweaving artificial intelligence and bio-signals in mental fatigue: unveiling dynamics and future pathways,\u201d","volume-title":"2023 20th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Volume 21","author":"Parveen","year":"2023"},{"key":"B36","doi-asserted-by":"publisher","first-page":"1941","DOI":"10.1109\/TAFFC.2022.3189222","article-title":"Joint feature adaptation and graph adaptive label propagation for cross-subject emotion recognition from EEG signals","volume":"13","author":"Peng","year":"2022","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B37","doi-asserted-by":"publisher","first-page":"101152","DOI":"10.1016\/j.cogsys.2023.101152","article-title":"A systematic literature review of emotion recognition using EEG signals","volume":"82","author":"Prabowo","year":"2023","journal-title":"IEEE Trans. Cogn. Dev. Syst"},{"key":"B38","doi-asserted-by":"publisher","first-page":"1132254","DOI":"10.3389\/fnhum.2023.1132254","article-title":"SSTM-IS: simplified stm method based on instance selection for real-time EEG emotion recognition","volume":"17","author":"Ran","year":"2023","journal-title":"Front. Hum. Neurosci"},{"key":"B39","doi-asserted-by":"publisher","first-page":"3277985","DOI":"10.1109\/TIM.2023.3277985","article-title":"Multisource associate domain adaptation for cross-subject and cross-session EEG emotion recognition","volume":"72","author":"She","year":"2023","journal-title":"IEEE Trans. Instrum. Meas"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1802.08735","article-title":"A DIRT-T approach to unsupervised domain adaptation","author":"Shu","year":"2018","journal-title":"arXiv"},{"key":"B41","first-page":"443","article-title":"\u201cDeep coral: correlation alignment for deep domain adaptation,\u201d","volume-title":"16th European Conference on Computer Vision (ECCV)","author":"Sun","year":"2016"},{"key":"B42","doi-asserted-by":"publisher","first-page":"235933","DOI":"10.3389\/fpsyg.2017.01454","article-title":"The influences of emotion on learning and memory","volume":"8","author":"Tyng","year":"2017","journal-title":"Front. Psychol"},{"key":"B43","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Van der Maaten","year":"2008","journal-title":"J. Mach. Learn. Res"},{"key":"B44","doi-asserted-by":"publisher","first-page":"15","DOI":"10.3389\/fnana.2017.00015","article-title":"The brainstem in emotion: a review","volume":"11","author":"Venkatraman","year":"2017","journal-title":"Front. Neuroanat"},{"key":"B45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.neucom.2020.09.017","article-title":"A review on transfer learning in eeg signal analysis","volume":"421","author":"Wan","year":"2021","journal-title":"Neurocomputing"},{"key":"B46","doi-asserted-by":"publisher","first-page":"9061","DOI":"10.1007\/s00521-020-05670-4","article-title":"A deep multi-source adaptation transfer network for cross-subject electroencephalogram emotion recognition","volume":"33","author":"Wang","year":"2021","journal-title":"Neural Comput. Appl"},{"key":"B47","doi-asserted-by":"publisher","first-page":"107626","DOI":"10.1016\/j.patcog.2020.107626","article-title":"A prototype-based SPD matrix network for domain adaptation EEG emotion recognition","volume":"110","author":"Wang","year":"2021","journal-title":"Pattern Recognit"},{"key":"B48","doi-asserted-by":"publisher","first-page":"106351","DOI":"10.1016\/j.neunet.2024.106351","article-title":"Channel reflection: knowledge-driven data augmentation for eeg-based brain\u2013computer interfaces","volume":"176","author":"Wang","year":"2024","journal-title":"Neural Netw"},{"key":"B49","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/TCDS.2020.3007453","article-title":"Transfer learning for EEG-based brain-computer interfaces: a review of progress made since 2016","volume":"14","author":"Wu","year":"2020","journal-title":"IEEE Trans. Cogn. Dev. Syst"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1505.00853","article-title":"Empirical evaluation of rectified activations in convolutional network","author":"Xu","year":"2015","journal-title":"arXiv"},{"key":"B51","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1109\/TAFFC.2023.3266808","article-title":"LGSNet: a two-stream network for micro-and macro-expression spotting with background modeling","volume":"15","author":"Yu","year":"2023","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1710.09412","article-title":"mixup: beyond empirical risk minimization","author":"Zhang","year":"2017","journal-title":"arXiv"},{"key":"B53","doi-asserted-by":"publisher","first-page":"1110","DOI":"10.1109\/TCYB.2018.2797176","article-title":"Emotionmeter: a multimodal framework for recognizing human emotions","volume":"49","author":"Zheng","year":"2018","journal-title":"IEEE Trans. Cybern"},{"key":"B54","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1109\/TAMD.2015.2431497","article-title":"Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks","volume":"7","author":"Zheng","year":"2015","journal-title":"IEEE Trans. Auton. Ment. Dev"},{"key":"B55","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1109\/TAFFC.2017.2712143","article-title":"Identifying stable patterns over time for emotion recognition from EEG","volume":"10","author":"Zheng","year":"2017","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2304.06496","article-title":"EEGMatch: learning with incomplete labels for semi-supervised EEG-based cross-subject emotion recognition","author":"Zhou","year":"2023","journal-title":"arXiv"},{"key":"B57","doi-asserted-by":"publisher","first-page":"103687","DOI":"10.1016\/j.bspc.2022.103687","article-title":"Multisource wasserstein adaptation coding network for EEG emotion recognition","volume":"76","author":"Zhu","year":"2022","journal-title":"Biomed. Signal Process. Control"}],"container-title":["Frontiers in Human Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnhum.2024.1464431\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,31]],"date-time":"2024-10-31T04:50:49Z","timestamp":1730350249000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnhum.2024.1464431\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,31]]},"references-count":57,"alternative-id":["10.3389\/fnhum.2024.1464431"],"URL":"https:\/\/doi.org\/10.3389\/fnhum.2024.1464431","relation":{},"ISSN":["1662-5161"],"issn-type":[{"value":"1662-5161","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,31]]},"article-number":"1464431"}}