{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:13:14Z","timestamp":1760145194710,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T00:00:00Z","timestamp":1720137600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["61379099"],"award-info":[{"award-number":["61379099"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the development of data mining technology, the analysis of event-related potential (ERP) data has evolved from statistical analysis of time-domain features to data-driven techniques based on supervised and unsupervised learning. However, there are still many challenges in understanding the relationship between ERP components and the representation of familiar and unfamiliar faces. To address this, this paper proposes a model based on Dynamic Multi-Scale Convolution for group recognition of familiar and unfamiliar faces. This approach uses generated weight masks for cross-subject familiar\/unfamiliar face recognition using a multi-scale model. The model employs a variable-length filter generator to dynamically determine the optimal filter length for time-series samples, thereby capturing features at different time scales. Comparative experiments are conducted to evaluate the model\u2019s performance against SOTA models. The results demonstrate that our model achieves impressive outcomes, with a balanced accuracy rate of 93.20% and an F1 score of 88.54%, outperforming the methods used for comparison. The ERP data extracted from different time regions in the model can also provide data-driven technical support for research based on the representation of different ERP components.<\/jats:p>","DOI":"10.3390\/s24134368","type":"journal-article","created":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T12:30:59Z","timestamp":1720182659000},"page":"4368","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Dynamic Multi-Scale Convolution Model for Face Recognition Using Event-Related Potentials"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-5699-6449","authenticated-orcid":false,"given":"Shengkai","family":"Li","sequence":"first","affiliation":[{"name":"School of Automation, Qingdao University, Qingdao 266071, China"},{"name":"State Key Laboratory of Multimodal Artifcial Intelligence Systems, The Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tonglin","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Multimodal Artifcial Intelligence Systems, The Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fangmei","family":"Yang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Multimodal Artifcial Intelligence Systems, The Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xian","family":"Li","sequence":"additional","affiliation":[{"name":"School of Automation, Qingdao University, Qingdao 266071, China"},{"name":"Shandong Key Laboratory of Industrial Control Technology, Qingdao University, Qingdao 266071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ziyang","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Multimodal Artifcial Intelligence Systems, The Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dongjie","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Automation, Qingdao University, Qingdao 266071, China"},{"name":"Shandong Key Laboratory of Industrial Control Technology, Qingdao University, Qingdao 266071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1016\/j.neuroimage.2005.12.002","article-title":"Self-referential processing in our brain\u2014A meta-analysis of imaging studies on the self","volume":"31","author":"Northoff","year":"2006","journal-title":"Neuroimage"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2933","DOI":"10.1016\/j.neuropsychologia.2012.07.040","article-title":"Dissociations of subliminal and supraliminal self-face from other-face processing: Behavioral and ERP evidence","volume":"50","author":"Geng","year":"2012","journal-title":"Neuropsychologia"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.braindev.2008.04.011","article-title":"Event-related potentials of self-face recognition in children with pervasive developmental disorders","volume":"31","author":"Gunji","year":"2009","journal-title":"Brain Dev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.brainres.2011.05.060","article-title":"Sex difference in the processing of task-relevant and task-irrelevant social information: An event-related potential study of familiar face recognition","volume":"1408","author":"Wang","year":"2011","journal-title":"Brain Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/S0926-6410(03)00145-9","article-title":"Is the N170 for faces cognitively penetrable? Evidence from repetition priming of Mooney faces of familiar and unfamiliar persons","volume":"17","author":"Jemel","year":"2003","journal-title":"Cogn. Brain Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1162\/jocn.1996.8.6.551","article-title":"Electrophysiological studies of face perception in humans","volume":"8","author":"Bentin","year":"1996","journal-title":"J. Cogn. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Van Rijsbergen, N.J., and Schyns, P.G. (2009). Dynamics of trimming the content of face representations for categorization in the brain. PLoS Comput. Biol., 5.","DOI":"10.1371\/journal.pcbi.1000561"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1109\/TNSRE.2016.2523678","article-title":"The time-varying networks in P300: A task-evoked EEG study","volume":"24","author":"Li","year":"2016","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1111\/j.1469-8986.2008.00708.x","article-title":"The Complex Trial Protocol (CTP): A new, countermeasure-resistant, accurate, P300-based method for detection of concealed information","volume":"45","author":"Rosenfeld","year":"2008","journal-title":"Psychophysiology"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/S0167-8760(96)00742-8","article-title":"P300 and probability: Comparison of oddball and single-stimulus paradigms","volume":"25","author":"Polich","year":"1997","journal-title":"Int. J. Psychophysiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1111\/j.1469-8986.1977.tb01312.x","article-title":"On quantifying surprise: The variation of event-related potentials with subjective probability","volume":"14","author":"Donchin","year":"1977","journal-title":"Psychophysiology"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1111\/j.1469-8986.1981.tb03020.x","article-title":"Young Psychophysiologist Award Address, 1980: P300 latency: A new metric of information processing","volume":"18","year":"1981","journal-title":"Psychophysiology"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Luck, S.J., and Kappenman, E.S. (2012). Oxford Handbook of Event-Related Potential Components, Oxford University Press.","DOI":"10.1093\/oxfordhb\/9780195374148.001.0001"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3216","DOI":"10.1152\/jn.00220.2011","article-title":"Taking into account latency, amplitude, and morphology: Improved estimation of single-trial ERPs by wavelet filtering and multiple linear regression","volume":"106","author":"Hu","year":"2011","journal-title":"J. Neurophysiol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1016\/j.mri.2008.01.011","article-title":"Across-trial averaging of event-related EEG responses and beyond","volume":"26","author":"Mouraux","year":"2008","journal-title":"Magn. Reson. Imaging"},{"key":"ref_16","unstructured":"Jacobson, A.L. Auto-threshold peak detection in physiological signals. Proceedings of the 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Istanbul, Turkey, 25\u201328 October 2001."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1080\/02643294.2011.648176","article-title":"Bootstrap analysis of the single subject with event related potentials","volume":"28","author":"Krigolson","year":"2011","journal-title":"Cogn. Neuropsychol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1142\/S0219635216500345","article-title":"A fuzzy integral method based on the ensemble of neural networks to analyze fMRI data for cognitive state classification across multiple subjects","volume":"15","author":"Cacha","year":"2016","journal-title":"J. Integr. Neurosci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1142\/S0129065706000482","article-title":"Classification of Mental Tasks from EEG Signals Using Extreme Learning Machine","volume":"16","author":"Liang","year":"2006","journal-title":"Int. J. Neural Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Guney, S., and Erda\u015f, \u00c7.B. (2019, January 1\u20133). A Deep LSTM Approach for Activity Recognition. Proceedings of the 42nd International Conference on Telecommunications and Signal Processing (TSP), Budapest, Hungary.","DOI":"10.1109\/TSP.2019.8768815"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2773","DOI":"10.1109\/TNSRE.2020.3048106","article-title":"EEG-Inception: A Novel Deep Convolutional Neural Network for Assistive ERP-Based Brain-Computer Interfaces","volume":"28","author":"Hornero","year":"2020","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_22","first-page":"5199","article-title":"MCGRAM: Linking Multi-Scale CNN With a Graph-Based Recurrent Attention Model for Subject-Independent ERP Detection","volume":"69","author":"Li","year":"2022","journal-title":"IEEE Trans. Circuits Syst. II Express Briefs"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, X., Lin, Y., Tan, Y., Guo, R., and Gao, X. (2022, January 5\u20137). A multi-scale EEGNet for cross-subject RSVP-based BCI system. Proceedings of the 2022 15th International Congress on Image and Signal Processing, Biomedical Engineering and Informatics (CISP-BMEI), Beijing, China.","DOI":"10.1109\/CISP-BMEI56279.2022.9980258"},{"key":"ref_24","unstructured":"Tang, W., Long, G., Liu, L., Zhou, T., Jiang, J., and Blumenstein, M. (2020). Rethinking 1d-cnn for time series classification: A stronger baseline. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1007\/s11571-024-10073-5","article-title":"EEG-FRM: A neural network based familiar and unfamiliar face EEG recognition method","volume":"18","author":"Chen","year":"2024","journal-title":"Cogn. Neurodyn."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"116630","DOI":"10.1016\/j.neuroimage.2020.116630","article-title":"Principle ERP reduction and analysis: Estimating and using principle ERP waveforms underlying ERPs across tasks, subjects and electrodes","volume":"212","author":"Campos","year":"2020","journal-title":"NeuroImage"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/S0168-5597(97)00048-8","article-title":"Estimate of physiological variability of peak latency in single sweep P300","volume":"104","author":"Nishida","year":"1997","journal-title":"Electroencephalogr. Clin. Neurophysiol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"109732","DOI":"10.1109\/ACCESS.2020.3002095","article-title":"Dynamic Multi-Scale Convolutional Neural Network for Time Series Classification","volume":"8","author":"Qian","year":"2020","journal-title":"IEEE Access"},{"key":"ref_29","unstructured":"Jernite, Y., Grave, E., Joulin, A., and Mikolov, T. (2017). Variable Computation in Recurrent Neural Networks. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"514361","DOI":"10.1155\/2015\/514361","article-title":"Brain signals of face processing as revealed by event-related potentials","volume":"2015","author":"Olivares","year":"2015","journal-title":"Behav. Neurol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1111\/j.1469-8986.2004.00193.x","article-title":"Parsing the late positive complex: Mental chronometry and the ERP components that inhabit the neighborhood of the P300","volume":"41","author":"Dien","year":"2004","journal-title":"Psychophysiology"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"056013","DOI":"10.1088\/1741-2552\/aace8c","article-title":"EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces","volume":"15","author":"Lawhern","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"0460c8","DOI":"10.1088\/1741-2552\/ac1610","article-title":"A Deep Learning Method for Single-Trial EEG Classification in RSVP Task Based on Spatiotemporal Features of ERPs","volume":"18","author":"Zang","year":"2021","journal-title":"J. Neural Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5391","DOI":"10.1002\/hbm.23730","article-title":"Deep Learning with Convolutional Neural Networks for EEG Decoding and Visualization","volume":"38","author":"Schirrmeister","year":"2017","journal-title":"Hum. Brain Mapp."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Truong, D., Sinha, M., Venkataraju, K.U., Milham, M., and Delorme, A. (2022, January 11\u201315). A streamable large-scale clinical EEG dataset for Deep Learning. Proceedings of the 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow, UK.","DOI":"10.1109\/EMBC48229.2022.9871708"},{"key":"ref_37","unstructured":"Chen, Y., Ren, K., Song, K., Wang, Y., Wang, Y., Li, D., and Qiu, L. (2024). EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Model. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sun, W., Zhou, X., Zhang, X., and He, X. (2020). A lightweight neural network combining dilated convolution and depthwise separable convolution. Cloud Computing, Smart Grid and Innovative Frontiers in Telecommunications, Proceedings of the 9th EAI International Conference on Cloud Computing, CloudComp 2019, and 4th EAI International Conference, SmartGIFT 2019, Beijing, China, 4\u20135 December 2019 and 21\u201322 December 2019, Springer.","DOI":"10.1007\/978-3-030-48513-9_17"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Guo, Z., Wang, J., Chen, S., and Kang, Y. (2023, January 27\u201329). A Lightweight Stereo Matching Neural Network Based on Depthwise Separable Convolution. Proceedings of the 2023 IEEE International Conference on Integrated Circuits, Technologies and Applications (ICTA), Hefei, China.","DOI":"10.1109\/ICTA60488.2023.10364258"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/13\/4368\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:10:40Z","timestamp":1760109040000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/13\/4368"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,5]]},"references-count":39,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["s24134368"],"URL":"https:\/\/doi.org\/10.3390\/s24134368","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,7,5]]}}}