{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T10:35:45Z","timestamp":1775644545176,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,4,20]],"date-time":"2025-04-20T00:00:00Z","timestamp":1745107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["61976132"],"award-info":[{"award-number":["61976132"]}]},{"name":"National Natural Science Foundation of China","award":["61991410"],"award-info":[{"award-number":["61991410"]}]},{"name":"National Natural Science Foundation of China","award":["KF202413"],"award-info":[{"award-number":["KF202413"]}]},{"name":"Shanghai Key Laboratory of Forensic Medicine, Academy of Forensic Science, Ministry of Justice","award":["61976132"],"award-info":[{"award-number":["61976132"]}]},{"name":"Shanghai Key Laboratory of Forensic Medicine, Academy of Forensic Science, Ministry of Justice","award":["61991410"],"award-info":[{"award-number":["61991410"]}]},{"name":"Shanghai Key Laboratory of Forensic Medicine, Academy of Forensic Science, Ministry of Justice","award":["KF202413"],"award-info":[{"award-number":["KF202413"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Electroencephalogram (EEG), as a kind of neurobiological signal, is an essential tool for studying human perception, yet its acquisition is often time-consuming and laborious. Accordingly, this paper presents the largest publicly available EEG dataset to date for familiar and unfamiliar face perception analysis (FUFP). The EEG signals of 66 channels were recorded from 8 participants, each exposed to 8 familiar faces (FFs) and 32 unfamiliar faces (UFs) randomly, repeated 20 times, yielding 6400 samples. Inspired by the inherent slight symmetry exhibited by the 2D position of EEG electrodes and EEG data, we employed five baseline machine learning methods, proving the feasibility of classifying familiarity through EEG. There are indeed neural features related to face familiarity in EEG signals. Event-related potential (ERP) analysis towards FFs and UF responses reveals that UFs induce larger N400 component amplitudes than FFs. Therefore, we propose a deep learning method based on ERP analysis and confident learning (ECL) for familiarity classification, which can effectively focus the model\u2019s attention on more discriminative features and clean the data. Experimental results show that our model\u2019s accuracy outperforms other existing familiarity classification models. We encourage researchers to utilize FUFP for algorithm tests and face perception analysis.<\/jats:p>","DOI":"10.3390\/sym17040623","type":"journal-article","created":{"date-parts":[[2025,4,20]],"date-time":"2025-04-20T20:31:36Z","timestamp":1745181096000},"page":"623","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Electroencephalogram-Based Familiar and Unfamiliar Face Perception Classification Underlying Event-Related Potential Analysis and Confident Learning"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1022-3385","authenticated-orcid":false,"given":"Zhihan","family":"Zuo","sequence":"first","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3160-9946","authenticated-orcid":false,"given":"Menglu","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-0535-8820","authenticated-orcid":false,"given":"Zhihe","family":"Lyu","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7085-8876","authenticated-orcid":false,"given":"Yuchun","family":"Fang","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1177\/1747021817740275","article-title":"Faces, people and the brain: The 45th Sir Frederic Bartlett Lecture","volume":"71","author":"Young","year":"2018","journal-title":"Q. J. Exp. Psychol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1167\/10.4.16","article-title":"Fast saccades toward faces: Face detection in just 100 ms","volume":"10","author":"Crouzet","year":"2010","journal-title":"J. Vision"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1080\/13506285.2019.1631925","article-title":"Human faces capture attention and attract first saccades without longer fixation","volume":"27","author":"Morrisey","year":"2019","journal-title":"Vis. Cogn."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Visconti, M., and Gobbini, M.I. (2015). Familiar face detection in 180 ms. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0136548"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1539","DOI":"10.1523\/JNEUROSCI.2646-14.2015","article-title":"Neural decoding reveals impaired face configural processing in the right fusiform face area of individuals with developmental prosopagnosia","volume":"35","author":"Zhang","year":"2015","journal-title":"J. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.cortex.2022.12.014","article-title":"What is the prevalence of developmental prosopagnosia? An empirical assessment of different diagnostic cutoffs","volume":"161","author":"DeGutis","year":"2023","journal-title":"Cortex"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.neuroimage.2017.12.023","article-title":"The neural network for face recognition: Insights from an fMRI study on developmental prosopagnosia","volume":"169","author":"Zhao","year":"2018","journal-title":"Neuroimage"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1093\/scan\/nsm003","article-title":"No global processing deficit in the navon task in 14 developmental prosopagnosics","volume":"2","author":"Duchaine","year":"2007","journal-title":"Soc. Cogn. Affect. Neur."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1679","DOI":"10.1109\/TCBB.2020.3006699","article-title":"A hierarchical discriminative sparse representation classifier for EEG signal detection","volume":"10","author":"Gu","year":"2021","journal-title":"IEEE\/ACM Trans. Comput. BioL. Bioinf."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1667","DOI":"10.1109\/TCBB.2020.3002562","article-title":"Epilepsy signal recognition using online transfer tsk fuzzy classifier underlying classification error and joint distribution consensus regularization","volume":"18","author":"Zhang","year":"2021","journal-title":"IEEE\/ACM Trans. Comput. BioL. Bioinf."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Toyoda, A., Ogawa, T., and Haseyama, M. (2017, January 17\u201320). MvLFDA-based video preference estimation using complementary properties of features. Proceedings of the IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296358"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1835","DOI":"10.1109\/TCBB.2019.2912955","article-title":"Deep learning for automated feature discovery and classification of sleep stages","volume":"17","author":"Sokolovsky","year":"2020","journal-title":"IEEE\/ACM Trans. Comput. BioL. Bioinf."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kanwal, S., Uzair, M., Ullah, H., Khan, S.D., Ullah, M., and Cheikh, F.A. (2019, January 22\u201325). An image based prediction model for sleep stage identification. Proceedings of the IEEE International Conference on Image Processing (ICIP), Taipei, China.","DOI":"10.1109\/ICIP.2019.8803026"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Arnau-Gonzalez, P., Katsigiannis, S., Arevalillo-Herraez, M., and Ramzan, N. (2019, January 22\u201325). Image-evoked affect and its impact on eeg-based biometrics. Proceedings of the IEEE International Conference on Image Processing (ICIP), Taipei, China.","DOI":"10.1109\/ICIP.2019.8803315"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Mukherjee, P., Das, A., Bhunia, A.K., and Roy, P.P. (2019, January 22\u201325). Cogni-net: Cognitive feature learning through deep visual perception. Proceedings of the IEEE International Conference on Image Processing (ICIP), Taipei, China.","DOI":"10.1109\/ICIP.2019.8803717"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Guo, Y., Nejati, H., and Cheung, N.M. (2017, January 17\u201320). Deep neural networks on graph signals for brain imaging analysis. Proceedings of the IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296892"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1093\/brain\/awr347","article-title":"Electrophysiological markers of covert face recognition in developmental prosopagnosia","volume":"135","author":"Eimer","year":"2012","journal-title":"Brain"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Williams, P., White, A., Merino, R.B., Hardin, S., Mizelle, J.C., and Kim, S. (2019, January 23\u201327). Facial recognition task for the classification of mild cognitive impairment with ensemble sparse classifier. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany,.","DOI":"10.1109\/EMBC.2019.8857203"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2193","DOI":"10.1007\/s11571-024-10078-0","article-title":"Black-white hole pattern: An investigation on the automated chronic neuropathic pain detection using EEG signals","volume":"18","author":"Tasci","year":"2024","journal-title":"Cogn. Neurodynamics"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/j.inffus.2023.03.022","article-title":"Epilepsy detection in 121 patient populations using hypercube pattern from EEG signals","volume":"96","author":"Tasci","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"101047","DOI":"10.1016\/j.aei.2020.101047","article-title":"SAFE: An EEG dataset for stable affective feature selection","volume":"44","author":"Lan","year":"2020","journal-title":"Adv. Eng. Inf."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4996","DOI":"10.1109\/JBHI.2022.3185587","article-title":"Sample-based data augmentation based on electroencephalogram intrinsic characteristics","volume":"26","author":"Li","year":"2022","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/TCDS.2018.2826840","article-title":"Domain adaptation techniques for EEG-based emotion recognition: A comparative study on two public datasets","volume":"11","author":"Lan","year":"2018","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"110215","DOI":"10.1016\/j.jneumeth.2024.110215","article-title":"EEG-based motor imagery channel selection and classification using hybrid optimization and two-tier deep learning","volume":"409","author":"Kumari","year":"2024","journal-title":"J. Neurosci. Methods"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.ymeth.2021.04.009","article-title":"Subject matching for cross-subject EEG-based recognition of driver states related to situation awareness","volume":"202","author":"Li","year":"2022","journal-title":"Methods"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"102575","DOI":"10.1016\/j.aei.2024.102575","article-title":"TFormer: A time\u2013frequency transformer with batch normalization for driver fatigue recognition","volume":"62","author":"Li","year":"2024","journal-title":"Adv. Eng. Inf."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1007\/s11571-021-09748-0","article-title":"LEDPatNet19: Automated emotion recognition model based on nonlinear LED pattern feature extraction function using EEG signals","volume":"16","author":"Tuncer","year":"2022","journal-title":"Cogn. Neurodynamics"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.1007\/s11760-018-1269-x","article-title":"Familiar\/unfamiliar face classification from EEG signals by utilizing pairwise distant channels and distinctive time interval","volume":"12","year":"2018","journal-title":"Signal Image Video Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ghosh, L., Dewan, D., Chowdhury, A., and Konar, A. (2021). Exploration of face-perceptual ability by EEG induced deep learning algorithm. Biomed. Signal Process. Control, 66.","DOI":"10.1016\/j.bspc.2020.102368"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2509413","DOI":"10.1109\/TIM.2021.3082985","article-title":"Lie detection using fuzzy ensemble approach with novel defuzzification method for classification of EEG signals","volume":"70","author":"Bablani","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"113448","DOI":"10.1016\/j.eswa.2020.113448","article-title":"An EEG based familiar and unfamiliar person identification and classification system using feature extraction and directed functional brain network","volume":"158","author":"Chang","year":"2020","journal-title":"Expert Sys. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"William, F., and Aygun, R. (2022, January 26\u201328). ConvoForest classification of new and familiar faces using EEG. Proceedings of the 16th IEEE International Conference on Semantic Computing (ICSC), Virtual.","DOI":"10.1109\/ICSC52841.2022.00052"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e13950","DOI":"10.1111\/psyp.13950","article-title":"Detecting a viewer\u2019s familiarity with a face: Evidence from event-related brain potentials and classifier analyses","volume":"59","author":"Wiese","year":"2022","journal-title":"Psychophysiology"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1126\/science.150.3700.1187","article-title":"Evoked-potential correlates of stimulus uncertainty","volume":"150","author":"Sutton","year":"1965","journal-title":"Science"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1109\/TSMCA.2007.909557","article-title":"The CAS-PEAL large-scale chinese face database and baseline evaluations","volume":"38","author":"Gao","year":"2008","journal-title":"IEEE Trans. Syst. Man. Cybern. Pt. A Syst. Humans"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Muramatsu, D., Makihara, Y., Iwama, H., Tanoue, T., and Yagi, Y. (2013, January 5\u20138). Gait verification system for supporting criminal investigation. Proceedings of the 2nd IAPR Asian Conference on Pattern Recognition (ACPR), Okinawa, Japan.","DOI":"10.1109\/ACPR.2013.195"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Wu, Q., Yang, K., Tong, L., Yan, B., Shu, J., and Yao, D. (2019). EEG-based identity authentication framework using face rapid serial visual presentation with optimized channels. Sensors, 19.","DOI":"10.3390\/s19010006"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Rossion, B., and Jacques, C. (2012). The N170: Understanding the time course of face perception in the human brain. Oxford Handbook of Event-Related Potential Components, Oxford University Press.","DOI":"10.1093\/oxfordhb\/9780195374148.013.0064"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1111\/j.1469-8986.1977.tb01312.x","article-title":"On quantifying surprise: The variation of event-related potentials with subjective probability","volume":"14","author":"Donchin","year":"1977","journal-title":"Psychophysiology"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.tics.2007.04.004","article-title":"Event-related potentials and recognition memory","volume":"11","author":"Rugg","year":"2007","journal-title":"Trends Cogn. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1080\/17588928.2012.674935","article-title":"More than a feeling: Pervasive influences of memory without awareness of retrieval","volume":"3","author":"Voss","year":"2012","journal-title":"Cogn. Neurosci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1016\/j.neuroimage.2006.12.016","article-title":"The FN400 indexes familiarity-based recognition of faces","volume":"36","author":"Curran","year":"2007","journal-title":"Neuroimage"},{"key":"ref_43","unstructured":"Luck, S.J. (2014). An Introduction to the Event-Related Potential Technique, MIT Press."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1090\/S0025-5718-1965-0178586-1","article-title":"An algorithm for the machine calculation of complex Fourier series","volume":"19","author":"Cooley","year":"1965","journal-title":"Math. Comput."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/BF02546511","article-title":"Generalized harmonic analysis","volume":"55","author":"Wiener","year":"1930","journal-title":"Acta Math."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/TAU.1967.1161901","article-title":"The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms","volume":"15","author":"Welch","year":"2003","journal-title":"IEEE Trans. Audio Electroacoust."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"The Bell Syst. Tech. J."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comp."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1613\/jair.1.12125","article-title":"Confident learning: Estimating uncertainty in dataset labels","volume":"70","author":"Northcutt","year":"2021","journal-title":"J. Artif. Intell. Res."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"3342","DOI":"10.3906\/elk-1608-130","article-title":"Classification of EEG signals of familiar and unfamiliar face stimuli exploiting most discriminative channels","volume":"25","author":"Ozbeyaz","year":"2017","journal-title":"Turk. J. Electr. Eng. Comput. Sci."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/17\/4\/623\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:18:10Z","timestamp":1760030290000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/17\/4\/623"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,20]]},"references-count":51,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4]]}},"alternative-id":["sym17040623"],"URL":"https:\/\/doi.org\/10.3390\/sym17040623","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,20]]}}}