{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T04:48:58Z","timestamp":1764996538598,"version":"3.41.2"},"reference-count":40,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T00:00:00Z","timestamp":1712620800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100011332","name":"University of Chinese Academy of Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100011332","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010814","name":"Anhui Provincial Department of Education","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100010814","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Neurosci."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Face recognition has been a longstanding subject of interest in the fields of cognitive neuroscience and computer vision research. One key focus has been to understand the relative importance of different facial features in identifying individuals. Previous studies in humans have demonstrated the crucial role of eyebrows in face recognition, potentially even surpassing the importance of the eyes. However, eyebrows are not only vital for face recognition but also play a significant role in recognizing facial expressions and intentions, which might occur simultaneously and influence the face recognition process.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>To address these challenges, our current study aimed to leverage the power of deep convolutional neural networks (DCNNs), an artificial face recognition system, which can be specifically tailored for face recognition tasks. In this study, we investigated the relative importance of various facial features in face recognition by selectively blocking feature information from the input to the DCNN. Additionally, we conducted experiments in which we systematically blurred the information related to eyebrows to varying degrees.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Our findings aligned with previous human research, revealing that eyebrows are the most critical feature for face recognition, followed by eyes, mouth, and nose, in that order. The results demonstrated that the presence of eyebrows was more crucial than their specific high-frequency details, such as edges and textures, compared to other facial features, where the details also played a significant role. Furthermore, our results revealed that, unlike other facial features, the activation map indicated that the significance of eyebrows areas could not be readily adjusted to compensate for the absence of eyebrow information. This finding explains why masking eyebrows led to more significant deficits in face recognition performance. Additionally, we observed a synergistic relationship among facial features, providing evidence for holistic processing of faces within the DCNN.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Overall, our study sheds light on the underlying mechanisms of face recognition and underscores the potential of using DCNNs as valuable tools for further exploration in this field.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fncom.2024.1209082","type":"journal-article","created":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T04:32:16Z","timestamp":1712637136000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Understanding of facial features in face perception: insights from deep convolutional neural networks"],"prefix":"10.3389","volume":"18","author":[{"given":"Qianqian","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yueyi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ning","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoyan","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,4,9]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1183","DOI":"10.1126\/science.1167748","article-title":"Predicting elections: child's play!","volume":"323","author":"Antonakis","year":"2009","journal-title":"Science"},{"key":"B2","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1038\/s41467-021-27606-9","article-title":"Face detection in untrained deep neural networks","volume":"12","author":"Baek","year":"2021","journal-title":"Nat. Commun."},{"key":"B3","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1037\/1528-3542.6.2.269","article-title":"Very first impressions","volume":"6","author":"Bar","year":"2006","journal-title":"Emotion"},{"key":"B4","doi-asserted-by":"crossref","DOI":"10.1109\/ICCV.2017.116","article-title":"\u201cHow far are we from solving the 2D and 3D face alignment problem? (and a dataset of 230,000 3D facial landmarks),\u201d","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV)","author":"Bulat","year":"2017"},{"key":"B5","doi-asserted-by":"publisher","first-page":"3963","DOI":"10.1371\/journal.pcbi.1003963","article-title":"Deep neural networks rival the representation of primate it cortex for core visual object recognition","volume":"10","author":"Cadieu","year":"2014","journal-title":"PLoS Comput. Biol."},{"key":"B6","doi-asserted-by":"publisher","first-page":"1019776","DOI":"10.3389\/fncom.2022.1019776","article-title":"EEG-based emotion recognition using hybrid CNN and LSTM classification","volume":"16","author":"Chakravarthi","year":"2022","journal-title":"Front. Comput. Neurosci."},{"key":"B7","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1068\/p060263","article-title":"Cue saliency in faces as assessed by the \u201cphotofit\u201d technique","volume":"6","author":"Davies","year":"1977","journal-title":"Perception"},{"key":"B8","doi-asserted-by":"crossref","first-page":"4685","DOI":"10.1109\/CVPR.2019.00482","article-title":"\u201cArcface: additive angular margin loss for deep face recognition,\u201d","volume-title":"2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Deng","year":"2019"},{"key":"B9","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1068\/p190661","article-title":"Reaction time measures of feature saliency in schematic faces","volume":"19","author":"Fraser","year":"1990","journal-title":"Perception"},{"key":"B10","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1038\/s41467-019-12623-6","article-title":"Convergent evolution of face spaces across human face-selective neuronal groups and deep convolutional networks","volume":"10","author":"Grossman","year":"2019","journal-title":"Nat. Commun."},{"key":"B11","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/978-3-319-46487-9_6","article-title":"\u201cMS-CELEB-1M: a dataset and benchmark for large-scale face recognition,\u201d","volume-title":"Computer Vision\u2014ECCV 2016","author":"Guo","year":"2016"},{"key":"B12","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1068\/p150235","article-title":"Exploring recognition with interchanged facial features","volume":"15","author":"Haig","year":"1986","journal-title":"Perception"},{"key":"B13","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1109\/CVPR.2016.90","article-title":"\u201cDeep residual learning for image recognition,\u201d","volume-title":"2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"He","year":"2016"},{"key":"B14","article-title":"\u201cLabeled faces in the wild: a database forstudying face recognition in unconstrained environments,\u201d","volume-title":"Workshop on Faces in \u201cReal-Life\u201d Images: Detection, Alignment, and Recognition","author":"Huang","year":"2008"},{"key":"B15","doi-asserted-by":"publisher","first-page":"5","DOI":"10.24867\/JGED-2016-1-005","article-title":"Eye-tracking analysis of face observing and face recognition","volume":"7","author":"Iskra","year":"2016","journal-title":"J. Graph. Eng. Design"},{"key":"B16","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1038\/s41467-021-22078-3","article-title":"Qualitative similarities and differences in visual object representations between brains and deep networks","volume":"12","author":"Jacob","year":"2021","journal-title":"Nat. Commun."},{"key":"B17","doi-asserted-by":"crossref","DOI":"10.1109\/EMBC.2019.8857005","article-title":"\u201cClassifying individuals with ASD through facial emotion recognition and eye-tracking,\u201d","volume-title":"41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)","author":"Jiang","year":"2019"},{"key":"B18","first-page":"18750","article-title":"\u201cAdaface: quality adaptive margin for face recognition,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Kim","year":"2022"},{"key":"B19","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1109\/ICCV.2009.5459250","article-title":"\u201cAttribute and simile classifiers for face verification,\u201d","volume-title":"2009 IEEE 12th International Conference on Computer Vision","author":"Kumar","year":"2009"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2201.05297","article-title":"MMNet: muscle motion-guided network for micro-expression recognition","author":"Li","year":"2022","journal-title":"arXiv preprint arXiv:2201.05297"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2384","DOI":"10.3390\/s20082384","article-title":"Emotion recognition using eye-tracking: taxonomy, review and current challenges","volume":"20","author":"Lim","year":"2020","journal-title":"Sensors"},{"key":"B22","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1080\/02699930701273849","article-title":"Minimum presentation time for masked facial expression discrimination","volume":"22","author":"Maarten Milders","year":"2008","journal-title":"Cogn. Emot."},{"key":"B23","first-page":"14225","article-title":"\u201cMagface: a universal representation for face recognition and quality assessment,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Meng","year":"2021"},{"key":"B24","doi-asserted-by":"publisher","first-page":"245","DOI":"10.3758\/s13423-016-1131-5","article-title":"The composite face illusion","volume":"24","author":"Murphy","year":"2017","journal-title":"Psychon. Bullet. Rev"},{"key":"B25","doi-asserted-by":"publisher","first-page":"a0037004","DOI":"10.1037\/a0037004","article-title":"A meta-analysis and review of holistic face processing","volume":"140","author":"Richler","year":"2014","journal-title":"Psychol. Bullet"},{"key":"B26","doi-asserted-by":"publisher","first-page":"553","DOI":"10.3389\/fpsyg.2012.00553","article-title":"Meanings, mechanisms, and measures of holistic processing","volume":"3","author":"Richler","year":"2012","journal-title":"Front. Psychol."},{"key":"B27","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1068\/p5027","article-title":"The role of eyebrows in face recognition","volume":"32","author":"Sadr","year":"2003","journal-title":"Perception"},{"key":"B28","doi-asserted-by":"crossref","DOI":"10.1109\/ICCV.2017.74","article-title":"\u201cGrad-CAM: visual explanations from deep networks via gradient-based localization,\u201d","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV)","author":"Selvaraju","year":"2017"},{"key":"B29","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1080\/14640749308401045","article-title":"Parts and wholes in face recognition","volume":"46","author":"Tanaka","year":"1993","journal-title":"Quart. J. Exp. Psychol"},{"key":"B30","doi-asserted-by":"publisher","first-page":"1876","DOI":"10.1080\/17470218.2016.1146780","article-title":"The \"parts and wholes\"of face recognition: a review of the literature","volume":"69","author":"Tanaka","year":"2016","journal-title":"Quart. J. Exp. Psychol"},{"key":"B31","doi-asserted-by":"publisher","first-page":"854218","DOI":"10.3389\/fncom.2022.854218","article-title":"The face inversion effect in deep convolutional neural networks","volume":"16","author":"Tian","year":"2022","journal-title":"Front. Comput. Neurosci"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1623","DOI":"10.1126\/science.1110589","article-title":"Inferences of competence from faces predict election outcomes","volume":"308","author":"Todorov","year":"2005","journal-title":"Science"},{"key":"B33","doi-asserted-by":"publisher","first-page":"592","DOI":"10.1111\/j.1467-9280.2006.01750.x","article-title":"First impressions: making up your mind after a 100-ms exposure to a face","volume":"17","author":"Willis","year":"2006","journal-title":"Psychol. Sci"},{"key":"B34","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1016\/j.cognition.2008.07.002","article-title":"Friend or foe: the effect of implicit trustworthiness judgments in social decision-making","volume":"108","author":"Wout","year":"2008","journal-title":"Cognition"},{"key":"B35","first-page":"9653","article-title":"\u201cSimmim: a simple framework for masked image modeling,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Xie","year":"2022"},{"key":"B36","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1073\/pnas.1403112111","article-title":"Performance-optimized hierarchical models predict neural responses in higher visual cortex","volume":"2014","author":"Yamins","year":"2014","journal-title":"Proc. Natl. Acad. Sci. U. S. A"},{"key":"B37","doi-asserted-by":"publisher","first-page":"e86041","DOI":"10.1371\/journal.pone.0086041","article-title":"CASME II: an improved spontaneous micro-expression database and the baseline evaluation","volume":"9","author":"Yan","year":"2014","journal-title":"PloS ONE"},{"key":"B38","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1068\/p160747","article-title":"Configurational information in face perception","volume":"16","author":"Young","year":"1987","journal-title":"Perception"},{"key":"B39","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1556\/JCEP.2.2004.1-2.6","article-title":"The origin of first impressions","volume":"2","author":"Zebrowitz","year":"2004","journal-title":"J. Cult. Evol. Psychol"},{"key":"B40","article-title":"\u201cS3FD: single shot scale-invariant face detector,\u201d","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV)","author":"Zhang","year":"2017"}],"container-title":["Frontiers in Computational Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2024.1209082\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T04:32:28Z","timestamp":1712637148000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2024.1209082\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,9]]},"references-count":40,"alternative-id":["10.3389\/fncom.2024.1209082"],"URL":"https:\/\/doi.org\/10.3389\/fncom.2024.1209082","relation":{},"ISSN":["1662-5188"],"issn-type":[{"type":"electronic","value":"1662-5188"}],"subject":[],"published":{"date-parts":[[2024,4,9]]},"article-number":"1209082"}}