{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T16:41:33Z","timestamp":1771260093272,"version":"3.50.1"},"reference-count":33,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T00:00:00Z","timestamp":1700092800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Ghent University, Imec, Meemoo, the Belgian Science Policy Office"},{"name":"Flanders Department of Culture, Youth, and Media"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Comput. Cult. Herit."],"published-print":{"date-parts":[[2023,12,31]]},"abstract":"<jats:p>The digitization of image archives across the globe has opened up vast collections of libraries, museums, and cultural heritage institutions. These collections provide valuable historical information to the public and researchers. Many image collections have little metadata describing who or what is depicted in a structured format, making it difficult to search for specific persons. This work presents a facial recognition pipeline to enrich these collections by recognizing the persons in each image. A reference dataset of over 6,000 known persons was constructed and facial recognition was performed on a dataset of over 150 thousand images. Detected faces were matched with the known faces using a similarity score on the face embeddings. We developed an interactive labeling tool to efficiently validate the face recognition predictions. A total of 182 thousand detected faces were labeled with this tool. Using a minimum similarity score of 0.5, the face recognition model achieved a precision of 0.936 and identified over 62 thousand persons from the image archives. We show how clustering can be used to identify new persons that were not included in the reference dataset. Furthermore, we highlight the potential of facial recognition to enhance the accessibility of the collections and offer new insights.<\/jats:p>","DOI":"10.1145\/3606704","type":"journal-article","created":{"date-parts":[[2023,7,5]],"date-time":"2023-07-05T12:20:13Z","timestamp":1688559613000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Enriching Image Archives via Facial Recognition"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9765-6000","authenticated-orcid":false,"given":"Kenzo","family":"Milleville","sequence":"first","affiliation":[{"name":"Ghent University\u2014IDLab, Imec, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3593-7851","authenticated-orcid":false,"given":"Alec","family":"Van den Broeck","sequence":"additional","affiliation":[{"name":"Ghent University\u2014IDLab, Imec, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-0483-1866","authenticated-orcid":false,"given":"Nastasia","family":"Vanderperren","sequence":"additional","affiliation":[{"name":"Meemoo, FlemishInstitute for Archives, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4333-5970","authenticated-orcid":false,"given":"Rony","family":"Vissers","sequence":"additional","affiliation":[{"name":"Meemoo, FlemishInstitute for Archives, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3479-044X","authenticated-orcid":false,"given":"Matthias","family":"Priem","sequence":"additional","affiliation":[{"name":"Meemoo, FlemishInstitute for Archives, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5327-4000","authenticated-orcid":false,"given":"Nico","family":"Van de Weghe","sequence":"additional","affiliation":[{"name":"Ghent University\u2014CartoGIS, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1094-2184","authenticated-orcid":false,"given":"Steven","family":"Verstockt","sequence":"additional","affiliation":[{"name":"Ghent University\u2014IDLab, Imec, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,11,16]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"2022. InsightFace: State of the art deep face analysis library. (2022). Retrieved December 29 2022 from https:\/\/github.com\/deepinsight\/insightface"},{"key":"e_1_3_2_3_2","doi-asserted-by":"crossref","unstructured":"Fadi Boutros Naser Damer Florian Kirchbuchner and Arjan Kuijper. 2022. Elasticface: Elastic margin loss for deep face recognition. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition . 1578\u20131587.","DOI":"10.1109\/CVPRW56347.2022.00164"},{"key":"e_1_3_2_4_2","first-page":"77","volume-title":"Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research)","volume":"81","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research). Sorelle A. Friedler and Christo Wilson (Eds.), Vol. 81. PMLR, 77\u201391. Retrieved from https:\/\/proceedings.mlr.press\/v81\/buolamwini18a.html"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00020"},{"key":"e_1_3_2_6_2","unstructured":"Brandon Castellano. 2022. PySceneDetect Intelligent scene cut detection and video splitting tool. (2022). Retrieved December 29 2022 from https:\/\/scenedetect.com\/en\/latest\/"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.3366\/ijhac.2014.0119"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3479010"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00525"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00482"},{"key":"e_1_3_2_12_2","unstructured":"Martin Ester Hans-Peter Kriegel J\u00f6rg Sander and Xiaowei Xu1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining . Vol. 96. 226\u2013231."},{"key":"e_1_3_2_13_2","unstructured":"Jia Guo Jiankang Deng Alexandros Lattas and Stefanos Zafeiriou. 2022. Sample and computation redistribution for efficient face detection. In International Conference on Learning Representations . https:\/\/openreview.net\/forum?id=RhB1AdoFfGE"},{"key":"e_1_3_2_14_2","volume-title":"Proceedings of the Workshop on Faces in\u2018Real-Life\u2019Images: Detection, Alignment, and Recognition","author":"Huang Gary B.","year":"2008","unstructured":"Gary B. Huang, Marwan Mattar, Tamara Berg, and Eric Learned-Miller. 2008. Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. In Proceedings of the Workshop on Faces in\u2018Real-Life\u2019Images: Detection, Alignment, and Recognition."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3583557"},{"key":"e_1_3_2_16_2","unstructured":"Jian Li Yabiao Wang Changan Wang Ying Tai Jianjun Qian Jian Yang Chengjie Wang Jilin Li and Feiyue Huang. 2019. DSFD: Dual Shot Face Detector. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition . 5060\u20135069."},{"key":"e_1_3_2_17_2","volume-title":"Proceedings of the DataTV 2021, 2nd International Workshop on Data-Driven Personalisation of Television","author":"Lisena Pasquale","year":"2021","unstructured":"Pasquale Lisena, Jorma Laaksonen, and Rapha\u00ebl Troncy. 2021. FaceRec: An interactive framework for face recognition in video archives. In Proceedings of the DataTV 2021, 2nd International Workshop on Data-Driven Personalisation of Television."},{"key":"e_1_3_2_18_2","unstructured":"Camillo Lugaresi Jiuqiang Tang Hadon Nash Chris McClanahan Esha Uboweja Michael Hays Fan Zhang Chuo-Ling Chang Ming Guang Yong Juhyun Lee Wan-Teh Chang Wei Hua Manfred Georg and Matthias Grundmann. 2019. Mediapipe: A framework for building perception pipelines. arXiv:1906.08172. Retrieved from https:\/\/arxiv.org\/abs\/1906.08172"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.6517242"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3365842"},{"key":"e_1_3_2_21_2","unstructured":"Alec Radford Jong Wook Kim Chris Hallacy Aditya Ramesh Gabriel Goh Sandhini Agarwal Girish Sastry Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger and Ilya Sutskever. 2021. Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research Vol. 139) Marina Meila and Tong Zhang (Eds.). PMLR 8748\u20138763. https:\/\/proceedings.mlr.press\/v139\/radford21a.html"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3186653"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.5075\/epfl-thesis-8857"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.220"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TTS.2021.3111823"},{"key":"e_1_3_2_27_2","first-page":"161","volume-title":"Proceedings of the 14th ICA conference: Digital Approaches to Cartographic Heritage","author":"Verstockt Steven","year":"2019","unstructured":"Steven Verstockt, Kenzo Milleville, Dilawar Ali, Francisco Porras-Bernandez, Georg Gartner, and Nico Van de Weghe. 2019. EURECA: European region enrichment in city archives and collections. In Proceedings of the 14th ICA conference: Digital Approaches to Cartographic Heritage. Aristoteleio Panepistimio Thessalonikis (APTh), 161\u2013169."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2001.990517"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.10.081"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-66096-3_7"},{"key":"e_1_3_2_31_2","article-title":"Learning face representation from scratch","author":"Yi Dong","year":"2014","unstructured":"Dong Yi, Zhen Lei, Shengcai Liao, and Stan Z. Li. 2014. Learning face representation from scratch. arXiv Preprint arXiv:1411.7923 (2014).","journal-title":"arXiv Preprint arXiv:1411.7923"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2016.2603342"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10796-012-9350-4"},{"key":"e_1_3_2_34_2","doi-asserted-by":"crossref","unstructured":"Zheng Zhu Guan Huang Jiankang Deng Yun Ye Junjie Huang Xinze Chen Jiagang Zhu Tian Yang Jiwen Lu Dalong Du and Jie Zhou. 2021. WebFace260M: A benchmark unveiling the power of million-scale deep face recognition. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 10492\u201310502.","DOI":"10.1109\/CVPR46437.2021.01035"}],"container-title":["Journal on Computing and Cultural Heritage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3606704","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3606704","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:51Z","timestamp":1750182531000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3606704"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,16]]},"references-count":33,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,12,31]]}},"alternative-id":["10.1145\/3606704"],"URL":"https:\/\/doi.org\/10.1145\/3606704","relation":{},"ISSN":["1556-4673","1556-4711"],"issn-type":[{"value":"1556-4673","type":"print"},{"value":"1556-4711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,16]]},"assertion":[{"value":"2022-12-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-18","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}