{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T08:41:43Z","timestamp":1770972103152,"version":"3.50.1"},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,12,31]],"date-time":"2023-12-31T00:00:00Z","timestamp":1703980800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Comput. Cult. Herit."],"published-print":{"date-parts":[[2023,12,31]]},"abstract":"<jats:p>This study examines the longstanding need and challenge of providing contextual analysis of historical images stored in digital visual archives and the accessibility of retrieving contextual information from these historical archives. Contextual analysis is essential for disciplines such as history and art history, as it allows for the contextualization of artwork and historical sources with historical narratives, which, in turn, enhances understanding of the artistic or political expression in the contents of cultural products. To address this challenge, a novel approach is proposed utilizing computer vision to trace the circulation and dissemination of historical photographs in their original contexts. This method involves first using YOLO v7 to crop historical images from pictorial magazines, then training machine learning models on the cropped printed images plus another large dataset of original historical photographs, and comparing the similarity of images between the datasets of printed images and original photographs. To ensure accuracy of image similarities between the two subsets with distinct image qualities, an ensemble of three machine learning models\u2014Vision Transformer, EfficientNetv2, and Swin Transformer\u2014was developed. Through this system, contexts in the circulation of historical photographs were discovered and new insights regarding the editing strategies of propaganda magazines in East Asia during WWII were uncovered. These outcomes offer supporting evidence for previous research in the history and art historical disciplines, and demonstrate the potential of computer vision for uncovering new information from digital visual archives. Our model achieves a 77.8% top-15 retrieval accuracy on our evaluation dataset.<\/jats:p>","DOI":"10.1145\/3631129","type":"journal-article","created":{"date-parts":[[2023,11,9]],"date-time":"2023-11-09T11:40:05Z","timestamp":1699530005000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Probing Historical Image Contexts: Enhancing Visual Archive Retrieval through Computer Vision"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3174-7110","authenticated-orcid":false,"given":"Lin","family":"Du","sequence":"first","affiliation":[{"name":"Department of Asian Languages and Cultures, University of California, Los Angeles"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2735-9319","authenticated-orcid":false,"given":"Brandon","family":"Le","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of California, Los Angeles"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4591-3546","authenticated-orcid":false,"given":"Edouardo","family":"Honig","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of California, Los Angeles"}]}],"member":"320","published-online":{"date-parts":[[2024,1,8]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.1093\/llc\/fqz013"},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.2307\/3045790"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/joc\/jqac036"},{"key":"e_1_3_2_5_1","unstructured":"Johannes Buchner. 2023. ImageHash: An image hashing library written in Python. https:\/\/github.com\/JohannesBuchner\/imagehash"},{"key":"e_1_3_2_6_1","first-page":"1597","volume-title":"International Conference on Machine Learning","author":"Chen Ting","year":"2020","unstructured":"Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In International Conference on Machine Learning (2020), 1597\u20131607. PMLR."},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3014458"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479010"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1093\/alh\/ajv028"},{"key":"e_1_3_2_10_1","unstructured":"Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)."},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.1080\/01973762.2013.761106"},{"key":"e_1_3_2_12_1","volume-title":"The Early Photographic Propaganda in Chinese Communist Party (CCP): A Case Study of Photographer Sha Fei's Photographic Practice from 1936 to the WWII","author":"Du Lin","year":"2016","unstructured":"Lin Du. 2016. The Early Photographic Propaganda in Chinese Communist Party (CCP): A Case Study of Photographer Sha Fei's Photographic Practice from 1936 to the WWII. MA thesis, Harvard University."},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3080920"},{"key":"e_1_3_2_14_1","unstructured":"Frick Collection. 2023. The Frick photoarchive. https:\/\/www.frick.org\/library\/photoarchive"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10502-022-09390-7"},{"issue":"3","key":"e_1_3_2_17_1","article-title":"Transforming information into knowledge: How computational methods reshape art history","volume":"015","author":"Lang Sabine","year":"2021","unstructured":"Sabine Lang and Bj\u00f6rn Ommer. 2021. Transforming information into knowledge: How computational methods reshape art history. Digital Humanities Quarterly 015, 3 (2021).","journal-title":"Digital Humanities Quarterly"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"issue":"2","key":"e_1_3_2_20_1","article-title":"Using computer vision to increase the research potential of photo archives","volume":"3","author":"Resig John","year":"2014","unstructured":"John Resig. 2014. Using computer vision to increase the research potential of photo archives. Journal of Digital Humanities 3, 2 (2014), 3\u20132. https:\/\/journalofdigitalhumanities.org\/3-2\/using-computer-vision-to-increase-the-research-potential-of-photo-archives-by-john-resig\/#:\u223c:text=This%20initial%20foray%20into%20using,detected%2C%20and%20corrections%20were%20offered","journal-title":"Journal of Digital Humanities"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"e_1_3_2_22_1","unstructured":"\u201cShina k\u014dnichi senku oyobi shigen k\u014dts\u016bm\u014d y\u014dzu. 1941. T\u014dky\u014d: T\u014dy\u014d Ky\u014dkai Ch\u014dsabu. https:\/\/id.lib.harvard.edu\/alma\/990146241510203941\/catalog"},{"key":"e_1_3_2_23_1","first-page":"34","article-title":"An examination of Sha Fei's series of works","volume":"7","author":"Si Sushi","year":"2016","unstructured":"Sushi Si. 2016. An examination of Sha Fei's series of works. Chinese Photography 7 (2016), 34\u201389.","journal-title":"Chinese Photography"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448211049459"},{"key":"e_1_3_2_25_1","first-page":"10096","volume-title":"International Conference on Machine Learning","author":"Tan Mingxing","year":"2021","unstructured":"Mingxing Tan and Quoc Le. 2021. EfficientNetV2: Smaller models and faster training. In International Conference on Machine Learning, PMLR, 10096\u201310106."},{"key":"e_1_3_2_26_1","unstructured":"TinEye. 2023. TinEye Match Engine. https:\/\/services.tineye.com\/MatchEngine"},{"key":"e_1_3_2_27_1","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_28_1","unstructured":"Chien-Yao Wang Alexey Bochkovskiy and Hong-Yuan Mark Liao. 2022. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv preprint arXiv:2207.02696 (2022)."},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/llc\/fqy085"}],"container-title":["Journal on Computing and Cultural Heritage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631129","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3631129","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:35:51Z","timestamp":1750178151000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,31]]},"references-count":28,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,12,31]]}},"alternative-id":["10.1145\/3631129"],"URL":"https:\/\/doi.org\/10.1145\/3631129","relation":{},"ISSN":["1556-4673","1556-4711"],"issn-type":[{"value":"1556-4673","type":"print"},{"value":"1556-4711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,31]]},"assertion":[{"value":"2023-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-25","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}