{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:38:43Z","timestamp":1770917923241,"version":"3.50.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,12,24]],"date-time":"2022-12-24T00:00:00Z","timestamp":1671840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EU H2020","award":["101004469"],"award-info":[{"award-number":["101004469"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Comput. Cult. Herit."],"published-print":{"date-parts":[[2023,3,31]]},"abstract":"<jats:p>\n            <jats:bold>Human pose estimation (HPE)<\/jats:bold>\n            is a central part of understanding the visual narration and body movements of characters depicted in artwork collections, such as Greek vase paintings. Unfortunately, existing HPE methods do not generalise well across domains resulting in poorly recognised poses. Therefore, we propose a two step approach: (1) adapting a dataset of natural images of known person and pose annotations to the style of Greek vase paintings by means of image style-transfer. We introduce a perceptually-grounded style transfer training to enforce perceptual consistency. Then, we fine-tune the base model with this newly created dataset. We show that using style-transfer learning significantly improves the SOTA performance on unlabelled data by more than 6%\u00a0\n            <jats:bold>mean average precision (mAP)<\/jats:bold>\n            as well as\n            <jats:bold>mean average recall (mAR)<\/jats:bold>\n            . (2) To improve the already strong results further, we created a small dataset (ClassArch) consisting of ancient Greek vase paintings from the 6\u20135th century BCE with person and pose annotations. We show that fine-tuning on this data with a style-transferred model improves the performance further. In a thorough ablation study, we give a targeted analysis of the influence of style intensities, revealing that the model learns generic domain styles. Additionally, we provide a pose-based image retrieval to demonstrate the effectiveness of our method. The code and pretrained models can be found at\n            <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"url\" xlink:href=\"https:\/\/github.com\/angelvillar96\/STLPose\">https:\/\/github.com\/angelvillar96\/STLPose<\/jats:ext-link>\n            .\n          <\/jats:p>","DOI":"10.1145\/3569089","type":"journal-article","created":{"date-parts":[[2022,11,1]],"date-time":"2022-11-01T12:03:50Z","timestamp":1667304230000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Enhancing Human Pose Estimation in Ancient Vase Paintings via Perceptually-grounded Style Transfer Learning"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2707-415X","authenticated-orcid":false,"given":"Prathmesh","family":"Madhu","sequence":"first","affiliation":[{"name":"Pattern Recognition Lab, Friedrich Alexander University, Erlangen, Bavaria, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5805-2098","authenticated-orcid":false,"given":"Angel","family":"Villar-Corrales","sequence":"additional","affiliation":[{"name":"Autonomous Intelligent Systems, University of Bonn, Bonn, North Rhine-Westphalia, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2453-7876","authenticated-orcid":false,"given":"Ronak","family":"Kosti","sequence":"additional","affiliation":[{"name":"Digital Humanities and Social Sciences, Friedrich Alexander University, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9579-7128","authenticated-orcid":false,"given":"Torsten","family":"Bendschus","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Klassische Arch\u00e4ologie, FAU, Erlangen, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2595-325X","authenticated-orcid":false,"given":"Corinna","family":"Reinhardt","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Klassische Arch\u00e4ologie, FAU, Erlangen, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4415-7408","authenticated-orcid":false,"given":"Peter","family":"Bell","sequence":"additional","affiliation":[{"name":"German Studies and Art Studies, Philipps University of Marburg, Marburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9550-5284","authenticated-orcid":false,"given":"Andreas","family":"Maier","sequence":"additional","affiliation":[{"name":"Pattern Recognition Lab, Friedrich Alexander University, Erlangen, Bavaria, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0455-3799","authenticated-orcid":false,"given":"Vincent","family":"Christlein","sequence":"additional","affiliation":[{"name":"Pattern Recognition Lab, Friedrich Alexander University, Erlangen, Bavaria, Germany"}]}],"member":"320","published-online":{"date-parts":[[2022,12,24]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330701"},{"key":"e_1_3_3_3_2","first-page":"9\u2013CB1","article-title":"Aby Warburg\u2019s pathosformel as methodological paradigm","volume":"9","author":"Becker Colleen M.","year":"2013","unstructured":"Colleen M. Becker. 2013. Aby Warburg\u2019s pathosformel as methodological paradigm. The Journal of Art Historiography 9 (2013), 9\u2013CB1.","journal-title":"The Journal of Art Historiography"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1515\/mial-2019-0004"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1080\/01973762.2013.761111"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.143"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33765-9_11"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.512"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2018.07.026"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00742"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.5244\/C.28.38"},{"key":"e_1_3_3_12_2","first-page":"14","article-title":"Of gods and goats: Weakly supervised learning of figurative art","volume":"8","author":"Crowley Elliot J.","year":"2013","unstructured":"Elliot J. Crowley and Andrew Zisserman. 2013. Of gods and goats: Weakly supervised learning of figurative art. Learning 8 (2013), 14.","journal-title":"Learning"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00110"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.256"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.169"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.81"},{"key":"e_1_3_3_18_2","volume-title":"Bild und Mythos: Geschichte Der Bilderz\u00e4hlung in Der Griechischen Kunst","author":"Giuliani Luca","year":"2003","unstructured":"Luca Giuliani. 2003. Bild und Mythos: Geschichte Der Bilderz\u00e4hlung in Der Griechischen Kunst. CH Beck, M\u00fcnchen."},{"key":"e_1_3_3_19_2","first-page":"249","volume-title":"Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research, Vol. 9)","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research, Vol. 9), Yee Whye Teh and Mike Titterington (Eds.). PMLR, Chia Laguna Resort, Sardinia, Italy, 249\u2013256."},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-015-0017-1"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_3_22_2","first-page":"1989","volume-title":"International Conference on Machine Learning","author":"Hoffman Judy","year":"2018","unstructured":"Judy Hoffman, Eric Tzeng, Taesung Park, Jun-Yan Zhu, Phillip Isola, Kate Saenko, Alexei Efros, and Trevor Darrell. 2018. CyCADA: Cycle-consistent adversarial domain adaptation. In International Conference on Machine Learning. PMLR, Sweden, 1989\u20131998."},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.243"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.167"},{"key":"e_1_3_3_25_2","volume-title":"Totentanz. Operationalizing Aby Warburg\u2019s Pathosformeln","author":"Impett Leonardo","year":"2017","unstructured":"Leonardo Impett and Franco Moretti. 2017. Totentanz. Operationalizing Aby Warburg\u2019s Pathosformeln. Technical Report. Stanford Literary Lab, Stanford."},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00525"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46466-4_3"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2019.00216"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2008.923513"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_3_3_31_2","volume-title":"ICLR: International Conference on Learning Representations","author":"Kingma Diederik P.","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Lei Ba. 2015. Adam: A method for stochastic gradient descent. In ICLR: International Conference on Learning Representations. ICLR, US."},{"key":"e_1_3_3_32_2","first-page":"386","volume-title":"Advances in Neural Information Processing Systems","author":"Li Yijun","year":"2017","unstructured":"Yijun Li, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu, and Ming-Hsuan Yang. 2017. Universal style transfer via feature transforms. In Advances in Neural Information Processing Systems. NIPS, USA, 386\u2013396."},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_3_34_2","first-page":"97","volume-title":"International Conference on Machine Learning","author":"Long Mingsheng","year":"2015","unstructured":"Mingsheng Long, Yue Cao, Jianmin Wang, and Michael Jordan. 2015. Learning transferable features with deep adaptation networks. In International Conference on Machine Learning. PMLR, France, 97\u2013105."},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3347317.3357242"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.542"},{"key":"e_1_3_3_37_2","volume-title":"Gestures in Attic Vase Painting: Use and Meaning, 550-450 BC","author":"McNiven Timothy John","year":"1983","unstructured":"Timothy John McNiven. 1983. Gestures in Attic Vase Painting: Use and Meaning, 550-450 BC. University of Michigan, Michigan."},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2578726.2578791"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00796"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(77)90006-6"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.395"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.533"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"e_1_3_3_45_2","volume-title":"BMVC","author":"Rodriguez A. L.","year":"2019","unstructured":"A. L. Rodriguez and K. Mikolajczyk. 2019. Domain adaptation for object detection via style consistency. In BMVC. BMVA Press, UK."},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00970"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00845"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.11588\/dah.2016.2.23376"},{"key":"e_1_3_3_49_2","series-title":"Archiving Conference","first-page":"1","author":"Seguin Benoit","year":"2018","unstructured":"Benoit Seguin, Lisandra Costiner, Isabella di Lenardo, and Fr\u00e9d\u00e9ric Kaplan. 2018. New techniques for the digitization of art historical photographic archives-the case of the Cini Foundation in Venice. In Archiving Conference(2018, 1). Society for Imaging Science and Technology, US, 1\u20135."},{"key":"e_1_3_3_50_2","first-page":"341","article-title":"Structural differentiation of pursuit scenes","author":"Stansbury-O\u2019Donnell Mark","year":"2009","unstructured":"Mark Stansbury-O\u2019Donnell. 2009. Structural differentiation of pursuit scenes. \\(\\sigma\\) \\(\\tau\\) o: Yatromanolakis -, - (2009), 341\u2013372.","journal-title":"\\(\\sigma\\) \\(\\tau\\) o: Yatromanolakis"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-49409-8_35"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00584"},{"key":"e_1_3_3_53_2","first-page":"1799","volume-title":"Advances in Neural Information Processing Systems","author":"Tompson Jonathan J.","year":"2014","unstructured":"Jonathan J. Tompson, Arjun Jain, Yann LeCun, and Christoph Bregler. 2014. Joint training of a convolutional network and a graphical model for human pose estimation. In Advances in Neural Information Processing Systems. NIPS, Canada, 1799\u20131807."},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.214"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.511"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46604-0_57"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01231-1_29"}],"container-title":["Journal on Computing and Cultural Heritage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569089","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3569089","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:41Z","timestamp":1750182701000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569089"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,24]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3,31]]}},"alternative-id":["10.1145\/3569089"],"URL":"https:\/\/doi.org\/10.1145\/3569089","relation":{},"ISSN":["1556-4673","1556-4711"],"issn-type":[{"value":"1556-4673","type":"print"},{"value":"1556-4711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,24]]},"assertion":[{"value":"2021-11-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-06-06","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}