{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T19:52:48Z","timestamp":1781639568799,"version":"3.54.5"},"reference-count":125,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T00:00:00Z","timestamp":1772236800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T00:00:00Z","timestamp":1772236800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100011079","name":"Universit\u00e9 Lumi\u00e8re Lyon 2","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100011079","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Objects present in paintings help art history specialists interpret and decode artworks. The analysis of large, digitized artistic collections became feasible thanks to modern object detection approaches. Nevertheless, the use of object detection models typically requires fine-tuning for specific tasks. Therefore, art history specialists remain constrained by the categories of objects in existing labeled artistic datasets when using artificial intelligence methods. This limitation can be overcome by using recent models that combine two modalities: vision and text. Vision-language models have made open-vocabulary detection (OVD) possible, allowing detection without restrictions on the applied categories, in contrast to fixed-vocabulary detection. Recent literature lacks a comprehensive review focusing on OVD in artistic images. In this paper we analyze state-of-the-art models for OVD, analyze their transferability to cultural heritage categories and systematically evaluate them on artistic datasets commonly used in literature. The DEArt and IconArt datasets, which are annotated with cultural heritage-specific categories contain paintings from the 11th to the 20th century. While the Watercolor2K dataset, annotated with common object categories consists of watercolor paintings. Based on our analysis, the OWLv2 model achieved the best performance in both object detection and grounding task scenarios on these datasets. Additionally, we discuss existing challenges of open-vocabulary segmentation in artistic images and future tasks.<\/jats:p>","DOI":"10.1007\/s11042-026-21443-y","type":"journal-article","created":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T02:15:39Z","timestamp":1772244939000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Open-vocabulary models for object detection and segmentation in visual art: survey and comparative study"],"prefix":"10.1007","volume":"85","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4559-0748","authenticated-orcid":false,"given":"Tetiana","family":"Yemelianenko","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5551-1105","authenticated-orcid":false,"given":"Iuliia","family":"Tkachenko","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2783-8643","authenticated-orcid":false,"given":"Tess","family":"Masclef","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6127-8843","authenticated-orcid":false,"given":"Mihaela","family":"Scuturici","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7722-9899","authenticated-orcid":false,"given":"Serge","family":"Miguet","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,2,28]]},"reference":[{"key":"21443_CR1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2022.104471","volume":"123","author":"K Tong","year":"2022","unstructured":"Tong K, Wu Y (2022) Deep learning-based detection from the perspective of small or tiny objects: A survey. Image Vis Comput 123:104471. https:\/\/doi.org\/10.1016\/j.imavis.2022.104471","journal-title":"Image Vis Comput"},{"key":"21443_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2024.108458","volume":"133","author":"Y Sun","year":"2024","unstructured":"Sun Y, Sun Z, Chen W (2024) The evolution of object detection methods. Eng Appl Artif Intell 133:108458. https:\/\/doi.org\/10.1016\/j.engappai.2024.108458","journal-title":"Eng Appl Artif Intell"},{"key":"21443_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2024.128102","volume":"598","author":"Z Li","year":"2024","unstructured":"Li Z, Dong Y, Shen L, Liu Y, Pei Y, Yang H, Zheng L, Ma J (2024) Development and challenges of object detection: A survey. Neurocomputing 598:128102. https:\/\/doi.org\/10.1016\/j.neucom.2024.128102","journal-title":"Neurocomputing"},{"issue":"5","key":"21443_CR4","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.1016\/j.icte.2024.07.005","volume":"10","author":"J Moon","year":"2024","unstructured":"Moon J, Bukhari M, Kim C, Nam Y, Maqsood M, Rho S (2024) Object detection under the lens of privacy: A critical survey of methods, challenges, and future directions. ICT Express 10(5):1124\u20131144. https:\/\/doi.org\/10.1016\/j.icte.2024.07.005","journal-title":"ICT Express"},{"issue":"1","key":"21443_CR5","doi-asserted-by":"publisher","first-page":"1941","DOI":"10.32604\/cmc.2023.032757","volume":"74","author":"J Cheng","year":"2022","unstructured":"Cheng J, Li H, Li D, Hua S, Sheng VS (2022) A survey on image semantic segmentation using deep learning techniques. Computers Materials and Continua 74(1):1941\u20131957. https:\/\/doi.org\/10.32604\/cmc.2023.032757","journal-title":"Computers Materials and Continua"},{"key":"21443_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2023.106669","volume":"126","author":"H Thisanke","year":"2023","unstructured":"Thisanke H, Deshan C, Chamith K, Seneviratne S, Vidanaarachchi R, Herath D (2023) Semantic segmentation using vision transformers: A survey. Eng Appl Artif Intell 126:106669. https:\/\/doi.org\/10.1016\/j.engappai.2023.106669","journal-title":"Eng Appl Artif Intell"},{"key":"21443_CR7","doi-asserted-by":"publisher","first-page":"102608","DOI":"10.1016\/j.inffus.2024.102608","volume":"114","author":"KK Brar","year":"2025","unstructured":"Brar KK, Goyal B, Dogra A, Mustafa MA, Majumdar R, Alkhayyat A, Kukreja V (2025) Image segmentation review: Theoretical background and recent advances. Inf Fusion 114:102608. https:\/\/doi.org\/10.1016\/j.inffus.2024.102608","journal-title":"Inf Fusion"},{"key":"21443_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.jag.2024.104208","volume":"134","author":"Z Chen","year":"2024","unstructured":"Chen Z, Wang H, Wu X, Wang J, Lin X, Wang C, Gao K, Chapman M, Li D (2024) Object detection in aerial images using dota dataset: A survey. Int J Appl Earth Obs Geoinf 134:104208. https:\/\/doi.org\/10.1016\/j.jag.2024.104208","journal-title":"Int J Appl Earth Obs Geoinf"},{"key":"21443_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.cageo.2024.105704","volume":"192","author":"P Scala","year":"2024","unstructured":"Scala P, Manno G, Ciraolo G (2024) Semantic segmentation of coastal aerial\/satellite images using deep learning techniques: An application to coastline detection. Comput Geosci 192:105704. https:\/\/doi.org\/10.1016\/j.cageo.2024.105704","journal-title":"Comput Geosci"},{"key":"21443_CR10","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1016\/j.cag.2021.07.003","volume":"99","author":"G Zamanakos","year":"2021","unstructured":"Zamanakos G, Tsochatzidis L, Amanatiadis A, Pratikakis I (2021) A comprehensive survey of lidar-based 3d object detection methods with deep learning for autonomous driving. Computers & Graphics 99:153\u2013181. https:\/\/doi.org\/10.1016\/j.cag.2021.07.003","journal-title":"Computers & Graphics"},{"key":"21443_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2022.108796","volume":"130","author":"R Qian","year":"2022","unstructured":"Qian R, Lai X, Li X (2022) 3d object detection for autonomous driving: A survey. Pattern Recogn 130:108796. https:\/\/doi.org\/10.1016\/j.patcog.2022.108796","journal-title":"Pattern Recogn"},{"issue":"10","key":"21443_CR12","doi-asserted-by":"publisher","first-page":"102226","DOI":"10.1016\/j.jksuci.2024.102226","volume":"36","author":"MAM Elhassan","year":"2024","unstructured":"Elhassan MAM, Zhou C, Khan A, Benabid A, Adam ABM, Mehmood A, Wambugu N (2024) Real-time semantic segmentation for autonomous driving: A review of cnns, transformers, and beyond. J King Saud Univ - Comput Inf Sci 36(10):102226. https:\/\/doi.org\/10.1016\/j.jksuci.2024.102226","journal-title":"J King Saud Univ - Comput Inf Sci"},{"key":"21443_CR13","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1016\/j.inffus.2022.09.031","volume":"90","author":"I Qureshi","year":"2023","unstructured":"Qureshi I, Yan J, Abbas Q, Shaheed K, Riaz AB, Wahid A, Khan MWJ, Szczuko P (2023) Medical image segmentation using deep semantic-based methods: A review of techniques, applications and emerging trends. Inf Fusion 90:316\u2013352. https:\/\/doi.org\/10.1016\/j.inffus.2022.09.031","journal-title":"Inf Fusion"},{"key":"21443_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2023.107840","volume":"169","author":"R Jiao","year":"2024","unstructured":"Jiao R, Zhang Y, Ding L, Xue B, Zhang J, Cai R, Jin C (2024) Learning with limited annotations: A survey on deep semi-supervised learning for medical image segmentation. Comput Biol Med 169:107840. https:\/\/doi.org\/10.1016\/j.compbiomed.2023.107840","journal-title":"Comput Biol Med"},{"key":"21443_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2024.108509","volume":"175","author":"J Luo","year":"2024","unstructured":"Luo J, Dai P, He Z, Huang Z, Liao S, Liu K (2024) Deep learning models for ischemic stroke lesion segmentation in medical images: A survey. Comput Biol Med 175:108509. https:\/\/doi.org\/10.1016\/j.compbiomed.2024.108509","journal-title":"Comput Biol Med"},{"key":"21443_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2021.106404","volume":"189","author":"O Wosner","year":"2021","unstructured":"Wosner O, Farjon G, Bar-Hillel A (2021) Object detection in agricultural contexts: A multiple resolution benchmark and comparison to human. Comput Electron Agric 189:106404. https:\/\/doi.org\/10.1016\/j.compag.2021.106404","journal-title":"Comput Electron Agric"},{"key":"21443_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2024.109090","volume":"223","author":"CM Badgujar","year":"2024","unstructured":"Badgujar CM, Poulose A, Gan H (2024) Agricultural object detection with you only look once (yolo) algorithm: A bibliometric and systematic literature review. Comput Electron Agric 223:109090. https:\/\/doi.org\/10.1016\/j.compag.2024.109090","journal-title":"Comput Electron Agric"},{"key":"21443_CR18","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.cogr.2021.08.001","volume":"1","author":"C Tan","year":"2021","unstructured":"Tan C, Xu X, Shen F (2021) A survey of zero shot detection: Methods and applications. Cognitive Robotics 1:159\u2013167. https:\/\/doi.org\/10.1016\/j.cogr.2021.08.001","journal-title":"Cognitive Robotics"},{"key":"21443_CR19","doi-asserted-by":"publisher","first-page":"8954","DOI":"10.1109\/TPAMI.2024.3413013","volume":"46","author":"C Zhu","year":"2023","unstructured":"Zhu C, Chen L (2023) A survey on open-vocabulary detection and segmentation: Past, present, and future. IEEE Trans Pattern Anal Mach Intell 46:8954\u20138975","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"21443_CR20","doi-asserted-by":"crossref","unstructured":"Bianchi L, Carrara F, Messina N, Gennaro C, Falchi F (2023) The devil is in the fine-grained details: Evaluating open-vocabulary object detectors for fine-grained understanding. In: 2024 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 22520\u201322529","DOI":"10.1109\/CVPR52733.2024.02125"},{"key":"21443_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11042-023-15968-9","volume":"83","author":"S Bengamra","year":"2023","unstructured":"Bengamra S, Mzoughi O, Bigand A, Zagrouba E (2023) A comprehensive survey on object detection in visual art: taxonomy and challenge. Multimedia Tools and Applications 83:1\u201334. https:\/\/doi.org\/10.1007\/s11042-023-15968-9","journal-title":"Multimedia Tools and Applications"},{"issue":"2","key":"21443_CR22","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","volume":"88","author":"M Everingham","year":"2010","unstructured":"Everingham M, Van Gool L, Williams CKI, Winn J, Zisserman A (2010) The pascal visual object classes (voc) challenge. Int J Comput Vision 88(2):303\u2013338","journal-title":"Int J Comput Vision"},{"key":"21443_CR23","doi-asserted-by":"crossref","unstructured":"Lin T-Y, Maire M, Belongie SJ, Hays J, Perona P, Ramanan D, Doll\u00e1r P, Zitnick CL (2014) Microsoft coco: Common objects in context. In: European conference on computer vision","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"21443_CR24","doi-asserted-by":"crossref","unstructured":"Gupta A, Dollar P, Girshick R (2019) LVIS: A dataset for large vocabulary instance segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR.2019.00550"},{"key":"21443_CR25","doi-asserted-by":"crossref","unstructured":"Karayev S, Trentacoste M, Han H, Agarwala A, Darrell T, Hertzmann A, Winnemoeller H (2013) Recognizing image style. ArXiv arXiv:1311.3715","DOI":"10.5244\/C.28.122"},{"key":"21443_CR26","doi-asserted-by":"crossref","unstructured":"Shen X, Efros AA, Aubry M (2019) Discovering visual patterns in art collections with spatially-consistent feature learning. In: Proceedings IEEE Conf. on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2019.00950"},{"key":"21443_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3273022","volume":"14","author":"G Strezoski","year":"2018","unstructured":"Strezoski G (2018) Worring M Omniart: A large-scale artistic benchmark. ACM Trans Multimed Comput Commun Appl 14:1\u201321. https:\/\/doi.org\/10.1145\/3273022","journal-title":"ACM Trans Multimed Comput Commun Appl"},{"key":"21443_CR28","doi-asserted-by":"crossref","unstructured":"Crowley EJ, Zisserman A (2014) In search of art. In: Workshop on computer vision for art analysis, ECCV","DOI":"10.1007\/978-3-319-16178-5_4"},{"key":"21443_CR29","doi-asserted-by":"crossref","unstructured":"Westlake N, Cai H, Hall P (2016) Detecting people in artwork with cnns. In: ECCV Workshops","DOI":"10.1007\/978-3-319-46604-0_57"},{"key":"21443_CR30","doi-asserted-by":"publisher","unstructured":"Cetinic E, She J (2022) Understanding and creating art with ai: Review and outlook. ACM Trans Multimedia Comput Commun Appl 18(2). https:\/\/doi.org\/10.1145\/3475799","DOI":"10.1145\/3475799"},{"key":"21443_CR31","doi-asserted-by":"crossref","unstructured":"Reshetnikov A, Marinescu M-CV, L\u00f3pez JM (2022) Deart: Dataset of european art. In: ECCV Workshops","DOI":"10.1007\/978-3-031-25056-9_15"},{"key":"21443_CR32","doi-asserted-by":"crossref","unstructured":"Gonthier N, Gousseau Y, Ladjal S, Bonfait O (2018) Weakly supervised object detection in artworks. In: Computer vision - ECCV 2018 workshops, pp 692\u2013709. Springer","DOI":"10.1007\/978-3-030-11012-3_53"},{"key":"21443_CR33","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2021.103299","volume":"214","author":"N Gonthier","year":"2022","unstructured":"Gonthier N, Ladjal S, Gousseau Y (2022) Multiple instance learning on deep features for weakly supervised object detection with extreme domain shifts. Comput Vis Image Underst 214:103299. https:\/\/doi.org\/10.1016\/j.cviu.2021.103299","journal-title":"Comput Vis Image Underst"},{"key":"21443_CR34","doi-asserted-by":"crossref","unstructured":"Inoue N, Furuta R, Yamasaki T, Aizawa K (2018) Cross-domain weakly-supervised object detection through progressive domain adaptation. In: The IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 5001\u20135009","DOI":"10.1109\/CVPR.2018.00525"},{"issue":"4","key":"21443_CR35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3458885","volume":"14","author":"F Milani","year":"2021","unstructured":"Milani F, Fraternali P (2021) A dataset and a convolutional model for iconography classification in paintings. Journal on Computing and Cultural Heritage (JOCCH) 14(4):1\u201318","journal-title":"Journal on Computing and Cultural Heritage (JOCCH)"},{"key":"21443_CR36","doi-asserted-by":"publisher","unstructured":"Ibrahim BIE, Eyharabide V, Le Page V, Billiet F (2022) Few-shot object detection: Application to medieval musicological studies. Journal of Imaging 8(2). https:\/\/doi.org\/10.3390\/jimaging8020018","DOI":"10.3390\/jimaging8020018"},{"key":"21443_CR37","doi-asserted-by":"crossref","unstructured":"Ginosar S, Haas D, Brown T, Malik J (2014) Detecting people in cubist art. In: SIGAI","DOI":"10.1007\/978-3-319-16178-5_7"},{"key":"21443_CR38","doi-asserted-by":"publisher","unstructured":"Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR\u201905), vol 1, pp 886\u20138931. https:\/\/doi.org\/10.1109\/CVPR.2005.177","DOI":"10.1109\/CVPR.2005.177"},{"issue":"9","key":"21443_CR39","doi-asserted-by":"publisher","first-page":"1627","DOI":"10.1109\/TPAMI.2009.167","volume":"32","author":"PF Felzenszwalb","year":"2010","unstructured":"Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D (2010) Object detection with discriminatively trained part-based models. IEEE Trans Pattern Anal Mach Intell 32(9):1627\u20131645. https:\/\/doi.org\/10.1109\/TPAMI.2009.167","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"1","key":"21443_CR40","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1007\/s11263-015-0869-y","volume":"118","author":"A Hern\u00e1ndez-Vela","year":"2016","unstructured":"Hern\u00e1ndez-Vela A, Sclaroff S, Escalera S (2016) Poselet-based contextual rescoring for human pose estimation via pictorial structures. Int J Comput Vision 118(1):49\u201364. https:\/\/doi.org\/10.1007\/s11263-015-0869-y","journal-title":"Int J Comput Vision"},{"key":"21443_CR41","doi-asserted-by":"publisher","unstructured":"Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: 2014 IEEE conference on computer vision and pattern recognition, pp 580\u2013587. https:\/\/doi.org\/10.1109\/CVPR.2014.81","DOI":"10.1109\/CVPR.2014.81"},{"key":"21443_CR42","doi-asserted-by":"publisher","unstructured":"Bengamra S, Mzoughi O, Bigand A, Zagrouba E (2023) Towards explainability in using deep learning for face detection in paintings, pp 832\u2013841. https:\/\/doi.org\/10.5220\/0011670300003411","DOI":"10.5220\/0011670300003411"},{"key":"21443_CR43","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.patrec.2018.02.014","volume":"126","author":"H Wechsler","year":"2019","unstructured":"Wechsler H, Toor AS (2019) Modern art challenges face detection. Pattern Recogn Lett 126:3\u201310. https:\/\/doi.org\/10.1016\/j.patrec.2018.02.014","journal-title":"Pattern Recogn Lett"},{"key":"21443_CR44","doi-asserted-by":"crossref","unstructured":"Sindel A, Maier AK, Christlein V (2022) Artfacepoints: High-resolution facial landmark detection in paintings and prints. In: ECCV Workshops","DOI":"10.1007\/978-3-031-25056-9_20"},{"key":"21443_CR45","doi-asserted-by":"publisher","unstructured":"Yaniv J, Newman Y, Shamir A (2019) The face of art: landmark detection and geometric style in portraits. ACM Trans Graph 38(4). https:\/\/doi.org\/10.1145\/3306346.3322984","DOI":"10.1145\/3306346.3322984"},{"key":"21443_CR46","doi-asserted-by":"publisher","unstructured":"Milani F, Pinciroli Vago NO, Fraternali P (2022) Proposals generation for weakly supervised object detection in artwork images. Journal of Imaging 8(8). https:\/\/doi.org\/10.3390\/jimaging8080215","DOI":"10.3390\/jimaging8080215"},{"key":"21443_CR47","doi-asserted-by":"crossref","unstructured":"Yemelianenko T, Tkachenko I, Masclef T, Scuturici M, Miguet S (2024) An approach for dataset extension for object detection in artworks using open-vocabulary models. In: ECCV Workshops","DOI":"10.1007\/978-3-031-91572-7_18"},{"key":"21443_CR48","doi-asserted-by":"publisher","unstructured":"Reshetnikov A, Marinescu m-c, Mor\u00e9 J (2020) Improving object detection in paintings based on time contexts. https:\/\/doi.org\/10.1109\/ICDMW51313.2020.00133","DOI":"10.1109\/ICDMW51313.2020.00133"},{"key":"21443_CR49","first-page":"1","volume":"2021","author":"D Kadish","year":"2021","unstructured":"Kadish D, Risi S, L\u00f8vlie AS (2021) Improving object detection in art images using only style transfer. International Joint Conference on Neural Networks (IJCNN) 2021:1\u20138","journal-title":"International Joint Conference on Neural Networks (IJCNN)"},{"key":"21443_CR50","doi-asserted-by":"publisher","unstructured":"Meyer L, Aaen JE, Tranberg AR, Kun P, Freiberger M, Risi S, L\u00f8vlie AS (2024) Algorithmic ways of seeing: Using object detection to facilitate art exploration. In: Proceedings of the CHI conference on human factors in computing systems. CHI \u201924. Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3613904.3642157","DOI":"10.1145\/3613904.3642157"},{"key":"21443_CR51","unstructured":"Minderer M, Gritsenko A, Houlsby N (2024) Scaling open-vocabulary object detection. In: Proceedings of the 37th international conference on neural information processing systems. NIPS \u201923. Curran Associates Inc"},{"key":"21443_CR52","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2015","unstructured":"Ren S, He K, Girshick RB, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39:1137\u20131149","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"21443_CR53","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"21443_CR54","doi-asserted-by":"crossref","unstructured":"Li LH, Zhang P, Zhang H, Yang J, Li C, Zhong Y, Wang L, Yuan L, Zhang L, Hwang J-N, Chang K-W, Gao J (2021) Grounded language-image pre-training. In: 2022 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 10955\u201310965","DOI":"10.1109\/CVPR52688.2022.01069"},{"key":"21443_CR55","doi-asserted-by":"publisher","unstructured":"Schlecht J, Carqu\u00e9 B, Ommer B (2011) Detecting gestures in medieval images. In: 2011 18th IEEE international conference on image processing, pp 1285\u20131288. https:\/\/doi.org\/10.1109\/ICIP.2011.6115669","DOI":"10.1109\/ICIP.2011.6115669"},{"key":"21443_CR56","doi-asserted-by":"crossref","unstructured":"Kell G, Griffiths R-R, Bourached A, Stork DG (2022) Extracting associations and meanings of objects depicted in artworks through bi-modal deep networks. arXiv:2203.07026","DOI":"10.2352\/EI.2022.34.13.CVAA-170"},{"key":"21443_CR57","doi-asserted-by":"crossref","unstructured":"Khan SJ, Noord N (2024) Context-infused visual grounding for art. arXiv:2410.12369","DOI":"10.1007\/978-3-031-91572-7_8"},{"key":"21443_CR58","doi-asserted-by":"crossref","unstructured":"Ufer N, Lang S, Ommer B (2021) Object retrieval and localization in large art collections using deep multi-style feature fusion and iterative voting. In: ECCV Workshops","DOI":"10.1007\/978-3-030-66096-3_12"},{"key":"21443_CR59","doi-asserted-by":"publisher","unstructured":"Hong Y, Kim J-W (2019) Art painting detection and identification based on deep learning and image local features. Multimedia Tools and Applications 78. https:\/\/doi.org\/10.1007\/s11042-018-6387-5","DOI":"10.1007\/s11042-018-6387-5"},{"key":"21443_CR60","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2021.104098","volume":"107","author":"G Pasqualino","year":"2021","unstructured":"Pasqualino G, Furnari A, Signorello G, Farinella GM (2021) An unsupervised domain adaptation scheme for single-stage artwork recognition in cultural sites. Image Vis Comput 107:104098. https:\/\/doi.org\/10.1016\/j.imavis.2021.104098","journal-title":"Image Vis Comput"},{"key":"21443_CR61","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2022.103487","volume":"222","author":"G Pasqualino","year":"2022","unstructured":"Pasqualino G, Furnari A, Farinella GM (2022) A multi camera unsupervised domain adaptation pipeline for object detection in cultural sites through adversarial learning and self-training. Comput Vis Image Underst 222:103487. https:\/\/doi.org\/10.1016\/j.cviu.2022.103487","journal-title":"Comput Vis Image Underst"},{"key":"21443_CR62","doi-asserted-by":"publisher","unstructured":"Lin T-Y, Goyal P, Girshick R, He K, Doll\u00e1r P (2017) Focal loss for dense object detection. In: 2017 IEEE international conference on computer vision (ICCV), pp 2999\u20133007. https:\/\/doi.org\/10.1109\/ICCV.2017.324","DOI":"10.1109\/ICCV.2017.324"},{"key":"21443_CR63","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1016\/j.culher.2023.06.018","volume":"62","author":"Z Zhang","year":"2023","unstructured":"Zhang Z, Zhang H, Hu J, Sfarra S, Mostacci M, Wang Y, Yang D, Maldague X, Niu D, Duan Y (2023) Defect detection: An improved yolox network applied to a replica of \u201cthe birth of venus\u2019\u2019 by botticelli. J Cult Herit 62:404\u2013411. https:\/\/doi.org\/10.1016\/j.culher.2023.06.018","journal-title":"J Cult Herit"},{"key":"21443_CR64","unstructured":"Dong G, Pan X, Liu S, Wu N, Kong X, Huang P, Wang Z Nondestructive detection of surface defects of curved mosaic ceramics based on deep learning. Ceramics International"},{"key":"21443_CR65","unstructured":"Ge Z, Liu S, Wang F, Li Z, Sun J (2021) Yolox: Exceeding yolo series in 2021. arXiv:2107.08430"},{"key":"21443_CR66","doi-asserted-by":"crossref","unstructured":"Woo S, Park J, Lee J-Y, Kweon IS (2018) Cbam: Convolutional block attention module. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y. (eds) Computer Vision - ECCV 2018, pp 3\u201319. Springer","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"21443_CR67","doi-asserted-by":"crossref","unstructured":"Wang C-Y, Bochkovskiy A, Liao H-YM (2023) YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In: Proceedings of the IEEE\/CVF Conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR52729.2023.00721"},{"key":"21443_CR68","doi-asserted-by":"publisher","first-page":"00364","DOI":"10.1016\/j.daach.2024.e00364","volume":"34","author":"M Antoun","year":"2024","unstructured":"Antoun M, Asmar D (2024) Human object interaction detection in paintings using multi-task learning. Digital Applications in Archaeology and Cultural Heritage 34:00364. https:\/\/doi.org\/10.1016\/j.daach.2024.e00364","journal-title":"Digital Applications in Archaeology and Cultural Heritage"},{"key":"21443_CR69","doi-asserted-by":"publisher","unstructured":"Chen J, Huang K, Zhu X, Qiu X, Wang H, Qin X (2024) Poetry4painting: Diversified poetry generation for large-size ancient paintings based on data augmentation. Comput Graph 116(C):206\u2013215https:\/\/doi.org\/10.1016\/j.cag.2023.07.029","DOI":"10.1016\/j.cag.2023.07.029"},{"key":"21443_CR70","doi-asserted-by":"crossref","unstructured":"Liu S, Zeng Z, Ren T, Li F, Zhang H, Yang J, Li C-y, Yang J, Su H, Zhu J-J, Zhang L (2023) Grounding dino: Marrying dino with grounded pre-training for open-set object detection. arXiv:2303.05499","DOI":"10.1007\/978-3-031-72970-6_3"},{"key":"21443_CR71","unstructured":"Zhang H, Li F, Liu S, Zhang L, Su H, Zhu J, Ni LM, Shum H-Y (2022) DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection"},{"key":"21443_CR72","doi-asserted-by":"crossref","unstructured":"Peng J, Bu X, Sun M, Zhang Z, Tan T, Yan J (2020) Large-scale object detection in the wild from imbalanced multi-labels. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 9706\u20139715","DOI":"10.1109\/CVPR42600.2020.00973"},{"key":"21443_CR73","doi-asserted-by":"crossref","unstructured":"Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Lin S, Guo B (2021) Swin transformer: Hierarchical vision transformer using shifted windows. In: 2021 IEEE\/CVF international conference on computer vision (ICCV), pp 9992\u201310002","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"21443_CR74","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2019) Bert: Pre-training of deep bidirectional transformers for language understanding. In: North american chapter of the association for computational linguistics"},{"key":"21443_CR75","doi-asserted-by":"publisher","unstructured":"Rezatofighi H, Tsoi N, Gwak J, Sadeghian A, Reid I, Savarese S (2019) Generalized intersection over union: A metric and a loss for bounding box regression. In: 2019 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 658\u2013666. https:\/\/doi.org\/10.1109\/CVPR.2019.00075","DOI":"10.1109\/CVPR.2019.00075"},{"key":"21443_CR76","doi-asserted-by":"publisher","unstructured":"Minderer M, Gritsenko A, Stone A, Neumann M, Weissenborn D, Dosovitskiy A, Mahendran A, Arnab A, Dehghani M, Shen Z, Wang X, Zhai X, Kipf T, Houlsby N (2022) Simple open-vocabulary object detection. In: Computer vision - ECCV 2022: 17th european conference, Tel Aviv, Israel, October 23\u201327, 2022, Proceedings, Part X, pp 728\u2013755. Springer. https:\/\/doi.org\/10.1007\/978-3-031-20080-9_42","DOI":"10.1007\/978-3-031-20080-9_42"},{"key":"21443_CR77","unstructured":"Radford A, Kim JW, Hallacy C, Ramesh A, Goh G, Agarwal S, Sastry G, Askell A, Mishkin P, Clark J, Krueger G, Sutskever I (2021) Learning transferable visual models from natural language supervision"},{"key":"21443_CR78","unstructured":"Chen X, Wang X, Changpinyo S, Piergiovanni A.J., Padlewski P, Salz D.M., Goodman S, Grycner A, Mustafa B, Beyer L, Kolesnikov A, Puigcerver J, Ding N, Rong K, Akbari H, Mishra G, Xue L, Thapliyal A.V., Bradbury J, Kuo W, Seyedhosseini M, Jia C, Ayan BK, Riquelme C, Steiner A, Angelova A, Zhai X, Houlsby N, Soricut R (2023) Pali: A jointly-scaled multilingual language-image model. arXiv:2209.06794"},{"key":"21443_CR79","doi-asserted-by":"crossref","unstructured":"Cheng T, Song L, Ge Y, Liu W, Wang X, Shan Y (2024) Yolo-world: Real-time open-vocabulary object detection. In: 2024 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 16901\u201316911","DOI":"10.1109\/CVPR52733.2024.01599"},{"key":"21443_CR80","doi-asserted-by":"publisher","unstructured":"Feng C, Zhong Y, Gao Y, Scott MR, Huang W (2021) Tood: Task-aligned one-stage object detection. In: 2021 IEEE\/CVF international conference on computer vision (ICCV), pp 3490\u20133499. https:\/\/doi.org\/10.1109\/ICCV48922.2021.00349","DOI":"10.1109\/ICCV48922.2021.00349"},{"key":"21443_CR81","unstructured":"Zhao T, Liu P, He X, Zhang L, Lee K (2024) Real-time transformer-based open-vocabulary detection with efficient fusion head. arXiv:2403.06892"},{"key":"21443_CR82","doi-asserted-by":"crossref","unstructured":"Zhao T, Liu P, Lee K (2024) Omdet: Large-scale vision-language multi-dataset pre-training with multimodal detection network. IET Computer Vision","DOI":"10.1049\/cvi2.12268"},{"key":"21443_CR83","doi-asserted-by":"publisher","unstructured":"Xiao B, Wu H, Xu W, Dai X, Hu H, Lu Y, Zeng M, Liu C, Yuan L (2024) Florence-2: Advancing a unified representation for a variety of vision tasks, pp 4818\u20134829. https:\/\/doi.org\/10.1109\/CVPR52733.2024.00461","DOI":"10.1109\/CVPR52733.2024.00461"},{"key":"21443_CR84","doi-asserted-by":"publisher","unstructured":"Cho K, Merrienboer B, Gulcehre C, Bougares F, Schwenk H, Bengio Y (2014). Learning phrase representations using rnn encoder-decoder for statistical machine translation. https:\/\/doi.org\/10.3115\/v1\/D14-1179","DOI":"10.3115\/v1\/D14-1179"},{"issue":"140","key":"21443_CR85","first-page":"1","volume":"21","author":"C Raffel","year":"2020","unstructured":"Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, Li W, Liu PJ (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res 21(140):1\u201367","journal-title":"J Mach Learn Res"},{"key":"21443_CR86","unstructured":"Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. In: Ghahramani Z, Welling M, Cortes C, Lawrence N, Weinberger KQ (eds) Advances in Neural Information Processing Systems, vol 27. Curran Associates Inc"},{"key":"21443_CR87","doi-asserted-by":"crossref","unstructured":"Ding M, Xiao B, Codella N, Luo P, Wang J, Yuan L (2022) Davit: Dual attention vision transformers. In: Computer vision-ECCV 2022: 17th european conference, Tel Aviv, Israel, October 23\u201327, 2022, Proceedings, Part XXIV, pp 74\u201392. Springer","DOI":"10.1007\/978-3-031-20053-3_5"},{"key":"21443_CR88","doi-asserted-by":"publisher","unstructured":"Shao S, Li Z, Zhang T, Peng C, Yu G, Zhang X, Li J, Sun J (2019) Objects365: A large-scale, high-quality dataset for object detection, pp 8429\u20138438. https:\/\/doi.org\/10.1109\/ICCV.2019.00852","DOI":"10.1109\/ICCV.2019.00852"},{"key":"21443_CR89","unstructured":"Kebe GY, Higgins P, Jenkins P, Darvish K, Sachdeva R, Barron R, Winder J, Engel D, Raff E, Ferraro F, Matuszek C (2021) A spoken language dataset of descriptions for speech-based grounded language learning. In: Thirty-fifth conference on neural information processing systems datasets and benchmarks track (Round 1)"},{"key":"21443_CR90","doi-asserted-by":"publisher","unstructured":"Li LH, Zhang P, Zhang H, Yang J, Li C, Zhong Y, Wang L, Yuan L, Zhang L, Hwang J-N, Chang K-W, Gao J (2022) Grounded language-image pre-training. In: 2022 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 10955\u201310965. https:\/\/doi.org\/10.1109\/CVPR52688.2022.01069","DOI":"10.1109\/CVPR52688.2022.01069"},{"key":"21443_CR91","doi-asserted-by":"crossref","unstructured":"Kuznetsova A, Rom H, Alldrin N, Uijlings J, Krasin I, Pont-Tuset J, Kamali S, Popov S, Malloci M, Kolesnikov A, Duerig T, Ferrari V (2020) The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale. IJCV","DOI":"10.1007\/s11263-020-01316-z"},{"key":"21443_CR92","doi-asserted-by":"publisher","unstructured":"Kazemzadeh S, Ordonez V, Matten M, Berg T (2014) Referitgame: Referring to objects in photographs of natural scenes, pp 787\u2013798. https:\/\/doi.org\/10.3115\/v1\/D14-1086","DOI":"10.3115\/v1\/D14-1086"},{"issue":"7","key":"21443_CR93","doi-asserted-by":"publisher","first-page":"8494","DOI":"10.1109\/TPAMI.2022.3232797","volume":"45","author":"Y-L Li","year":"2023","unstructured":"Li Y-L, Liu X, Wu X, Li Y, Qiu Z, Xu L, Xu Y, Fang H-S, Lu C (2023) Hake: A knowledge engine foundation for human activity understanding. IEEE Trans Pattern Anal Mach Intell 45(7):8494\u20138506. https:\/\/doi.org\/10.1109\/TPAMI.2022.3232797","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"21443_CR94","doi-asserted-by":"publisher","unstructured":"Liao Y, Liu S, Wang F, Chen Y, Qian C, Feng J (2020) Ppdm: Parallel point detection and matching for real-time human-object interaction detection, pp 479\u2013487. https:\/\/doi.org\/10.1109\/CVPR42600.2020.00056","DOI":"10.1109\/CVPR42600.2020.00056"},{"key":"21443_CR95","unstructured":"Chen X, Wang X, Changpinyo S, Piergiovanni A, Padlewski P, Salz D, Goodman S, Grycner A, Mustafa B, Beyer L et al (2022) PaLI: a jointly-scaled multilingual language-image model. https:\/\/doi.org\/10.48550\/arXiv.2209.06794"},{"key":"21443_CR96","unstructured":"Hu JE, Shen Y, Wallis P, Allen-Zhu Z, Li Y, Wang S, Chen W (2021) Lora: Low-rank adaptation of large language models. arXiv:2106.09685"},{"key":"21443_CR97","doi-asserted-by":"crossref","unstructured":"Stork DG, Bourached A, Cann GH, Griffiths R-R (2021) Computational identification of significant actors in paintings through symbols and attributes. In: Computer vision and image analysis of art","DOI":"10.2352\/ISSN.2470-1173.2021.14.CVAA-015"},{"key":"21443_CR98","unstructured":"Dahaghin M, Castillo M, Riahidehkordi K, Toso M, Bue AD (2024) Gaussian heritage: 3d digitization of cultural heritage with integrated object segmentation. arXiv:2409.19039"},{"key":"21443_CR99","unstructured":"Cheng B, Schwing AG, Kirillov A (2021) Per-pixel classification is not all you need for semantic segmentation"},{"key":"21443_CR100","doi-asserted-by":"crossref","unstructured":"Cheng B, Misra I, Schwing AG, Kirillov A, Girdhar R (2022) Masked-attention mask transformer for universal image segmentation. CVPR","DOI":"10.1109\/CVPR52688.2022.00135"},{"key":"21443_CR101","doi-asserted-by":"crossref","unstructured":"Qin J, Wu J, Yan P, Li M, Yuxi R, Xiao X, Wang Y, Wang R, Wen S, Pan X et al (2023) Freeseg: Unified, universal and open-vocabulary image segmentation. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 19446\u201319455","DOI":"10.1109\/CVPR52729.2023.01863"},{"key":"21443_CR102","doi-asserted-by":"crossref","unstructured":"Yan B, Jiang Y, Wu J, Wang D, Yuan Z, Luo P, Lu H (2023) Universal instance perception as object discovery and retrieval. In: CVPR","DOI":"10.1109\/CVPR52729.2023.01471"},{"key":"21443_CR103","doi-asserted-by":"crossref","unstructured":"L\u00fcddecke T, Ecker AS (2021) Image segmentation using text and image prompts. In: 2022 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), 7076\u20137086","DOI":"10.1109\/CVPR52688.2022.00695"},{"key":"21443_CR104","unstructured":"Ren T, Liu S, Zeng A, Lin J, Li K, Cao H, Chen J, Huang X, Chen Y, Yan F, Zeng Z, Zhang H, Li F, Yang J, Li H, Jiang Q, Zhang L (2024) Grounded SAM: assembling open-world models for diverse visual tasks"},{"key":"21443_CR105","doi-asserted-by":"crossref","unstructured":"Xie B, Cao J, Xie J, Khan FS, Pang Y (2024) Sed: A simple encoder-decoder for open-vocabulary semantic segmentation. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR52733.2024.00329"},{"key":"21443_CR106","doi-asserted-by":"publisher","unstructured":"Cho S, Shin H, Hong S, Arnab A, Seo PH, Kim S (2024) Cat-seg: Cost aggregation for open-vocabulary semantic segmentation. In: 2024 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 4113\u20134123. https:\/\/doi.org\/10.1109\/CVPR52733.2024.00394","DOI":"10.1109\/CVPR52733.2024.00394"},{"key":"21443_CR107","doi-asserted-by":"publisher","unstructured":"Hu Q, Zhou W, Peng X, Zhang X, Xie P, Liu Y, Peng J, Fan J (2024) Dranet: A semantic segmentation network for chinese landscape paintings. Digit. Signal Process. 147(C). https:\/\/doi.org\/10.1016\/j.dsp.2024.104427","DOI":"10.1016\/j.dsp.2024.104427"},{"key":"21443_CR108","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrras.2024.100904","volume":"17","author":"S Xie","year":"2024","unstructured":"Xie S (2024) The application of hyperpixel segmentation algorithm in chinese painting. J Radiation Res Appl Sci 17:100904. https:\/\/doi.org\/10.1016\/j.jrras.2024.100904","journal-title":"J Radiation Res Appl Sci"},{"key":"21443_CR109","doi-asserted-by":"crossref","unstructured":"Ivanova D, Aversa M, Henderson P, Williamson J (2024) Artefact: Benchmarking segmentation models on diverse analogue media damage","DOI":"10.1109\/WACV61041.2025.00723"},{"key":"21443_CR110","doi-asserted-by":"crossref","unstructured":"Enayati A, Palmieri L, Vascon S, Pelillo M, Aslan S (2023) Semantic motif segmentation of archaeological fresco fragments. In: Proceedings of the IEEE\/CVF international conference on computer vision (ICCV) workshops, pp 1717\u20131725","DOI":"10.1109\/ICCVW60793.2023.00187"},{"key":"21443_CR111","doi-asserted-by":"crossref","unstructured":"Xiao T, Liu Y, Zhou B, Jiang Y, Sun J (2018) Unified perceptual parsing for scene understanding. arXiv:1807.10221","DOI":"10.1007\/978-3-030-01228-1_26"},{"key":"21443_CR112","doi-asserted-by":"crossref","unstructured":"Liu Z, Mao H, Wu C, Feichtenhofer C, Darrell T, Xie S (2022) A convnet for the 2020s. In: 2022 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 11966\u201311976","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"21443_CR113","unstructured":"Xie E, Wang W, Yu Z, Anandkumar A, \u00c1lvarez JM, Luo P (2021) Segformer: Simple and efficient design for semantic segmentation with transformers. In: Neural information processing systems"},{"key":"21443_CR114","unstructured":"Oquab M, Darcet T, Moutakanni T, Vo HQ, Szafraniec M, Khalidov V, Fernandez P, Haziza D, Massa F, El-Nouby A, Assran M, Ballas N, Galuba W, Howes R, Huang P-Y.B, Li S-W, Misra I, Rabbat M.G., Sharma V, Synnaeve G, Xu H, J\u00e9gou H, Mairal J, Labatut P, Joulin A, Bojanowski P (2023) Dinov2: Learning robust visual features without supervision. arXiv:2304.07193"},{"key":"21443_CR115","doi-asserted-by":"crossref","unstructured":"Kirillov A, Mintun E, Ravi N, Mao H, Rolland C, Gustafson L, Xiao T, Whitehead S, Berg AC, Lo W-Y, Doll\u00e1r P, Girshick RB (2023) Segment anything. In: 2023 IEEE\/CVF international conference on computer vision (ICCV), pp 3992\u20134003","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"21443_CR116","doi-asserted-by":"crossref","unstructured":"Tian J, Aggarwal L, Colaco A, Kira Z, Gonz\u00e1lez-Franco M (2023) Diffuse, attend, and segment: Unsupervised zero-shot segmentation using stable diffusion. In: 2024 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 3554\u20133563","DOI":"10.1109\/CVPR52733.2024.00341"},{"key":"21443_CR117","unstructured":"Couairon G, Verbeek J, Schwenk H, Cord M (2022) Diffedit: Diffusion-based semantic image editing with mask guidance. arXiv:2210.11427"},{"key":"21443_CR118","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. arXiv:1505.04597","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"21443_CR119","unstructured":"Jocher G, Chaurasia A, Qiu J (2023) Ultralytics YOLOv8. https:\/\/github.com\/ultralytics\/ultralytics"},{"key":"21443_CR120","doi-asserted-by":"crossref","unstructured":"Cohen N, Newman Y, Shamir A (2022) Semantic segmentation in art paintings. Computer Graphics Forum 41","DOI":"10.1111\/cgf.14473"},{"key":"21443_CR121","unstructured":"Beyer L, Steiner A, Pinto AS, Kolesnikov A, Wang X, Salz DM, Neumann M, Alabdulmohsin I.M., Tschannen M, Bugliarello E, Unterthiner T, Keysers D, Koppula S, Liu F, Grycner A, Gritsenko AA, Houlsby N, Kumar M, Rong K, Eisenschlos JM, Kabra R, Bauer M, Bovsnjak M, Chen X, Minderer M, Voigtlaender P, Bica I, Balazevic I, Puigcerver J, Papalampidi P, Henaff O, Xiong X, Soricut R, Harmsen J, Zhai X-Q (2024) Paligemma: A versatile 3b vlm for transfer. arXiv:2407.07726"},{"key":"21443_CR122","doi-asserted-by":"crossref","unstructured":"Zhai X, Mustafa B, Kolesnikov A, Beyer L (2023) Sigmoid loss for language image pre-training. In: 2023 IEEE\/CVF international conference on computer vision (ICCV), pp 11941\u201311952","DOI":"10.1109\/ICCV51070.2023.01100"},{"key":"21443_CR123","unstructured":"GemmaTeam, Riviere M, Pathak S, Sessa PG, Hardin C, Bhupatiraju S, Hussenot L, Mesnard T, Shahriari B, Ram\u2019e A, Ferret J, Liu P, Tafti PD, Friesen A, Casbon M, Ramos S, Kumar R, Lan CL, Jerome S, Tsitsulin A (2024) Gemma 2: Improving open language models at a practical size. arXiv:2408.00118"},{"key":"21443_CR124","unstructured":"Ravi N, Gabeur V, Hu Y-T, Hu R, Ryali C, Ma T, Khedr H, R\u00e4dle R, Rolland C, Gustafson L, Mintun E, Pan J, Alwala KV, Carion N, Wu C-Y, Girshick R, Doll\u00e1r P, Feichtenhofer C (2024) Sam 2: Segment anything in images and videos. arXiv:2408.00714"},{"key":"21443_CR125","doi-asserted-by":"publisher","unstructured":"Chen L-C, Barron JT, Papandreou G, Murphy K, Yuille AL (2016) Semantic image segmentation with task-specific edge detection using cnns and a discriminatively trained domain transform. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 4545\u20134554. https:\/\/doi.org\/10.1109\/CVPR.2016.492","DOI":"10.1109\/CVPR.2016.492"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-026-21443-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-026-21443-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-026-21443-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T19:03:50Z","timestamp":1781636630000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-026-21443-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,28]]},"references-count":125,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["21443"],"URL":"https:\/\/doi.org\/10.1007\/s11042-026-21443-y","relation":{},"ISSN":["1573-7721"],"issn-type":[{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,28]]},"assertion":[{"value":"26 June 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 February 2026","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 February 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 February 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All the authors involved in this manuscript give full consent for publication of this submitted article.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no conflict of interest.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"245"}}