{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T04:34:16Z","timestamp":1784003656667,"version":"3.55.0"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"20","license":[{"start":{"date-parts":[[2023,8,2]],"date-time":"2023-08-02T00:00:00Z","timestamp":1690934400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,2]],"date-time":"2023-08-02T00:00:00Z","timestamp":1690934400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In recent years, transformers, initially developed for language, have been successfully applied to visual tasks. Vision transformers have been shown to push the state of the art in a wide range of tasks, including image classification, object detection, and semantic segmentation. While ample research has shown promising results in art attribution and art authentication tasks using convolutional neural networks, this paper examines whether the superiority of vision transformers extends to art authentication, improving, thus, the reliability of computer-based authentication of artworks. Using a carefully compiled dataset of authentic paintings by Vincent van Gogh and two contrast datasets, we compare the art authentication performances of Swin transformers with those of EfficientNet. Using a standard contrast set containing imitations and proxies (works by painters with styles closely related to van Gogh), we find that EfficientNet achieves the best performance overall. With a contrast set that only consists of imitations, we find the Swin transformer to be superior to EfficientNet by achieving an authentication accuracy of over 85%. These results lead us to conclude that vision transformers represent a strong and promising contender in art authentication, particularly in enhancing the computer-based ability to detect artistic imitations.<\/jats:p>","DOI":"10.1007\/s00521-023-08864-8","type":"journal-article","created":{"date-parts":[[2023,8,2]],"date-time":"2023-08-02T13:02:26Z","timestamp":1690981346000},"page":"11849-11858","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Art authentication with vision transformers"],"prefix":"10.1007","volume":"36","author":[{"given":"Ludovica","family":"Schaerf","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9627-1523","authenticated-orcid":false,"given":"Eric","family":"Postma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carina","family":"Popovici","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,8,2]]},"reference":[{"key":"8864_CR1","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780195147353.001.0001","volume-title":"The expert versus the object: judging fakes and false attributions in the visual arts","author":"RD Spencer","year":"2004","unstructured":"Spencer RD (2004) The expert versus the object: judging fakes and false attributions in the visual arts. Oxford University Press, Oxford"},{"key":"8864_CR2","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1057\/978-1-137-54405-6_19","volume-title":"The Palgrave handbook on art crime","author":"R Sloggett","year":"2019","unstructured":"Sloggett R (2019) Unmasking art forgery: scientific approaches In: Hufnagel S, Chappell D (eds). The Palgrave handbook on art crime. Springer, London, pp 381\u2013406"},{"key":"8864_CR3","doi-asserted-by":"crossref","unstructured":"Postma EO, Herik HJvd (2000) Discovering the visual signature of painters. Future directions for intelligent systems and information sciences. The future of speech and image technologies, brain computers, WWW, and Bioinformatics. Springer, Heidelberg, pp 129\u2013147","DOI":"10.1007\/978-3-7908-1856-7_7"},{"issue":"4","key":"8864_CR4","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1109\/MSP.2008.923513","volume":"25","author":"CR Johnson","year":"2008","unstructured":"Johnson CR, Hendriks E, Berezhnoy IJ, Brevdo E, Hughes SM, Daubechies I, Li J, Postma E, Wang JZ (2008) Image processing for artist identification. IEEE Signal Process Mag 25(4):37\u201348","journal-title":"IEEE Signal Process Mag"},{"issue":"3","key":"8864_CR5","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1016\/j.sigpro.2012.09.025","volume":"93","author":"H Qi","year":"2013","unstructured":"Qi H, Taeb A, Hughes SM (2013) Visual stylometry using background selection and wavelet-HMT-based Fisher information distances for attribution and dating of impressionist paintings. Signal Process 93(3):541\u2013553","journal-title":"Signal Process"},{"issue":"2","key":"8864_CR6","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1016\/j.acha.2015.11.005","volume":"41","author":"H Liu","year":"2016","unstructured":"Liu H, Chan RH, Yao Y (2016) Geometric tight frame based stylometry for art authentication of van gogh paintings. Appl Comput Harmon Anal 41(2):590\u2013602","journal-title":"Appl Comput Harmon Anal"},{"issue":"6","key":"8864_CR7","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1109\/TPAMI.2011.203","volume":"34","author":"J Li","year":"2011","unstructured":"Li J, Yao L, Hendriks E, Wang JZ (2011) Rhythmic brushstrokes distinguish van gogh from his contemporaries: findings via automated brushstroke extraction. IEEE Trans Pattern Anal Mach Intell 34(6):1159\u20131176","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"6735","key":"8864_CR8","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1038\/20833","volume":"399","author":"RP Taylor","year":"1999","unstructured":"Taylor RP, Micolich AP, Jonas D (1999) Fractal analysis of Pollock\u2019s drip paintings. Nature 399(6735):422\u2013422","journal-title":"Nature"},{"issue":"4","key":"8864_CR9","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1109\/MSP.2015.2406955","volume":"32","author":"N van Noord","year":"2015","unstructured":"van Noord N, Hendriks E, Postma E (2015) Toward discovery of the artist\u2019s style: learning to recognize artists by their artworks. IEEE Signal Process Mag 32(4):46\u201354","journal-title":"IEEE Signal Process Mag"},{"key":"8864_CR10","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1016\/j.patcog.2016.06.005","volume":"61","author":"N van Noord","year":"2017","unstructured":"van Noord N, Postma E (2017) Learning scale-variant and scale-invariant features for deep image classification. Pattern Recogn 61:583\u2013592","journal-title":"Pattern Recogn"},{"key":"8864_CR11","doi-asserted-by":"crossref","unstructured":"Dobbs T, Ras Z (2022) On art authentication and the Rijksmuseum challenge: a residual neural network approach. Expert Syst Appl 116933","DOI":"10.1016\/j.eswa.2022.116933"},{"key":"8864_CR12","volume-title":"Deep Learning","author":"I Goodfellow","year":"2016","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep Learning. MIT press, Cambridge, MA"},{"key":"8864_CR13","doi-asserted-by":"publisher","first-page":"109687","DOI":"10.1016\/j.asoc.2022.109687","volume":"130","author":"A Amelio","year":"2022","unstructured":"Amelio A, Bonifazi G, Corradini E, Di Saverio S, Marchetti M, Ursino D, Virgili L (2022) Defining a deep neural network ensemble for identifying fabric colors. Appl Soft Comput 130:109687","journal-title":"Appl Soft Comput"},{"key":"8864_CR14","doi-asserted-by":"publisher","first-page":"116282","DOI":"10.1016\/j.eswa.2021.116282","volume":"191","author":"E Corradini","year":"2022","unstructured":"Corradini E, Porcino G, Scopelliti A, Ursino D, Virgili L (2022) Fine-tuning Salgan and Pathgan for extending saliency map and gaze path prediction from natural images to websites. Expert Syst Appl 191:116282. https:\/\/doi.org\/10.1016\/j.eswa.2021.116282","journal-title":"Expert Syst Appl"},{"key":"8864_CR15","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/j.eswa.2018.07.026","volume":"114","author":"E Cetinic","year":"2018","unstructured":"Cetinic E, Lipic T, Grgic S (2018) Fine-tuning convolutional neural networks for fine art classification. Expert Syst Appl 114:107\u2013118","journal-title":"Expert Syst Appl"},{"key":"8864_CR16","unstructured":"Bell P, Offert F (2021) Reflections on connoisseurship and computer vision. J Art Historiography (24)"},{"key":"8864_CR17","unstructured":"Zhu Y, Ji Y, Zhang Y, Xu L, Zhou AL, Chan E (2019) Machine: the new art connoisseur. arXiv preprint arXiv:1911.10091"},{"key":"8864_CR18","doi-asserted-by":"crossref","unstructured":"Lyu S, Rockmore D, Farid H (2004) A digital technique for art authentication. In: Proceedings of the National Academy of the U.S.A. 101(49), pp 17006\u201317010","DOI":"10.1073\/pnas.0406398101"},{"issue":"4","key":"8864_CR19","doi-asserted-by":"publisher","first-page":"1279","DOI":"10.1073\/pnas.0910530107","volume":"107","author":"JM Hughes","year":"2010","unstructured":"Hughes JM, Graham DJ, Rockmore DN (2010) Quantification of artistic style through sparse coding analysis in the drawings of Pieter Bruegel the Elder. Proc Natl Acad Sci 107(4):1279\u20131283","journal-title":"Proc Natl Acad Sci"},{"key":"8864_CR20","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, Uszkoreit J, Houlsby N (2021) An image is worth 16x16 words: transformers for image recognition at scale. In: 9th international conference on learning representations, ICLR 2021, Virtual Event, Austria, May 3\u20137"},{"key":"8864_CR21","doi-asserted-by":"crossref","unstructured":"Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Lin S, Guo B (2021) Swin transformer: hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE\/CVF international conference on computer vision (ICCV)","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"8864_CR22","doi-asserted-by":"crossref","unstructured":"Liu Z, Hu H, Lin Y, Yao Z, Xie Z, Wei Y, Ning J, Cao Y, Zhang Z, Dong L, Wei F, Guo B (2022) Swin transformer v2: scaling up capacity and resolution. In: CVPR 2022","DOI":"10.1109\/CVPR52688.2022.01170"},{"key":"8864_CR23","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2016.90"},{"key":"8864_CR24","unstructured":"Tan M, Le Q (2019) Efficientnet: Rethinking model scaling for convolutional neural networks. In: International conference on machine learning, pp 6105\u20136114 . PMLR"},{"key":"8864_CR25","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, 2009. CVPR 2009. IEEE. https:\/\/ieeexplore.ieee.org\/abstract\/document\/5206848\/","DOI":"10.1109\/CVPR.2009.5206848"},{"issue":"6","key":"8864_CR26","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84\u201390","journal-title":"Commun ACM"},{"key":"8864_CR27","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2015) Rethinking the inception architecture for computer vision","DOI":"10.1109\/CVPR.2016.308"},{"key":"8864_CR28","unstructured":"Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition"},{"key":"8864_CR29","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Lu, Polosukhin I (2017) Attention is all you need. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems, vol 30, pp 6000\u20136010"},{"key":"8864_CR30","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/j.aiopen.2022.10.001","volume":"3","author":"T Lin","year":"2022","unstructured":"Lin T, Wang Y, Liu X, Qiu X (2022) A survey of transformers. AI Open 3:111\u2013132","journal-title":"AI Open"},{"key":"8864_CR31","unstructured":"OpenAI: GPT-4 Technical report (2023)"},{"key":"8864_CR32","volume-title":"L\u2019oeuvre de Vincent van Gogh: Catalogue Raisonn\u00e9","author":"JB de la Faille","year":"1928","unstructured":"de la Faille JB (1928) L\u2019oeuvre de Vincent van Gogh: Catalogue Raisonn\u00e9. Van Oest, Paris"},{"key":"8864_CR33","doi-asserted-by":"crossref","unstructured":"David LO, Pedrini H, Dias Z, Rocha A (2021) Authentication of Vincent van Gogh\u2019s work. In: International conference on computer analysis of images and patterns, pp 371\u2013380 . Springer","DOI":"10.1007\/978-3-030-89131-2_34"},{"key":"8864_CR34","unstructured":"Nelson MR (2011) Underneath the van Gogh F614. Chemmatters, 15"},{"issue":"4","key":"8864_CR35","doi-asserted-by":"publisher","first-page":"289","DOI":"10.2307\/3780755","volume":"19","author":"W Feilchenfeldt","year":"1989","unstructured":"Feilchenfeldt W (1989) Van Gogh fakes: the Wacker affair, with an illustrated catalogue of the forgeries. Simiolus: Netherlands Q Hist Art 19(4):289\u2013316","journal-title":"Simiolus: Netherlands Q Hist Art"},{"key":"8864_CR36","doi-asserted-by":"crossref","unstructured":"Gonthier N, Gousseau Y, Ladjal S (2021) An analysis of the transfer learning of convolutional neural networks for artistic images. In: Pattern recognition. ICPR international workshops and challenges: virtual event, January 10\u201315, 2021, Proceedings, Part III, pp 546\u2013561. Springer","DOI":"10.1007\/978-3-030-68796-0_39"},{"key":"8864_CR37","doi-asserted-by":"publisher","unstructured":"He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. https:\/\/doi.org\/10.48550\/ARXIV.1502.01852. arXiv:abs\/1502.01852","DOI":"10.48550\/ARXIV.1502.01852"},{"key":"8864_CR38","doi-asserted-by":"crossref","unstructured":"Dong X, Bao J, Chen D, Zhang W, Yu N, Yuan L, Chen D, Guo B (2022) CSwin transformer: a general vision transformer backbone with cross-shaped windows. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 12124\u201312134","DOI":"10.1109\/CVPR52688.2022.01181"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-08864-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-023-08864-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-08864-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,8]],"date-time":"2024-07-08T14:06:18Z","timestamp":1720447578000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-023-08864-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,2]]},"references-count":38,"journal-issue":{"issue":"20","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["8864"],"URL":"https:\/\/doi.org\/10.1007\/s00521-023-08864-8","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,2]]},"assertion":[{"value":"17 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}