{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T22:28:15Z","timestamp":1775255295396,"version":"3.50.1"},"reference-count":105,"publisher":"Public Library of Science (PLoS)","issue":"8","license":[{"start":{"date-parts":[[2021,8,26]],"date-time":"2021-08-26T00:00:00Z","timestamp":1629936000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["PGS-D"],"award-info":[{"award-number":["PGS-D"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["276.54.001"],"award-info":[{"award-number":["276.54.001"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1617861"],"award-info":[{"award-number":["1617861"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1513967"],"award-info":[{"award-number":["1513967"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["276.54.001"],"award-info":[{"award-number":["276.54.001"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["276.54.001"],"award-info":[{"award-number":["276.54.001"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008982","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1617861"],"award-info":[{"award-number":["1617861"]}],"id":[{"id":"10.13039\/501100008982","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008982","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1513967"],"award-info":[{"award-number":["1513967"]}],"id":[{"id":"10.13039\/501100008982","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>In this paper, we capture and explore the painterly depictions of materials to enable the study of depiction and perception of materials through the artists\u2019 eye. We annotated a dataset of 19k paintings with 200k+ bounding boxes from which polygon segments were automatically extracted. Each bounding box was assigned a coarse material label (e.g., fabric) and half was also assigned a fine-grained label (e.g., velvety, silky). The dataset in its entirety is available for browsing and downloading at<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/materialsinpaintings.tudelft.nl\/\" xlink:type=\"simple\">materialsinpaintings.tudelft.nl<\/jats:ext-link>. We demonstrate the cross-disciplinary utility of our dataset by presenting novel findings across human perception, art history and, computer vision. Our experiments include a demonstration of how painters create convincing depictions using a stylized approach. We further provide an analysis of the spatial and probabilistic distributions of materials depicted in paintings, in which we for example show that strong patterns exists for material presence and location. Furthermore, we demonstrate how paintings could be used to build more robust computer vision classifiers by learning a more perceptually relevant feature representation. Additionally, we demonstrate that training classifiers on paintings could be used to uncover hidden perceptual cues by visualizing the features used by the classifiers. We conclude that our dataset of painterly material depictions is a rich source for gaining insights into the depiction and perception of materials across multiple disciplines and hope that the release of this dataset will drive multidisciplinary research.<\/jats:p>","DOI":"10.1371\/journal.pone.0255109","type":"journal-article","created":{"date-parts":[[2021,8,26]],"date-time":"2021-08-26T17:32:03Z","timestamp":1629999123000},"page":"e0255109","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":17,"title":["Materials In Paintings (MIP): An interdisciplinary dataset for perception, art history, and computer vision"],"prefix":"10.1371","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5739-6507","authenticated-orcid":true,"given":"Mitchell J. P.","family":"Van Zuijlen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hubert","family":"Lin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kavita","family":"Bala","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sylvia C.","family":"Pont","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maarten W. A.","family":"Wijntjes","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2021,8,26]]},"reference":[{"key":"pone.0255109.ref001","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctv1453m48","volume-title":"Perspective as symbolic form","author":"E Panofsky","year":"2020"},{"key":"pone.0255109.ref002","volume-title":"The birth and rebirth of pictorial space","author":"J White","year":"1957"},{"key":"pone.0255109.ref003","volume-title":"The Science of Art: Optical themes in western art from Brunelleschi to Seurat","author":"M Kemp","year":"1992"},{"key":"pone.0255109.ref004","volume-title":"Optics, painting & photography","author":"MH Pirenne","year":"1970"},{"key":"pone.0255109.ref005","volume-title":"Art and representation: New principles in the analysis of pictures","author":"J Willats","year":"1997"},{"issue":"7031","key":"pone.0255109.ref006","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1038\/434301a","article-title":"The artist as neuroscientist","volume":"434","author":"P Cavanagh","year":"2005","journal-title":"Nature"},{"issue":"1-2","key":"pone.0255109.ref007","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1163\/156856807782753877","article-title":"Statistical regularities of art images and natural scenes: Spectra, sparseness and nonlinearities","volume":"21","author":"DJ Graham","year":"2008","journal-title":"Spatial vision"},{"issue":"9","key":"pone.0255109.ref008","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1068\/p5971","article-title":"Variations in intensity statistics for representational and abstract art, and for art from the Eastern and Western hemispheres","volume":"37","author":"DJ Graham","year":"2008","journal-title":"Perception"},{"key":"pone.0255109.ref009","doi-asserted-by":"crossref","first-page":"171","DOI":"10.3389\/fnhum.2011.00171","article-title":"Do artists see their retinas?","volume":"5","author":"F Perdreau","year":"2011","journal-title":"Frontiers in Human Neuroscience"},{"key":"pone.0255109.ref010","volume-title":"A study in the psychology of pictorial representation","author":"EH Gombrich","year":"1960"},{"issue":"3","key":"pone.0255109.ref011","doi-asserted-by":"crossref","first-page":"227","DOI":"10.2307\/1574154","article-title":"The ecological approach to the visual perception of pictures","volume":"11","author":"JJ Gibson","year":"1978","journal-title":"Leonardo"},{"issue":"8","key":"pone.0255109.ref012","first-page":"2009","article-title":"Material perception: What can you see in a brief glance?","volume":"9","author":"L Sharan","year":"2009","journal-title":"Vision Sciences Society Annual Meeting Abstract"},{"issue":"9","key":"pone.0255109.ref013","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/14.9.12","article-title":"Accuracy and speed of material categorization in real-world images","volume":"14","author":"L Sharan","year":"2014","journal-title":"Journal of vision"},{"issue":"8","key":"pone.0255109.ref014","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/13.8.9","article-title":"Perceptual qualities and material classes","volume":"13","author":"RW Fleming","year":"2013","journal-title":"Journal of Vision"},{"issue":"7","key":"pone.0255109.ref015","first-page":"1","article-title":"Painterly depiction of material properties","volume":"20","author":"MJP van Zuijlen","year":"2020","journal-title":"Journal of Vision"},{"issue":"3-5","key":"pone.0255109.ref016","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1163\/156856808784532581","article-title":"Reflections in art","volume":"21","author":"P Cavanagh","year":"2008","journal-title":"Spatial vision"},{"issue":"7","key":"pone.0255109.ref017","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1068\/i0459aap","article-title":"The art of transparency","volume":"2","author":"B Sayim","year":"2011","journal-title":"i-Perception"},{"key":"pone.0255109.ref018","doi-asserted-by":"crossref","unstructured":"Isola P, Xiao J, Torralba A, Oliva A. What makes an image memorable? In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2011. p. 145\u2013152.","DOI":"10.1109\/CVPR.2011.5995721"},{"issue":"4","key":"pone.0255109.ref019","article-title":"The intrinsic memorability of face photographs","volume":"142","author":"WA Bainbridge","year":"2013","journal-title":"Journal of Experimental Psychology: General"},{"issue":"4","key":"pone.0255109.ref020","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.3758\/s13428-015-0647-3","article-title":"The Novel Object and Unusual Name (NOUN) Database: A collection of novel images for use in experimental research","volume":"48","author":"JS Horst","year":"2016","journal-title":"Behavior research methods"},{"key":"pone.0255109.ref021","doi-asserted-by":"crossref","unstructured":"Machajdik J, Hanbury A. Affective image classification using features inspired by psychology and art theory. In: Proceedings of the 18th ACM international conference on Multimedia; 2010. p. 83\u201392.","DOI":"10.1145\/1873951.1873965"},{"key":"pone.0255109.ref022","unstructured":"Sartori A, Yan Y, \u00d6zbal G, Salah AAA, Salah AA, Sebe N. Looking at Mondrian\u2019s victory Boogie-Woogie: what do I feel? In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015). vol. 1; 2015. p. 1\u20137."},{"issue":"5","key":"pone.0255109.ref023","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/MSP.2011.941851","article-title":"Aesthetics and emotions in images","volume":"28","author":"D Joshi","year":"2011","journal-title":"IEEE Signal Processing Magazine"},{"issue":"12","key":"pone.0255109.ref024","doi-asserted-by":"crossref","first-page":"2306","DOI":"10.1109\/TVCG.2013.234","article-title":"What makes a visualization memorable?","volume":"19","author":"MA Borkin","year":"2013","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"issue":"5","key":"pone.0255109.ref025","doi-asserted-by":"crossref","first-page":"1780","DOI":"10.3758\/s13428-016-0820-3","article-title":"SCEGRAM: An image database for semantic and syntactic inconsistencies in scenes","volume":"49","author":"S \u00d6hlschl\u00e4ger","year":"2017","journal-title":"Behavior research methods"},{"issue":"38","key":"pone.0255109.ref026","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.1719616115","article-title":"Mid-level visual features underlie the high-level categorical organization of the ventral stream","volume":"115","author":"B Long","year":"2018","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pone.0255109.ref027","article-title":"Material properties and image cues for convincing grapes: the know-how of the 17th-century pictorial recipe by Willem Beurs","volume":"1","author":"F Di Cicco","year":"2020","journal-title":"Art & Perception"},{"key":"pone.0255109.ref028","doi-asserted-by":"crossref","first-page":"68100K","DOI":"10.1117\/12.766636","volume-title":"Computer image analysis in the study of art","author":"DJ Graham","year":"2008"},{"key":"pone.0255109.ref029","doi-asserted-by":"crossref","first-page":"72401N","DOI":"10.1117\/12.817185","volume-title":"Human Vision and Electronic Imaging XIV","author":"DJ Graham","year":"2009"},{"issue":"22","key":"pone.0255109.ref030","doi-asserted-by":"crossref","first-page":"R914","DOI":"10.1016\/j.cub.2011.10.003","article-title":"Visual perception: Lightness in a high-dynamic-range world","volume":"21","author":"DJ Graham","year":"2011","journal-title":"Current Biology"},{"key":"pone.0255109.ref031","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.visres.2015.03.018","article-title":"Preference for luminance histogram regularities in natural scenes","volume":"120","author":"DJ Graham","year":"2016","journal-title":"Vision research"},{"issue":"10","key":"pone.0255109.ref032","doi-asserted-by":"crossref","first-page":"2359","DOI":"10.1364\/JOSAA.23.002359","article-title":"Frequency of metamerism in natural scenes","volume":"23","author":"DH Foster","year":"2006","journal-title":"J Opt Soc Am A"},{"key":"pone.0255109.ref033","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.visres.2015.07.005","article-title":"Spatial distributions of local illumination color in natural scenes","volume":"120","author":"SM Nascimento","year":"2016","journal-title":"Vision research"},{"key":"pone.0255109.ref034","doi-asserted-by":"crossref","unstructured":"Ciurea F, Funt B. A large image database for color constancy research. In: Color and Imaging Conference. vol. 2003. Society for Imaging Science and Technology; 2003. p. 160\u2013164.","DOI":"10.2352\/CIC.2003.11.1.art00028"},{"key":"pone.0255109.ref035","doi-asserted-by":"crossref","DOI":"10.1038\/srep35805","article-title":"The southampton-york natural scenes (SYNS) dataset: Statistics of surface attitude","volume":"6","author":"WJ Adams","year":"2016","journal-title":"Scientific reports"},{"issue":"6","key":"pone.0255109.ref036","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0020409","article-title":"Natural images from the birthplace of the human eye","volume":"6","author":"G Tka\u010dik","year":"2011","journal-title":"PLoS one"},{"issue":"12","key":"pone.0255109.ref037","doi-asserted-by":"crossref","first-page":"1463","DOI":"10.1068\/p5321","article-title":"A biologically inspired algorithm for the recovery of shading and reflectance images","volume":"33","author":"A Olmos","year":"2004","journal-title":"Perception"},{"issue":"7","key":"pone.0255109.ref038","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1038\/nn.2831","article-title":"Cardinal rules: visual orientation perception reflects knowledge of environmental statistics","volume":"14","author":"AR Girshick","year":"2011","journal-title":"Nature neuroscience"},{"key":"pone.0255109.ref039","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpsyg.2018.00454","article-title":"Reliable top-left light convention starts with Early Renaissance: An extensive approach comprising 10k artworks","volume":"9","author":"CC Carbon","year":"2018","journal-title":"Frontiers in Psychology"},{"issue":"3","key":"pone.0255109.ref040","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1038\/630","article-title":"Where is the sun?","volume":"1","author":"J Sun","year":"1998","journal-title":"Nature neuroscience"},{"issue":"6152","key":"pone.0255109.ref041","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1038\/331163a0","article-title":"Perception of shape from shading","volume":"331","author":"VS Ramachandran","year":"1988","journal-title":"Nature"},{"key":"pone.0255109.ref042","volume-title":"The perception of the visual world","author":"JJ Gibson","year":"1950"},{"issue":"4","key":"pone.0255109.ref043","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1068\/p120411","article-title":"Light source position in the perception of object shape","volume":"12","author":"K Berbaum","year":"1983","journal-title":"Perception"},{"issue":"1","key":"pone.0255109.ref044","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0010-0277(01)00116-0","article-title":"Prior knowledge on the illumination position","volume":"81","author":"P Mamassian","year":"2001","journal-title":"Cognition"},{"issue":"2","key":"pone.0255109.ref045","article-title":"Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Feature","author":"B Saleh","year":"2016","journal-title":"International Journal for Digital Art History"},{"key":"pone.0255109.ref046","article-title":"A quantitative approach to beauty. Perceived attractiveness of human faces in world painting","volume":"1","author":"J De La Rosa","year":"2015","journal-title":"International Journal for Digital Art History"},{"key":"pone.0255109.ref047","doi-asserted-by":"crossref","unstructured":"Shen X, Efros AA, Aubry M. Discovering visual patterns in art collections with spatially-consistent feature learning. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2019. p. 9270\u20139279.","DOI":"10.1109\/CVPR.2019.00950"},{"issue":"Supplement_1","key":"pone.0255109.ref048","doi-asserted-by":"crossref","first-page":"i156","DOI":"10.1093\/llc\/fqz055","article-title":"Automatic detection and visualization of garment color in Western portrait paintings","volume":"34","author":"C Sar\u0131","year":"2019","journal-title":"Digital Scholarship in the Humanities"},{"key":"pone.0255109.ref049","doi-asserted-by":"crossref","unstructured":"Crowley EJ, Zisserman A. The state of the art: object retrieval in paintings using discriminative regions. In: British Machine Vision Conference; 2014.","DOI":"10.5244\/C.28.38"},{"key":"pone.0255109.ref050","doi-asserted-by":"crossref","DOI":"10.1515\/9783110583618","volume-title":"Steinformen","author":"I Augart","year":"2018"},{"issue":"3","key":"pone.0255109.ref051","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1080\/00357529.1990.11761676","article-title":"Rocks depicted in painting & sculpture","volume":"65","author":"R Dietrich","year":"1990","journal-title":"Rocks & Minerals"},{"key":"pone.0255109.ref052","volume-title":"Seeing through clothes","author":"A Hollander","year":"1993"},{"key":"pone.0255109.ref053","doi-asserted-by":"crossref","DOI":"10.5040\/9781474269643","volume-title":"Fabric of vision: dress and drapery in painting","author":"A Hollander","year":"2016"},{"key":"pone.0255109.ref054","volume-title":"Dress in Italian painting, 1460-1500","author":"E Birbari","year":"1975"},{"key":"pone.0255109.ref055","volume-title":"The art of dress: fashion in England and France 1750 to 1820","author":"A Ribeiro","year":"1995"},{"key":"pone.0255109.ref056","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/978-1-4020-4441-0_2","volume-title":"A Corpus of Rembrandt Paintings","author":"M De Winkel","year":"2005"},{"key":"pone.0255109.ref057","unstructured":"Bol M, Lehmann AS. Painting skin and water: towards a material iconography of translucent motifs in Early Netherlandish painting. In: Symposium for the Study of Underdrawing and Technology in Painting. Peeters; 2012. p. 215\u2013228."},{"key":"pone.0255109.ref058","first-page":"86","article-title":"Fleshing out the rody: The\u2019colours of the naked\u2019 in workshop practice and art theory, 1400-1600","volume":"59","author":"AS Lehmann","year":"2008","journal-title":"Nederlands Kunsthistorisch Jaarboek"},{"key":"pone.0255109.ref059","unstructured":"Bambach C. Anatomy in the renaissance; 2002. Available from: https:\/\/www.metmuseum.org\/toah\/hd\/anat\/hd_anat.htm."},{"key":"pone.0255109.ref060","volume-title":"The rhetoric of perspective: Realism and illusionism in seventeenth-century Dutch still-life painting","author":"H Grootenboer","year":"2006"},{"issue":"5","key":"pone.0255109.ref061","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1111\/j.1467-8365.2012.00933.x","article-title":"Laying the table: The procedures of still life","volume":"35","author":"J Woodall","year":"2012","journal-title":"Art History"},{"key":"pone.0255109.ref062","volume-title":"Dutch flower painting, 1600-1720","author":"P Taylor","year":"1995"},{"key":"pone.0255109.ref063","doi-asserted-by":"crossref","DOI":"10.1117\/12.429489","article-title":"On Seeing Stuff: The Perception of Materials by Humans and Machines","volume":"4299","author":"EH Adelson","year":"2001","journal-title":"Proceedings of the SPIE"},{"key":"pone.0255109.ref064","unstructured":"Fei-Fei L, Fergus R, Perona P. Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) workshop; 2004. p. 178\u2013178."},{"key":"pone.0255109.ref065","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L. Imagenet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition; 2009. p. 248\u2013255.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"pone.0255109.ref066","unstructured":"Krizhevsky A. Learning multiple layers of features from tiny images. (Technical Report) University of Toronto. 2009."},{"key":"pone.0255109.ref067","doi-asserted-by":"crossref","DOI":"10.1145\/2461912.2462002","article-title":"OpenSurfaces: A richly annotated catalog of surface appearance","volume":"32","author":"S Bell","year":"2013","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"pone.0255109.ref068","doi-asserted-by":"crossref","unstructured":"Bell S, Upchurch P, Snavely N, Bala K. Material recognition in the wild with the materials in context database. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2015. p. 3479\u20133487.","DOI":"10.1109\/CVPR.2015.7298970"},{"key":"pone.0255109.ref069","doi-asserted-by":"crossref","unstructured":"Caesar H, Uijlings J, Ferrari V. Coco-stuff: Thing and stuff classes in context. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2018. p. 1209\u20131218.","DOI":"10.1109\/CVPR.2018.00132"},{"key":"pone.0255109.ref070","unstructured":"Visual Art Encyclopedia;. Available from: https:\/\/www.wikiart.org\/en\/about."},{"key":"pone.0255109.ref071","doi-asserted-by":"crossref","unstructured":"Bar Y, Levy N, Wolf L. Classification of artistic styles using binarized features derived from a deep neural network. In: European conference on computer vision. Springer; 2014. p. 71\u201384.","DOI":"10.1007\/978-3-319-16178-5_5"},{"key":"pone.0255109.ref072","doi-asserted-by":"crossref","unstructured":"Elgammal A, Liu B, Kim D, Elhoseiny M, Mazzone M. The shape of art history in the eyes of the machine. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 32; 2018.","DOI":"10.1609\/aaai.v32i1.11894"},{"key":"pone.0255109.ref073","unstructured":"Strezoski G, Worring M. Omniart: multi-task deep learning for artistic data analysis. arXiv preprint arXiv:170800684. 2017."},{"key":"pone.0255109.ref074","doi-asserted-by":"crossref","unstructured":"Tan WR, Chan CS, Aguirre HE, Tanaka K. ArtGAN: Artwork synthesis with conditional categorical GANs. In: IEEE International Conference on Image Processing (ICIP); 2017. p. 3760\u20133764.","DOI":"10.1109\/ICIP.2017.8296985"},{"issue":"6","key":"pone.0255109.ref075","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1007\/s00138-014-0621-6","article-title":"Painting-91: a large scale database for computational painting categorization","volume":"25","author":"FS Khan","year":"2014","journal-title":"Machine vision and applications"},{"key":"pone.0255109.ref076","doi-asserted-by":"crossref","unstructured":"Mao H, Cheung M, She J. Deepart: Learning joint representations of visual arts. In: Proceedings of the 25th ACM international conference on Multimedia; 2017. p. 1183\u20131191.","DOI":"10.1145\/3123266.3123405"},{"issue":"3","key":"pone.0255109.ref077","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/MSP.2014.2347059","article-title":"Visual domain adaptation: A survey of recent advances","volume":"32","author":"VM Patel","year":"2015","journal-title":"IEEE Signal Processing Magazine"},{"key":"pone.0255109.ref078","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.neucom.2018.05.083","article-title":"Deep visual domain adaptation: A survey","volume":"312","author":"M Wang","year":"2018","journal-title":"Neurocomputing"},{"issue":"5","key":"pone.0255109.ref079","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3400066","article-title":"A survey of unsupervised deep domain adaptation","volume":"11","author":"G Wilson","year":"2020","journal-title":"ACM Transactions on Intelligent Systems and Technology (TIST)"},{"issue":"11","key":"pone.0255109.ref080","doi-asserted-by":"crossref","first-page":"3365","DOI":"10.1109\/TVCG.2019.2921336","article-title":"Neural atyle transfer: A review","volume":"26","author":"Y Jing","year":"2020","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"pone.0255109.ref081","unstructured":"Geirhos R, Rubisch P, Michaelis C, Bethge M, Wichmann FA, Brendel W. ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness. In: International Conference on Learning Representations; 2019.Available from: https:\/\/openreview.net\/forum?id=Bygh9j09KX."},{"issue":"3","key":"pone.0255109.ref082","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1007\/s11263-013-0609-0","article-title":"Recognizing materials using perceptually inspired features","volume":"103","author":"L Sharan","year":"2013","journal-title":"International Journal of Computer Vision"},{"key":"pone.0255109.ref083","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1146\/annurev-vision-102016-061429","article-title":"Material perception","volume":"3","author":"RW Fleming","year":"2017","journal-title":"Annual review of vision science"},{"issue":"3","key":"pone.0255109.ref084","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.evolhumbehav.2010.09.003","article-title":"Carotenoid and melanin pigment coloration affect perceived human health","volume":"32","author":"ID Stephen","year":"2011","journal-title":"Evolution and Human Behavior"},{"issue":"6","key":"pone.0255109.ref085","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/j.jaad.2007.07.040","article-title":"Color homogeneity and visual perception of age, health, and attractiveness of female facial skin","volume":"57","author":"PJ Matts","year":"2007","journal-title":"Journal of the American Academy of Dermatology"},{"key":"pone.0255109.ref086","doi-asserted-by":"crossref","DOI":"10.1561\/9781601980878","volume-title":"The appearance of human skin: A survey","author":"T Igarashi","year":"2007"},{"key":"pone.0255109.ref087","volume-title":"Proceedings of SIGGRAPH","author":"HW Jensen","year":"2001"},{"key":"pone.0255109.ref088","article-title":"Extreme clicking for efficient object annotation","author":"DP Papadopoulos","year":"2017","journal-title":"International Journal of Computer Vision"},{"key":"pone.0255109.ref089","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","author":"S Ren","year":"2015","journal-title":"Advances in neural information processing systems"},{"key":"pone.0255109.ref090","unstructured":"Wu Y, Kirillov A, Massa F, Lo WY, Girshick R. Detectron2; 2019. https:\/\/github.com\/facebookresearch\/detectron2."},{"key":"pone.0255109.ref091","volume-title":"On reflection","author":"J Miller","year":"1998"},{"key":"pone.0255109.ref092","unstructured":"Pacanowski R, Granier X, Schlick C, Pierre P. Sketch and paint-based interface for highlight modeling. In: Fifth Eurographics conference on Sketch-Based Interfaces and Modeling; 2008."},{"issue":"4","key":"pone.0255109.ref093","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/MCG.2003.1210865","article-title":"Stylized highlights for cartoon rendering and animation","volume":"23","author":"Ki Anjyo","year":"2003","journal-title":"IEEE Computer Graphics and Applications"},{"key":"pone.0255109.ref094","doi-asserted-by":"crossref","unstructured":"Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, et al. Microsoft coco: Common objects in context. In: European conference on computer vision. Springer; 2014. p. 740\u2013755.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"pone.0255109.ref095","doi-asserted-by":"crossref","unstructured":"Zhou B, Zhao H, Puig X, Fidler S, Barriuso A, Torralba A. Scene parsing through ade20k dataset. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2017. p. 633\u2013641.","DOI":"10.1109\/CVPR.2017.544"},{"key":"pone.0255109.ref096","doi-asserted-by":"crossref","unstructured":"Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benenson R, et al. The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2016. p. 3213\u20133223.","DOI":"10.1109\/CVPR.2016.350"},{"key":"pone.0255109.ref097","doi-asserted-by":"crossref","unstructured":"Lin H, Upchurch P, Bala K. Block annotation: Better image annotation with sub-image decomposition. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV); 2019. p. 5290\u20135300.","DOI":"10.1109\/ICCV.2019.00539"},{"key":"pone.0255109.ref098","doi-asserted-by":"crossref","unstructured":"Maninis KK, Caelles S, Pont-Tuset J, Van Gool L. Deep extreme cut: From extreme points to object segmentation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2018. p. 616\u2013625.","DOI":"10.1109\/CVPR.2018.00071"},{"key":"pone.0255109.ref099","doi-asserted-by":"crossref","unstructured":"Benenson R, Popov S, Ferrari V. Large-scale interactive object segmentation with human annotators. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2019. p. 11700\u201311709.","DOI":"10.1109\/CVPR.2019.01197"},{"key":"pone.0255109.ref100","doi-asserted-by":"crossref","unstructured":"Ling H, Gao J, Kar A, Chen W, Fidler S. Fast interactive object annotation with curve-gcn. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2019. p. 5257\u20135266.","DOI":"10.1109\/CVPR.2019.00540"},{"issue":"3","key":"pone.0255109.ref101","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1145\/1015706.1015720","article-title":"\u201cGrabCut\u201d interactive foreground extraction using iterated graph cuts","volume":"23","author":"C Rother","year":"2004","journal-title":"ACM transactions on graphics (TOG)"},{"key":"pone.0255109.ref102","unstructured":"Wei XS, Wu J, Cui Q. Deep learning for fine-grained image analysis: A survey. arXiv preprint arXiv:190703069. 2019."},{"key":"pone.0255109.ref103","unstructured":"Wah C, Branson S, Welinder P, Perona P, Belongie S. The caltech-ucsd birds-200-2011 dataset. Computation & Neural Systems Technical Report, CNS-TR California Institute of Technology, Pasadena, CA. 2011."},{"key":"pone.0255109.ref104","doi-asserted-by":"crossref","unstructured":"Van Horn G, Mac Aodha O, Song Y, Cui Y, Sun C, Shepard A, et al. The inaturalist species classification and detection dataset. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2018. p. 8769\u20138778.","DOI":"10.1109\/CVPR.2018.00914"},{"key":"pone.0255109.ref105","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV); 2017. p. 618\u2013626.","DOI":"10.1109\/ICCV.2017.74"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0255109","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,7]],"date-time":"2023-11-07T22:20:37Z","timestamp":1699395637000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0255109"}},"subtitle":[],"editor":[{"given":"Omar Sultan","family":"Al-Kadi","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,8,26]]},"references-count":105,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8,26]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0255109","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,26]]}}}