{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:22:06Z","timestamp":1750220526323,"version":"3.41.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T00:00:00Z","timestamp":1670889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Comput. Cult. Herit."],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>\n            We discuss preliminary successes and major outstanding challenges in extracting messages, stories, morals, and especially\n            <jats:italic>meaning<\/jats:italic>\n            in crafted or \u201cauthored\u201d images, such as artworks. Traditional semantic image understanding seeks to summarize an image (such as through a caption), or to answer basic questions expressed in free-text natural language, but can neither infer plausible\n            <jats:italic>reasons<\/jats:italic>\n            the creator made the artwork nor compute a high-level message or meaning it conveys. Such meaning is often abstract, dependent upon genre, period, and art movement, and exploits visual conventions such as special objects and signs (\u201csignifiers\u201d), composition, and possibly non-realistic style. Several of these properties have no counterpart in the natural photographs that are studied in most semantic image analysis, nor in the application-specific image analysis applied to robotics, autonomous driving, medical diagnosis, or remote sensing. For such reasons, the extraction of meaning from works in a variety of styles and subjects will be both a tool for art scholars and a grand challenge to artificial intelligence research.\n          <\/jats:p>","DOI":"10.1145\/3471619","type":"journal-article","created":{"date-parts":[[2022,11,15]],"date-time":"2022-11-15T12:20:26Z","timestamp":1668514826000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Automatic Computation of Meaning in Authored Images Such as Artworks: A Grand Challenge for AI"],"prefix":"10.1145","volume":"15","author":[{"given":"David","family":"G. Stork","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,12,13]]},"reference":[{"unstructured":"Play Magnus. [n. d.]. Retrieved from www.playmagnus.com\/.","key":"e_1_3_1_2_2"},{"doi-asserted-by":"publisher","key":"e_1_3_1_3_2","DOI":"10.1086\/sou.26.2.23208074"},{"doi-asserted-by":"publisher","key":"e_1_3_1_4_2","DOI":"10.1126\/science.1259433"},{"key":"e_1_3_1_5_2","volume-title":"Visual Theory: Paintings and Interpretation","author":"Bryson Norman","year":"1991","unstructured":"Norman Bryson, Michael Ann Holly, and Keith Moxey (Eds.). 1991. Visual Theory: Paintings and Interpretation. HarperCollins, New York, NY."},{"doi-asserted-by":"publisher","key":"e_1_3_1_6_2","DOI":"10.1109\/MIS.2017.4531228"},{"key":"e_1_3_1_7_2","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/978-81-322-3972-7_3","volume-title":"Fundamental of Artificial Intelligence","author":"Chowdhary K. R.","year":"2020","unstructured":"K. R. Chowdhary. 2020. First order predicate logic. In Fundamental of Artificial Intelligence. Springer, New Delhi, Chapter 3, 51\u201388."},{"doi-asserted-by":"publisher","key":"e_1_3_1_8_2","DOI":"10.1109\/CVPR.2017.352"},{"key":"e_1_3_1_9_2","first-page":"363","volume-title":"Studies in Computational Intelligence","author":"Damodaran Nikhil","year":"2019","unstructured":"Nikhil Damodaran, Sowmya Vishvanathan, Govind Divu, and Soman Kp. 2019. Scene classification using transfer learning: Theories and applications. In Studies in Computational Intelligence. Springer, Berlin, 363\u2013399."},{"key":"e_1_3_1_10_2","volume-title":"How to Read a Painting: Lessons from the Old Masters","author":"Rynck Patrick de","year":"2004","unstructured":"Patrick de Rynck. 2004. How to Read a Painting: Lessons from the Old Masters. Harry N. Abrams, New York, NY."},{"key":"e_1_3_1_11_2","volume-title":"The Golden Legend (Modern translation ed.)","author":"Voragine Jacobus de","year":"2018","unstructured":"Jacobus de Voragine. 2018. The Golden Legend (Modern translation ed.). Patristic Publishing, Omaha, NE."},{"key":"e_1_3_1_12_2","volume-title":"Pattern Classification (2nd ed.)","author":"Duda Richard O.","year":"2001","unstructured":"Richard O. Duda, Peter E. Hart, and David G. Stork. 2001. Pattern Classification (2nd ed.). John Wiley and Sons, New York, NY."},{"doi-asserted-by":"publisher","key":"e_1_3_1_13_2","DOI":"10.1609\/aaai.v32i1.11894"},{"doi-asserted-by":"publisher","key":"e_1_3_1_14_2","DOI":"10.1073\/pnas.1422953112"},{"doi-asserted-by":"publisher","key":"e_1_3_1_15_2","DOI":"10.5555\/3086952"},{"doi-asserted-by":"publisher","key":"e_1_3_1_16_2","DOI":"10.1109\/CVPR.2018.00430"},{"doi-asserted-by":"publisher","key":"e_1_3_1_17_2","DOI":"10.1109\/KIMAS.2005.1427113"},{"doi-asserted-by":"publisher","key":"e_1_3_1_18_2","DOI":"10.1163\/9789004418554_006"},{"doi-asserted-by":"publisher","key":"e_1_3_1_19_2","DOI":"10.1086\/sou.4.2_3.23202426"},{"doi-asserted-by":"publisher","key":"e_1_3_1_20_2","DOI":"10.1109\/TIP.2017.2651399"},{"key":"e_1_3_1_21_2","volume-title":"To Be, or Not to Be: Four Hundred Years of Vanitas Paintings","author":"Kelly Raymond J.","year":"2006","unstructured":"Raymond J. Kelly. 2006. To Be, or Not to Be: Four Hundred Years of Vanitas Paintings. Flint Institute Press, Flint, MI."},{"doi-asserted-by":"publisher","key":"e_1_3_1_22_2","DOI":"10.1007\/s11263-019-01248-3"},{"key":"e_1_3_1_23_2","volume-title":"The Vanitas Still Lifes of Harmen Steenwyck (1612\u20131656): Metaphoric Realism","author":"Koozin Kristine","year":"1990","unstructured":"Kristine Koozin. 1990. The Vanitas Still Lifes of Harmen Steenwyck (1612\u20131656): Metaphoric Realism. Vol. 1. Edwin Mellen Press, Lewison, NY."},{"key":"e_1_3_1_24_2","volume-title":"Dutch Paintings in the Metropolitan Museum of Art","author":"Liedtke Walter","year":"2007","unstructured":"Walter Liedtke. 2007. Dutch Paintings in the Metropolitan Museum of Art. Metropolitan Museum of Art and Yale University Presses, New York, NY."},{"doi-asserted-by":"publisher","key":"e_1_3_1_25_2","DOI":"10.1145\/3092919.3092924"},{"doi-asserted-by":"publisher","key":"e_1_3_1_26_2","DOI":"10.1145\/3347317.3357242"},{"doi-asserted-by":"publisher","key":"e_1_3_1_27_2","DOI":"10.1016\/j.artint.2007.10.009"},{"key":"e_1_3_1_28_2","first-page":"747","volume-title":"Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics","author":"Mitchell Margaret","year":"2012","unstructured":"Margaret Mitchell, Jesse Dodge, Amit Goyal, Kota Yamaguchi, Karl Stratos, Xufeng Han, Alyssa Mensch, Alexander Berg, Tamara Berg, and Hal Daum\u00e9 III. 2012. Midge: Generating image descriptions from computer vision detections. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. 747\u2013756."},{"key":"e_1_3_1_29_2","first-page":"227","volume-title":"Handbook of Visual Communication: Theory, Methods and Media","author":"Moriarty Sandra","year":"2005","unstructured":"Sandra Moriarty. 2005. Visual semiotics theory. In Handbook of Visual Communication: Theory, Methods and Media, Ken Smith, Sandra Moriary, Gretchen Barbatsis, and Keith Kenney (Eds.). Lawrence Erlbaum, Mahwah, NJ, Chapter 15, 227\u2013241."},{"key":"e_1_3_1_30_2","volume-title":"Meaning in the Visual Arts","author":"Panofsky Erwin","year":"1955","unstructured":"Erwin Panofsky. 1955. Meaning in the Visual Arts. Doubleday, New York, NY."},{"key":"e_1_3_1_31_2","volume-title":"The Appeal of Lemons: Appearance and Meaning in Mid Seventeenth-century Dutch Painting","author":"Piepmeier Mary","year":"2018","unstructured":"Mary Piepmeier. 2018. The Appeal of Lemons: Appearance and Meaning in Mid Seventeenth-century Dutch Painting. MS Thesis. University of North Carolina at Chapel Hill, Chapel Hill, NC."},{"doi-asserted-by":"publisher","key":"e_1_3_1_32_2","DOI":"10.1007\/s11263-015-0816-y"},{"doi-asserted-by":"publisher","key":"e_1_3_1_33_2","DOI":"10.1038\/nature24270"},{"unstructured":"Emily L. Spratt and Ahmed Elgammal. 2014. The Digital Humanities Unveiled: Perceptions Held by Art Historians and Computer Scientists about Computer Vision Technology. Retrieved from https:\/\/arxiv.org\/abs\/1411.6714.","key":"e_1_3_1_34_2"},{"key":"e_1_3_1_35_2","volume-title":"Proceedings of the Image Processing for Art Investigations (IP4AI\u201911)","author":"Stone David M.","year":"2011","unstructured":"David M. Stone and David G. Stork. 2011. Computer assisted connoisseurship: The interdisciplinary science of computer vision and image analysis in the study of art. In Proceedings of the Image Processing for Art Investigations (IP4AI\u201911). Museum of Modern Art, Museum of Modern Art, New York, NY."},{"doi-asserted-by":"publisher","key":"e_1_3_1_36_2","DOI":"10.1038\/scientificamerican1204-76"},{"key":"e_1_3_1_37_2","volume-title":"Computer Vision and Analysis of Art","author":"Stork David G.","year":"2021","unstructured":"David G. Stork, Anthony Bourached, George H. Cann, and Ryan-Rhis Griffiths. 2021. Computational identification of significant actors in paintings through symbols and attributes. In Computer Vision and Analysis of Art, David G. Stork and Kurt Heumiller (Eds.). IS&T, San Francisco, CA."},{"key":"e_1_3_1_38_2","first-page":"379","volume-title":"Digital Imaging for Cultural Heritage Preservation","author":"Stork David G.","year":"2011","unstructured":"David G. Stork, Jacob Collins, Marco Duarte, Yasuo Furuichi, David Kale, Ashutosh Kulkarni, M. Dirk Robinson, Christopher W. Tyler, Sara Schechner, and Nicholas Williams. 2011. Did early renaissance painters trace optically projected images? The conclusion of independent scientists, art historians, and artists. In Digital Imaging for Cultural Heritage Preservation, Filippo Stanco, Sebastiano Battiato, and Giovanni Gallo (Eds.). CRC Press, Boca Raton, FL, Chapter 8, 379\u2013407."},{"doi-asserted-by":"publisher","key":"e_1_3_1_39_2","DOI":"10.1109\/CVPR.2018.00131"},{"doi-asserted-by":"publisher","key":"e_1_3_1_40_2","DOI":"10.1016\/j.procs.2018.11.121"},{"doi-asserted-by":"publisher","key":"e_1_3_1_41_2","DOI":"10.1109\/TNNLS.2016.2603784"},{"key":"e_1_3_1_42_2","first-page":"101","volume-title":"Intelligent Narrative Technologies","author":"Valls-Vargas Josep","year":"2015","unstructured":"Josep Valls-Vargas, Santiago Onta\u00f1\u00f3n, and Jichen Zhu. 2015. Toward character role assignment for natural language stories. In Intelligent Narrative Technologies. 101\u2013104."},{"doi-asserted-by":"publisher","key":"e_1_3_1_43_2","DOI":"10.3233\/ICG-180075"},{"key":"e_1_3_1_44_2","volume-title":"Handbook of Knowledge Representation","author":"Harmelen Frank van","year":"2008","unstructured":"Frank van Harmelen, Vladimir Lifschitz, and Bruce Porter (Eds.). 2008. Handbook of Knowledge Representation. Elsevier, Amsterdam, Netherlands."},{"key":"e_1_3_1_45_2","first-page":"3630","volume-title":"Advances in Neural Information Processing Systems","author":"Vinyals Oriol","year":"2016","unstructured":"Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, and Dean Wierstra. 2016. Matching networks for one shot learning. In Advances in Neural Information Processing Systems, Daniel Lee, Masashi Sugiyama, Ulrich von Luxburg, Isabelle Guyon, and Roman Garnett (Eds.), Vol. 29. Curran Associates, Red Hook, NY, 3630\u20133638."},{"key":"e_1_3_1_46_2","volume-title":"How to Read Italian Renaissance Painting","author":"Zuffi Stefano","year":"2010","unstructured":"Stefano Zuffi. 2010. How to Read Italian Renaissance Painting. Harry N. Abrams, New York, NY."}],"container-title":["Journal on Computing and Cultural Heritage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3471619","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3471619","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:48Z","timestamp":1750195488000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3471619"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,13]]},"references-count":45,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3471619"],"URL":"https:\/\/doi.org\/10.1145\/3471619","relation":{},"ISSN":["1556-4673","1556-4711"],"issn-type":[{"type":"print","value":"1556-4673"},{"type":"electronic","value":"1556-4711"}],"subject":[],"published":{"date-parts":[[2022,12,13]]},"assertion":[{"value":"2021-01-31","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-06-17","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}