{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T04:51:10Z","timestamp":1788324670703,"version":"build-2803163510"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,10,31]],"date-time":"2020-10-31T00:00:00Z","timestamp":1604102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2020,10,31]]},"abstract":"<jats:p>It has long been hypothesized that perceptual ambiguities play an important role in aesthetic experience: A work with some ambiguity engages a viewer more than one that does not. However, current frameworks for testing this theory are limited by the availability of stimuli and data collection methods. This article presents an approach to measuring the perceptual ambiguity of a collection of images. Crowdworkers are asked to describe image content, after different viewing durations. Experiments are performed using images created with Generative Adversarial Networks, using the Artbreeder website. We show that text processing of viewer responses can provide a fine-grained way to measure and describe image ambiguities.<\/jats:p>","DOI":"10.1145\/3418054","type":"journal-article","created":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T14:31:06Z","timestamp":1604673066000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Toward Quantifying Ambiguities in Artistic Images"],"prefix":"10.1145","volume":"17","author":[{"given":"Xi","family":"Wang","sequence":"first","affiliation":[{"name":"TU Berlin and MIT, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zoya","family":"Bylinskii","sequence":"additional","affiliation":[{"name":"Adobe Research, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aaron","family":"Hertzmann","sequence":"additional","affiliation":[{"name":"Adobe Research, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Pepperell","sequence":"additional","affiliation":[{"name":"Fovolab\/Cardiff Metropolitan University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,11,6]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Steven Bird Ewan Klein and Edward Loper. 2009. Natural Language Processing with Python. O\u2019Reilly Media.  Steven Bird Ewan Klein and Edward Loper. 2009. Natural Language Processing with Python. O\u2019Reilly Media."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the CoNLL Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics","author":"Boros Tiberiu","year":"2018","unstructured":"Tiberiu Boros , Stefan Daniel Dumitrescu , and Ruxandra Burtica . 2018 . NLP-cube: End-to-end raw text processing with neural networks . In Proceedings of the CoNLL Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics , Brussels, Belgium, 171--179. Retrieved from http:\/\/www.aclweb.org\/anthology\/K18- 2017. Tiberiu Boros, Stefan Daniel Dumitrescu, and Ruxandra Burtica. 2018. NLP-cube: End-to-end raw text processing with neural networks. In Proceedings of the CoNLL Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics, Brussels, Belgium, 171--179. Retrieved from http:\/\/www.aclweb.org\/anthology\/K18-2017."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0803390105"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797612465439"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201919)","author":"Brock Andrew","year":"2019","unstructured":"Andrew Brock , Jeff Donahue , and Karen Simonyan . 2019 . Large scale GAN training for high fidelity natural image synthesis . In Proceedings of the International Conference on Learning Representations (ICLR\u201919) . Andrew Brock, Jeff Donahue, and Karen Simonyan. 2019. Large scale GAN training for high fidelity natural image synthesis. In Proceedings of the International Conference on Learning Representations (ICLR\u201919)."},{"key":"e_1_2_1_6_1","volume-title":"Art perception in the museum: How we spend time and space in art exhibitions. i-Percept. 8, 1","author":"Carbon Claus-Christian","year":"2017","unstructured":"Claus-Christian Carbon . 2017. Art perception in the museum: How we spend time and space in art exhibitions. i-Percept. 8, 1 ( 2017 ), 2041669517694184. Claus-Christian Carbon. 2017. Art perception in the museum: How we spend time and space in art exhibitions. i-Percept. 8, 1 (2017), 2041669517694184."},{"key":"e_1_2_1_7_1","volume-title":"Visiting Picasso: The Notebooks and Letters of Roland Penrose. Thames 8 Hudson.","author":"Cowling Elizabeth","year":"2006","unstructured":"Elizabeth Cowling . 2006 . Visiting Picasso: The Notebooks and Letters of Roland Penrose. Thames 8 Hudson. Elizabeth Cowling. 2006. Visiting Picasso: The Notebooks and Letters of Roland Penrose. Thames 8 Hudson."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201907)","author":"Nathaniel","unstructured":"Nathaniel D. Daw and Aaron C. Courville. 2007. The Pigeon as particle filter . In Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201907) . Nathaniel D. Daw and Aaron C. Courville. 2007. The Pigeon as particle filter. In Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201907)."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.concog.2007.07.005"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1167\/7.1.10"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00453"},{"key":"e_1_2_1_12_1","volume-title":"Potential Images: Ambiguity and Indeterminacy in Modern Art","author":"Gamboni Dario","year":"2004","unstructured":"Dario Gamboni . 2004 . Potential Images: Ambiguity and Indeterminacy in Modern Art . Reaktion Books . Dario Gamboni. 2004. Potential Images: Ambiguity and Indeterminacy in Modern Art. Reaktion Books."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2231816.2231817"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201914)","author":"Goodfellow Ian J.","year":"2014","unstructured":"Ian J. Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative adversarial nets . In Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201914) . Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201914)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809939.1809957"},{"key":"e_1_2_1_16_1","volume-title":"Visual indeterminacy in GAN art. Leonardo 53, 4","author":"Hertzmann Aaron","year":"2020","unstructured":"Aaron Hertzmann . 2020. Visual indeterminacy in GAN art. Leonardo 53, 4 ( 2020 ). Aaron Hertzmann. 2020. Visual indeterminacy in GAN art. Leonardo 53, 4 (2020)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/312624.312649"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainresbull.2007.04.009"},{"key":"e_1_2_1_19_1","volume-title":"Image ambiguity and fluency. PLoS ONE 8, 9","author":"Jakesch Martina","year":"2013","unstructured":"Martina Jakesch , Helmut Leder , and Michael Forster . 2013. Image ambiguity and fluency. PLoS ONE 8, 9 ( 2013 ). Martina Jakesch, Helmut Leder, and Michael Forster. 2013. Image ambiguity and fluency. PLoS ONE 8, 9 (2013)."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1068\/p3030"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2013.05.001"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1163\/22134913-00002049"},{"key":"e_1_2_1_23_1","volume-title":"Variants of Semantic Instability (SeIns) in the arts. A classification study based on experiential reports. Psychol. Aesthet. Creativ. Arts 12, 1","author":"Muth Claudia","year":"2018","unstructured":"Claudia Muth , Vera Hesslinger , and Claus-Christian Carbon . 2018. Variants of Semantic Instability (SeIns) in the arts. A classification study based on experiential reports. Psychol. Aesthet. Creativ. Arts 12, 1 ( 2018 ). Claudia Muth, Vera Hesslinger, and Claus-Christian Carbon. 2018. Variants of Semantic Instability (SeIns) in the arts. A classification study based on experiential reports. Psychol. Aesthet. Creativ. Arts 12, 1 (2018)."},{"key":"e_1_2_1_24_1","volume-title":"The appeal of challenge in the perception of art: How ambiguity, solvability of ambiguity, and the opportunity for insight affect appreciation. Psychol. Aesthet. Creativ. Arts 9, 3","author":"Muth Claudia","year":"2015","unstructured":"Claudia Muth , Vera M. Hesslinger , and Claus-Christian Carbon . 2015. The appeal of challenge in the perception of art: How ambiguity, solvability of ambiguity, and the opportunity for insight affect appreciation. Psychol. Aesthet. Creativ. Arts 9, 3 ( 2015 ). Claudia Muth, Vera M. Hesslinger, and Claus-Christian Carbon. 2015. The appeal of challenge in the perception of art: How ambiguity, solvability of ambiguity, and the opportunity for insight affect appreciation. Psychol. Aesthet. Creativ. Arts 9, 3 (2015)."},{"key":"e_1_2_1_25_1","volume-title":"Semantic stability is more pleasurable in unstable episodic contexts. On the relevance of perceptual challenge in art appreciation. Front. Hum. Neurosci. 10","author":"Muth Claudia","year":"2016","unstructured":"Claudia Muth , Marius H. Raab , and Claus-Christian Carbon . 2016. Semantic stability is more pleasurable in unstable episodic contexts. On the relevance of perceptual challenge in art appreciation. Front. Hum. Neurosci. 10 ( 2016 ), 43 pages. DOI:https:\/\/doi.org\/10.3389\/fnhum.2016.00043 10.3389\/fnhum.2016.00043 Claudia Muth, Marius H. Raab, and Claus-Christian Carbon. 2016. Semantic stability is more pleasurable in unstable episodic contexts. On the relevance of perceptual challenge in art appreciation. Front. Hum. Neurosci. 10 (2016), 43 pages. DOI:https:\/\/doi.org\/10.3389\/fnhum.2016.00043"},{"key":"e_1_2_1_26_1","volume-title":"Encyclopedia of Perception","author":"Oliva Aude","unstructured":"Aude Oliva . 2009. Visual scene perception . In Encyclopedia of Perception . SAGE Publications , Thousand Oaks, CA , 1112--1117. Aude Oliva. 2009. Visual scene perception. In Encyclopedia of Perception. SAGE Publications, Thousand Oaks, CA, 1112--1117."},{"key":"e_1_2_1_27_1","volume-title":"Connecting art and the brain: An artist\u2019s perspective on visual indeterminacy. Front. Hum. Neurosci. 5","author":"Pepperell Robert","year":"2011","unstructured":"Robert Pepperell . 2011. Connecting art and the brain: An artist\u2019s perspective on visual indeterminacy. Front. Hum. Neurosci. 5 ( 2011 ), 84 pages. Robert Pepperell. 2011. Connecting art and the brain: An artist\u2019s perspective on visual indeterminacy. Front. Hum. Neurosci. 5 (2011), 84 pages."},{"key":"e_1_2_1_28_1","volume-title":"Artworks as dichotomous objects: Implications for the scientific study of aesthetic experience. Front. Hum. Neurosci. 9 (June","author":"Pepperell Robert","year":"2015","unstructured":"Robert Pepperell . 2015. Artworks as dichotomous objects: Implications for the scientific study of aesthetic experience. Front. Hum. Neurosci. 9 (June 2015 ), 295 pages. Robert Pepperell. 2015. Artworks as dichotomous objects: Implications for the scientific study of aesthetic experience. Front. Hum. Neurosci. 9 (June 2015), 295 pages."},{"key":"e_1_2_1_29_1","volume-title":"Meaning in visual search. Science 187, 4180","author":"Potter Mary C.","year":"1975","unstructured":"Mary C. Potter . 1975. Meaning in visual search. Science 187, 4180 ( 1975 ), 965--966. Mary C. Potter. 1975. Meaning in visual search. Science 187, 4180 (1975), 965--966."},{"key":"e_1_2_1_30_1","volume-title":"Understanding sentences and scenes: The role of conceptual short-term memory","author":"Potter Mary C.","year":"1999","unstructured":"Mary C. Potter . 1999. Understanding sentences and scenes: The role of conceptual short-term memory . Fleeting Memories : Cognition of Brief Visual Stimuli ( 1999 ). Bradford, UK , 13--46. Mary C. Potter. 1999. Understanding sentences and scenes: The role of conceptual short-term memory. Fleeting Memories: Cognition of Brief Visual Stimuli (1999). Bradford, UK, 13--46."},{"key":"e_1_2_1_31_1","volume-title":"Gerhard Richter\u2014Text: Writing, Interviews and Letters 1961\u20132007. Thames 8 Hudson","author":"Richter Gerhard","unstructured":"Gerhard Richter , Dietmar Elger , and Hans Ulrich Obrist . 2009. Gerhard Richter\u2014Text: Writing, Interviews and Letters 1961\u20132007. Thames 8 Hudson , London . Gerhard Richter, Dietmar Elger, and Hans Ulrich Obrist. 2009. Gerhard Richter\u2014Text: Writing, Interviews and Letters 1961\u20132007. Thames 8 Hudson, London."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201907)","author":"Russell Bryan","unstructured":"Bryan Russell , Antonio Torralba , Kevin Murphy , and William T. Freeman . 2007. LabelMe: A database and web-based tool for image annotation . In Proceedings of the International Conference on Computer Vision (ICCV\u201907) . Bryan Russell, Antonio Torralba, Kevin Murphy, and William T. Freeman. 2007. LabelMe: A database and web-based tool for image annotation. In Proceedings of the International Conference on Computer Vision (ICCV\u201907)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1994.tb00500.x"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0952523808080930"},{"key":"e_1_2_1_35_1","volume-title":"Putting reward in art: A tentative prediction error account of visual art. i-Percept. 2, 9","author":"de Cruys Sander Van","year":"2011","unstructured":"Sander Van de Cruys and Johan Wagemans . 2011. Putting reward in art: A tentative prediction error account of visual art. i-Percept. 2, 9 ( 2011 ). Sander Van de Cruys and Johan Wagemans. 2011. Putting reward in art: A tentative prediction error account of visual art. i-Percept. 2, 9 (2011)."},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 3rd Eurographics Conference on Computational Aesthetics in Graphics, Visualization, and Imaging. 121--128","author":"Wallraven C.","unstructured":"C. Wallraven , K. Kaulard , C. K\u00fcrner , R. Pepperell , and H. B\u00fclthoff . 2007. In the eye of the beholder - Perception of indeterminate art . In Proceedings of the 3rd Eurographics Conference on Computational Aesthetics in Graphics, Visualization, and Imaging. 121--128 . C. Wallraven, K. Kaulard, C. K\u00fcrner, R. Pepperell, and H. B\u00fclthoff. 2007. In the eye of the beholder - Perception of indeterminate art. In Proceedings of the 3rd Eurographics Conference on Computational Aesthetics in Graphics, Visualization, and Imaging. 121--128."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 4th Symposium on Applied Perception in Graphics and Visualization. 115--122","author":"Wallraven Christian","unstructured":"Christian Wallraven , Kathrin Kaulard , Cora K\u00fcrner , Robert Pepperell , and Heinrich H. B\u00fclthoff . 2007. Psychophysics for perception of (in)determinate art . In Proceedings of the 4th Symposium on Applied Perception in Graphics and Visualization. 115--122 . Christian Wallraven, Kathrin Kaulard, Cora K\u00fcrner, Robert Pepperell, and Heinrich H. B\u00fclthoff. 2007. Psychophysics for perception of (in)determinate art. In Proceedings of the 4th Symposium on Applied Perception in Graphics and Visualization. 115--122."}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3418054","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3418054","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:35Z","timestamp":1750195895000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3418054"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,31]]},"references-count":37,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,10,31]]}},"alternative-id":["10.1145\/3418054"],"URL":"https:\/\/doi.org\/10.1145\/3418054","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,31]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}