{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T04:18:27Z","timestamp":1773807507178,"version":"3.50.1"},"reference-count":90,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T00:00:00Z","timestamp":1636934400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2021,12,31]]},"abstract":"<jats:p>We present a first-person, retrospective exploration of two radio sonification pieces that employ narrative scaffolding to teach audiences how to listen to data. To decelerate and articulate design processes that occurred at the rapid pace of radio production, the sound designer and producer wrote retrospective design accounts. We then revisited the radio pieces through principles drawn from guidance design, data storytelling, visualization literacy, and sound studies. Finally, we speculated how these principles might be applied through interactive, voice-based technologies. First-person methods enabled us to access the implicit knowledge embedded in radio production and translate it to technologies of interest to the human\u2013computer-interaction community, such as voice user interfaces that rely on auditory display. Traditionally, sonification practitioners have focused more on generating sounds than on teaching people how to listen; our process, however, treated sound and narrative as a holistic, sonic-narrative experience. Our first-person retrospection illuminated the role of narrative in designing to support people as they learn to listen to data.<\/jats:p>","DOI":"10.1145\/3461762","type":"journal-article","created":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T17:27:28Z","timestamp":1636997248000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Examining Narrative Sonification: Using First-Person Retrospection Methods to Translate Radio Production to Interaction Design"],"prefix":"10.1145","volume":"28","author":[{"given":"Jordan","family":"Wirfs-Brock","sequence":"first","affiliation":[{"name":"Department of Information Science, University of Colorado Boulder, Boulder, Colorado, CO"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alli","family":"Fam","sequence":"additional","affiliation":[{"name":"Marketplace\/New Hampshire Public Radio, Pillsbury St, Concord NH, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laura","family":"Devendorf","sequence":"additional","affiliation":[{"name":"ATLAS Institute, University of Colorado Boulder, Boulder, Colorado, CO"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian","family":"Keegan","sequence":"additional","affiliation":[{"name":"Department of Information Science, University of Colorado Boulder, Boulder, Colorado, CO"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,11,15]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Marketplace. 2011. Marketplace FAQs: When You \u201cdo the numbers\u201d Each Day What Are the Songs You Play? Retrieved on June 6 2021 fromhttps:\/\/www.marketplace.org\/faqs\/."},{"key":"e_1_3_2_3_2","volume-title":"The Sonification Handbook","author":"Hermann Thomas","year":"2011","unstructured":"Thomas Hermann, Andy Hunt, and John G. Neuhoff. 2011. The Sonification Handbook. Logos Publishing House."},{"key":"e_1_3_2_4_2","unstructured":"NETFLIX. 2020. Lin-Manuel Miranda - Wait for It. Retrieved on September 22 2020 from https:\/\/www.netflix.com\/watch\/81025975."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702431"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2017.33"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1177\/1468794109343625"},{"key":"e_1_3_2_8_2","volume-title":"Proceedings of the International Conference on Auditory Display","author":"Barbour J.","year":"2004","unstructured":"J. Barbour. 2004. Analytic listening: A case study of radio production. In Proceedings of the International Conference on Auditory Display. Georgia Institute of Technology. Retrieved from https:\/\/smartech.gatech.edu\/handle\/1853\/50759."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1162\/LEON_a_01116"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.an.13.100184.002431"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0277-9536(97)00088-9"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1057\/978-1-137-59829-5"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3565"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1807180116"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1080\/00330124.2013.781490"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2317968"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.5555\/380681"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-954X.1984.tb00113.x"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598468"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13730"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318078"},{"key":"e_1_3_2_22_2","unstructured":"Roy Peter Clark. 2020. Explanatory Journalism is Entering a Golden Age in the Middle of the Coronavirus Pandemic. Retrieved on June 6 2021 from https:\/\/www.poynter.org\/reporting-editing\/2020\/explanatory-journalism-is-entering-a-golden-age-in-the-middle-of-the-coronavirus-pandemic\/."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.5555\/2783107.2783115"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10734-010-9387-6"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apacoust.2012.05.010"},{"key":"e_1_3_2_26_2","first-page":"342","volume-title":"Proceedings of the International Conference on Auditory Display","author":"Campo Alberto de","year":"2007","unstructured":"Alberto de Campo. 2007. Toward a data sonification design space map. In Proceedings of the International Conference on Auditory Display. Georgia Institute of Technology, 342\u2013347."},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the 2008 International Conference on Auditory Display","author":"Dingler Tilman","year":"2008","unstructured":"Tilman Dingler, Jeffrey Lindsay, and Bruce N. Walker. 2008. Learnabiltiy of sound cues for environmental features: Auditory icons, earcons, spearcons, and speech. In Proceedings of the 2008 International Conference on Auditory Display. Georgia Institute of Technology. Retrieved from https:\/\/smartech.gatech.edu\/handle\/1853\/49940."},{"key":"e_1_3_2_28_2","unstructured":"Graham Dove and Sara Jones. 2012. Narrative visualization: Sharing insights into complex data. In Interfaces and Human Computer Interaction (IHCI\u201912) 21-23 Jul 2012 Lisbon Portugal . https:\/\/openaccess.city.ac.uk\/id\/eprint\/1134"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1093\/iwc\/iwz024"},{"key":"e_1_3_2_30_2","first-page":"25","article-title":"Trace interviews: An actor-centered approach","volume":"9","author":"Dubois Elizabeth","year":"2015","unstructured":"Elizabeth Dubois and Heather Ford. 2015. Trace interviews: An actor-centered approach. International Journal of Communication 9, 0 (June 2015), 25. Retrieved from https:\/\/ijoc.org\/index.php\/ijoc\/article\/view\/3378.","journal-title":"International Journal of Communication"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2901790.2901821"},{"key":"e_1_3_2_32_2","volume-title":"Handbook of Complementary Methods in Education Research","author":"Erickson Frederick","year":"2012","unstructured":"Frederick Erickson. 2012. Definition and analysis of data from videotape: Some research procedures and their rationales. In Handbook of Complementary Methods in Education Research. J. L. Green, G. Camilli, P. B. Elmore, A. Skukauskaiti, and E. Grace (Eds.), Routledge."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1080\/17512780701275531"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.2307\/271044"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395442"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0202_3"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15326969eco0504_2"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.5555\/915292"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bandc.2010.01.005"},{"key":"e_1_3_2_40_2","unstructured":"Jacob Goldstein and David Kestenbaum. 2011. U.S. Home Prices Sung As Opera. Retrieved June 6 2021 from https:\/\/www.npr.org\/sections\/money\/2011\/04\/27\/135737940\/the-case-shiller-index-sung-as-opera."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466240"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702297"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702561"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196745"},{"key":"e_1_3_2_45_2","volume-title":"Data Visualization: A Practical Introduction","author":"Healy Kieran","year":"2018","unstructured":"Kieran Healy. 2018. Data Visualization: A Practical Introduction. Princeton University Press."},{"key":"e_1_3_2_46_2","unstructured":"John Hudak. Shining Light on Explanatory Journalism\u2019s Impact on Media Democracy and Society. Retrieved February 24 2016 from https:\/\/www.brookings.edu\/blog\/fixgov\/2016\/02\/24\/shining-light-on-explanatory-journalisms-impact-on-media-democracy-and-society\/."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1037\/aca0000090"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2017.1355026"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0401_2"},{"key":"e_1_3_2_50_2","unstructured":"Julia Barton and Roman Mars. 2013. 99 Percent Invisible: The Broadcast Clock. Retrieved September 22 2020 from https:\/\/99percentinvisible.org\/episode\/the-broadcast-clock\/."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720944603"},{"key":"e_1_3_2_52_2","doi-asserted-by":"crossref","unstructured":"Grace Li and Bruce N. Walker. 2019. Mixed speech and non-speech auditory displays: Impacts of design learning and individual differences in musical engagement. In 25th International Conference on Auditory Display (ICAD\u201919) 23-27 June 2019 Northumbria University Newcastle upon Tyne UK . DOI:https:\/\/doi.org\/10.21785\/icad2019.019","DOI":"10.21785\/icad2019.019"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.21785\/icad2019.071"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1177\/1470412905054673"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1201\/b17511"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1177\/1064804618773563"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.21785\/icad2019.069"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/0022-1031(76)90076-7"},{"issue":"1","key":"e_1_3_2_59_2","first-page":"43","article-title":"Transcription as theory","volume":"10","author":"Ochs Elinor","year":"1979","unstructured":"Elinor Ochs. 1979. Transcription as theory. Developmental Pragmatics 10, 1 (1979), 43\u201372.","journal-title":"Developmental Pragmatics"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1002\/sce.21452"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395584"},{"key":"e_1_3_2_62_2","unstructured":"Julian Edgerton Orr. 1987. Talking about machines: Social aspects of expertise . Xerox Palo Alto Research Center Intelligent Systems Laboratory."},{"key":"e_1_3_2_63_2","volume-title":"The Oxford Handbook of Sound Studies","author":"Pinch Trevor","year":"2012","unstructured":"Trevor Pinch and Karin Bijsterveld. 2012. New keys to the world of sound. In The Oxford Handbook of Sound Studies. T. Pinch and K. Bijsterveld (Eds.), Oxford University Press, Oxford."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3322276.3322310"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.5555\/3235128"},{"key":"e_1_3_2_66_2","first-page":"64","volume-title":"Proceedings of the Music Technology Workshop 2016: Establishing a Partnership between Music Technology, Business Analytics and Industry in Ireland","author":"Roddy Stephen","year":"2016","unstructured":"Stephen Roddy and Brian Bridges. 2016. Sounding human with data: The role of embodied conceptual metaphors and aesthetics in representing and exploring data sets. In Proceedings of the Music Technology Workshop 2016: Establishing a Partnership between Music Technology, Business Analytics and Industry in Ireland. University College Dublin, 64\u201376."},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-020-00318-y"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1086\/596646"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-0378-8_15"},{"key":"e_1_3_2_70_2","unstructured":"Kai Ryssdal and Alli Fam. 2020. Here\u2019s What the Crescendo of Unemployment Sounds Like. Retrieved October 2 2021 from https:\/\/www.marketplace.org\/2020\/06\/24\/heres-what-the-crescendo-of-unemployment-sounds-like\/."},{"key":"e_1_3_2_71_2","unstructured":"Kai Ryssdal and Alli Fam. 2020. What Sound does a Volatile Stock Market Make? Retrieved October 2 2021 from https:\/\/www.marketplace.org\/2020\/03\/31\/the-sounds-of-a-volatile-stock-market\/."},{"key":"e_1_3_2_72_2","unstructured":"Christine Schmidt. 2018. \u201cJournalism practice may feel like a product on a conveyor belt\u201d: Researchers on the Future of Automated News Production and Consumption. Retrieved September 22 2020 from https:\/\/www.niemanlab.org\/2018\/05\/journalism-practice-may-feel-like-a-product-on-a-conveyor-belt-researchers-on-the-future-of-automated-news-production-and-consumption\/."},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819923"},{"key":"e_1_3_2_74_2","volume-title":"The Reflective Practitioner: How Professionals Think in Action (1st. ed.)","author":"Schon Donald A.","year":"1983","unstructured":"Donald A. Schon. 1983. The Reflective Practitioner: How Professionals Think in Action (1st. ed.). Basic Books, New York, NY."},{"issue":"1","key":"e_1_3_2_75_2","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1002\/acp.940","article-title":"The cognitive representation of filmic event summaries","volume":"18","author":"Schwan Stephan","year":"2004","unstructured":"Stephan Schwan and B\u00e4rbel Garsoffky. 2004. The cognitive representation of filmic event summaries. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition 18, 1 (2004), 37\u201355.","journal-title":"Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.179"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376460"},{"key":"e_1_3_2_78_2","volume-title":"The Encyclopedia of Human-Computer Interaction","author":"Stappers Pieter Jan","year":"2012","unstructured":"Pieter Jan Stappers and Elisa Giaccardi. 2012. Research through design. In The Encyclopedia of Human-Computer Interaction, Claude Ghaoui (Ed.). Interaction Design Foundation. Retrieved from https:\/\/www.interaction-design.org\/literature\/book\/the-encyclopedia-of-human-computer-interaction-2nd-ed\/research-through-design."},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1177\/030631289019003001"},{"key":"e_1_3_2_80_2","unstructured":"Dean Starkman. 2010. The Hamster Wheel. Retrieved September 22 2020 from https:\/\/www.cjr.org\/cover_story\/the_hamster_wheel.php."},{"key":"e_1_3_2_81_2","volume-title":"The Oxford Handbook of Sound Studies","author":"Supper Alexandra","year":"2011","unstructured":"Alexandra Supper. 2011. The search for the \u201ckiller application\u201d: Drawing the boundaries around the sonification of scientific data. In The Oxford Handbook of Sound Studies. T. Pinch and K. Bijsterveld (Eds.). Oxford University Press, New York. DOI:https:\/\/doi.org\/10.1093\/oxfordhb\/9780195388947.013.0064"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1179\/0308018815Z.000000000109"},{"key":"e_1_3_2_83_2","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1201\/9781315281575-3","volume-title":"Data-Driven Storytelling","author":"Thudt Alice","year":"2018","unstructured":"Alice Thudt, Jagoda Walny, Theresia Gschwandtner, Jason Dykes, and John Stasko. 2018. Exploration and explanation in data-driven storytelling. In Data-Driven Storytelling, Nathalie Henry Riche, Christophe Hurter, Nicholas Diakopoulos, and Sheelagh Carpendale (Eds.). AK Peters\/CRC Press, 59\u201383."},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781315281575-2"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780190497118.001.0001"},{"key":"e_1_3_2_86_2","volume-title":"Proceedings of the 11th Meeting of the International Conference on Auditory Display","author":"Walker Bruce N.","year":"2005","unstructured":"Bruce N. Walker and Michael A. Nees. 2005. Brief training for performance of a point estimation sonification task. In Proceedings of the 11th Meeting of the International Conference on Auditory Display. Georgia Institute of Technology. DOI:https:\/\/doi.org\/1853\/50101"},{"key":"e_1_3_2_87_2","unstructured":"Jordan Wirfs-Brock. 2016. Listen to U.S. Coal Production Fall Off A Cliff. Retrieved June 6 2021 from http:\/\/insideenergy.org\/2016\/05\/03\/listen-to-u-s-coal-production-fall-off-a-cliff\/."},{"key":"e_1_3_2_88_2","volume-title":"Sonification and Information: Concepts, Instruments and Techniques","author":"Worrall David","year":"2009","unstructured":"David Worrall. 2009. Sonification and Information: Concepts, Instruments and Techniques. Ph.D. Dissertation. University of Canberra."},{"key":"e_1_3_2_89_2","unstructured":"Roxanna Xia Swetha Kannan and Terry Castleman. 2019. The Ocean Game: The sea is rising. Can you save your town? - Los Angeles Times. Retrieved June 6 2021 from https:\/\/www.latimes.com\/projects\/la-me-climate-change-ocean-game\/."},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598556"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-0378-8_8"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461762","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461762","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:06Z","timestamp":1750191426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461762"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,15]]},"references-count":90,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,12,31]]}},"alternative-id":["10.1145\/3461762"],"URL":"https:\/\/doi.org\/10.1145\/3461762","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,15]]},"assertion":[{"value":"2020-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}