{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:09:49Z","timestamp":1750219789646,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,12,13]],"date-time":"2023-12-13T00:00:00Z","timestamp":1702425600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004359","name":"Swedish Research Council","doi-asserted-by":"crossref","award":["2017-03979"],"award-info":[{"award-number":["2017-03979"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NordForsks Nordic University Hub \u201cNordic Sound and Music Computing Network\u2014Nordic SMC\u201d","award":["86892"],"award-info":[{"award-number":["86892"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2023,12,31]]},"abstract":"<jats:p>This article presents three studies where we probe aesthetics strategies of sound produced by movement sonification of a Pepper robot by mapping its movements to sound models.<\/jats:p>\n          <jats:p>We developed two sets of sound models. The first set was made by two sound models, a sawtooth-based one and another based on feedback chains, for investigating how the perception of synthesized robot sounds would depend on their design complexity. We implemented the second set of sound models for probing the \u201cmateriality\u201d of sound made by a robot in motion. This set consisted of a sound synthesis based on an engine highlighting the robot\u2019s internal mechanisms, a metallic sound synthesis highlighting the robot\u2019s typical appearance, and a whoosh sound synthesis highlighting the movement.<\/jats:p>\n          <jats:p>We conducted three studies. The first study explores how the first set of sound models can influence the perception of expressive gestures of a Pepper robot through an online survey. In the second study, we carried out an experiment in a museum installation with a Pepper robot presented in two scenarios: (1) while welcoming patrons into a restaurant and (2) while providing information to visitors in a shopping center. Finally, in the third study, we conducted an online survey with stimuli similar to those used in the second study.<\/jats:p>\n          <jats:p>Our findings suggest that participants preferred more complex sound models for the sonification of robot movements. Concerning the materiality, participants liked better subtle sounds that blend well with the ambient sound (i.e., less distracting) and soundscapes in which sound sources can be identified. Also, sound preferences varied depending on the context in which participants experienced the robot-generated sounds (e.g., as a live museum installation vs. an online display).<\/jats:p>","DOI":"10.1145\/3585277","type":"journal-article","created":{"date-parts":[[2023,3,17]],"date-time":"2023-03-17T12:07:14Z","timestamp":1679054834000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Probing Aesthetics Strategies for Robot Sound: Complexity and Materiality in Movement Sonification"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3572-6429","authenticated-orcid":false,"given":"Adrian B.","family":"Latupeirissa","sequence":"first","affiliation":[{"name":"KTH Royal Institute of Technology, Sweden"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1244-881X","authenticated-orcid":false,"given":"Claudio","family":"Panariello","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology, Sweden"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3086-0322","authenticated-orcid":false,"given":"Roberto","family":"Bresin","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology, Sweden"}]}],"member":"320","published-online":{"date-parts":[[2023,12,13]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-014-0263-x"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203766880"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2017.06.003"},{"key":"e_1_3_3_5_2","first-page":"145","volume-title":"The Sonification Handbook","author":"Barrass Stephen","year":"2011","unstructured":"Stephen Barrass and Paul Vickers. 2011. Sonification design and aesthetics. In The Sonification Handbook. Logos Verlag, Berlin, 145\u2013164."},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.21785\/icad2017.049"},{"key":"e_1_3_3_7_2","first-page":"1","article-title":"Auditory and other non-verbal expressions of affect for robots","volume":"06","author":"Bethel Cindy L.","year":"2006","unstructured":"Cindy L. Bethel and Robin R. Murphy. 2006. Auditory and other non-verbal expressions of affect for robots. AAAI Fall Symposium Technical Report FS-06-01 (2006), 1\u20135.","journal-title":"AAAI Fall Symposium"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2016.00385"},{"key":"e_1_3_3_9_2","volume-title":"Film Art: An Introduction","author":"Bordwell David","year":"2017","unstructured":"David Bordwell, Kristin Thompson, and Jeff Smith. 2017. Film Art: An Introduction. Vol. 11. McGraw-Hill Education, New York."},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cortex.2011.05.009"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/2536811"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3077981.3078047"},{"key":"e_1_3_3_13_2","unstructured":"Alejandro de la Garza. 2021. Electric Cars Can Sound Like Anything. That\u2019s a Huge Opportunity to Craft the Soundscape of the Future. Retrieved March 2 2022 from https:\/\/time.com\/5951773\/electric-car-sound-future\/."},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssci.2019.02.021"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12283-014-0164-0"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2005.31"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-013-0200-4"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-021-00788-4"},{"key":"e_1_3_3_19_2","first-page":"43","volume-title":"Sound and Music Computing","author":"Frid Emma","year":"2018","unstructured":"Emma Frid, Roberto Bresin, and Simon Alexanderson. 2018. Perception of mechanical sounds inherent to expressive gestures of a Nao robot-implications for movement sonification of humanoids. In Sound and Music Computing. Zenodo, Cyprus, 43\u201351."},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.5555\/915292"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720811417254"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993169"},{"key":"e_1_3_3_23_2","volume-title":"The Sonification Handbook","author":"Hermann Thomas","year":"2011","unstructured":"Thomas Hermann. 2011. Model-based sonification. In The Sonification Handbook. Logos Verlag, Berlin."},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70540-6_197"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11370-010-0070-7"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2021.3137013"},{"key":"e_1_3_3_27_2","article-title":"Simply the B.E.S.T.! Creation and validation of the bremen emotional sounds toolkit","author":"Kappas Arvid","year":"2015","unstructured":"Arvid Kappas, Dennis K\u00fcster, Pasquale Dente, and Christina Basedow. 2015. Simply the B.E.S.T.! Creation and validation of the bremen emotional sounds toolkit. In International Convention of Psychological Science.","journal-title":"International Convention of Psychological Science"},{"key":"e_1_3_3_28_2","article-title":"The sonification report: Status of the field and research agenda","author":"Kramer Gregory","year":"1997","unstructured":"Gregory Kramer, B. N. Walker, Terri Bonebright, Perry Cook, J. Flowers, Nadine Miner, John Neuhoff, R. Bargar, S. Barrass, J. Berger, et\u00a0al. 1997. The sonification report: Status of the field and research agenda. In Proceedings of the International Community for Auditory Display (ICAD \u201997).","journal-title":"Proceedings of the International Community for Auditory Display (ICAD \u201997)"},{"key":"e_1_3_3_29_2","volume-title":"17th International Congress on Acoustics","author":"Kyn\u010dl L","year":"2001","unstructured":"L Kyn\u010dl and O Ji\u0159\u00ed\u010dek. 2001. Psychoacoustic product sound quality evaluation. In 17th International Congress on Acoustics."},{"issue":"3","key":"e_1_3_3_30_2","first-page":"47","article-title":"Product sound design: Intentional and consequential sounds","volume":"47","author":"Langeveld Lau","year":"2013","unstructured":"Lau Langeveld, Ren\u00e9 van Egmond, Reinier Jansen, and Elif \u00d6zcan. 2013. Product sound design: Intentional and consequential sounds. Advances in Industrial Design Engineering 47, 3 (2013), 47\u201373.","journal-title":"Advances in Industrial Design Engineering"},{"key":"e_1_3_3_31_2","volume-title":"Sound and Music Computing Conference","author":"Latupeirissa Adrian Benigno","year":"2019","unstructured":"Adrian Benigno Latupeirissa, Emma Frid, and Roberto Bresin. 2019. Sonic characteristics of robots in films. In Sound and Music Computing Conference."},{"key":"e_1_3_3_32_2","first-page":"434","volume-title":"Proceedings of the Sound and Music Computing Conference","author":"Latupeirissa Adrian Benigno","year":"2020","unstructured":"Adrian Benigno Latupeirissa, Claudio Panariello, and Roberto Bresin. 2020. Exploring emotion perception in sonic HRI. In Proceedings of the Sound and Music Computing Conference. Zenodo, 434\u2013441."},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-013-0178-y"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3171221.3171261"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020238"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2012.2192811"},{"issue":"1","key":"e_1_3_3_37_2","first-page":"5","article-title":"Reflecting on the presence of science fiction robots in computing literature","volume":"8","author":"Mubin Omar","year":"2019","unstructured":"Omar Mubin, Kewal Wadibhasme, Philipp Jordan, and Mohammad Obaid. 2019. Reflecting on the presence of science fiction robots in computing literature. ACM Transactions on Human-Robot Interaction (THRI) 8, 1 (2019), 5.","journal-title":"ACM Transactions on Human-Robot Interaction (THRI)"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2022.862663"},{"key":"e_1_3_3_39_2","first-page":"1","article-title":"From vocal sketching to sound models by means of a sound-based musical transcription system","author":"Panariello Claudio","year":"2019","unstructured":"Claudio Panariello, Sk\u00f6ld Sk\u00f6ld, Emma Frid, and Roberto Bresin. 2019. From vocal sketching to sound models by means of a sound-based musical transcription system. In Proceedings of the 16th Sound And Music Computing Conference, 1\u20137.","journal-title":"Proceedings of the 16th Sound And Music Computing Conference"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-015-0304-0"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3434073.3444658"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0077714"},{"key":"e_1_3_3_43_2","volume-title":"The Oxford Handbook of Algorithmic Music","author":"Scaletti Carla","year":"2018","unstructured":"Carla Scaletti. 2018. Sonification \\(\\ne\\) music. The Oxford Handbook of Algorithmic Music."},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720816634228"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2014.6926247"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1038\/385308a0"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020239"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2018.8525795"},{"key":"e_1_3_3_49_2","unstructured":"Ren\u00e9 T\u00fcnnermann Jan Hammerschmidt and Thomas Hermann. 2013. Blended sonification: Sonification for casual information interaction. Georgia Institute of Technology."},{"key":"e_1_3_3_50_2","first-page":"135","volume-title":"The Routledge Companion to Sounding Art","author":"Vickers Paul","year":"2016","unstructured":"Paul Vickers. 2016. Sonification and music, music and sonification. In The Routledge Companion to Sounding Art. Taylor & Francis, London, 135\u2013144."},{"key":"e_1_3_3_51_2","doi-asserted-by":"crossref","first-page":"89","DOI":"10.4324\/9781315569628-6","volume-title":"Body, Sound and Space in Music and Beyond: Multimodal Explorations","author":"Vickers Paul","year":"2017","unstructured":"Paul Vickers, Bennett Hogg, and David Worrall. 2017. Aesthetics of sonification: Taking the subject-position. In Body, Sound and Space in Music and Beyond: Multimodal Explorations. Routledge, New York, 89\u2013109."},{"key":"e_1_3_3_52_2","first-page":"103","volume-title":"Auditory Display","author":"Vogt Katharina","year":"2009","unstructured":"Katharina Vogt, David Pirr\u00f2, Ingo Kobenz, Robert H\u00f6ldrich, and Gerhard Eckel. 2009. PhysioSonic-Evaluated movement sonification as auditory feedback in physiotherapy. Auditory Display. Springer, 103\u2013120."},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2015.1093856"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS51168.2021.9636365"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA48506.2021.9562082"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3585277","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3585277","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:56Z","timestamp":1750178276000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3585277"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,13]]},"references-count":54,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,12,31]]}},"alternative-id":["10.1145\/3585277"],"URL":"https:\/\/doi.org\/10.1145\/3585277","relation":{},"ISSN":["2573-9522"],"issn-type":[{"type":"electronic","value":"2573-9522"}],"subject":[],"published":{"date-parts":[[2023,12,13]]},"assertion":[{"value":"2022-05-11","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}