{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T12:29:44Z","timestamp":1764937784067,"version":"3.41.0"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T00:00:00Z","timestamp":1733184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2025,3,31]]},"abstract":"<jats:p>As robots enter everyday spaces like offices, the sounds they create affect how they are perceived. We present \u201cMusic Mode,\u201d a novel mapping between a robot\u2019s joint motions and sounds, programmed by artists and engineers to make the robot generate music as it moves. Two experiments were designed to characterize the effect of this musical augmentation on human users. In the first experiment, a robot performed three tasks while playing three different sound mappings. Results showed that participants observing the robot perceived it as more safe, animate, intelligent, anthropomorphic, and likable when playing the Music Mode Orchestra software. To test whether the results of the first experiment were due to the Music Mode algorithm, rather than music alone, we conducted a second experiment. Here, the robot performed the same three tasks, while a participant observed via video, but the Orchestra music was either linked to its movement or random. Participants rated the robots as more intelligent when the music was linked to the movement. Robots using Music Mode logged approximately 200 hours of operation while navigating, wiping tables, and sorting trash, and bystander comments made during this operating time served as an embedded case study. This article has both designerly contributions and engineering contributions. The contributions are as follows: (1) an interdisciplinary choreographic, musical, and coding design process to develop a real-world robot sound feature, (2) a technical implementation for movement-based sound generation, and (3) two experiments and an embedded case study of robots running this feature during daily work activities that resulted in increased likeability and perceived intelligence of the robot.<\/jats:p>","DOI":"10.1145\/3686811","type":"journal-article","created":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T13:55:28Z","timestamp":1723038928000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Music Mode: Transforming Robot Movement into Music Increases Likability and Perceived Intelligence"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7233-2659","authenticated-orcid":false,"given":"Catie","family":"Cuan","sequence":"first","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-2211-7387","authenticated-orcid":false,"given":"Emre","family":"Fisher","sequence":"additional","affiliation":[{"name":"ASML, San Jose, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6912-1666","authenticated-orcid":false,"given":"Allison","family":"Okamura","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-9536-8638","authenticated-orcid":false,"given":"Tom","family":"Engbersen","sequence":"additional","affiliation":[{"name":"Skydio, San Mateo, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,12,3]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Aethon. [n. d.]. TUG Robot. Retrieved February 27 2023 from https:\/\/aethon.com\/PDF\/TUG_T2_Datasheet.pdf"},{"key":"e_1_3_2_3_2","unstructured":"Badger. [n. d.]. Badger Robot. Retrieved February 27 2023 from https:\/\/www.badger-technologies.com\/platform\/robots.html"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-008-0001-3"},{"key":"e_1_3_2_5_2","first-page":"73","article-title":"Empirically informed sound synthesis application for enhancing the perception of expressive robotic movement","author":"Bellona Jon","year":"2017","unstructured":"Jon Bellona, Lin Bai, Luke Dahl, and Amy LaViers. 2017. Empirically informed sound synthesis application for enhancing the perception of expressive robotic movement. In International Conference on Auditory Display, 73\u201380.","journal-title":"International Conference on Auditory Display"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/792704.792733"},{"key":"e_1_3_2_7_2","volume-title":"Workshop on Sound in Human-Robot Interaction at International Conference on Human-Robot Interaction","author":"Bresin Roberto","year":"2021","unstructured":"Roberto Bresin, Emma Frid, Adrian Latupeirissa, and Claudio Panariello. 2021. Robust non-verbal expression in humanoid robots: New methods for augmenting expressive movements with sound. In Workshop on Sound in Human-Robot Interaction at International Conference on Human-Robot Interaction. Retrieved from https:\/\/hal.science\/hal-03250920\/"},{"key":"e_1_3_2_8_2","first-page":"254","article-title":"The robotic social attributes scale (RoSAS) development and validation","author":"Carpinella Colleen M.","year":"2017","unstructured":"Colleen M. Carpinella, Alisa B. Wyman, Michael A. Perez, and Steven J. Stroessner. 2017. The robotic social attributes scale (RoSAS) development and validation. In 2017 ACM\/IEEE International Conference on Human-Robot Interaction, 254\u2013262.","journal-title":"2017 ACM\/IEEE International Conference on Human-Robot Interaction"},{"key":"e_1_3_2_9_2","first-page":"434","article-title":"Effects of robot sound on auditory localization in human-robot collaboration","author":"Cha Elizabeth","year":"2018","unstructured":"Elizabeth Cha, Naomi T. Fitter, Yunkyung Kim, Terrence Fong, and Maja J. Matari\u0107. 2018. Effects of robot sound on auditory localization in human-robot collaboration. In ACM\/IEEE International Conference on Human-Robot Interaction, 434\u2013442.","journal-title":"ACM\/IEEE International Conference on Human-Robot Interaction"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1515\/pjbr-2019-0024"},{"key":"e_1_3_2_11_2","first-page":"255","article-title":"Curtain and time to compile: A demonstration of an experimental testbed for human-robot interaction","author":"Cuan Catie","year":"2018","unstructured":"Catie Cuan, Ishaan Pakrasi, Erin Berl, and Amy LaViers. 2018. Curtain and time to compile: A demonstration of an experimental testbed for human-robot interaction. In IEEE International Symposium on Robot and Human Interactive Communication, 255\u2013261.","journal-title":"IEEE International Symposium on Robot and Human Interactive Communication"},{"key":"e_1_3_2_12_2","first-page":"1","article-title":"Data-driven design of sound for enhancing the perception of expressive robotic movement","author":"Dahl Luke","year":"2017","unstructured":"Luke Dahl, Jon Bellona, Lin Bai, and Amy LaViers. 2017. Data-driven design of sound for enhancing the perception of expressive robotic movement. In International Conference on Movement Computing, 1\u20138.","journal-title":"International Conference on Movement Computing"},{"key":"e_1_3_2_13_2","first-page":"144","article-title":"An agent-based system for robotic musical performance","author":"Eigenfeldt Arne","year":"2008","unstructured":"Arne Eigenfeldt and Ajay Kapur. 2008. An agent-based system for robotic musical performance. In Conference on New Interfaces for Musical Expression, 144\u2013149.","journal-title":"Conference on New Interfaces for Musical Expression"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-021-00788-4"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2010.05.015"},{"key":"e_1_3_2_16_2","unstructured":"Guy Hoffman. 2011. On stage: Robots as performers. In Workshop on Human-Robot Interaction: Perspectives and Contributions to Robotics from the Human Sciences at Robotics Science and Systems Vol. 1 21. Retrieved from https:\/\/hrc2.io\/assets\/pdfs\/papers\/HoffmanWkRSS11.pdf"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.3.1.Hoffman"},{"key":"e_1_3_2_18_2","first-page":"317","article-title":"Effects of robotic companionship on music enjoyment and agent perception","author":"Hoffman Guy","year":"2013","unstructured":"Guy Hoffman and Keinan Vanunu. 2013. Effects of robotic companionship on music enjoyment and agent perception. In ACM\/IEEE International Conference on Human-Robot Interaction, 317\u2013324.","journal-title":"ACM\/IEEE International Conference on Human-Robot Interaction"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1753925"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2990-5_1"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-016-0370-y"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/2157689.2157698"},{"key":"e_1_3_2_23_2","first-page":"4599","article-title":"A history of robotic musical instruments","volume":"10","author":"Kapur Ajay","year":"2005","unstructured":"Ajay Kapur. 2005. A history of robotic musical instruments. In ICMC, Vol. 10. 4599.","journal-title":"ICMC"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1162\/COMJ_a_00090"},{"key":"e_1_3_2_25_2","unstructured":"Kleomenis Katevas Patrick G. T. Healey and Matthew Tobias Harris. 2014. Robot stand-up: Engineering a comic performance. In Workshop on Humanoid Robots and Creativity at the IEEE\/RAS International Conference on Humanoid Robots. Retrieved from https:\/\/minoskt.github.io\/papers\/HumanoidRobots14.pdf"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/CTS.2011.5928689"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25504-5_5"},{"key":"e_1_3_2_28_2","unstructured":"Adrian Benigno Latupeirissa and Roberto Bresin. 2020. Understanding non-verbal sound of humanoid robots in films. In Workshop on Mental Models of Robots at International Conference on Human-Robot Interaction. Retrieved from https:\/\/www.diva-portal.org\/smash\/record.jsf?pid=diva2"},{"key":"e_1_3_2_29_2","first-page":"255","volume-title":"Sound and Music Computing Conference","author":"Latupeirissa Adrian Benigno","year":"2019","unstructured":"Adrian Benigno Latupeirissa, Emma Frid, and Roberto Bresin. 2019. Sonic characteristics of robots in films. In Sound and Music Computing Conference, 255\u2013260."},{"key":"e_1_3_2_30_2","first-page":"434","volume-title":"Sound and Music Computing Conference","author":"Latupeirissa Adrian Benigno","year":"2020","unstructured":"Adrian Benigno Latupeirissa, Claudio Panariello, and Roberto Bresin. 2020. Exploring emotion perception in sonic HRI. In Sound and Music Computing Conference. Zenodo, 434\u2013441."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.3390\/arts7020011"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3434073.3444668"},{"key":"e_1_3_2_33_2","article-title":"Electric and autonomous vehicle: From sound quality to innovative sound design","author":"Misdariis Nicolas","year":"2019","unstructured":"Nicolas Misdariis, Andrea Cera, and William Rodriguez. 2019. Electric and autonomous vehicle: From sound quality to innovative sound design. In ICA-International Congress on Acoustics.","journal-title":"ICA-International Congress on Acoustics"},{"key":"e_1_3_2_34_2","first-page":"2297","volume-title":"IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Mizumoto Takeshi","year":"2009","unstructured":"Takeshi Mizumoto, Hiroshi Tsujino, Toru Takahashi, Tetsuya Ogata, and Hiroshi G. Okuno. 2009. Thereminist robot: Development of a robot theremin player with feedforward and feedback arm control based on a theremin\u2019s pitch model. In IEEE\/RSJ International Conference on Intelligent Robots and Systems, 2297\u20132302."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3409120.3410667"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300730"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020238"},{"key":"e_1_3_2_38_2","volume-title":"Expressive musical robots: Building, evaluating, and interfacing with an ensemble of mechatronic instruments: A thesis submitted to the Victoria University of Wellington in fulfilment of the requirements for the degree of Doctor of Philosophy","author":"Murphy Jim","year":"2014","unstructured":"Jim Murphy. 2014. Expressive musical robots: Building, evaluating, and interfacing with an ensemble of mechatronic instruments: A thesis submitted to the Victoria University of Wellington in fulfilment of the requirements for the degree of Doctor of Philosophy. Ph. D. Dissertation. Massey University."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-022-00891-0"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3434073.3444658"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771822000358"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN46459.2019.8956410"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN46459.2019.8956386"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2021.662355"},{"key":"e_1_3_2_45_2","first-page":"50","volume-title":"Conference on New Interfaces for Musical Expression","author":"Singer Eric","year":"2005","unstructured":"Eric Singer, Jeff Feddersen, and Bil Bowen. 2005. A large-scale networked robotic musical instrument installation. In Conference on New Interfaces for Musical Expression, 50\u201355."},{"key":"e_1_3_2_46_2","first-page":"181","volume-title":"Conference on New Interfaces for Musical Expression","author":"Singer Eric","year":"2004","unstructured":"Eric Singer, Jeff Feddersen, Chad Redmon, and Bil Bowen. 2004. LEMUR\u2019s musical robots. In Conference on New Interfaces for Musical Expression, 181\u2013184."},{"key":"e_1_3_2_47_2","first-page":"188","volume-title":"Conference on New Interfaces for Musical Expression","volume":"3","author":"Singer Eric","year":"2003","unstructured":"Eric Singer, Kevin Larke, and David Bianciardi. 2003. LEMUR GuitarBot: MIDI robotic string instrument. In Conference on New Interfaces for Musical Expression, Vol. 3, 188\u2013191."},{"key":"e_1_3_2_48_2","volume-title":"International Conference on Human Behavior in Design","author":"Sirkin David","year":"2014","unstructured":"David Sirkin and Wendy Ju. 2014. Using embodied design improvisation as a design research tool. In International Conference on Human Behavior in Design."},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.5555\/2993778.2993827"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020239"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2004.825886"},{"key":"e_1_3_2_52_2","first-page":"1","article-title":"Theatrical performances using robots as actors","author":"Szecsei Denise","year":"2019","unstructured":"Denise Szecsei. 2019. Theatrical performances using robots as actors. In Research on Equity and Sustained Participation in Engineering, Computing, and Technology. IEEE, 1\u20133.","journal-title":"Research on Equity and Sustained Participation in Engineering, Computing, and Technology"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1162\/comj.2006.30.4.28"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/1514095.1514152"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2015.7333568"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN47096.2020.9223452"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA48506.2021.9562082"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686811","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3686811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:05:52Z","timestamp":1750291552000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686811"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,3]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3,31]]}},"alternative-id":["10.1145\/3686811"],"URL":"https:\/\/doi.org\/10.1145\/3686811","relation":{},"ISSN":["2573-9522"],"issn-type":[{"type":"electronic","value":"2573-9522"}],"subject":[],"published":{"date-parts":[[2024,12,3]]},"assertion":[{"value":"2023-04-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-19","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}