{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T00:23:40Z","timestamp":1760574220803,"version":"build-2065373602"},"reference-count":83,"publisher":"Association for Computing Machinery (ACM)","issue":"5","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2025,10,31]]},"abstract":"<jats:p>Auditory Augmented Reality (AAR) is a way of augmenting our aural perception of reality. AAR could offer new ways of expressing information embedded in everyday objects by augmenting their auditory contact properties in real-time. Many acoustic augmentations (e.g., altering the sound, reverb) are available, but how they impact the perception of the physical object and its audio properties are unknown. In two experiments, we explore the effects of different audio feedback (surface materials, musical instruments) and reverb parameters (mixing, depth) on perceived simultaneity, unity, agency, and object properties (object size, material, room size), along with their recognition. We found that audio feedback had a significant but small effect on interaction and altered perceived object properties. Mixing in reverb reduced audio recognition but boosted reverb determination. We offer guidelines on combining audio feedback and reverb based on acoustic properties and reverb parameter adjustment to provide multi-level feedback for AAR.<\/jats:p>","DOI":"10.1145\/3745770","type":"journal-article","created":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T11:59:42Z","timestamp":1750852782000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["The Perception of a Tap: Using Auditory Augmented Reality to Alter the Contact Properties of a Physical Object"],"prefix":"10.1145","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7981-6023","authenticated-orcid":false,"given":"Isna Alfi","family":"Bustoni","sequence":"first","affiliation":[{"name":"Department of Computer Science and Electronics, Universitas Gadjah Mada, Sleman, Indonesia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8333-5687","authenticated-orcid":false,"given":"Mark","family":"McGill","sequence":"additional","affiliation":[{"name":"School of Computing Science, University of Glasgow, Glasgow, United Kingdom of Great Britain and Northern Ireland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9720-3899","authenticated-orcid":false,"given":"Stephen","family":"Brewster","sequence":"additional","affiliation":[{"name":"School of Computing Science, University of Glasgow, Glasgow, United Kingdom of Great Britain and Northern Ireland"}]}],"member":"320","published-online":{"date-parts":[[2025,10,14]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1101\/2022.02.18.481001"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32796-4_13"},{"key":"e_1_3_3_4_2","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/978-3-642-32796-4_13","volume-title":"Haptic and Audio Interaction Design","author":"Altinsoy M. Ercan","year":"2012","unstructured":"M. Ercan Altinsoy. 2012. Knocking sound as quality sign for household appliances and the evaluation of the audio-haptic interaction. In Haptic and Audio Interaction Design. Charlotte Magnusson, Delphine Szymczak, and Stephen Brewster (Eds.), Springer, Berlin, 121\u2013130."},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1162\/pres.1997.6.4.355"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2016.12.005"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.3233\/rnn-140460"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185585"},{"key":"e_1_3_3_9_2","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1007\/978-3-030-31908-3_20","volume-title":"Virtual Reality and Augmented Reality","author":"Bauer Valentin","year":"2019","unstructured":"Valentin Bauer, Anna Nagele, Chris Baume, Tim Cowlishaw, Henry Cooke, Chris Pike, and Patrick G. T. Healey. 2019. Designing an interactive and collaborative experience in audio augmented reality. In Virtual Reality and Augmented Reality. Patrick Bourdot, Victoria Interrante, Luciana Nedel, Nadia Magnenat-Thalmann, and Gabriel Zachmann (Eds.), Springer International Publishing, Cham, 305\u2013311."},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/11555261_95"},{"key":"e_1_3_3_11_2","volume-title":"Proceedings of the International Conference on New Interfaces for Musical Expression Conference","author":"Bosi Mathieu","year":"2012","unstructured":"Mathieu Bosi and Sergi Jord\u00e0. 2012. Towards fast multi-point force and hit detection in tabletops using mechanically intercoupled force sensing resistors. In Proceedings of the International Conference on New Interfaces for Musical Expression Conference. Retrieved from http:\/\/www.future-instruments.net\/fr\/mute.php"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.4018\/jaci.2010040102"},{"key":"e_1_3_3_13_2","unstructured":"Jonas Braasch Hari V. Savitala and Jens Blauert. 2007. Modeling the precedence effect for percussive sounds with different attack transients 3801\u20133806."},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2018.00535"},{"key":"e_1_3_3_15_2","first-page":"155","article-title":"Experimentally derived guidelines for the creation of Earcons","volume":"95","author":"Brewster Stephen A.","year":"1995","unstructured":"Stephen A. Brewster, Peter C. Wright, and Alistair D. N. Edwards. 1995. Experimentally derived guidelines for the creation of Earcons. In Adjunct Proceedings of HCI, Vol. 95, 155\u2013159.","journal-title":"Adjunct Proceedings of HCI"},{"key":"e_1_3_3_16_2","first-page":"19","article-title":"Interaction design with audio: Speculating on sound in future design education","author":"Bryan-Kinns N.","year":"2017","unstructured":"N. Bryan-Kinns. 2017. Interaction design with audio: Speculating on sound in future design education. In Proceedings of the 4th Central China International Design Science Seminar, 19\u201322.","journal-title":"Proceedings of the 4th Central China International Design Science Seminar"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apacoust.2019.02.025"},{"key":"e_1_3_3_18_2","unstructured":"Andres Calvo. 2017.\u00a0A Body-Grounded Kinesthetic Haptic Device for Virtual Reality. Ph.D. Dissertation. Massachusets Institute of Technology."},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3424636.3426897"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2017.00445"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3446382.3450216"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84882-733-2_6"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42949-022-00073-x"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.biosystemseng.2004.03.007"},{"key":"e_1_3_3_25_2","unstructured":"Manuel Eberl. 2016. Fisher\u2013Yates Shuffle. Archive of Formal Proofs. Formal Proof Development. Retrieved September 2016 from https:\/\/isa-afp.org\/entries\/Fisher_Yates.html"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474784"},{"key":"e_1_3_3_27_2","unstructured":"Jasmin Frenette. 2000. Reducing Artificial Reverberation Algorithm Requirements Using Time-Variant Feedback Delay Networks. Ph.D. Dissertation"},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1007\/978-3-642-12439-6_18","volume-title":"Auditory Display","author":"Frissen Ilja","year":"2010","unstructured":"Ilja Frissen, Brian F. G. Katz, and Catherine Guastavino. 2010. Effect of sound source stimuli on the perception of reverberation in large volumes. In Auditory Display. S\u00f8lvi Ystad, Mitsuko Aramaki, Richard Kronland-Martinet, and Kristoffer Jensen (Eds.), Springer, Berlin, 358\u2013376."},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203774458"},{"key":"e_1_3_3_30_2","unstructured":"Marcello A. G\u00f3mez-Maureira Carolien Teunisse Hanna Schraffenberger and Fons Verbeek. 2014.\u00a0Illuminating shadows: Introducing shadow interaction in spatial augmented reality.\u00a0In Creating The Difference: Proceedings of CHI Sparks 2014 Conference April 3 2014. J. P. van Leeuwen P. J. Stappers M. H. Lammers and M. J. M. R. Thissen (Eds.) The Hague Netherlands 11\u201318. CHI Nederland. Retrieved from http\/\/:chi-sparks.nl\/2014\/proceedings"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.4119\/unibi\/2935744.2"},{"key":"e_1_3_3_32_2","unstructured":"Brent Edward Insko. 2001.\u00a0Passive Haptics Significantly Enhances Virtual Environments. Ph.D. Dissertation. The University of North Carolina Chapel Hill. Advisor(s) Frederick P. Brooks. Order Number: AAI3007820."},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1121\/1.3298437"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413572"},{"key":"e_1_3_3_35_2","doi-asserted-by":"crossref","unstructured":"Koo Junghyun Seungryeol Paik and Kyogu Lee. 2021. Reverb conversion of mixed vocal tracks using an end-to-end convolutional deep neural network. arXiv:2103.02147. Retrieved from https:\/\/arxiv.org\/abs\/2103.02147","DOI":"10.1109\/ICASSP39728.2021.9414038"},{"key":"e_1_3_3_36_2","volume-title":"Latency Guidelines for Touchscreen Virtual Button Feedback","author":"Kaaresoja Topi Johannes","year":"2015","unstructured":"Topi Johannes Kaaresoja. 2015. Latency Guidelines for Touchscreen Virtual Button Feedback. Ph.D. Dissertation. School of Computing Science, University of Glasgow."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3172324"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1523\/jneurosci.3798-14.2015"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1121\/1.4818743"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1162\/105474600566907"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-015-1015-1"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","unstructured":"Michael Krzyzaniak David Frohlich and Philip J. B. Jackson. 2019. Six types of audio that defy reality! a taxonomy of audio augmented reality with examples 160\u2013167. DOI: 10.1145\/3356590.3356615","DOI":"10.1145\/3356590.3356615"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411109.3411142"},{"key":"e_1_3_3_44_2","unstructured":"Jacques Lemordant and Jacques Lemordant. 2010. Basic Concepts in Augmented Reality Audio Title: Basic Concepts in Augmented Reality Audio. Retrieved from http:\/\/wam.inrialpes.fr\/people\/lemordant\/"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720817697536"},{"key":"e_1_3_3_46_2","doi-asserted-by":"crossref","unstructured":"Anatole L\u00e9cuyer. 2009. Simulating haptic feedback using vision: A survey of research and applications of pseudo-haptic feedback. Presence 18 1 (2009) 39\u201353. Retrieved from http:\/\/direct.mit.edu\/pvar\/article-pdf\/18\/1\/39\/1624884\/pres.18.1.39.pdf","DOI":"10.1162\/pres.18.1.39"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376702"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.07.002"},{"key":"e_1_3_3_49_2","unstructured":"Ryan W. Metcalfe. 2007. The Size-Weight Illusion in a Natural and Augmented Environment with Congruent and Incongruent Size Information. Retrieved from http:\/\/ir.lib.sfu.ca\/handle\/1892\/112"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/VR51125.2022.00091"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1051\/matecconf\/202032000006"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258821"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47214-0_11"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apacoust.2020.107486"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/2628363.2628401"},{"key":"e_1_3_3_56_2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/978-3-642-21478-3_2","volume-title":"Multidisciplinary Aspects of Time and Time Perception","author":"Power Sean Enda","year":"2011","unstructured":"Sean Enda Power. 2011. Temporal illusions\u2014Philosophical considerations. In Multidisciplinary Aspects of Time and Time Perception. A. Vatakis, A. Esposito, M. Giagkou, F. Cummins, and G. Papadelis (Eds.), Springer, 11\u201335."},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3335082.3335097"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1353\/sub.1999.0015"},{"key":"e_1_3_3_59_2","unstructured":"Urban Schlemmer. 2011.\u00a0Reverb design. In\u00a04th International Pure Data Convention 2011. Weimar-Berlin."},{"key":"e_1_3_3_60_2","volume-title":"Arguably Augmented Reality Relationships Between the Virtual and the Real","author":"Schraffenberger Hanna Kathrin","year":"2018","unstructured":"Hanna Kathrin Schraffenberger. 2018. Arguably Augmented Reality Relationships Between the Virtual and the Real. Ph.D. Dissertation. Leiden University."},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1155\/2011\/291860"},{"key":"e_1_3_3_62_2","volume-title":"Physical Audio Signal Processing: For Virtual Musical Instruments and Digital Audio Effects","author":"Smith Julius O.","year":"2010","unstructured":"Julius O. Smith. 2010. Physical Audio Signal Processing: For Virtual Musical Instruments and Digital Audio Effects. W3K Publishing."},{"key":"e_1_3_3_63_2","unstructured":"Julius O. Smith. 2010. Physical Audio Signal Processing. Retrieved July 11 2025 from http:\/\/ccrma.stanford.edu\/~jos\/pasp\/"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2019.03001"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1162\/GREY_a_00177"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-011-0086-0"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702374"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300888"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2015.14"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376856"},{"key":"e_1_3_3_71_2","volume-title":"An Experimental Study on the Influence of Colour in Emotional Knocking Sounds","author":"Turato Asia","year":"2021","unstructured":"Asia Turato. 2021. Emotions in Everyday Sounds. An Experimental Study on the Influence of Colour in Emotional Knocking Sounds. Ph.D. Dissertation. Dipartimento di Studi Linguistici e Letterari\u2014DISLL."},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0020606"},{"key":"e_1_3_3_73_2","volume-title":"Proceedings of the International Conference on Auditory Display","author":"T\u00fcnnermann Rene","year":"2013","unstructured":"Rene T\u00fcnnermann, Jan Hammerschmidt, and Thomas Hermann. 2013. Blended sonification-sonification for casual information interaction. In Proceedings of the International Conference on Auditory Display. Retrieved from http:\/\/www.cinismoilustrado.com\/2012\/07\/mirar-el-celular.html"},{"key":"e_1_3_3_74_2","unstructured":"Brygg Ullmer and Hiroshi Ishii. 2001. Emerging frameworks for tangible user interfaces. In Human-Computer Interaction in the New Millenium. John M. Carroll (Ed.) Addison-Wesley 579\u2013601."},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","unstructured":"Marian Weger Thomas Hermann and Robert H\u00f6ldrich. 2019. Real-time auditory contrast enhancement (June 2019) 254\u2013261. DOI: 10.21785\/icad2019.026","DOI":"10.21785\/icad2019.026"},{"key":"e_1_3_3_76_2","article-title":"Granular synthesis for display of time-varying probability densities","volume":"8","author":"Williamson John","year":"2004","unstructured":"John Williamson and Roderick Murray-Smith. 2004. Granular synthesis for display of time-varying probability densities. In Proceedings of the International Workshop on Interactive Sonification, 8 January 2004, Bielefeld, Germany.","journal-title":"Proceedings of the International Workshop on Interactive Sonification"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240642"},{"key":"e_1_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978963"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/2814895.2814925"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.17743\/jaes.2022.0048"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.5057\/ijae.IJAE-D-21-00002"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.5555\/3294771.3294893"},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173225.3173341"},{"key":"e_1_3_3_84_2","volume-title":"Digital Audio Signal Processing","author":"Zolzer Udo","year":"1997","unstructured":"Udo Zolzer. 1997. Digital Audio Signal Processing (1st ed.). John Wiley, Chichester.","edition":"1"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3745770","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,15]],"date-time":"2025-10-15T06:52:12Z","timestamp":1760511132000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3745770"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,14]]},"references-count":83,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,10,31]]}},"alternative-id":["10.1145\/3745770"],"URL":"https:\/\/doi.org\/10.1145\/3745770","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"type":"print","value":"1073-0516"},{"type":"electronic","value":"1557-7325"}],"subject":[],"published":{"date-parts":[[2025,10,14]]},"assertion":[{"value":"2024-05-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}