{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T05:40:07Z","timestamp":1752471607839,"version":"3.41.2"},"reference-count":35,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T00:00:00Z","timestamp":1752451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Virtual Real."],"abstract":"<jats:p>In virtual reality (VR) environments, selecting and manipulating multiple out-of-view objects is often challenging because most current VR systems lack integrated haptics. To address this limitation, we propose a sonification method that guides users\u2019 hands to target objects outside their field of view by assigning distinct auditory parameters (pan, frequency, and amplitude) to the three spatial axes. These parameters are discretized into three exponential steps within a comfortable volume (less than 43\u00a0dB) and frequency range (150\u2013700\u00a0Hz), determined via pilot studies to avoid listener fatigue. Our method dynamically shifts the sound source location depending on the density of the target objects: when objects are sparsely positioned, each object serves as its own sound source, whereas for dense clusters, a single sound source is placed at the cluster\u2019s center to prevent overlapping sounds. We validated our technique through user studies involving two VR applications: a shooting game that requires rapid weapon selection and a 3D cube keyboard for text entry. Compared to a no-sound baseline, our sonification significantly improved positional accuracy in eyes-free selection tasks. In the shooting game, participants could more easily swap weapons without losing sight of on-screen action, while in the keyboard task, typing accuracy more than doubled during blind entry. These findings suggest that sonification can substantially enhance eyes-free interaction in VR without relying on haptic or visual cues, thereby offering a promising avenue for more efficient and comfortable VR experiences.<\/jats:p>","DOI":"10.3389\/frvir.2025.1598776","type":"journal-article","created":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T05:25:59Z","timestamp":1752470759000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Enhancing eyes-free interaction in virtual reality using sonification for multiple object selection"],"prefix":"10.3389","volume":"6","author":[{"given":"Yota","family":"Takahara","sequence":"first","affiliation":[]},{"given":"Arinobu","family":"Niijima","sequence":"additional","affiliation":[]},{"given":"Chanho","family":"Park","sequence":"additional","affiliation":[]},{"given":"Takefumi","family":"Ogawa","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,7,14]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"651","DOI":"10.3156\/jsoft.33.3_651","article-title":"An investigation of stereoscopic vision and real-scale body motions in a virtual game","volume":"33","author":"Abe","year":"2021","journal-title":"J. Jpn. Soc. Fuzzy Theory Intelligent Inf."},{"key":"B2","doi-asserted-by":"publisher","first-page":"105429","DOI":"10.1016\/j.compbiomed.2022.105429","article-title":"A comparison of input devices for precise interaction tasks in vr-based surgical planning and training","volume":"145","author":"Allgaier","year":"2022","journal-title":"Comput. Biol. Med."},{"key":"B3","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1109\/3DUI.2017.7893323","article-title":"Vibrotactile assistance for user guidance towards selection targets in vr and the cognitive resources involved","volume-title":"2017 IEEE symposium on 3D user interfaces (3DUI)","author":"Ariza","year":"2017"},{"key":"B4","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s005300050108","article-title":"Using sonification","volume":"7","author":"Barrass","year":"1999","journal-title":"Multimed. Syst."},{"key":"B5","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/VRAIS.1998.658418","article-title":"An evaluation of wearable information spaces","volume-title":"Proceedings. IEEE 1998 virtual reality annual international symposium (cat. No.98CB36180)","author":"Billinghurst","year":"1998"},{"key":"B6","doi-asserted-by":"publisher","first-page":"102032","DOI":"10.1016\/j.displa.2021.102032","article-title":"Using visual and auditory cues to locate out-of-view objects in head-mounted augmented reality","volume":"69","author":"Binetti","year":"2021","journal-title":"Displays"},{"key":"B7","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1145\/3531706.3536456","article-title":"Exploring needs and design opportunities for virtual reality-based contour delineations of medical structures","volume-title":"Companion of the 2022 ACM SIGCHI symposium on engineering interactive computing systems","author":"Chen","year":"2022"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3613904.3642394","article-title":"Minexr: mining personalized extended reality interfaces","volume":"24","author":"Cho","year":"2024","journal-title":"Proc. 2024 CHI Conf. Hum. Factors Comput. Syst."},{"key":"B9","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1037\/\/0033-2909.112.1.155","article-title":"A power primer","volume":"112","author":"Cohen","year":"1992","journal-title":"Psychol. Bull."},{"key":"B10","doi-asserted-by":"publisher","first-page":"e82491","DOI":"10.1371\/journal.pone.0082491","article-title":"A systematic review of mapping strategies for the sonification of physical quantities","volume":"8","author":"Dubus","year":"2013","journal-title":"PloS one"},{"key":"B11","first-page":"44","article-title":"Spherical layout with proximity-based multimodal feedback for eyes-free target acquisition in virtual reality","volume-title":"HCII 2019","author":"Gao","year":"2019"},{"key":"B12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3528171","article-title":"Exploring sonification mapping strategies for spatial auditory guidance in immersive virtual environments","volume":"19","author":"Gao","year":"2022","journal-title":"ACM Trans. Appl. Percept."},{"key":"B13","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1016\/j.ijhcs.2015.08.004","article-title":"Interactive spatial sonification for non-visual exploration of virtual maps","volume":"85","author":"Geronazzo","year":"2016","journal-title":"Int. J. Human-Computer Stud."},{"key":"B14","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of nasa-tlx (task load index): results of empirical and theoretical research","volume":"52","author":"Hart","year":"1988","journal-title":"Adv. Psychol."},{"key":"B15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2160125.2160136","article-title":"Realtime sonification of the center of gravity for skiing","volume-title":"Proceedings of the 3rd augmented human international conference","author":"Hasegawa","year":"2012"},{"key":"B16","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1109\/ISMAR62088.2024.00115","article-title":"From research to practice: survey and taxonomy of object selection in consumer vr applications","volume-title":"2024 IEEE international symposium on mixed and augmented reality (ISMAR)","author":"Maslych","year":"2024"},{"key":"B17","doi-asserted-by":"publisher","first-page":"5930","DOI":"10.1038\/s41598-023-32778-z","article-title":"Sonification as a reliable alternative to conventional visual surgical navigation","volume":"13","author":"Matinfar","year":"2023","journal-title":"Sci. Rep."},{"key":"B18","doi-asserted-by":"publisher","first-page":"155","DOI":"10.21785\/ICAD2019.008","article-title":"Auditory displays to facilitate object targeting in 3d space","volume":"8","author":"May","year":"2019","journal-title":"Proc. 2019 Int. Conf. Auditory Disp."},{"key":"B19","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/3DUI.2010.5444722","article-title":"Audio haptic feedbacks for an acquisition task in a multi-target context","volume-title":"2010 IEEE symposium on 3D user interfaces (3DUI)","author":"M\u00e9n\u00e9las","year":"2010"},{"key":"B20","doi-asserted-by":"publisher","first-page":"566","DOI":"10.1145\/274644.274720","article-title":"Designing audio aura","volume":"98","author":"Mynatt","year":"1998","journal-title":"Proc. SIGCHI Conf. Hum. Factors Comput. Syst."},{"key":"B21","doi-asserted-by":"publisher","first-page":"163212","DOI":"10.4108\/eai.13-7-2018.163212","article-title":"A review of gamification in virtual reality (vr) sport","volume":"6","author":"Nor","year":"2019","journal-title":"EAI Endorsed Trans. Creative Technol."},{"key":"B22","first-page":"51","article-title":"Aroma: abstract representation of presence supporting mutual awareness","author":"Pedersen","year":"1997"},{"key":"B23","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.vrih.2023.12.001","article-title":"Exploring the effect of fingertip aero-haptic feedforward cues in directing eyes-free target acquisition in vr","volume":"6","author":"Ren","year":"2024","journal-title":"Virtual Real. and Intelligent Hardw."},{"key":"B24","first-page":"605","volume-title":"Pitch and pitch perception","author":"Schneider","year":"2018"},{"key":"B25","doi-asserted-by":"publisher","first-page":"332","DOI":"10.3389\/fnins.2014.00332","article-title":"Sonification as a possible stroke rehabilitation strategy","volume":"8","author":"Scholz","year":"2014","journal-title":"Front. Neurosci."},{"key":"B26","doi-asserted-by":"publisher","first-page":"21","DOI":"10.3758\/s13423-012-0333-8","article-title":"Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review","volume":"20","author":"Sigrist","year":"2013","journal-title":"Psychonomic Bull. and Rev."},{"key":"B27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1250\/ast.e23.66","article-title":"Revision of iso 226 \u201cnormal equal-loudness-level contours\u201d from 2003 to 2023 edition: the background and results","volume":"45","author":"Suzuki","year":"2024","journal-title":"Acoust. Sci. Technol."},{"key":"B28","first-page":"1","article-title":"Minimizing errors in eyes-free target acquisition in virtual reality through auditory feedback","volume-title":"Proceedings of the 2024 ACM symposium on spatial user interaction","author":"Takahara","year":"2024"},{"key":"B29","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1007\/978-3-031-42280-5_2","article-title":"Point- and volume-based multi-object acquisition in vr","volume-title":"Human-computer interaction \u2013 interact 2023","author":"Wu","year":"2023"},{"key":"B30","doi-asserted-by":"publisher","first-page":"1352","DOI":"10.1109\/THMS.2022.3186592","article-title":"Applying sonification to sketching in the air with mobile ar devices","volume":"52","author":"Xu","year":"2022","journal-title":"IEEE Trans. Human-Machine Syst."},{"key":"B31","first-page":"1","article-title":"Eyes-free target acquisition in interaction space around the body for virtual reality","volume-title":"Proceedings of the 2018 CHI conference on human factors in computing systems","author":"Yan","year":"2018"},{"key":"B32","doi-asserted-by":"crossref","first-page":"277","DOI":"10.21785\/icad2019.018","article-title":"Psychoacoustical signal processing for three-dimensional sonification","volume-title":"Proceedings of the 25th international Conference on auditory display (ICAD 2019)","author":"Ziemer","year":"2019"},{"key":"B33","doi-asserted-by":"publisher","first-page":"2786","DOI":"10.1121\/1.5147752","article-title":"Linearity, orthogonality, and resolution of psychoacoustic sonification for multidimensional data","volume":"148","author":"Ziemer","year":"2020","journal-title":"J. Acoust. Soc. Am."},{"key":"B34","doi-asserted-by":"publisher","first-page":"930944","DOI":"10.3389\/fnins.2022.930944","article-title":"Pampas: a psychoacoustical method for the perceptual analysis of multidimensional sonification","volume":"16","author":"Ziemer","year":"2022","journal-title":"Front. Neurosci."},{"key":"B35","article-title":"Psychoacoustics: facts and models","author":"Zwicker","year":"2013"}],"container-title":["Frontiers in Virtual Reality"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2025.1598776\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T05:26:01Z","timestamp":1752470761000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2025.1598776\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,14]]},"references-count":35,"alternative-id":["10.3389\/frvir.2025.1598776"],"URL":"https:\/\/doi.org\/10.3389\/frvir.2025.1598776","relation":{},"ISSN":["2673-4192"],"issn-type":[{"value":"2673-4192","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,14]]},"article-number":"1598776"}}