{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T08:00:42Z","timestamp":1773734442653,"version":"3.50.1"},"reference-count":78,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T00:00:00Z","timestamp":1724284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["61936015,62072306"],"award-info":[{"award-number":["61936015,62072306"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,8,22]]},"abstract":"<jats:p>Augmented reality that integrates virtual content in real-world surroundings has attracted lots of concentration as the growing trend of the metaverse. Acoustic augmented reality (AAR) applications have proliferated due to readily available earphones and speakers. AAR can provide omnidirectional engagement through the all-around sense of spatial information. Most existing AAR approaches offer immersive experiences by playing binaural spatial audios according to head-related transfer functions (HRTF). These involve complex modeling and require the user to wear a headphone. Air nonlinearity that can reproduce audible sounds from ultrasound offers opportunities to achieve device-free and omnidirectional sound source projection in AAR. This paper proposes Visar, a device-free virtual sound spots projection system leveraging air nonlinearity. Visar achieves simultaneous tracking and sound spot generation while suppressing unintended audio leakages caused by grating lobes and nonlinear effects in mixing lobes through optimization. Considering multi-user scenarios, Visar also proposed a multi-spot scheduling scheme to mitigate the mutual interference between the spots. Extensive experiments show the tracking error is 7.83cm and the orientation estimation error is 10.06\u00b0, respectively, envisioning the considerable potential of Visar in AAR applications.<\/jats:p>","DOI":"10.1145\/3678546","type":"journal-article","created":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T14:36:21Z","timestamp":1725892581000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Visar: Projecting Virtual Sound Spots for Acoustic Augmented Reality Using Air Nonlinearity"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-9170-8479","authenticated-orcid":false,"given":"Juntao","family":"Zhou","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China and Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7129-6764","authenticated-orcid":false,"given":"Yijie","family":"Li","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China and Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-3922-6123","authenticated-orcid":false,"given":"Yida","family":"Wang","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China and Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2190-0919","authenticated-orcid":false,"given":"Dian","family":"Ding","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China and Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9024-3692","authenticated-orcid":false,"given":"Yu","family":"Lu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China and Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0782-4953","authenticated-orcid":false,"given":"Yi-Chao","family":"Chen","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China and Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1617-3593","authenticated-orcid":false,"given":"Guangtao","family":"Xue","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China and Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3"}]}],"member":"320","published-online":{"date-parts":[[2024,9,9]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2001. BS.1387: Method for objective measurements of perceived audio quality. ITU. https:\/\/www.itu.int\/rec\/R-REC-BS.1387-1-200111-I\/en"},{"key":"e_1_2_1_2_1","unstructured":"Apple. [n.d.]. Airpods Pro (2nd generation). https:\/\/www.apple.com\/airpods-pro\/."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-0755-7_4"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1913183"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.physio.2010.12.004"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/JOE.2002.805097"},{"key":"e_1_2_1_7_1","volume-title":"Acoustic beamforming: Analysis of uncertainty and metrological performances. Mechanical systems and signal processing 22, 3","author":"Castellini Paolo","year":"2008","unstructured":"Paolo Castellini and Milena Martarelli. 2008. Acoustic beamforming: Analysis of uncertainty and metrological performances. Mechanical systems and signal processing 22, 3 (2008), 672--692."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3081333.3081355"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3563766.3564091"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.fl.11.010179.000303"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1907379"},{"key":"e_1_2_1_12_1","unstructured":"Focusonics. [n. d.]. Focusonics Directional Speakers. https:\/\/www.focusonics.com\/. Accessed on May 1 2023.."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3560905.3568530"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3643832.3661863"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apacoust.2012.04.001"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPSN54338.2022.00018"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.4784426"},{"key":"e_1_2_1_18_1","volume-title":"HRTF individualization: A survey. arXiv preprint arXiv:2003.06183","author":"Guezenoc Corentin","year":"2020","unstructured":"Corentin Guezenoc and Renaud Seguier. 2020. HRTF individualization: A survey. arXiv preprint arXiv:2003.06183 (2020)."},{"key":"e_1_2_1_19_1","volume-title":"Fundamentals and applications of nonlinear acoustics","author":"Hamilton Mark F","year":"1986","unstructured":"Mark F Hamilton. 1986. Fundamentals and applications of nonlinear acoustics. VOLUME HI: BACKGROUND MATERIALS (1986), 82."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2016.7524392"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"S. Haykin. 1985. Array signal processing.","DOI":"10.1109\/MASSP.1985.1163737"},{"key":"e_1_2_1_22_1","unstructured":"HEADREC. [n. d.]. Binal 2 datasheet. https:\/\/headrec.com\/products\/binal-two."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1088\/0957-0233\/4\/10\/018"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Sverre Holm et al. 2019. Waves with power-law attenuation. Vol. 714. Springer.","DOI":"10.1007\/978-3-030-14927-7"},{"key":"e_1_2_1_25_1","unstructured":"Holosonics. [n. d.]. Holosonics Audio Spotlight Series. https:\/\/www.holosonics.com\/. Accessed on May 1 2023.."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apacoust.2007.05.007"},{"key":"e_1_2_1_27_1","volume-title":"Accurate indoor localization using acoustic direction finding via smart phones. arXiv preprint arXiv:1306.1651","author":"Huang Wenchao","year":"2013","unstructured":"Wenchao Huang, Yan Xiong, Xiang-Yang Li, Hao Lin, Xufei Mao, Panlong Yang, and Yunhao Liu. 2013. Accurate indoor localization using acoustic direction finding via smart phones. arXiv preprint arXiv:1306.1651 (2013)."},{"key":"e_1_2_1_28_1","volume-title":"Acoustic characterization of panel materials under simulated ocean conditions using a parametric array source. The journal of the acoustical society of America 124, 2","author":"Humphrey Victor F","year":"2008","unstructured":"Victor F Humphrey, Stephen P Robinson, John D Smith, Michael J Martin, Graham A Beamiss, Gary Hayman, and Nicholas L Carroll. 2008. Acoustic characterization of panel materials under simulated ocean conditions using a parametric array source. The journal of the acoustical society of America 124, 2 (2008), 803--814."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TETC.2019.2953041"},{"key":"e_1_2_1_30_1","unstructured":"Texas Instruments. [n. d.]. Data Sheet OPA541. https:\/\/www.ti.com\/lit\/ds\/symlink\/opa541.pdf."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132272.3132285"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.102.064308"},{"key":"e_1_2_1_33_1","unstructured":"Soundlazer kickstarter. 2016. https:\/\/www.kickstarter.com\/projects\/richardhaberkern\/soundlazer."},{"key":"e_1_2_1_34_1","volume-title":"OCEANS 2000 MTS\/IEEE Conference and Exhibition. Conference Proceedings (Cat. No. 00CH37158)","volume":"2","author":"Kim Byung-Chul","year":"2000","unstructured":"Byung-Chul Kim and I-Tai Lu. 2000. Parameter study of OFDM underwater communications system. In OCEANS 2000 MTS\/IEEE Conference and Exhibition. Conference Proceedings (Cat. No. 00CH37158), Vol. 2. IEEE, 1251--1255."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCE.2012.6241713"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.2063208"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/JOE.2002.1040931"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/SECON58729.2023.10287491"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3636534.3649360"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13673-019-0207-4"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsv.2023.117644"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973755"},{"key":"e_1_2_1_43_1","unstructured":"Microsoft. [n. d.]. SoundScape. https:\/\/www.microsoft.com\/en-us\/research\/product\/soundscape\/."},{"key":"e_1_2_1_44_1","volume-title":"Media Conference (GEM). IEEE, 1--4.","author":"Morse Christopher","year":"2019","unstructured":"Christopher Morse, Adam Chernick, Zeyu Ren, Sabrina Naumovski, and Luke Gehron. 2019. Sound space: Communicating acoustics through interactive visualization. In 2019 IEEE Games, Entertainment, Media Conference (GEM). IEEE, 1--4."},{"key":"e_1_2_1_45_1","volume-title":"Sound waves in rooms. Reviews of modern physics 16, 2","author":"Morse Philip M","year":"1944","unstructured":"Philip M Morse and Richard H Bolt. 1944. Sound waves in rooms. Reviews of modern physics 16, 2 (1944), 69."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742674"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858580"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322263.1322265"},{"key":"e_1_2_1_49_1","volume-title":"Sound from ultrasound: The parametric array as an audible sound source. Ph. D. Dissertation","author":"Pompei F Joseph","unstructured":"F Joseph Pompei. 2002. Sound from ultrasound: The parametric array as an audible sound source. Ph. D. Dissertation. Massachusetts Institute of Technology."},{"key":"e_1_2_1_50_1","unstructured":"ADMP401 POWER. [n.d.]. Data Sheet ADMP401. POWER 8616 ([n.d.]) 00."},{"key":"e_1_2_1_51_1","volume-title":"Luigi Maffei, Ricardo Hern\u00e1ndez-Molina, and Massimiliano Masullo.","author":"Puyana-Romero Virginia","year":"2017","unstructured":"Virginia Puyana-Romero, Lilian Solange Lopez-Segura, Luigi Maffei, Ricardo Hern\u00e1ndez-Molina, and Massimiliano Masullo. 2017. Interactive soundscapes: 360-video based immersive virtual reality in a tool for the participatory acoustic environment evaluation of urban areas. Acta acustica united with acustica 103, 4 (2017), 574--588."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2018.8485978"},{"key":"e_1_2_1_53_1","volume-title":"Human height. Our world in data","author":"Appel C","year":"2019","unstructured":"MRoser, C Appel, and H Ritchie. 2019. Human height. Our world in data. 2019. Availble online at: https:\/\/ourworldindata.org\/human-height (2019)."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3081333.3081366"},{"key":"e_1_2_1_55_1","volume-title":"15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18). 547--560.","author":"Roy Nirupam","unstructured":"Nirupam Roy, Sheng Shen, Haitham Hassanieh, and Romit Roy Choudhury. 2018. Inaudible voice commands: The long-range attack and defense. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18). 547--560."},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3534586","article-title":"Auritus: An open-source optimization toolkit for training and development of human movement models and filters using earables","volume":"6","author":"Saha Swapnil Sayan","year":"2022","unstructured":"Swapnil Sayan Saha, Sandeep Singh Sandha, Siyou Pei, Vivek Jain, Ziqi Wang, Yuchen Li, Ankur Sarker, and Mani Srivastava. 2022. Auritus: An open-source optimization toolkit for training and development of human movement models and filters using earables. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--34.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/990064.990088"},{"key":"e_1_2_1_58_1","volume-title":"Auditory function in normal-hearing, noise-exposed human ears. Ear and hearing 36, 2","author":"Stamper Greta C","year":"2015","unstructured":"Greta C Stamper and Tiffany A Johnson. 2015. Auditory function in normal-hearing, noise-exposed human ears. Ear and hearing 36, 2 (2015), 172--184."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1080\/19401493.2014.888594"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300248"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2022.3179870"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264950"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3570361.3613279"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.3390\/s16091387"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1906764"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1908830"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1918525"},{"key":"e_1_2_1_68_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3351273","article-title":"Acousticid: gait-based human identification using acoustic signal","volume":"3","author":"Xu Wei","year":"2019","unstructured":"Wei Xu, ZhiWen Yu, Zhu Wang, Bin Guo, and Qi Han. 2019. Acousticid: gait-based human identification using acoustic signal. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--25.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_69_1","volume-title":"Beamwidth control in parametric acoustic array. Japanese journal of applied physics 44, 9R","author":"Yang Jun","year":"2005","unstructured":"Jun Yang, Khim-Sia Tan, Woon-Seng Gan, Meng-Hwa Er, and Yong-Hong Yan. 2005. Beamwidth control in parametric acoustic array. Japanese journal of applied physics 44, 9R (2005), 6817."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3452296.3472907"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372224.3419213"},{"key":"e_1_2_1_72_1","doi-asserted-by":"crossref","first-page":"2214","DOI":"10.1121\/1.4920066","article-title":"Differential pattern time delay shift coding underwater acoustic communication using parametric array","volume":"137","author":"Yin Jingwei","year":"2015","unstructured":"Jingwei Yin, Xiao Zhang, and Yiming Zhou. 2015. Differential pattern time delay shift coding underwater acoustic communication using parametric array. The Journal of the Acoustical Society of America 137, 4 (2015), 2214--2214.","journal-title":"The Journal of the Acoustical Society of America"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.389414"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742662"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3081333.3081356"},{"key":"e_1_2_1_76_1","volume-title":"Reconfigurable and Phase-Engineered Acoustic Metasurfaces for Broadband Wavefront Manipulation. Advanced Physics Research","author":"Zeng Kexin","year":"2023","unstructured":"Kexin Zeng, Zhendong Li, Zichao Guo, and Zhonggang Wang. 2023. Reconfigurable and Phase-Engineered Acoustic Metasurfaces for Broadband Wavefront Manipulation. Advanced Physics Research (2023), 2300128."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3134052"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20072148"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678546","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3678546","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T14:41:02Z","timestamp":1755787262000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678546"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,22]]},"references-count":78,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,8,22]]}},"alternative-id":["10.1145\/3678546"],"URL":"https:\/\/doi.org\/10.1145\/3678546","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,22]]},"assertion":[{"value":"2024-09-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}