{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T16:02:42Z","timestamp":1781193762336,"version":"3.54.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T00:00:00Z","timestamp":1715558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Sichuan Natural Science Foundation Project","award":["24ZNSFSC0038"],"award-info":[{"award-number":["24ZNSFSC0038"]}]},{"DOI":"10.13039\/501100006374","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62122095, 62341201, 62072472, U2336204, 62202256"],"award-info":[{"award-number":["62122095, 62341201, 62072472, U2336204, 62202256"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Guoqiang Institute, Tsinghua University"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,5,13]]},"abstract":"<jats:p>With the growing popularity of smart speakers, numerous novel acoustic sensing applications have been proposed for low-frequency human speech and high-frequency inaudible sounds. Spatial information plays a crucial role in these acoustic applications, enabling various location-based services. However, typically commercial microphone arrays face limitations in spatial perception of inaudible sounds due to their sparse array geometries optimized for low-frequency speech. In this paper, we introduce MetaAng, a system designed to augment microphone arrays by enabling wideband spatial perception across both speech signals and inaudible sounds by leveraging the spatial encoding capabilities of acoustic metasurfaces. Our design is grounded in the fact that, while sensitive to high-frequency signals, acoustic metasurfaces are almost non-responsive to low-frequency speech due to significant wavelength discrepancy. This observation allows us to integrate acoustic metasurfaces with sparse array geometry, simultaneously enhancing the spatial perception of high-frequency and low-frequency acoustic signals. To achieve this, we first utilize acoustic metasurfaces and a configuration optimization algorithm to encode the unique features for each incident angle. Then, we propose an unrolling soft thresholding network that employs neural-enhanced priors and compressive sensing for high-accuracy, high-resolution multi-source angle estimation. We implement a prototype, and experimental results demonstrate that MetaAng maintains robustness across various scenarios, facilitating multiple applications, including localization and tracking.<\/jats:p>","DOI":"10.1145\/3659583","type":"journal-article","created":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T12:20:41Z","timestamp":1715775641000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Pushing the Limits of Acoustic Spatial Perception via Incident Angle Encoding"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8481-2644","authenticated-orcid":false,"given":"Yongjian","family":"Fu","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Central South University, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2716-5369","authenticated-orcid":false,"given":"Yongzhao","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China, Chengdu, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2531-0107","authenticated-orcid":false,"given":"Hao","family":"Pan","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9024-3692","authenticated-orcid":false,"given":"Yu","family":"Lu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9702-3417","authenticated-orcid":false,"given":"Xinyi","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6630-0976","authenticated-orcid":false,"given":"Lili","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2782-183X","authenticated-orcid":false,"given":"Ju","family":"Ren","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Tsinghua University, China and Zhongguancun Laboratory, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6619-554X","authenticated-orcid":false,"given":"Xiong","family":"Li","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China, Chengdu, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9886-1412","authenticated-orcid":false,"given":"Xiaosong","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China, Chengdu, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6717-461X","authenticated-orcid":false,"given":"Yaoxue","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Tsinghua University, Beijing, China and Zhongguancun Laboratory, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,15]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"HomePod (2nd generation). https:\/\/www.apple.com\/homepod-2nd-generation\/specs\/."},{"key":"e_1_2_1_2_1","unstructured":"Nest Mini (2nd Gen). https:\/\/store.google.com\/us\/product\/google_nest_mini?hl=en-US."},{"key":"e_1_2_1_3_1","volume-title":"simulate real-world designs, devices, and processes with multiphysics software from comsol. https:\/\/www.ti.com\/product\/LM386","author":"COMSOL","year":"2023","unstructured":"COMSOL: simulate real-world designs, devices, and processes with multiphysics software from comsol. https:\/\/www.ti.com\/product\/LM386, 2023.2."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.3390\/designs5040070"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/dac.3576"},{"key":"e_1_2_1_6_1","unstructured":"Bela platform 2017. https:\/\/bela.io."},{"key":"e_1_2_1_7_1","first-page":"39","volume-title":"Conventional beamforming techniques. Microphone array signal processing","author":"Benesty J.","year":"2008","unstructured":"J. Benesty, J. Chen, and Y. Huang. Conventional beamforming techniques. Microphone array signal processing, pages 39-65, 2008."},{"key":"e_1_2_1_8_1","volume-title":"Speech enhancement using microphone array with multi-stage processing. IEICE transactions on fundamentals of electronics, communications and computer sciences, 79(3):386-394","author":"Cao Y.","year":"1996","unstructured":"Y. Cao, S. SRIDHARAN, and M. MOODY. Speech enhancement using microphone array with multi-stage processing. IEICE transactions on fundamentals of electronics, communications and computer sciences, 79(3):386-394, 1996."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6463\/abc6d7"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/SLT.2018.8639593"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2009.5273816"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11831-022-09747-2"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3560905.3568530"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/admt.202100698"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458864.3467880"},{"key":"e_1_2_1_16_1","first-page":"1083","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Ha U.","year":"2020","unstructured":"U. Ha, J. Leng, A. Khaddaj, and F. Adib. Food and liquid sensing in practical environments using rfids. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20), pages 1083-1100, 2020."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1162\/0899766054322964"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1049\/cje.2016.01.024"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-32547-3"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCNT.2010.45"},{"key":"e_1_2_1_21_1","volume-title":"A study on localization in wireless sensor networks using frequency diversity for mitigating multipath effects. Elektronika ir Elektrotechnika, 19(3):82-87","author":"Lazaro A.","year":"2013","unstructured":"A. Lazaro, D. Girbau, P. Moravek, and R. Villarino. A study on localization in wireless sensor networks using frequency diversity for mitigating multipath effects. Elektronika ir Elektrotechnika, 19(3):82-87, 2013."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384419.3430780"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3560905.3568528"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3565287.3610270"},{"issue":"3","key":"e_1_2_1_25_1","first-page":"1","article-title":"Echospot: Spotting your locations via acoustic sensing. Proceedings of the ACM on Interactive, Mobile","volume":"5","author":"Lian J.","year":"2021","unstructured":"J. Lian, J. Lou, L. Chen, and X. Yuan. Echospot: Spotting your locations via acoustic sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 5(3):1-21, 2021.","journal-title":"Wearable and Ubiquitous Technologies"},{"issue":"3","key":"e_1_2_1_26_1","first-page":"1","article-title":"Fall detection via inaudible acoustic sensing. Proceedings of the ACM on Interactive, Mobile","volume":"5","author":"Lian J.","year":"2021","unstructured":"J. Lian, X. Yuan, M. Li, and N.-F. Tzeng. Fall detection via inaudible acoustic sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 5(3):1-21, 2021.","journal-title":"Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3390\/en14123446"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2018.8462116"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1063\/5.0074503"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP40776.2020.9053327"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/3202580"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973755"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210240.3210325"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300061.3345439"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms14608"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20174803"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858580"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2500423.2500436"},{"key":"e_1_2_1_39_1","volume-title":"A signal subspace approach to multiple emitter location spectral estimation. Ph. D. Thesis","author":"Schmidt R. O.","year":"1981","unstructured":"R. O. Schmidt. A signal subspace approach to multiple emitter location spectral estimation. Ph. D. Thesis, Stanford University, 1981."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2017.2711501"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372224.3380884"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01257"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3659603"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241568"},{"key":"e_1_2_1_45_1","unstructured":"W. Sun. From active to passive spatial acoustic sensing and applications. PhD thesis 2022."},{"key":"e_1_2_1_46_1","volume-title":"Programmable acoustic metasurfaces. Advanced functional materials, 29(13):1808489","author":"Tian Z.","year":"2019","unstructured":"Z. Tian, C. Shen, J. Li, E. Reit, Y. Gu, H. Fu, S. A. Cummer, and T. J. Huang. Programmable acoustic metasurfaces. Advanced functional materials, 29(13):1808489, 2019."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2003.1248813"},{"key":"e_1_2_1_48_1","first-page":"165","volume-title":"13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16)","author":"Vasisht D.","year":"2016","unstructured":"D. Vasisht, S. Kumar, and D. Katabi. Decimeter-level localization with a single wifi access point. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16), pages 165-178, 2016."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300061.3345453"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740070.2626330"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3117811.3117830"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581791.3596867"},{"key":"e_1_2_1_53_1","first-page":"845","volume-title":"18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21)","author":"Wang M.","year":"2021","unstructured":"M. Wang, W. Sun, and L. Qiu. {MAVL}: Multiresolution analysis of voice localization. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21), pages 845-858, 2021."},{"key":"e_1_2_1_54_1","volume-title":"Proc. of NSDI","author":"Wang M.","year":"2021","unstructured":"M. Wang, W. Sun, and L. Qiu. Mavl: Multiresolution analysis of voice localization. In Proc. of NSDI, 2021."},{"issue":"1","key":"e_1_2_1_55_1","first-page":"1","article-title":"Uface: Your smartphone can\" hear\" your facial expression! Proceedings of the ACM on Interactive, Mobile","volume":"8","author":"Wang S.","year":"2024","unstructured":"S. Wang, L. Zhong, Y. Fu, L. Chen, J. Ren, and Y. Zhang. Uface: Your smartphone can\" hear\" your facial expression! Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 8(1):1-27, 2024.","journal-title":"Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973764"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-246X.2011.05130.x"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.23919\/Eusipco47968.2020.9287225"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2789168.2790113"},{"key":"e_1_2_1_60_1","volume-title":"Estimating angle of arrival (aoa) of multiple echoes in a steering vector space. arXiv preprint arXiv:2109.13072","author":"Wei Y.-L.","year":"2021","unstructured":"Y.-L. Wei and R. R. Choudhury. Estimating angle of arrival (aoa) of multiple echoes in a steering vector space. arXiv preprint arXiv:2109.13072, 2021."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2019.06.027"},{"issue":"11","key":"e_1_2_1_62_1","first-page":"3570","article-title":"Non-smooth equations based method for l1-norm problems with applications to compressed sensing. Nonlinear Analysis: Theory","volume":"74","author":"Xiao Y.","year":"2011","unstructured":"Y. Xiao, Q. Wang, and Q. Hu. Non-smooth equations based method for l1-norm problems with applications to compressed sensing. Nonlinear Analysis: Theory, Methods & Applications, 74(11):3570-3577, 2011.","journal-title":"Methods & Applications"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2789168.2790125"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME51207.2021.9428249"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3081333.3081356"},{"issue":"4","key":"e_1_2_1_66_1","first-page":"1","article-title":"Your smart speaker can\" hear\" your heartbeat! Proceedings of the ACM on Interactive, Mobile","volume":"4","author":"Zhang F.","year":"2020","unstructured":"F. Zhang, Z. Wang, B. Jin, J. Xiong, and D. Zhang. Your smart speaker can\" hear\" your heartbeat! Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 4(4):1-24, 2020.","journal-title":"Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3495243.3560518"},{"issue":"3","key":"e_1_2_1_68_1","first-page":"481","article-title":"Speech enhancement using compact microphone array and applications in distant speech acquisition","volume":"18","author":"Zhang H.","year":"2009","unstructured":"H. Zhang, Q. Fu, and Y. Yan. Speech enhancement using compact microphone array and applications in distant speech acquisition. Chinese Journal of Electronics, 18(3):481-486, 2009.","journal-title":"Chinese Journal of Electronics"},{"key":"e_1_2_1_69_1","volume-title":"Microphone array generalization for multichannel narrowband deep speech enhancement. arXiv preprint arXiv:2107.12601","author":"Zhang S.","year":"2021","unstructured":"S. Zhang and X. Li. Microphone array generalization for multichannel narrowband deep speech enhancement. arXiv preprint arXiv:2107.12601, 2021."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583120.3586954"},{"key":"e_1_2_1_71_1","first-page":"1359","volume-title":"20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23)","author":"Zhang Y.","year":"2023","unstructured":"Y. Zhang, Y. Wang, L. Yang, M. Wang, Y.-C. Chen, L. Qiu, Y. Liu, G. Xue, and J. Yu. Acoustic sensing and communication using metasurface. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23), pages 1359-1374, 2023."},{"key":"e_1_2_1_72_1","volume-title":"Beamtransformer: Microphone array-based overlapping speech detection. arXiv preprint arXiv:2109.04049","author":"Zheng S.","year":"2021","unstructured":"S. Zheng, S. Zhang, W. Huang, Q. Chen, H. Suo, M. Lei, J. Feng, and Z. Yan. Beamtransformer: Microphone array-based overlapping speech detection. arXiv preprint arXiv:2109.04049, 2021."},{"key":"e_1_2_1_73_1","volume-title":"Multifunctional acoustic metasurface based on an array of helmholtz resonators. Physical review B, 99(17):174109","author":"Zhu Y.","year":"2019","unstructured":"Y. Zhu and B. Assouar. Multifunctional acoustic metasurface based on an array of helmholtz resonators. Physical review B, 99(17):174109, 2019."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3659583","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3659583","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:03:34Z","timestamp":1755882214000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3659583"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,13]]},"references-count":73,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,5,13]]}},"alternative-id":["10.1145\/3659583"],"URL":"https:\/\/doi.org\/10.1145\/3659583","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,13]]},"assertion":[{"value":"2024-05-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}