{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T05:52:56Z","timestamp":1778305976134,"version":"3.51.4"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,12,21]],"date-time":"2022-12-21T00:00:00Z","timestamp":1671580800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62272388, 62172332"],"award-info":[{"award-number":["62272388, 62172332"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NSFC A3 Foresight Program","award":["62061146001"],"award-info":[{"award-number":["62061146001"]}]},{"name":"International Cooperation of Shaanxi","award":["2019KWZ-05, 2020KWZ-013"],"award-info":[{"award-number":["2019KWZ-05, 2020KWZ-013"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,12,21]]},"abstract":"<jats:p>Earphones are emerging as the most popular wearable devices and there has been a growing trend in bringing intelligence to earphones. Previous efforts include adding extra sensors (e.g., accelerometer and gyroscope) or peripheral hardware to make earphones smart. These methods are usually complex in design and also incur additional cost. In this paper, we present Earmonitor, a low-cost system that uses the in-ear earphones to achieve sensing purposes. The basic idea behind Earmonitor is that each person's ear canal varies in size and shape. We therefore can extract the unique features from the ear canal-reflected signals to depict the personalized differences in ear canal geometry. Furthermore, we discover that the signal variations are also affected by the fine-grained physiological activities. We can therefore further detect the subtle heartbeat from the ear canal reflections. Experiments show that Earmonitor can achieve up to 96.4% Balanced Accuracy (BAC) and low False Acceptance Rate (FAR) for user identification on a large-scale data of 120 subjects. For heartbeat monitoring, without any training, we propose signal processing schemes to achieve high sensing accuracy even in the most challenging scenarios when the target is walking or running.<\/jats:p>","DOI":"10.1145\/3569472","type":"journal-article","created":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T15:34:01Z","timestamp":1673451241000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["Earmonitor"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8454-4010","authenticated-orcid":false,"given":"Xue","family":"Sun","sequence":"first","affiliation":[{"name":"Northwest University, xi'an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5396-4554","authenticated-orcid":false,"given":"Jie","family":"Xiong","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7322-2320","authenticated-orcid":false,"given":"Chao","family":"Feng","sequence":"additional","affiliation":[{"name":"Shaanxi International Joint Research Centre for the Battery-Free Internet of Things, and Northwest University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9040-8864","authenticated-orcid":false,"given":"Wenwen","family":"Deng","sequence":"additional","affiliation":[{"name":"Northwest University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4520-4675","authenticated-orcid":false,"given":"Xudong","family":"Wei","sequence":"additional","affiliation":[{"name":"Northwest University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5816-6922","authenticated-orcid":false,"given":"Dingyi","family":"Fang","sequence":"additional","affiliation":[{"name":"Internet of Things Research Center, and Northwest University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1180-6806","authenticated-orcid":false,"given":"Xiaojiang","family":"Chen","sequence":"additional","affiliation":[{"name":"Internet of Things Research Center, and Northwest University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,1,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Apple. 2020. https:\/\/www.apple.com\/airpods-pro\/. (2020)."},{"key":"e_1_2_1_2_1","first-page":"366","article-title":"Perceptual objective listening quality assessment (polqa), the third generation itu-t standard for end-to-end speech quality measurement part i---temporal alignment","volume":"61","author":"Beerends John G","year":"2013","unstructured":"John G Beerends, Christian Schmidmer, Jens Berger, Matthias Obermann, Raphael Ullmann, Joachim Pomy, and Michael Keyhl. 2013. Perceptual objective listening quality assessment (polqa), the third generation itu-t standard for end-to-end speech quality measurement part i---temporal alignment. Journal of the Audio Engineering Society 61, 6 (2013), 366--384.","journal-title":"Journal of the Audio Engineering Society"},{"key":"e_1_2_1_3_1","volume-title":"Investigating sources of inaccuracy in wearable optical heart rate sensors. NPJ digital medicine 3, 1","author":"Bent Brinnae","year":"2020","unstructured":"Brinnae Bent, Benjamin A Goldstein, Warren A Kibbe, and Jessilyn P Dunn. 2020. Investigating sources of inaccuracy in wearable optical heart rate sensors. NPJ digital medicine 3, 1 (2020), 1--9."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264902"},{"key":"e_1_2_1_5_1","volume-title":"Zhanan Zou, Phuc Nguyen, Hoang Truong, Taeho Kim, Nicholas Farrow, Anh Nguyen, Jianliang Xiao, et al.","author":"Bui Nam","year":"2019","unstructured":"Nam Bui, Nhat Pham, Jessica Jacqueline Barnitz, Zhanan Zou, Phuc Nguyen, Hoang Truong, Taeho Kim, Nicholas Farrow, Anh Nguyen, Jianliang Xiao, et al. 2019. ebp: A wearable system for frequent and comfortable blood pressure monitoring from user's ear. In The 25th annual international conference on mobile computing and networking. 1--17."},{"key":"e_1_2_1_6_1","volume-title":"Motion-resilient Heart Rate Monitoring with In-ear Microphones. CoRR abs\/2108.09393","author":"Butkow Kayla-Jade","year":"2021","unstructured":"Kayla-Jade Butkow, Ting Dang, Andrea Ferlini, Dong Ma, and Cecilia Mascolo. 2021. Motion-resilient Heart Rate Monitoring with In-ear Microphones. CoRR abs\/2108.09393 (2021). arXiv:2108.09393 https:\/\/arxiv.org\/abs\/2108.09393"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384419.3430730"},{"key":"e_1_2_1_8_1","volume-title":"Variational mode decomposition","author":"Dragomiretskiy Konstantin","year":"2013","unstructured":"Konstantin Dragomiretskiy and Dominique Zosso. 2013. Variational mode decomposition. IEEE transactions on signal processing 62, 3 (2013), 531--544."},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Xiaoran Fan Longfei Shangguan Siddharth Rupavatharam Yanyong Zhang Jie Xiong Yunfei Ma and Richard E Howard. 2021. HeadFi: bringing intelligence to all headphones.. In MobiCom. 147--159.","DOI":"10.1145\/3447993.3448624"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3117811.3117823"},{"key":"e_1_2_1_11_1","volume-title":"EarGate: Gait-based User Identification with In-ear Microphones. arXiv preprint arXiv:2108.12305","author":"Ferlini Andrea","year":"2021","unstructured":"Andrea Ferlini, Dong Ma, Robert Harle, and Cecilia Mascolo. 2021. EarGate: Gait-based User Identification with In-ear Microphones. arXiv preprint arXiv:2108.12305 (2021)."},{"key":"e_1_2_1_12_1","first-page":"1","article-title":"Voice In Ear: Spoofing-Resistant and Passphrase-Independent Body Sound Authentication","volume":"5","author":"Gao Yang","year":"2021","unstructured":"Yang Gao, Yincheng Jin, Jagmohan Chauhan, Seokmin Choi, Jiyang Li, and Zhanpeng Jin. 2021. Voice In Ear: Spoofing-Resistant and Passphrase-Independent Body Sound Authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1--25.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_13_1","first-page":"1","article-title":"EarEcho: Using ear canal echo for wearable authentication","volume":"3","author":"Gao Yang","year":"2019","unstructured":"Yang Gao, Wei Wang, Vir V Phoha, Wei Sun, and Zhanpeng Jin. 2019. EarEcho: Using ear canal echo for wearable authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--24.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_14_1","unstructured":"Bill Gillham. 2008. Developing a questionnaire. A&C Black."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2015.2471183"},{"key":"e_1_2_1_16_1","unstructured":"Polar H10. 2019. https:\/\/www.polar.com\/us-en\/products\/accessories\/h10_heart_rate_sensor\/. (2019)."},{"key":"e_1_2_1_17_1","unstructured":"Wireless Bluetooth Sports Headphones. 2020. https:\/\/www.jabra.cn\/sports-headphones\/. (2020)."},{"key":"e_1_2_1_18_1","volume-title":"Chi Chao Tung, and Henry H Liu","author":"Huang Norden E","year":"1998","unstructured":"Norden E Huang, Zheng Shen, Steven R Long, Manli C Wu, Hsing H Shih, Quanan Zheng, Nai-Chyuan Yen, Chi Chao Tung, and Henry H Liu. 1998. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: mathematical, physical and engineering sciences 454, 1971 (1998), 903--995."},{"key":"e_1_2_1_19_1","unstructured":"Huawei. 2020. https:\/\/consumer.huawei.com\/en\/headphones\/freebuds-pro\/. (2020)."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3133964"},{"key":"e_1_2_1_21_1","volume-title":"OESense: employing occlusion effect for in-ear human sensing. arXiv preprint arXiv:2106.08607","author":"Ma Dong","year":"2021","unstructured":"Dong Ma, Andrea Ferlini, and Cecilia Mascolo. 2021. OESense: employing occlusion effect for in-ear human sensing. arXiv preprint arXiv:2106.08607 (2021)."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2017.2720463"},{"key":"e_1_2_1_23_1","first-page":"203","article-title":"Transfer characteristics of headphones measured on human ears","volume":"43","author":"M\u00f8ller Henrik","year":"1995","unstructured":"Henrik M\u00f8ller, Dorte Hammersh\u00f8i, Clemen Boje Jensen, and Michael Friis S\u00f8rensen. 1995. Transfer characteristics of headphones measured on human ears. Journal of the Audio Engineering Society 43, 4 (1995), 203--217.","journal-title":"Journal of the Audio Engineering Society"},{"key":"e_1_2_1_24_1","unstructured":"BIOPAC MP160. 2016. https:\/\/www.biopac.com\/product\/mp150-system-221\/. (2016)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131897"},{"key":"e_1_2_1_26_1","first-page":"21","article-title":"PERCEVAL: Perceptual evaluation of the quality of audio signals","volume":"40","author":"Paillard Bruno","year":"1992","unstructured":"Bruno Paillard, Philippe Mabilleau, Sarto Morissette, and Jo\u00ebl Soumagne. 1992. PERCEVAL: Perceptual evaluation of the quality of audio signals. Journal of the Audio Engineering Society 40, 1\/2 (1992), 21--31.","journal-title":"Journal of the Audio Engineering Society"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3390\/s150923402"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.HJ.0000285785.83490.6c"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2004.836525"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.3654019"},{"key":"e_1_2_1_31_1","unstructured":"Grand View Research. 2020. https:\/\/www.grandviewresearch.com\/press-release\/global-earphones-headphones-market\/. (2020)."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2017.2691658"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACV.1994.341300"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/PROC.1973.9150"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2009.4960661"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2004.12.013"},{"key":"e_1_2_1_37_1","article-title":"Visualizing data using t-SNE","volume":"9","author":"der Maaten Laurens Van","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, 11 (2008).","journal-title":"Journal of machine learning research"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.408329"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264950"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161188"},{"key":"e_1_2_1_41_1","volume-title":"Tacotron: Towards end-to-end speech synthesis. arXiv preprint arXiv:1703.10135","author":"Wang Yuxuan","year":"2017","unstructured":"Yuxuan Wang, RJ Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Zhifeng Chen, Samy Bengio, et al. 2017. Tacotron: Towards end-to-end speech synthesis. arXiv preprint arXiv:1703.10135 (2017)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3448098","article-title":"EarDynamic: An Ear Canal Deformation Based Continuous User Authentication Using In-Ear Wearables","volume":"5","author":"Wang Zi","year":"2021","unstructured":"Zi Wang, Sheng Tan, Linghan Zhang, Yili Ren, Zhi Wang, and Jie Yang. 2021. EarDynamic: An Ear Canal Deformation Based Continuous User Authentication Using In-Ear Wearables. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1--27.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAU.1967.1161901"},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3351273","article-title":"Acousticid: gait-based human identification using acoustic signal","volume":"3","author":"Xu Wei","year":"2019","unstructured":"Wei Xu, ZhiWen Yu, Zhu Wang, Bin Guo, and Qi Han. 2019. Acousticid: gait-based human identification using acoustic signal. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--25.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307334.3326074"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432192"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569472","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3569472","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T20:56:19Z","timestamp":1752612979000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569472"}},"subtitle":["In-ear Motion-resilient Acoustic Sensing Using Commodity Earphones"],"short-title":[],"issued":{"date-parts":[[2022,12,21]]},"references-count":46,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,21]]}},"alternative-id":["10.1145\/3569472"],"URL":"https:\/\/doi.org\/10.1145\/3569472","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,21]]},"assertion":[{"value":"2023-01-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}