{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T00:31:41Z","timestamp":1768523501739,"version":"3.49.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,12,17]],"date-time":"2020-12-17T00:00:00Z","timestamp":1608163200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. 61802373, No. 62072450"],"award-info":[{"award-number":["No. 61802373, No. 62072450"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"EU Horizon 2020 research and innovation programme IDEA-FAST","award":["No. 853981"],"award-info":[{"award-number":["No. 853981"]}]},{"DOI":"10.13039\/501100001809","name":"Youth Innovation Promotion Association, Chinese Academy of Sciences","doi-asserted-by":"publisher","award":["No. 2020109"],"award-info":[{"award-number":["No. 2020109"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"EU CHIST-ERA RadioSense Project"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2020,12,17]]},"abstract":"<jats:p>Vital sign monitoring is a common practice amongst medical professionals, and plays a key role in patient care and clinical diagnosis. Traditionally, dedicated equipment is employed to monitor these vital signs. For example, electrocardiograms (ECG) with 3-12 electrodes are attached to the target chest for heartbeat monitoring. In the last few years, wireless sensing becomes a hot research topic and wireless signal itself is utilized for sensing purposes without requiring the target to wear any sensors. The contact-free nature of wireless sensing makes it particularly appealing in current COVID-19 pandemic. Recently, promising progress has been achieved and the sensing granularity has been pushed to millimeter level, fine enough to monitor respiration which causes a chest displacement of 5 mm. While a great success with respiration monitoring, it is still very challenging to monitor heartbeat due to the extremely subtle chest displacement (0.1 - 0.5 mm) - smaller than 10% of that caused by respiration. What makes it worse is that the tiny heartbeat-caused chest displacement is buried inside the respiration-caused displacement. In this paper, we show the feasibility of employing the popular smart speakers (e.g., Amazon Echo) to monitor an individual's heartbeats in a contact-free manner. To extract the submillimeter heartbeat motion in the presence of other interference movements, a series of novel signal processing schemes are employed. We successfully prototype the first real-time heartbeat monitoring system using a commodity smart speaker. Experiment results show that the proposed system can monitor a target's heartbeat accurately, achieving a median heart rate estimation error of 0.75 beat per minute (bpm), and a median heartbeat interval estimation error of 13.28 ms (less than 1.8%), outperforming even some popular commodity products available on the market.<\/jats:p>","DOI":"10.1145\/3432237","type":"journal-article","created":{"date-parts":[[2020,12,18]],"date-time":"2020-12-18T15:39:14Z","timestamp":1608305954000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":36,"title":["Your Smart Speaker Can \"Hear\" Your Heartbeat!"],"prefix":"10.1145","volume":"4","author":[{"given":"Fusang","family":"Zhang","sequence":"first","affiliation":[{"name":"State Key Laboratory of Computer Sciences, Institute of Software, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}]},{"given":"Zhi","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Computer Sciences, Institute of Software, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}]},{"given":"Beihong","family":"Jin","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Computer Sciences, Institute of Software, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}]},{"given":"Jie","family":"Xiong","sequence":"additional","affiliation":[{"name":"College of Information and Computer Sciences, University of Massachusetts Amherst, USA"}]},{"given":"Daqing","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of High Confidence Software Technologies (Ministryof Education), School of Electronics Engineering and Computer Science, Peking University, Beijing, China, Telecom SudParis, InstitutPolytechnique de Paris, Evry, France"}]}],"member":"320","published-online":{"date-parts":[[2020,12,18]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"2014. Kiwi application. http:\/\/patrickhealthappreview.blogspot.com\/2014\/06\/app-review-kiwi-instant-heart-rate.html.  2014. Kiwi application. http:\/\/patrickhealthappreview.blogspot.com\/2014\/06\/app-review-kiwi-instant-heart-rate.html."},{"key":"e_1_2_2_2_1","unstructured":"2018. Kangyuan bracelet. https:\/\/www.kangyuanai.com\/index\/index\/product.html.  2018. Kangyuan bracelet. https:\/\/www.kangyuanai.com\/index\/index\/product.html."},{"key":"e_1_2_2_3_1","unstructured":"2019. Heart Disease and Stroke Statistics-2019 At-a-Glance. https:\/\/healthmetrics.heart.org\/wp-content\/uploads\/2019\/02\/At-A-Glance-Heart-Disease-and-Stroke-Statistics-%E2%80%93-2019.pdf.  2019. Heart Disease and Stroke Statistics-2019 At-a-Glance. https:\/\/healthmetrics.heart.org\/wp-content\/uploads\/2019\/02\/At-A-Glance-Heart-Disease-and-Stroke-Statistics-%E2%80%93-2019.pdf."},{"key":"e_1_2_2_4_1","unstructured":"2020. Apple watch. https:\/\/www.apple.com\/watch\/.  2020. Apple watch. https:\/\/www.apple.com\/watch\/."},{"key":"e_1_2_2_5_1","unstructured":"2020. Cardiovascular Diseases. https:\/\/www.who.int\/health-topics\/cardiovascular-diseases\/#tab=tab_1.  2020. Cardiovascular Diseases. https:\/\/www.who.int\/health-topics\/cardiovascular-diseases\/#tab=tab_1."},{"key":"e_1_2_2_6_1","unstructured":"2020. Fitbit wrist band. https:\/\/www.fitbit.com\/.  2020. Fitbit wrist band. https:\/\/www.fitbit.com\/."},{"key":"e_1_2_2_7_1","unstructured":"2020. Heart Rate Monitor. https:\/\/play.google.com\/store\/apps\/details?id=com.repsi.heartrate&hl=en.  2020. Heart Rate Monitor. https:\/\/play.google.com\/store\/apps\/details?id=com.repsi.heartrate&hl=en."},{"key":"e_1_2_2_8_1","unstructured":"2020. smart speaker market. https:\/\/marketingland.com\/more-than-200-million-smart-speakers-have-been-sold-why-arent-they-a-marketing-channel-276012.  2020. smart speaker market. https:\/\/marketingland.com\/more-than-200-million-smart-speakers-have-been-sold-why-arent-they-a-marketing-channel-276012."},{"key":"e_1_2_2_9_1","volume-title":"Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15)","author":"Adib Fadel","unstructured":"Fadel Adib , Hongzi Mao , Zachary Kabelac , Dina Katabi , and Robert C. Miller . 2015. Smart Homes that Monitor Breathing and Heart Rate . In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15) , 837--846. Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C. Miller. 2015. Smart Homes that Monitor Breathing and Heart Rate. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 837--846."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351237"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314390"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130924"},{"key":"e_1_2_2_13_1","volume-title":"41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 3896--3899","author":"Hu J.","unstructured":"J. Hu , Y. He , J. Liu , M. He , and W. Wang . 2019. Illumination Robust Heart-rate Extraction from Single-wavelength Infrared Camera Using Spatial-channel Expansion . 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 3896--3899 . J. Hu, Y. He, J. Liu, M. He, and W. Wang. 2019. Illumination Robust Heart-rate Extraction from Single-wavelength Infrared Camera Using Spatial-channel Expansion. 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 3896--3899."},{"key":"e_1_2_2_14_1","volume-title":"Chi Chao Tung, and Henry H Liu","author":"Huang Norden E","year":"1998","unstructured":"Norden E Huang , Zheng Shen , Steven R Long , Manli C Wu , Hsing H Shih , Quanan Zheng , Nai-Chyuan Yen , Chi Chao Tung, and Henry H Liu . 1998 . The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London . Series A: mathematical, physical and engineering sciences 454, 1971 (1998), 903--995. Norden E Huang, Zheng Shen, Steven R Long, Manli C Wu, Hsing H Shih, Quanan Zheng, Nai-Chyuan Yen, Chi Chao Tung, and Henry H Liu. 1998. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: mathematical, physical and engineering sciences 454, 1971 (1998), 903--995."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1080\/00207219308907103"},{"key":"e_1_2_2_16_1","volume-title":"IEEE International Conference on Automation Science and Engineering (CASE), 186--193","author":"Jia R.","unstructured":"R. Jia , M. Jin , Z. Chen , and C. J. Spanos . 2015. SoundLoc: Accurate room-level indoor localization using acoustic signatures . IEEE International Conference on Automation Science and Engineering (CASE), 186--193 . R. Jia, M. Jin, Z. Chen, and C. J. Spanos. 2015. SoundLoc: Accurate room-level indoor localization using acoustic signatures. IEEE International Conference on Automation Science and Engineering (CASE), 186--193."},{"key":"e_1_2_2_17_1","volume-title":"The ECG Made Easy E-Book","author":"John Hampton","unstructured":"Hampton John and Joanna Hampton . 2019. The ECG Made Easy E-Book . Elsevier Health Sciences . Hampton John and Joanna Hampton. 2019. The ECG Made Easy E-Book. Elsevier Health Sciences."},{"key":"e_1_2_2_18_1","volume-title":"Zong Woo Geem, and Gi-Tae Han","author":"Kim Seong-Hoon","year":"2019","unstructured":"Seong-Hoon Kim , Zong Woo Geem, and Gi-Tae Han . 2019 . A Novel Human Respiration Pattern Recognition Using Signals of Ultra-Wideband Radar Sensor. Sensors (Basel, Switzerland) 19, 15 (2019). Seong-Hoon Kim, Zong Woo Geem, and Gi-Tae Han. 2019. A Novel Human Respiration Pattern Recognition Using Signals of Ultra-Wideband Radar Sensor. Sensors (Basel, Switzerland) 19, 15 (2019)."},{"key":"e_1_2_2_19_1","volume-title":"Pathophysiology of heart disease: a collaborative project of medical students and faculty","author":"Lilly Leonard S","unstructured":"Leonard S Lilly . 2012. Pathophysiology of heart disease: a collaborative project of medical students and faculty . Lippincott Williams & Wilkins . Leonard S Lilly. 2012. Pathophysiology of heart disease: a collaborative project of medical students and faculty. Lippincott Williams & Wilkins."},{"key":"e_1_2_2_20_1","volume-title":"LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1466--1474","author":"Lu L.","unstructured":"L. Lu , J. Yu , Y. Chen , H. Liu , Y. Zhu , Y. Liu , and M. Li . 2018 . LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1466--1474 . L. Lu, J. Yu, Y. Chen, H. Liu, Y. Zhu, Y. Liu, and M. Li. 2018. LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1466--1474."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973755"},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Marcel Miynczak and Gerard Cybulski. 2016. Improvement of Body Posture Changes Detection During Ambulatory Respiratory Measurements Using Impedance Pneumography Signals. Mediterranean Conference on Medical and Biological Engineering and Computing (2016).  Marcel Miynczak and Gerard Cybulski. 2016. Improvement of Body Posture Changes Detection During Ambulatory Respiratory Measurements Using Impedance Pneumography Signals. Mediterranean Conference on Medical and Biological Engineering and Computing (2016).","DOI":"10.1007\/978-3-319-32703-7_34"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742674"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"Giardino ND Lehrer PM and Edelberg R. 2002. Comparison of finger plethysmograph to ECG in the measurement of heart rate variability. Psychophysiology. Frontiers in public health 39 2 (2002) 246--253.  Giardino ND Lehrer PM and Edelberg R. 2002. Comparison of finger plethysmograph to ECG in the measurement of heart rate variability. Psychophysiology. Frontiers in public health 39 2 (2002) 246--253.","DOI":"10.1111\/1469-8986.3920246"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322263.1322265"},{"key":"e_1_2_2_26_1","volume-title":"IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1574--1582","author":"Qian K.","unstructured":"K. Qian , C. Wu , F. Xiao , Y. Zheng , Y. Zhang , Z. Yang , and Y. Liu . 2018. Acousticcardiogram: Monitoring Heartbeats using Acoustic Signals on Smart Devices . In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1574--1582 . K. Qian, C. Wu, F. Xiao, Y. Zheng, Y. Zhang, Z. Yang, and Y. Liu. 2018. Acousticcardiogram: Monitoring Heartbeats using Acoustic Signals on Smart Devices. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1574--1582."},{"key":"e_1_2_2_27_1","volume-title":"13th International Conference on Signal Processing and Communication Systems (ICSPCS), 1--5.","author":"Raheel M. S.","unstructured":"M. S. Raheel and et al. 2019. Breathing and Heartrate Monitoring System using IR-UWB Radar . 13th International Conference on Signal Processing and Communication Systems (ICSPCS), 1--5. M. S. Raheel and et al. 2019. Breathing and Heartrate Monitoring System using IR-UWB Radar. 13th International Conference on Signal Processing and Communication Systems (ICSPCS), 1--5."},{"key":"e_1_2_2_28_1","volume-title":"2018 IEEE Radar Conference (RadarConf18)","author":"Santra A.","unstructured":"A. Santra , R. V. Ulaganathan , T. Finke , A. Baheti , D. Noppeney , J. R. Wolfgang , and S. Trotta . 2018. Short-range multi-mode continuous-wave radar for vital sign measurement and imaging . In 2018 IEEE Radar Conference (RadarConf18) . 0946--0950. A. Santra, R. V. Ulaganathan, T. Finke, A. Baheti, D. Noppeney, J. R. Wolfgang, and S. Trotta. 2018. Short-range multi-mode continuous-wave radar for vital sign measurement and imaging. In 2018 IEEE Radar Conference (RadarConf18). 0946--0950."},{"key":"e_1_2_2_29_1","volume-title":"Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems, 43--56","author":"Shahriar Nirjon","year":"2012","unstructured":"Nirjon Shahriar , Robert F. Dickerson , Qiang Li , Philip Asare , John A. Stankovic , Dezhi Hong , Ben Zhang , Xiaofan Jiang , Guobin Shen , and Feng Zhao . 2012 . Musicalheart: A hearty way of listening to music . In Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems, 43--56 . Nirjon Shahriar, Robert F. Dickerson, Qiang Li, Philip Asare, John A. Stankovic, Dezhi Hong, Ben Zhang, Xiaofan Jiang, Guobin Shen, and Feng Zhao. 2012. Musicalheart: A hearty way of listening to music. In Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems, 43--56."},{"key":"e_1_2_2_30_1","volume-title":"2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 4144--4147","author":"Torres M. E.","unstructured":"M. E. Torres , M. A. Colominas , G. Schlotthauer , and P. Flandrin . 2011. A complete ensemble empirical mode decomposition with adaptive noise . In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 4144--4147 . M. E. Torres, M. A. Colominas, G. Schlotthauer, and P. Flandrin. 2011. A complete ensemble empirical mode decomposition with adaptive noise. In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 4144--4147."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300248"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264950"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2018.2877607"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161188"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jappgeo.2012.05.002"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6579\/aa6d02"},{"key":"e_1_2_2_37_1","volume-title":"Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (MobiCom '16)","author":"Wang Wei","year":"2016","unstructured":"Wei Wang , Alex X. Liu , and Ke Sun . 2016 . Device-free gesture tracking using acoustic signals . In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (MobiCom '16) , 82--94. Wei Wang, Alex X. Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (MobiCom '16), 82--94."},{"key":"e_1_2_2_38_1","volume-title":"IEEE Conference on Computer Communications, INFOCOM, 1225--1233","author":"Xie Y.","unstructured":"Y. Xie , F. Li , Y. Wu , S. Yang , and Y. Wang . 2019. D3-Guard: Acoustic-based Drowsy Driving Detection Using Smartphones . IEEE Conference on Computer Communications, INFOCOM, 1225--1233 . Y. Xie, F. Li, Y. Wu, S. Yang, and Y. Wang. 2019. D3-Guard: Acoustic-based Drowsy Driving Detection Using Smartphones. IEEE Conference on Computer Communications, INFOCOM, 1225--1233."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351273"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742662"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397326"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191785"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973762"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3432237","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3432237","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:10Z","timestamp":1750193230000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3432237"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,17]]},"references-count":43,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,12,17]]}},"alternative-id":["10.1145\/3432237"],"URL":"https:\/\/doi.org\/10.1145\/3432237","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,17]]},"assertion":[{"value":"2020-12-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}