{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T17:02:00Z","timestamp":1780765320046,"version":"3.54.1"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T00:00:00Z","timestamp":1599177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2020,9,4]]},"abstract":"<jats:p>Smart homes of the future are envisioned to have the ability to recognize many types of home activities such as running a washing machine, flushing the toilet, and using a microwave. In this paper, we present a new sensing technology, VibroSense, which is able to recognize 18 different types of activities throughout a house by observing structural vibration patterns on a wall or ceiling using a laser Doppler vibrometer. The received vibration data is processed and sent to a deep neural network which is trained to distinguish between 18 activities. We conducted a system evaluation, where we collected data of 18 home activities in 5 different houses for 2 days in each house. The results demonstrated that our system can recognize 18 home activities with an average accuracy of up to 96.6%. After re-setup of the device on the second day, the average recognition accuracy decreased to 89.4%. We also conducted follow-up experiments, where we evaluated VibroSense under various scenarios to simulate real-world conditions. These included simulating online recognition, differentiating between specific stages of a device's activity, and testing the effects of shifting the laser's position during re-setup. Based on these results, we discuss the opportunities and challenges of applying VibroSense in real-world applications.<\/jats:p>","DOI":"10.1145\/3411828","type":"journal-article","created":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T21:39:45Z","timestamp":1599255585000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["VibroSense"],"prefix":"10.1145","volume":"4","author":[{"given":"Wei","family":"Sun","sequence":"first","affiliation":[{"name":"Institute of Software Chinese Academy of Sciences, School of Computer Science and Technology, University of Chinese Academy of Sciences, Cornell University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tuochao","family":"Chen","sequence":"additional","affiliation":[{"name":"Cornell University, Peking University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiayi","family":"Zheng","sequence":"additional","affiliation":[{"name":"Cornell University, SUNY-University at Buffalo"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenyu","family":"Lei","sequence":"additional","affiliation":[{"name":"Cornell University, Huazhong University of Science and Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucy","family":"Wang","sequence":"additional","affiliation":[{"name":"Cornell University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Steeper","sequence":"additional","affiliation":[{"name":"Cornell University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"He","sequence":"additional","affiliation":[{"name":"Cornell University, Hangzhou dianzi University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Dressa","sequence":"additional","affiliation":[{"name":"Cornell University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feng","family":"Tian","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, University of Chinese Academy of Sciences, State Key Laboratory of Computer Science, Institute of Software Chinese Academy of Sciences"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,9,4]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Feb","author":"Accessed","year":"2020","unstructured":"Accessed : Feb . 2020 . VibroGo . https:\/\/www.polytec.com\/eu\/vibrometry\/products\/single-point-vibrometers\/vibrogo\/ Accessed: Feb. 2020. VibroGo. https:\/\/www.polytec.com\/eu\/vibrometry\/products\/single-point-vibrometers\/vibrogo\/"},{"key":"e_1_2_1_2_1","volume-title":"Prediction of watermelon quality based on vibration spectrum. Postharvest biology and technology 86","author":"Abbaszadeh R","year":"2013","unstructured":"R Abbaszadeh , A Rajabipour , H Ahmadi , MJ Mahjoob , and M Delshad . 2013. Prediction of watermelon quality based on vibration spectrum. Postharvest biology and technology 86 ( 2013 ), 291--293. R Abbaszadeh, A Rajabipour, H Ahmadi, MJ Mahjoob, and M Delshad. 2013. Prediction of watermelon quality based on vibration spectrum. Postharvest biology and technology 86 (2013), 291--293."},{"key":"e_1_2_1_3_1","volume-title":"Wave propagation in elastic solids","author":"Achenbach Jan","unstructured":"Jan Achenbach . 2012. Wave propagation in elastic solids . Elsevier . Jan Achenbach. 2012. Wave propagation in elastic solids. Elsevier."},{"key":"e_1_2_1_4_1","volume-title":"Nonlinearity in eardrum vibration as a function of frequency and sound pressure. Hearing research 263, 1-2","author":"Aerts JRM","year":"2010","unstructured":"JRM Aerts and JJJ Dirckx . 2010. Nonlinearity in eardrum vibration as a function of frequency and sound pressure. Hearing research 263, 1-2 ( 2010 ), 26--32. JRM Aerts and JJJ Dirckx. 2010. Nonlinearity in eardrum vibration as a function of frequency and sound pressure. Hearing research 263, 1-2 (2010), 26--32."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/HSCMA.2011.5942375"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172962"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302506.3312490"},{"key":"e_1_2_1_8_1","volume-title":"Laser Doppler Vibrometry: Development of advanced solutions answering to technology's needs. Mechanical systems and signal processing 20, 6","author":"Castellini P","year":"2006","unstructured":"P Castellini , M Martarelli , and EP Tomasini . 2006. Laser Doppler Vibrometry: Development of advanced solutions answering to technology's needs. Mechanical systems and signal processing 20, 6 ( 2006 ), 1265--1285. P Castellini, M Martarelli, and EP Tomasini. 2006. Laser Doppler Vibrometry: Development of advanced solutions answering to technology's needs. Mechanical systems and signal processing 20, 6 (2006), 1265--1285."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM.2015.7146508"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12654-3_16"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370233"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299171"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601119"},{"key":"e_1_2_1_14_1","volume-title":"Monitoring hand-washing practices using structural vibrations. Structural Health Monitoring","author":"Fagert Jonathon","year":"2017","unstructured":"Jonathon Fagert , Mostafa Mirshekari , Shijia Pan , Pei Zhang , and Hae Young Noh . 2017. Monitoring hand-washing practices using structural vibrations. Structural Health Monitoring ( 2017 ). Jonathon Fagert, Mostafa Mirshekari, Shijia Pan, Pei Zhang, and Hae Young Noh. 2017. Monitoring hand-washing practices using structural vibrations. Structural Health Monitoring (2017)."},{"key":"e_1_2_1_15_1","volume-title":"Vibration Source Separation for Multiple People Gait Monitoring Using Footstep-Induced Floor Vibrations. Structural Health Monitoring 2019","author":"JONATHON FAGERT, MOSTAFA MIRSHEKARI, SHIJIA PAN, PEI","year":"2019","unstructured":"JONATHON FAGERT, MOSTAFA MIRSHEKARI, SHIJIA PAN, PEI ZHANG, and HAE YOUNG NOH. 2019. Vibration Source Separation for Multiple People Gait Monitoring Using Footstep-Induced Floor Vibrations. Structural Health Monitoring 2019 ( 2019 ). JONATHON FAGERT, MOSTAFA MIRSHEKARI, SHIJIA PAN, PEI ZHANG, and HAE YOUNG NOH. 2019. Vibration Source Separation for Multiple People Gait Monitoring Using Footstep-Induced Floor Vibrations. Structural Health Monitoring 2019 (2019)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1166253.1166269"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1620545.1620581"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11831-015-9145-0"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1864349.1864375"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00065"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.mao.0000244352.49824.e6"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005537-200103000-00022"},{"key":"e_1_2_1_24_1","volume-title":"Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167","author":"Ioffe Sergey","year":"2015","unstructured":"Sergey Ioffe and Christian Szegedy . 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 ( 2015 ). Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1620545.1620582"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753604"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242609"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702416"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025773"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702178"},{"key":"e_1_2_1_31_1","unstructured":"Shengjie Li Xiang Li Qin Lv Guiyu Tian and Daqing Zhang. 2018. WiFit: Ubiquitous bodyweight exercise monitoring with commodity Wi-Fi devices. In 2018 IEEE SmartWorld Ubiquitous Intelligence & Computing Advanced & Trusted Computing Scalable Computing & Communications Cloud & Big Data Computing Internet of People and Smart City Innovation (Smart-World\/SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI). IEEE 530--537.  Shengjie Li Xiang Li Qin Lv Guiyu Tian and Daqing Zhang. 2018. WiFit: Ubiquitous bodyweight exercise monitoring with commodity Wi-Fi devices. In 2018 IEEE SmartWorld Ubiquitous Intelligence & Computing Advanced & Trusted Computing Scalable Computing & Communications Cloud & Big Data Computing Internet of People and Smart City Innovation (Smart-World\/SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI). IEEE 530--537."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/RTSS.2014.30"},{"key":"#cr-split#-e_1_2_1_33_1.1","doi-asserted-by":"crossref","unstructured":"Guomin Luo and Daming Zhang. 2012. Wavelet Denoising. https:\/\/doi.org\/10.5772\/37424 10.5772\/37424","DOI":"10.5772\/37424"},{"key":"#cr-split#-e_1_2_1_33_1.2","doi-asserted-by":"crossref","unstructured":"Guomin Luo and Daming Zhang. 2012. Wavelet Denoising. https:\/\/doi.org\/10.5772\/37424","DOI":"10.5772\/37424"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICC.2015.7248370"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3274187"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymssp.2018.04.026"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994551.2996715"},{"key":"e_1_2_1_38_1","volume-title":"Dani\u00ebl De Greef, Felipe Pires, Peter Aerts, and Joris JJ Dirckx.","author":"Muyshondt Pieter GG","year":"2016","unstructured":"Pieter GG Muyshondt , Joris AM Soons , Dani\u00ebl De Greef, Felipe Pires, Peter Aerts, and Joris JJ Dirckx. 2016 . A single-ossicle ear: acoustic response and mechanical properties measured in duck. Hearing research 340 (2016), 35--42. Pieter GG Muyshondt, Joris AM Soons, Dani\u00ebl De Greef, Felipe Pires, Peter Aerts, and Joris JJ Dirckx. 2016. A single-ossicle ear: acoustic response and mechanical properties measured in duck. Hearing research 340 (2016), 35--42."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131898"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1111\/str.12098"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360322.3360851"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130954"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-79576-6_1"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74853-3_16"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2500423.2500436"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2012.6247801"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsv.2015.02.029"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.optlaseng.2016.10.023"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360773.3360887"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3376897.3379162"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370440"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1081992.1082018"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858243"},{"key":"e_1_2_1_54_1","volume-title":"Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research 15, 1","author":"Srivastava Nitish","year":"2014","unstructured":"Nitish Srivastava , Geoffrey Hinton , Alex Krizhevsky , Ilya Sutskever , and Ruslan Salakhutdinov . 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research 15, 1 ( 2014 ), 1929--1958. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research 15, 1 (2014), 1929--1958."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1088\/0964-1726\/13\/2\/002"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2012.6224591"},{"key":"e_1_2_1_57_1","first-page":"1","article-title":"Novel applications of laser Doppler vibration measurements to medical imaging","volume":"14","author":"Tabatabai Habib","year":"2013","unstructured":"Habib Tabatabai , David E Oliver , John W Rohrbaugh , and Christopher Papadopoulos . 2013 . Novel applications of laser Doppler vibration measurements to medical imaging . Sensing and Imaging: An International Journal 14 , 1 - 2 (2013), 13--28. Habib Tabatabai, David E Oliver, John W Rohrbaugh, and Christopher Papadopoulos. 2013. Novel applications of laser Doppler vibration measurements to medical imaging. Sensing and Imaging: An International Journal 14, 1-2 (2013), 13--28.","journal-title":"Sensing and Imaging: An International Journal"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24646-6_10"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76652-0_2"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00340-011-4585-1"},{"key":"e_1_2_1_61_1","volume-title":"Characterization of silicon micro-oscillators by scanning laser vibrometry. Review of scientific instruments 73, 10","author":"Vignola JF","year":"2002","unstructured":"JF Vignola , X Liu , SF Morse , BH Houston , JA Bucaro , MH Marcus , DM Photiadis , and L Sekaric . 2002. Characterization of silicon micro-oscillators by scanning laser vibrometry. Review of scientific instruments 73, 10 ( 2002 ), 3584--3588. JF Vignola, X Liu, SF Morse, BH Houston, JA Bucaro, MH Marcus, DM Photiadis, and L Sekaric. 2002. Characterization of silicon micro-oscillators by scanning laser vibrometry. Review of scientific instruments 73, 10 (2002), 3584--3588."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971744"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2016.2557795"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2018.1700144"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1007\/11428572_5"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376875"},{"key":"e_1_2_1_67_1","volume-title":"Simultaneous remote extraction of multiple speech sources and heart beats from secondary speckles pattern. Optics express 17, 24","author":"Zalevsky Zeev","year":"2009","unstructured":"Zeev Zalevsky , Yevgeny Beiderman , Israel Margalit , Shimshon Gingold , Mina Teicher , Vicente Mico , and Javier Garcia . 2009. Simultaneous remote extraction of multiple speech sources and heart beats from secondary speckles pattern. Optics express 17, 24 ( 2009 ), 21566--21580. Zeev Zalevsky, Yevgeny Beiderman, Israel Margalit, Shimshon Gingold, Mina Teicher, Vicente Mico, and Javier Garcia. 2009. Simultaneous remote extraction of multiple speech sources and heart beats from secondary speckles pattern. Optics express 17, 24 (2009), 21566--21580."},{"key":"e_1_2_1_68_1","first-page":"12","article-title":"RGB-D camera-based daily living activity recognition","volume":"2","author":"Zhang Chenyang","year":"2012","unstructured":"Chenyang Zhang and Yingli Tian . 2012 . RGB-D camera-based daily living activity recognition . Journal of computer vision and image processing 2 , 4 (2012), 12 . Chenyang Zhang and Yingli Tian. 2012. RGB-D camera-based daily living activity recognition. Journal of computer vision and image processing 2, 4 (2012), 12.","journal-title":"Journal of computer vision and image processing"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242608"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3274184"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173847"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2008.2005612"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sna.2003.10.051"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411828","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411828","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:48Z","timestamp":1750195488000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411828"}},"subtitle":["Recognizing Home Activities by Deep Learning Subtle Vibrations on an Interior Surface of a House from a Single Point Using Laser Doppler Vibrometry"],"short-title":[],"issued":{"date-parts":[[2020,9,4]]},"references-count":74,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9,4]]}},"alternative-id":["10.1145\/3411828"],"URL":"https:\/\/doi.org\/10.1145\/3411828","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,4]]},"assertion":[{"value":"2020-09-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}