{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T10:48:04Z","timestamp":1778150884722,"version":"3.51.4"},"reference-count":94,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,1,18]],"date-time":"2022-01-18T00:00:00Z","timestamp":1642464000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"FCT - Foundation for Science and Technology, I.P.","award":["UID\/CEC\/00326\/2020"],"award-info":[{"award-number":["UID\/CEC\/00326\/2020"]}]},{"name":"European Social Fund, through the Regional Operational Program Centro 2020"},{"name":"Fundaci\u00f3n CSIC, Interreg Portugal-Espanha"},{"name":"Foundation for Science and Technology","award":["SFRH\/BD\/147371\/2019"],"award-info":[{"award-number":["SFRH\/BD\/147371\/2019"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2023,2,28]]},"abstract":"<jats:p>The increasing amount of human-related and\/or human-originated data in current systems is both an opportunity and a challenge. Nevertheless, despite relying on the processing of large amounts of data, most of the so-called smart systems that we have nowadays merely consider humans as sources of data, not as system beneficiaries or even active \u201ccomponents.\u201d For truly smart systems, we need to create systems that are able to understand human actions and emotions, and take them into account when deciding on the system behavior. Naturally, in order to achieve this, we first have to empower systems with human sensing capabilities, possibly in ways that are as inconspicuous as possible. In this context, in this article we survey existing approaches to unobtrusive monitorization of human beings, namely, of their activity, vital signs, and emotional states. After setting a taxonomy for human sensing, we proceed to present and analyze existing solutions for unobtrusive sensing. Subsequently, we identify and discuss open issues and challenges in this area. Although there are surveys that address some of the concerned fields of research, such as healthcare, human monitorization, or even the use-specific techniques like channel state information or image recognition, as far as we know this is the first comprehensive survey on unobtrusive sensing of human beings.<\/jats:p>","DOI":"10.1145\/3491208","type":"journal-article","created":{"date-parts":[[2022,1,18]],"date-time":"2022-01-18T09:50:32Z","timestamp":1642499432000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["A Survey of Approaches to Unobtrusive Sensing of Humans"],"prefix":"10.1145","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4930-1587","authenticated-orcid":false,"given":"Jos\u00e9 Marcelo","family":"Fernandes","sequence":"first","affiliation":[{"name":"University of Coimbra, CISUC, Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6273-1285","authenticated-orcid":false,"given":"Jorge S\u00e1","family":"Silva","sequence":"additional","affiliation":[{"name":"University of Coimbra, INESC, Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3849-5515","authenticated-orcid":false,"given":"Andr\u00e9","family":"Rodrigues","sequence":"additional","affiliation":[{"name":"Polytechnic of Coimbra, Coimbra Business School Research Centre| ISCAC, Portugal and University of Coimbra, CISUC, Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1347-0242","authenticated-orcid":false,"given":"Fernando","family":"Boavida","sequence":"additional","affiliation":[{"name":"University of Coimbra, CISUC, Coimbra, Portugal"}]}],"member":"320","published-online":{"date-parts":[[2022,1,18]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Linux 802.11n CSI Tool. 2018. Retrieved October 10 2018 from https:\/\/dhalperi.github.io\/linux-80211n-csitool\/."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1186\/1475-925X-10-93"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2013.2262913"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.5555\/2616448.2616478"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702200"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-014-0121-2"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.3390\/s131115549"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.10.3.229"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.3390\/s18082578"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1177\/1528083716652834"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0192691"},{"key":"e_1_3_2_13_2","article-title":"Smart Wearable Devices: Fitness Healthcare Entertainment and Enterprise 2013\u20132018","author":"Bhas N.","year":"2013","unstructured":"N. Bhas. 2013. Smart Wearable Devices: Fitness Healthcare Entertainment and Enterprise 2013\u20132018. Technical Report Juniper Research, Basingstoke, UK.","journal-title":"Juniper Research, Basingstoke, UK"},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/IASP.2010.5476146","volume-title":"2010 International Conference on Image Analysis and Signal Processing","author":"Bin Shen","year":"2010","unstructured":"Shen Bin, Liu Yuan, and Wang Xiaoyi. 2010. Research on data mining models for the internet of things. In 2010 International Conference on Image Analysis and Signal Processing. IEEE, 127\u2013132."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/MEMB.2003.1213622"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2016.31"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2017.05.007"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1088\/0967-3334\/26\/4\/007"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.01.040"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11036-010-0260-8"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2008.03.012"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICICS.1997.647126"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2018.2881008"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2013.06.058"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2016.09.015"},{"key":"e_1_3_2_26_2","unstructured":"Fitbit. 2018. Retrieved October 10 2018 from https:\/\/www.fitbit.com\/eu\/home."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2007.891930"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICC.2018.8422330"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/5.554205"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-016-0669-3"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1177\/1948550612444616"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241560"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0190466"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682283"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSN48538.2019.00026"},{"key":"e_1_3_2_36_2","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1109\/SEC.2018.00016","volume-title":"2018 IEEE\/ACM Symposium on Edge Computing (SEC\u201918)","author":"Hung Chien-Chun","year":"2018","unstructured":"Chien-Chun Hung, Ganesh Ananthanarayanan, Peter Bodik, Leana Golubchik, Minlan Yu, Paramvir Bahl, and Matthai Philipose. 2018. Videoedge: Processing camera streams using hierarchical clusters. In 2018 IEEE\/ACM Symposium on Edge Computing (SEC\u201918). IEEE, 115\u2013131."},{"key":"e_1_3_2_37_2","unstructured":"Socionext America. 2018 Socionext CMOS 24-GHz Radar Sensor Retrieved October 10 2018 from http:\/\/socionextus.com\/wp-content\/uploads\/2016\/07\/CN00010AE-SOCIONEXT.pdf."},{"key":"e_1_3_2_38_2","unstructured":"Infineon\u2019s innovative XENSIV\u2122 60 GHz radar chip enables things to see and revolutionizes the Human Machine Interface. 2018. Retrieved October 10 2018 from https:\/\/www.infineon.com\/cms\/en\/product\/promopages\/60GHz\/?redirId=59739."},{"key":"e_1_3_2_39_2","unstructured":"Jawbone. 2018. Retrieved October 10 2018 from https:\/\/jawbone.com\/up."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.5555\/2959355.2959377"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3131672.3131679"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.5555\/2602339.2602347"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2020.2996078"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.26"},{"key":"e_1_3_2_45_2","first-page":"89351P","volume-title":"Advanced Biomedical and Clinical Diagnostic Systems XII","author":"Klaessens John H. G. M.","year":"2014","unstructured":"John H. G. M. Klaessens, Marlies Van Den Born, Albert Van Der Veen, Janine Sikkens-Van De Kraats, Frank A. M. van den Dungen, and Rudolf M. Verdaasdonk. 2014. Development of a baby friendly non-contact method for measuring vital signs: First results of clinical measurements in an open incubator at a neonatal intensive care unit. In Advanced Biomedical and Clinical Diagnostic Systems XII, Vol. 8935. International Society for Optics and Photonics, 89351P."},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2012.6346392"},{"key":"e_1_3_2_47_2","first-page":"4938","volume-title":"2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC\u201915)","author":"Kwon Sungjun","year":"2015","unstructured":"Sungjun Kwon, Jeehoon Kim, Dongseok Lee, and Kwangsuk Park. 2015. ROI analysis for remote photoplethysmography on facial video. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC\u201915). IEEE, 4938\u20134941."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2008.07.056"},{"issue":"93","key":"e_1_3_2_49_2","first-page":"1","article-title":"Inside wearables: How the science of human behavior change offers the secret to long-term engagement","volume":"200","author":"Ledger Dan","year":"2014","unstructured":"Dan Ledger and Daniel McCaffrey. 2014. Inside wearables: How the science of human behavior change offers the secret to long-term engagement. Endeavour Partners 200, 93 (2014), 1.","journal-title":"Endeavour Partners"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.snb.2009.04.040"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1155\/2015\/548136"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.543"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2746285.2746303"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.3042908"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.3390\/s91209572"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3310194"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/4567213"},{"key":"e_1_3_2_58_2","volume-title":"ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion","author":"McGilloway Sin\u00e9ad","year":"2000","unstructured":"Sin\u00e9ad McGilloway, Roddy Cowie, Ellen Douglas-Cowie, Stan Gielen, Machiel Westerdijk, and Sybert Stroeve. 2000. Approaching automatic recognition of emotion from voice: A rough benchmark. In ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion."},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/tnsm.2018.2815280"},{"key":"e_1_3_2_60_2","unstructured":"H. Mo S. Ding S. Yang X. Zheng and A. V. Vasilakos. 2020. The role of edge robotics as-a-service in monitoring COVID-19 infection."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742674"},{"key":"e_1_3_2_62_2","article-title":"Security and privacy for mobile edge caching: Challenges and solutions","author":"Ni Jianbing","year":"2020","unstructured":"Jianbing Ni, Kuan Zhang, and Athanasios V. Vasilakos. 2020. Security and privacy for mobile edge caching: Challenges and solutions. IEEE Wireless Communications 28, 3 (2021), 77\u201383.","journal-title":"IEEE Wireless Communications"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2015.2398816"},{"key":"e_1_3_2_64_2","unstructured":"EPoSS\u2014The European Technology Platform on Smart Systems Integration. 2013. EPoSS Response to the Self Assessment Exercise Launched by the European Commission for Renewed Recognition as European Technology Platform."},{"issue":"1","key":"e_1_3_2_65_2","article-title":"Under surveillance and overwrought: American Muslims\u2019 emotional and behavioral responses to government surveillance","volume":"8","author":"O\u2019Connor Alexander J.","year":"2014","unstructured":"Alexander J. O\u2019Connor and Farhana Jahan. 2014. Under surveillance and overwrought: American Muslims\u2019 emotional and behavioral responses to government surveillance. Journal of Muslim Mental Health 8, 1 (2014).","journal-title":"Journal of Muslim Mental Health"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-020-09904-8"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2005.856863"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2013.2287473"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1364\/BOE.6.004378"},{"issue":"5","key":"e_1_3_2_70_2","first-page":"8","article-title":"Walabot DIY can see into walls","volume":"76","author":"Pierce Alan","year":"2017","unstructured":"Alan Pierce. 2017. Walabot DIY can see into walls. Tech Directions 76, 5 (2017), 8.","journal-title":"Tech Directions"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1001953"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0954579405050340"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2020.2973314"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2922283"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2015.7218494"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.55.1.110"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.3390\/rs12121995"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2011.2163157"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.2013.6704479"},{"key":"e_1_3_2_80_2","unstructured":"Geophone sm 24. 2018. Retrieved October 10 2018 from https:\/\/www.sparkfun.com\/products\/11744."},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3408308.3427983"},{"key":"e_1_3_2_82_2","first-page":"37","volume-title":"2007 11th IEEE International Symposium on Wearable Computers","author":"Tapia Emmanuel Munguia","year":"2007","unstructured":"Emmanuel Munguia Tapia, Stephen S. Intille, William Haskell, Kent Larson, Julie Wright, Abby King, and Robert Friedman. 2007. Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In 2007 11th IEEE International Symposium on Wearable Computers. IEEE, 37\u201340."},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1049\/htl.2014.0077"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIRCA.2018.8597322"},{"issue":"1","key":"e_1_3_2_85_2","first-page":"1","article-title":"Using smart speakers to contactlessly monitor heart rhythms","volume":"4","author":"Wang Anran","year":"2021","unstructured":"Anran Wang, Dan Nguyen, Arun R. Sridhar, and Shyamnath Gollakota. 2021. Using smart speakers to contactlessly monitor heart rhythms. Communications Biology 4, 1 (2021), 1\u201312.","journal-title":"Communications Biology"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3161188"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3078855"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2005.857637"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3059488"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2016.12.005"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10015-011-0939-3"},{"key":"e_1_3_2_92_2","unstructured":"Zephyr. 2018. Retrieved October 10 2018 from https:\/\/www.zephyranywhere.com\/."},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2019.2925910"},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973762"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2018.08.010"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491208","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491208","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:18Z","timestamp":1750183758000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491208"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,18]]},"references-count":94,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,2,28]]}},"alternative-id":["10.1145\/3491208"],"URL":"https:\/\/doi.org\/10.1145\/3491208","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,18]]},"assertion":[{"value":"2020-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}