{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,8]],"date-time":"2025-09-08T06:52:50Z","timestamp":1757314370784,"version":"3.41.0"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T00:00:00Z","timestamp":1715385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2024,5,31]]},"abstract":"<jats:p>Human activity recognition\u00a0(HAR) and, more broadly, activities of daily life recognition using wearable devices have the potential to transform a number of applications, including mobile healthcare, smart homes, and fitness monitoring. Recent approaches for HAR use multiple sensors on various locations on the body to achieve higher accuracy for complex activities. While multiple sensors increase the accuracy, they are also susceptible to reliability issues when one or more sensors are unable to provide data to the application due to sensor malfunction, user error, or energy limitations. Training multiple activity classifiers that use a subset of sensors is not desirable, since it may lead to reduced accuracy for applications. To handle these limitations, we propose a novel generative approach that recovers the missing data of sensors using data available from other sensors. The recovered data are then used to seamlessly classify activities. Experiments using three publicly available activity datasets show that with data missing from one sensor, the proposed approach achieves accuracy that is within 10% of the accuracy with no missing data. Moreover, implementation on a wearable device prototype shows that the proposed approach takes about 1.5\u00a0ms for recovering data in the w-HAR dataset, which results in an energy consumption of 606\u00a0\u03bcJ. The low-energy consumption ensures that SensorGAN is suitable for effectively recovering data in tinyML applications on energy-constrained devices.<\/jats:p>","DOI":"10.1145\/3609425","type":"journal-article","created":{"date-parts":[[2023,7,14]],"date-time":"2023-07-14T12:29:47Z","timestamp":1689337787000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["SensorGAN: A Novel Data Recovery Approach for Wearable Human Activity Recognition"],"prefix":"10.1145","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1914-7526","authenticated-orcid":false,"given":"Dina","family":"Hussein","sequence":"first","affiliation":[{"name":"Washington State University, Pullman, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1085-2189","authenticated-orcid":false,"given":"Ganapati","family":"Bhat","sequence":"additional","affiliation":[{"name":"Washington State University, Pullman, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,5,11]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3563948"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485434"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-014-0095-0"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24646-6_1"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.3390\/s20185356"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1249\/MSS.0b013e3181a24536"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40279-014-0142-5"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33018009"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2017.2765202"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1002\/9780470904848"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2009.18"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1002\/mds.26642"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2010.5665861"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2019.06.007"},{"key":"e_1_3_1_16_2","unstructured":"Hardkernel. 2014. ODROID-XU3. Retrieved from https:\/\/www.hardkernel.com\/shop\/odroid-xu3\/"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.3390\/s20143811"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3508352.3549430"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE54114.2022.9774548"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2014.73"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/1964897.1964918"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/SURV.2012.110112.00192"},{"key":"e_1_3_1_23_2","first-page":"131","volume-title":"Proceedings of the IEEE International Conference on Big Data and Smart Computing (BigComp\u201917)","author":"Lee Song-Mi","year":"2017","unstructured":"Song-Mi Lee, Sang Min Yoon, and Heeryon Cho. 2017. Human activity recognition from accelerometer data using Convolutional neural network. In Proceedings of the IEEE International Conference on Big Data and Smart Computing (BigComp\u201917). IEEE, 131\u2013134."},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3414117"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1002\/mds.25628"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.3390\/s17112556"},{"key":"e_1_3_1_27_2","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke et\u00a0al. 2019. Pytorch: An imperative style, high-performance deep learning library. Adv. Neural Info. Process. Syst. 32 (2019).","journal-title":"Adv. Neural Info. Process. Syst."},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.3390\/fi12090155"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2012.13"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.3390\/s140610146"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.3390\/s150102059"},{"key":"e_1_3_1_32_2","article-title":"Conditional GAN for timeseries generation","author":"Smith Kaleb E.","year":"2020","unstructured":"Kaleb E. Smith and Anthony O. Smith. 2020. Conditional GAN for timeseries generation. Retrieved from https:\/\/arXiv:2006.16477","journal-title":"Retrieved from https:\/\/arXiv:2006.16477"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2011.21"},{"key":"e_1_3_1_34_2","article-title":"Recognizing activities and spatial context using wearable sensors","author":"Subramanya Amarnag","year":"2012","unstructured":"Amarnag Subramanya, Alvin Raj, Jeff A. Bilmes, and Dieter Fox. 2012. Recognizing activities and spatial context using wearable sensors. Retrieved from https:\/\/arXiv:1206.6869","journal-title":"Retrieved from https:\/\/arXiv:1206.6869"},{"issue":"1","key":"e_1_3_1_35_2","first-page":"3221","article-title":"Accelerating t-SNE using tree-based algorithms","volume":"15","author":"Maaten Laurens Van Der","year":"2014","unstructured":"Laurens Van Der Maaten. 2014. Accelerating t-SNE using tree-based algorithms. J. Mach. Learn. Res. 15, 1 (2014), 3221\u20133245.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2016.2545708"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.310"},{"key":"e_1_3_1_38_2","first-page":"5689","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Yoon Jinsung","year":"2018","unstructured":"Jinsung Yoon, James Jordon, and Mihaela Schaar. 2018. GAIN: Missing data imputation using generative adversarial nets. In Proceedings of the International Conference on Machine Learning. PMLR, 5689\u20135698."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2020.2983593"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCE-Asia.2016.7804737"}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3609425","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3609425","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:23Z","timestamp":1750178783000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3609425"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,11]]},"references-count":39,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,5,31]]}},"alternative-id":["10.1145\/3609425"],"URL":"https:\/\/doi.org\/10.1145\/3609425","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"type":"print","value":"1539-9087"},{"type":"electronic","value":"1558-3465"}],"subject":[],"published":{"date-parts":[[2024,5,11]]},"assertion":[{"value":"2022-09-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-04","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}