{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:22:42Z","timestamp":1785543762573,"version":"3.56.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T00:00:00Z","timestamp":1640563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Key Research Program of Frontier Sciences, CAS","award":["QYZDY-SSW-JSC002"],"award-info":[{"award-number":["QYZDY-SSW-JSC002"]}]},{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2018YFB0803400"],"award-info":[{"award-number":["2018YFB0803400"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"China National Natural Science Foundation","doi-asserted-by":"crossref","award":["61822209, 61932016, 61625205, 62132018"],"award-info":[{"award-number":["61822209, 61932016, 61625205, 62132018"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,12,27]]},"abstract":"<jats:p>Leveraging sensor data of mobile devices and wearables, activity detection is a critical task in various intelligent systems. Most recent work train deep models to improve the accuracy of recognizing specific human activities, which, however, rely on specially collected and accurately labeled sensor data. It is labor-intensive and time-consuming to collect and label large-scale sensor data that cover various people, mobile devices, and environments. In production scenarios, on the one hand, the lack of accurately labeled sensor data poses significant challenges to the detection of key activities; on the other hand, massive continuously generated sensor data attached with inexact information is severely underutilized. For example, in an on-demand food delivery system, detecting the key activity that the rider gets off his\/her motorcycle to hand food over to the customer is essential for predicting the exact delivery time. Nevertheless, the system has only the raw sensor data and the clicking \"finish delivery\" events, which are highly relevant to the key activity but very inexact, since different riders may click \"finish delivery\" at any time in the last-mile delivery. Without exact labels of key activities, in this work, we propose a system, named KATN, to detect the exact regions of key activities based on inexact supervised learning. We design a novel siamese key activity attention network (SAN) to learn both discriminative and detailed sequential features of the key activity under the supervision of inexact labels. By interpreting the behaviors of SAN, an exact time estimation method is devised. We also provide a personal adaptation mechanism to cope with diverse habits of users. Extensive experiments on both public datasets and data from a real-world food delivery system testify the significant advantages of our design. Furthermore, based on KATN, we propose a novel user-friendly annotation mechanism to facilitate the annotation of large-scale sensor data for a wide range of applications.<\/jats:p>","DOI":"10.1145\/3494957","type":"journal-article","created":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T17:40:33Z","timestamp":1640886033000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["KATN"],"prefix":"10.1145","volume":"5","author":[{"given":"Xuanke","family":"You","sequence":"first","affiliation":[{"name":"University of Science and Technology of China, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lan","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haikuo","family":"Yu","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mu","family":"Yuan","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiang-Yang","family":"Li","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,12,30]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Roy Adams and Benjamin M Marlin. 2018. Learning Time Series Segmentation Models from Temporally Imprecise Labels.. In UAI. 135--144. Roy Adams and Benjamin M Marlin. 2018. Learning Time Series Segmentation Models from Temporally Imprecise Labels.. In UAI. 135--144."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2017.08.017"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Bandar Almaslukh A. M. Artoli and J. Al-Muhtadi. 2018. A Robust Deep Learning Approach for Position-Independent Smartphone-Based Human Activity Recognition. Sensors (Basel Switzerland) 18 (2018). Bandar Almaslukh A. M. Artoli and J. Al-Muhtadi. 2018. A Robust Deep Learning Approach for Position-Independent Smartphone-Based Human Activity Recognition. Sensors (Basel Switzerland) 18 (2018).","DOI":"10.3390\/s18113726"},{"key":"e_1_2_1_4_1","doi-asserted-by":"crossref","unstructured":"D. Anguita A. Ghio L. Oneto X. Parra and Jorge Luis Reyes-Ortiz. 2012. Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine. In IWAAL. D. Anguita A. Ghio L. Oneto X. Parra and Jorge Luis Reyes-Ortiz. 2012. Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine. In IWAAL.","DOI":"10.1007\/978-3-642-35395-6_30"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Gentry Atkinson and Vangelis Metsis. 2021. TSAR: a Time Series Assisted Relabeling Tool for Reducing Label Noise. (2021). Gentry Atkinson and Vangelis Metsis. 2021. TSAR: a Time Series Assisted Relabeling Tool for Reducing Label Noise. (2021).","DOI":"10.1145\/3453892.3453900"},{"key":"e_1_2_1_6_1","volume-title":"Rethinking Class Activation Mapping for Weakly Supervised Object Localization. In European Conference on Computer Vision. Springer, 618--634","author":"Bae Wonho","year":"2020","unstructured":"Wonho Bae , Junhyug Noh , and Gunhee Kim . 2020 . Rethinking Class Activation Mapping for Weakly Supervised Object Localization. In European Conference on Computer Vision. Springer, 618--634 . Wonho Bae, Junhyug Noh, and Gunhee Kim. 2020. Rethinking Class Activation Mapping for Weakly Supervised Object Localization. In European Conference on Computer Vision. Springer, 618--634."},{"key":"e_1_2_1_7_1","volume-title":"Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473","author":"Bahdanau Dzmitry","year":"2014","unstructured":"Dzmitry Bahdanau , Kyunghyun Cho , and Yoshua Bengio . 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 ( 2014 ). Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.10.009"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3380985"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3380985"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2019.04.004"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-012-0822-8"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161190"},{"key":"e_1_2_1_14_1","first-page":"1","article-title":"Towards reliable, automated general movement assessment for perinatal stroke screening in infants using wearable accelerometers","volume":"3","author":"Gao Yan","year":"2019","unstructured":"Yan Gao , Yang Long , Yu Guan , Anna Basu , Jessica Baggaley , and Thomas Ploetz . 2019 . Towards reliable, automated general movement assessment for perinatal stroke screening in infants using wearable accelerometers . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3 , 1 (2019), 1 -- 22 . Yan Gao, Yang Long, Yu Guan, Anna Basu, Jessica Baggaley, and Thomas Ploetz. 2019. Towards reliable, automated general movement assessment for perinatal stroke screening in infants using wearable accelerometers. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 1 (2019), 1--22.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2858933"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASRU.2013.6707742"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3090076"},{"key":"e_1_2_1_18_1","volume-title":"Long short-term memory. Neural computation 9, 8","author":"Hochreiter Sepp","year":"1997","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber . 1997. Long short-term memory. Neural computation 9, 8 ( 1997 ), 1735--1780. Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735--1780."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2009.09.002"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2016.08.017"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3214269"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2010.11.005"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00745"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2017.7917595"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2019.2930913"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341163.3347744"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCAS.2010.5537907"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Haojie Ma Wenzhong Li Xiao Zhang Songcheng Gao and Sanglu Lu. 2019. AttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition.. In IJCAI. 3109--3115. Haojie Ma Wenzhong Li Xiao Zhang Songcheng Gao and Sanglu Lu. 2019. AttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition.. In IJCAI. 3109--3115.","DOI":"10.24963\/ijcai.2019\/431"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.3390\/s100201154"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2018.2858559"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP40776.2020.9053609"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267242.3267287"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/9762098"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369818"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130959"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1108\/IJRDM-02-2020-0043"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3390\/s140610146"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2017.7952264"},{"key":"e_1_2_1_39_1","unstructured":"Eu Wern Teh Mrigank Rochan and Yang Wang. 2016. Attention Networks for Weakly Supervised Object Localization.. In BMVC. 1--11. Eu Wern Teh Mrigank Rochan and Yang Wang. 2016. Attention Networks for Weakly Supervised Object Localization.. In BMVC. 1--11."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2494091.2496039"},{"key":"e_1_2_1_41_1","volume-title":"Attention is all you need. arXiv preprint arXiv:1706.03762","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , Lukasz Kaiser , and Illia Polosukhin . 2017. Attention is all you need. arXiv preprint arXiv:1706.03762 ( 2017 ). Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. arXiv preprint arXiv:1706.03762 (2017)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.683"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2018.02.010"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2019.2917225"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2890793"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682847"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267242.3267286"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314420"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/PASSAT\/SocialCom.2011.193"},{"key":"e_1_2_1_50_1","volume-title":"Workshops at the Twenty-Fifth AAAI Conference on Artificial Intelligence.","author":"Zhao Liyue","year":"2011","unstructured":"Liyue Zhao , Gita Sukthankar , and Rahul Sukthankar . 2011 . Robust active learning using crowdsourced annotations for activity recognition . In Workshops at the Twenty-Fifth AAAI Conference on Artificial Intelligence. Liyue Zhao, Gita Sukthankar, and Rahul Sukthankar. 2011. Robust active learning using crowdsourced annotations for activity recognition. In Workshops at the Twenty-Fifth AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.319"},{"key":"e_1_2_1_52_1","volume-title":"XHAR: Deep Domain Adaptation for Human Activity Recognition with Smart Devices. In 2020 17th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). IEEE, 1--9.","author":"Zhou Zhijun","year":"2020","unstructured":"Zhijun Zhou , Yingtian Zhang , Xiaojing Yu , Panlong Yang , Xiang-Yang Li , Jing Zhao , and Hao Zhou . 2020 . XHAR: Deep Domain Adaptation for Human Activity Recognition with Smart Devices. In 2020 17th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). IEEE, 1--9. Zhijun Zhou, Yingtian Zhang, Xiaojing Yu, Panlong Yang, Xiang-Yang Li, Jing Zhao, and Hao Zhou. 2020. XHAR: Deep Domain Adaptation for Human Activity Recognition with Smart Devices. In 2020 17th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). IEEE, 1--9."},{"key":"e_1_2_1_53_1","volume-title":"A brief introduction to weakly supervised learning. National science review 5, 1","author":"Zhou Zhi-Hua","year":"2018","unstructured":"Zhi-Hua Zhou . 2018. A brief introduction to weakly supervised learning. National science review 5, 1 ( 2018 ), 44--53. Zhi-Hua Zhou. 2018. A brief introduction to weakly supervised learning. National science review 5, 1 (2018), 44--53."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403307"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494957","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3494957","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:59Z","timestamp":1750191539000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494957"}},"subtitle":["Key Activity Detection via Inexact Supervised Learning"],"short-title":[],"issued":{"date-parts":[[2021,12,27]]},"references-count":54,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12,27]]}},"alternative-id":["10.1145\/3494957"],"URL":"https:\/\/doi.org\/10.1145\/3494957","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,27]]},"assertion":[{"value":"2021-12-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}