{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T18:05:18Z","timestamp":1758823518941,"version":"3.41.2"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T00:00:00Z","timestamp":1662508800000},"content-version":"vor","delay-in-days":1,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["JP21H03428, JP21H05299, JP21J10059"],"award-info":[{"award-number":["JP21H03428, JP21H05299, JP21J10059"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020959","name":"JST-Mirai Program","doi-asserted-by":"publisher","award":["JP21473170"],"award-info":[{"award-number":["JP21473170"]}],"id":[{"id":"10.13039\/501100020959","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,9,6]]},"abstract":"<jats:p>The development of a machine-learning-based human activity recognition (HAR) system using body-worn sensors is mainly composed of three phases: data collection, model training, and evaluation. During data collection, the HAR developer collects labeled data from participants wearing inertial sensors. In the model training phase, the developer trains the HAR model on the collected training data. In the evaluation phase, the developer evaluates the trained HAR model on the collected test data. When the HAR model cannot achieve the target recognition accuracy, the developer iterates the above procedures by taking certain measures, including collecting additional training data, until the re-trained model achieves the target accuracy. However, collecting labeled data for HAR requires additional time and incurs high monetary costs. In addition, it is difficult to determine the amount and type of data to collect for achieving the target accuracy while reducing costs. To address this issue, this paper proposes a new method that predicts the performance improvement of the current HAR model, i.e., it determines the level of performance improvement achievable by re-training the HAR model with additional data, before collecting the additional data. Thus, the method enables the HAR developer to establish a strategy for additional data collection by providing advice such as \"If labeled data for the Walking and Running activities from two additional participants is collected, the HAR accuracy of the current HAR model for Walking will improve by 20%.\" To achieve this, a neural network called AIP-Net is proposed to estimate the improvement in performance by analyzing the feature space of the current HAR model using the proposed entropy-based attention mechanism. The performance of AIP-Net was evaluated on eight HAR datasets using leave-one-dataset-out cross-validation.<\/jats:p>","DOI":"10.1145\/3550319","type":"journal-article","created":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T14:54:27Z","timestamp":1662562467000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Predicting Performance Improvement of Human Activity Recognition Model by Additional Data Collection"],"prefix":"10.1145","volume":"6","author":[{"given":"Kei","family":"Tanigaki","sequence":"first","affiliation":[{"name":"Osaka University, Graduate School of Information Science and Technology, Suita, Osaka, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tze Chuin","family":"Teoh","sequence":"additional","affiliation":[{"name":"Osaka University, School of Engineering, Suita, Osaka, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Naoya","family":"Yoshimura","sequence":"additional","affiliation":[{"name":"Osaka University, Graduate School of Information Science and Technology, Suita, Osaka, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takuya","family":"Maekawa","sequence":"additional","affiliation":[{"name":"Osaka University, Graduate School of Information Science and Technology, Suita, Osaka, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takahiro","family":"Hara","sequence":"additional","affiliation":[{"name":"Osaka University, Graduate School of Information Science and Technology, Suita, Osaka, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,9,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.pervasivehealth.2013.252120"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370437"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1186\/1475-925X-14-S2-S6"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24646-6_1"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxt075"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3478119","article-title":"SenseCollect: We need efficient ways to collect on-body sensor-based human activity data! Proceedings of the ACM on Interactive","volume":"5","author":"Chen Wenqiang","year":"2021","unstructured":"Wenqiang Chen, Shupei Lin, Elizabeth Thompson, and John Stankovic. 2021. SenseCollect: We need efficient ways to collect on-body sensor-based human activity data! Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1--27.","journal-title":"Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.2991\/icaita-16.2016.13"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of SAI intelligent systems conference. Springer, 1238--1250","author":"Duffy William","year":"2018","unstructured":"William Duffy, Kevin Curran, Daniel Kelly, and Tom Lunney. 2018. Addressing the problem of activity recognition with experience sampling and weak learning. In Proceedings of SAI intelligent systems conference. Springer, 1238--1250."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/SMC.2015.525"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432227"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351244"},{"volume-title":"Principal component analysis","author":"Jolliffe Ian","key":"e_1_2_1_13_1","unstructured":"Ian Jolliffe. 2002. Principal component analysis. Wiley Online Library."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","unstructured":"Katerina Karagiannaki Athanasia Panousopoulou and Panagiotis Tsakalides. 2016. The FORTH-TRACE dataset for human activity recognition of simple activities and postural transitions using a body area network. https:\/\/doi.org\/10.5281\/zenodo.841301","DOI":"10.5281\/zenodo.841301"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11517-010-0701-3"},{"key":"e_1_2_1_16_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik","year":"2014","unstructured":"Diederik Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00875"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2017.09.032"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341163.3347744"},{"key":"e_1_2_1_20_1","volume-title":"2017 IEEE International Conference on Big Data and Smart Computing (BigComp). IEEE, 131--134","author":"Lee Song-Mi","year":"2017","unstructured":"Song-Mi Lee, Sang Min Yoon, and Heeryon Cho. 2017. Human activity recognition from accelerometer data using convolutional neural network. In 2017 IEEE International Conference on Big Data and Smart Computing (BigComp). IEEE, 131--134."},{"key":"e_1_2_1_21_1","volume-title":"Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio.","author":"Lin Zhouhan","year":"2017","unstructured":"Zhouhan Lin, Minwei Feng, Cicero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio. 2017. A structured self-attentive sentence embedding. arXiv preprint arXiv:1703.03130 (2017)."},{"key":"e_1_2_1_22_1","volume-title":"Recognizing workshop activity using body worn microphones and accelerometers. In Pervasive","author":"Lukowicz Paul","year":"2004","unstructured":"Paul Lukowicz, Jamie A Ward, Holger Junker, Mathias St\u00e4ger, Gerhard Tr\u00f6ster, Amin Atrash, and Thad Starner. 2004. Recognizing workshop activity using body worn microphones and accelerometers. In Pervasive 2004. 18--32."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2011.24"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12654-3_15"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432222"},{"volume-title":"Bootstrapping personalised human activity recognition models using online active learning. In 2015 IEEE International Conference on Computer and Information Technology","author":"Miu Tudor","key":"e_1_2_1_26_1","unstructured":"Tudor Miu, Paolo Missier, and Thomas Pl\u00f6tz. 2015. Bootstrapping personalised human activity recognition models using online active learning. In 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing. IEEE, 1138--1147."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerCom53586.2022.9762388"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17112556"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131898"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.3390\/s16010115"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CHASE.2017.115"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66808-6_18"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2008.4911590"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.97"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2017.01.008"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123988"},{"volume-title":"Activity Recognition in Pervasive Intelligent Environments","author":"van Kasteren Tim","key":"e_1_2_1_37_1","unstructured":"Tim van Kasteren, Gwenn Englebienne, and Ben JA Kr\u00f6se. 2011. Human activity recognition from wireless sensor network data: Benchmark and software. In Activity Recognition in Pervasive Intelligent Environments. Springer, 165--186."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409635.1409637"},{"key":"e_1_2_1_39_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998--6008."},{"key":"e_1_2_1_40_1","volume-title":"International Conference on Machine Learning. PMLR, 6438--6447","author":"Verma Vikas","year":"2019","unstructured":"Vikas Verma, Alex Lamb, Christopher Beckham, Amir Najafi, Ioannis Mitliagkas, David Lopez-Paz, and Yoshua Bengio. 2019. Manifold mixup: Better representations by interpolating hidden states. In International Conference on Machine Learning. PMLR, 6438--6447."},{"key":"e_1_2_1_41_1","volume-title":"Mex: Multi-modal exercises dataset for human activity recognition. arXiv preprint arXiv:1908.08992","author":"Wijekoon Anjana","year":"2019","unstructured":"Anjana Wijekoon, Nirmalie Wiratunga, and Kay Cooper. 2019. Mex: Multi-modal exercises dataset for human activity recognition. arXiv preprint arXiv:1908.08992 (2019)."},{"key":"e_1_2_1_42_1","volume-title":"SPHERE: A sensor platform for healthcare in a residential environment. In Designing, developing, and facilitating smart cities","author":"Woznowski Przemyslaw","year":"2017","unstructured":"Przemyslaw Woznowski, Alison Burrows, Tom Diethe, Xenofon Fafoutis, Jake Hall, Sion Hannuna, Massimo Camplani, Niall Twomey, Michal Kozlowski, Bo Tan, et al. 2017. SPHERE: A sensor platform for healthcare in a residential environment. In Designing, developing, and facilitating smart cities. Springer, 315--333."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5220\/0005932503690377"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411836"},{"key":"e_1_2_1_45_1","first-page":"60","article-title":"Unsupervised Factory Activity Recognition with Wearable Sensors Using Process Instruction Information","volume":"3","author":"Xia Qingxin","year":"2019","unstructured":"Qingxin Xia, Atsushi Wada, Joseph Korpela, Takuya Maekawa, and Yasuo Namioka. 2019. Unsupervised Factory Activity Recognition with Wearable Sensors Using Process Instruction Information. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2 (2019), 60.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534572"},{"key":"e_1_2_1_47_1","volume-title":"mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412","author":"Zhang Hongyi","year":"2017","unstructured":"Hongyi Zhang, Moustapha Cisse, Yann N Dauphin, and David Lopez-Paz. 2017. mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 (2017)."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550319","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3550319","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3550319","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:43:23Z","timestamp":1752468203000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550319"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,6]]},"references-count":47,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9,6]]}},"alternative-id":["10.1145\/3550319"],"URL":"https:\/\/doi.org\/10.1145\/3550319","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2022,9,6]]},"assertion":[{"value":"2022-09-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}