{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T19:03:19Z","timestamp":1783710199619,"version":"3.55.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,6,21]],"date-time":"2019-06-21T00:00:00Z","timestamp":1561075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2019,6,21]]},"abstract":"<jats:p>This paper presents an unsupervised method for recognizing assembly work done by factory workers by using wearable sensor data. Such assembly work is a common part of line production systems and typically involves the factory workers performing a repetitive work process made up of a sequence of manual operations, such as setting a board on a workbench and screwing parts onto the board. This study aims to recognize the starting and ending times for individual operations in such work processes through analysis of sensor data collected from the workers along with analysis of the process instructions that detail and describe the flow of operations for each work process. We propose a particle-filter-based factory activity recognition method that leverages (i) trend changes in the sensor data detected by a nonparametric Bayesian hidden Markov model, (ii) semantic similarities between operations discovered in the process instructions, (iii) sensor-data similarities between consecutive repetitions of individual operations, and (iv) frequent sensor-data patterns (motifs) discovered in the overall assembly work processes. We evaluated the proposed method using sensor data from six workers collected in actual factories, achieving a recognition accuracy of 80% (macro-averaged F-measure).<\/jats:p>","DOI":"10.1145\/3328931","type":"journal-article","created":{"date-parts":[[2019,6,24]],"date-time":"2019-06-24T13:45:01Z","timestamp":1561383901000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":36,"title":["Unsupervised Factory Activity Recognition with Wearable Sensors Using Process Instruction Information"],"prefix":"10.1145","volume":"3","author":[{"given":"Xia","family":"Qingxin","sequence":"first","affiliation":[{"name":"Osaka University, Graduate School of Information Science and Technology, Suita, Osaka, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atsushi","family":"Wada","sequence":"additional","affiliation":[{"name":"Toshiba Corporation, Corporate Manufacturing Engineering Center, Yokohama, Kanagawa, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph","family":"Korpela","sequence":"additional","affiliation":[{"name":"Osaka University, Graduate School of Information Science and Technology, Suita, Osaka, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Takuya","family":"Maekawa","sequence":"additional","affiliation":[{"name":"Osaka University, Graduate School of Information Science and Technology, Suita, Osaka, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yasuo","family":"Namioka","sequence":"additional","affiliation":[{"name":"Toshiba Corporation, Corporate Manufacturing Engineering Center, Yokohama, Kanagawa, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,6,21]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5220\/0005216501430150"},{"key":"e_1_2_1_2_1","volume-title":"WOAR","author":"Aehnelt Mario","year":"2014","unstructured":"Mario Aehnelt , Enrico Gutzeit , and Bodo Urban . 2014 . Using activity recognition for the tracking of assembly processes: Challenges and requirements . In WOAR 2014. 12--21. Mario Aehnelt, Enrico Gutzeit, and Bodo Urban. 2014. Using activity recognition for the tracking of assembly processes: Challenges and requirements. In WOAR 2014. 12--21."},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Mario Aehnelt and Bodo Urban. 2015. The knowledge gap: providing situation-aware information assistance on the shop floor. In HCI in Business. 232--243.  Mario Aehnelt and Bodo Urban. 2015. The knowledge gap: providing situation-aware information assistance on the shop floor. In HCI in Business. 232--243.","DOI":"10.1007\/978-3-319-20895-4_22"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2809563.2809577"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2790044.2790058"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/b95631"},{"key":"e_1_2_1_7_1","volume-title":"Smart Factory--Mobile Computing in Production Environments. In the MobiSys 2004 Workshop on Applications of Mobile Embedded Systems (WAMES","author":"Bauer Martin","year":"2004","unstructured":"Martin Bauer , Lamine Jendoubi , and Oliver Siemoneit . 2004 . Smart Factory--Mobile Computing in Production Environments. In the MobiSys 2004 Workshop on Applications of Mobile Embedded Systems (WAMES 2004). Martin Bauer, Lamine Jendoubi, and Oliver Siemoneit. 2004. Smart Factory--Mobile Computing in Production Environments. In the MobiSys 2004 Workshop on Applications of Mobile Embedded Systems (WAMES 2004)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2006.87"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/11428572_4"},{"key":"e_1_2_1_10_1","volume-title":"Sequential Monte Carlo methods","author":"Doucet Arnaud","unstructured":"Arnaud Doucet . 2001. Sequential Monte Carlo methods . Wiley Online Library . Arnaud Doucet. 2001. Sequential Monte Carlo methods. Wiley Online Library."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409635.1409638"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/2567709.2502602"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2468531"},{"key":"e_1_2_1_14_1","volume-title":"UbiComp","author":"Korpela Joseph","year":"2015","unstructured":"Joseph Korpela , Ryosuke Miyaji , Takuya Maekawa , Kazunori Nozaki , and Hiroo Tamagawa . 2015. Evaluating tooth brushing performance with smartphone sound data . In UbiComp 2015 . 109--120. Joseph Korpela, Ryosuke Miyaji, Takuya Maekawa, Kazunori Nozaki, and Hiroo Tamagawa. 2015. Evaluating tooth brushing performance with smartphone sound data. In UbiComp 2015. 109--120."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2802083.2808400"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/MED.2009.5164574"},{"key":"e_1_2_1_17_1","volume-title":"the 2004 Conference on Empirical Methods in Natural Language Processing (EMNLP '04)","author":"Kudo Taku","year":"2004","unstructured":"Taku Kudo , Kaoru Yamamoto , and Yuji Matsumoto . 2004 . Applying conditional random fields to Japanese morphological analysis . In the 2004 Conference on Empirical Methods in Natural Language Processing (EMNLP '04) . 230--237. Taku Kudo, Kaoru Yamamoto, and Yuji Matsumoto. 2004. Applying conditional random fields to Japanese morphological analysis. In the 2004 Conference on Empirical Methods in Natural Language Processing (EMNLP '04). 230--237."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/11748625_1"},{"key":"e_1_2_1_19_1","volume-title":"The 2nd Workshop on Temporal Data Mining. 53--68","author":"Lin Jessica","year":"2002","unstructured":"Jessica Lin , Eamonn Keogh , Stefano Lonardi , and Pranav Patel . 2002 . Finding motifs in time series . In The 2nd Workshop on Temporal Data Mining. 53--68 . Jessica Lin, Eamonn Keogh, Stefano Lonardi, and Pranav Patel. 2002. Finding motifs in time series. In The 2nd Workshop on Temporal Data Mining. 53--68."},{"key":"e_1_2_1_20_1","volume-title":"Montage in der industriellen Produktion: Ein Handbuch f\u00fcr die Praxis","author":"Lotter Bruno","unstructured":"Bruno Lotter and Hans-Peter Wiendahl . 2013. Montage in der industriellen Produktion: Ein Handbuch f\u00fcr die Praxis . Springer-Verlag . Bruno Lotter and Hans-Peter Wiendahl. 2013. Montage in der industriellen Produktion: Ein Handbuch f\u00fcr die Praxis. Springer-Verlag."},{"key":"e_1_2_1_21_1","volume-title":"Manufacturing systems and technologies for the new frontier","author":"Lucke Dominik","unstructured":"Dominik Lucke , Carmen Constantinescu , and Engelbert Westk\u00e4mper . 2008. Smart factory-a step towards the next generation of manufacturing . In Manufacturing systems and technologies for the new frontier . Springer , 115--118. Dominik Lucke, Carmen Constantinescu, and Engelbert Westk\u00e4mper. 2008. Smart factory-a step towards the next generation of manufacturing. In Manufacturing systems and technologies for the new frontier. Springer, 115--118."},{"key":"e_1_2_1_22_1","volume-title":"Ubicomp","author":"Lukowicz Paul","year":"2002","unstructured":"Paul Lukowicz , Holger Junker , Mathias St\u00e4ger , Thomas von Bueren , and Gerhard Tr\u00f6ster . 2002. WearNET: A distributed multi-sensor system for context aware wearables . In Ubicomp 2002 . 361--370. Paul Lukowicz, Holger Junker, Mathias St\u00e4ger, Thomas von Bueren, and Gerhard Tr\u00f6ster. 2002. WearNET: A distributed multi-sensor system for context aware wearables. In Ubicomp 2002. 361--370."},{"key":"e_1_2_1_23_1","volume-title":"Recognizing workshop activity using body worn microphones and accelerometers. In Pervasive","author":"Lukowicz Paul","year":"2004","unstructured":"Paul Lukowicz , Jamie A Ward , Holger Junker , Mathias St\u00e4ger , Gerhard Tr\u00f6ster , Amin Atrash , and Thad Starner . 2004 . Recognizing workshop activity using body worn microphones and accelerometers. In Pervasive 2004. 18--32. Paul Lukowicz, Jamie A Ward, Holger Junker, Mathias St\u00e4ger, Gerhard Tr\u00f6ster, Amin Atrash, and Thad Starner. 2004. Recognizing workshop activity using body worn microphones and accelerometers. In Pervasive 2004. 18--32."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-012-0556-8"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31205-2_15"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerComW.2012.6197551"},{"key":"e_1_2_1_27_1","volume-title":"UbiComp","author":"Maekawa Takuya","year":"2016","unstructured":"Takuya Maekawa , Daisuke Nakai , Kazuya Ohara , and Yasuo Namioka . 2016. Toward practical factory activity recognition: unsupervised understanding of repetitive assembly work in a factory . In UbiComp 2016 . 1088--1099. Takuya Maekawa, Daisuke Nakai, Kazuya Ohara, and Yasuo Namioka. 2016. Toward practical factory activity recognition: unsupervised understanding of repetitive assembly work in a factory. In UbiComp 2016. 1088--1099."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2011.24"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12654-3_15"},{"key":"e_1_2_1_30_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg S Corrado and Jeff Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. In Advances in Neural Information Processing Systems 26. 3111--3119.   Tomas Mikolov Ilya Sutskever Kai Chen Greg S Corrado and Jeff Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. In Advances in Neural Information Processing Systems 26. 3111--3119."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971763.2971764"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-540-74048-3","volume-title":"Dynamic time warping. Information retrieval for music and motion","author":"M\u00fcller Meinard","year":"2007","unstructured":"Meinard M\u00fcller . 2007. Dynamic time warping. Information retrieval for music and motion ( 2007 ), 69--84. Meinard M\u00fcller. 2007. Dynamic time warping. Information retrieval for music and motion (2007), 69--84."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/2354409.2355089"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.proeng.2014.03.108"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804263"},{"key":"e_1_2_1_36_1","volume-title":"IAAI","volume":"20","author":"Ravi N.","year":"2005","unstructured":"N. Ravi , N. Dandekar , P. Mysore , and M.L. Littman . 2005. Activity recognition from accelerometer data . In IAAI 2005 , Vol. 20 . 1541--1546. N. Ravi, N. Dandekar, P. Mysore, and M.L. Littman. 2005. Activity recognition from accelerometer data. In IAAI 2005, Vol. 20. 1541--1546."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2006.286350"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2007.4373775"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807545"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1107548.1107578"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3328931","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3328931","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:54:41Z","timestamp":1750204481000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3328931"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,21]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,6,21]]}},"alternative-id":["10.1145\/3328931"],"URL":"https:\/\/doi.org\/10.1145\/3328931","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,21]]},"assertion":[{"value":"2019-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}