{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,17]],"date-time":"2026-11-17T03:04:41Z","timestamp":1794884681054,"version":"4.9.1"},"reference-count":42,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,25]],"date-time":"2021-12-25T00:00:00Z","timestamp":1640390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The automatic, sensor-based assessment of human activities is highly relevant for production and logistics, to optimise the economics and ergonomics of these processes. One challenge for accurate activity recognition in these domains is the context-dependence of activities: Similar movements can correspond to different activities, depending on, e.g., the object handled or the location of the subject. In this paper, we propose to explicitly make use of such context information in an activity recognition model. Our first contribution is a publicly available, semantically annotated motion capturing dataset of subjects performing order picking and packaging activities, where context information is recorded explicitly. The second contribution is an activity recognition model that integrates movement data and context information. We empirically show that by using context information, activity recognition performance increases substantially. Additionally, we analyse which of the pieces of context information is most relevant for activity recognition. The insights provided by this paper can help others to design appropriate sensor set-ups in real warehouses for time management.<\/jats:p>","DOI":"10.3390\/s22010134","type":"journal-article","created":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T01:06:54Z","timestamp":1640567214000},"page":"134","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Context-Aware Human Activity Recognition in Industrial Processes"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4827-3206","authenticated-orcid":false,"given":"Friedrich","family":"Niemann","sequence":"first","affiliation":[{"name":"Chair of Materials Handling and Warehousing, TU Dortmund University, Joseph-von-Fraunhofer-Str. 2-4, 44227 Dortmund, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1488-4236","authenticated-orcid":false,"given":"Stefan","family":"L\u00fcdtke","sequence":"additional","affiliation":[{"name":"Institute for Enterprise Systems, University of Mannheim, L15 1, 68131 Mannheim, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Bartelt","sequence":"additional","affiliation":[{"name":"Institute for Enterprise Systems, University of Mannheim, L15 1, 68131 Mannheim, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3349-4951","authenticated-orcid":false,"given":"Michael","family":"ten Hompel","sequence":"additional","affiliation":[{"name":"Chair of Materials Handling and Warehousing, TU Dortmund University, Joseph-von-Fraunhofer-Str. 2-4, 44227 Dortmund, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Schlick, C., Bruder, R., and Luczak, H. (2018). Arbeitswirtschaft. Arbeitswissenschaft, Springer.","DOI":"10.1007\/978-3-662-56037-2"},{"key":"ref_2","unstructured":"(2021, October 22). REFA-Time Study. Available online: https:\/\/refa.de\/en\/international-global-consulting\/time-studies."},{"key":"ref_3","unstructured":"Sadowsky, V., and Ten Hompel, M. (2007). Beitrag zur Analytischen Leistungsermittlung von Kommissioniersystemen, Logistik f\u00fcr die Praxis, Verl. Praxiswissen."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lotter, B., Deuse, J., and Lotter, E. (2016). Die Prim\u00e4re Produktion, Springer.","DOI":"10.1007\/978-3-662-53212-6"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Menolotto, M., Komaris, D.S., Tedesco, S., O\u2019Flynn, B., and Walsh, M. (2020). Motion Capture Technology in Industrial Applications: A Systematic Review. Sensors, 20.","DOI":"10.3390\/s20195687"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Reining, C., Schlangen, M., Hissmann, L., ten Hompel, M., Moya, F., and Fink, G.A. (2018, January 20). Attribute Representation for Human Activity Recognition of Manual Order Picking Activities. Proceedings of the 5th International Workshop on Sensor-Based Activity Recognition and Interaction (iWOAR \u201918), New York, NY, USA.","DOI":"10.1145\/3266157.3266214"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Reining, C., Rueda, F.M., Hompel, M.t., and Fink, G.A. (2018, January 9\u201312). Towards a Framework for Semi-Automated Annotation of Human Order Picking Activities Using Motion Capturing. Proceedings of the Federated Conference on Computer Science and Information Systems, Poznan, Poland.","DOI":"10.15439\/2018F188"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Niemann, F., Reining, C., Moya Rueda, F., Nair, N.R., Steffens, J.A., Fink, G.A., and ten Hompel, M. (2020). LARa: Creating a Dataset for Human Activity Recognition in Logistics Using Semantic Attributes. Sensors, 20.","DOI":"10.3390\/s20154083"},{"key":"ref_9","first-page":"9","article-title":"Cyber-physischer Zwilling - Framework zur Generierung menschlicher Bewegungsdaten in der Intralogistik","volume":"2020","author":"Avsar","year":"2021","journal-title":"Logist. J. Proc."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Helmold, M. (2020). Lean Management And Kaizen: Fundamentals from Cases and Examples in Operations and Supply Chain Management, Springer. Management For Professionals.","DOI":"10.1007\/978-3-030-46981-8"},{"key":"ref_11","first-page":"1","article-title":"A survey on smartphone-based systems for opportunistic user context recognition","volume":"45","author":"Gluhak","year":"2013","journal-title":"ACM Comput. Surv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"798","DOI":"10.1016\/j.ijhcs.2003.11.009","article-title":"Defining and evaluating context for wearable computing","volume":"60","author":"Bristow","year":"2004","journal-title":"Int. J.-Hum.-Comput. Stud."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/MPRV.2017.3971131","article-title":"Recognizing Detailed Human Context in the Wild from Smartphones and Smartwatches","volume":"16","author":"Vaizman","year":"2017","journal-title":"IEEE Pervasive Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s00779-003-0253-8","article-title":"What we talk about when we talk about context","volume":"8","author":"Dourish","year":"2004","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1016\/S0097-8493(99)00120-X","article-title":"There is more to context than location","volume":"23","author":"Schmidt","year":"1999","journal-title":"Comput. Graph."},{"key":"ref_16","unstructured":"Niemann, F., Avsar, H., Steffens, J.A., and Nair, N.R. (2021, November 30). Context-Aware Activity Recognition in Logistics (CAARL)\u2014A Optical Motion Capture Dataset. 24 November 2021. Available online: https:\/\/doi.org\/10.5281\/zenodo.5680951."},{"key":"ref_17","unstructured":"Niemann, F., Reining, C., Moya Rueda, F., Nair, N.R., Steffens, J.A., Fink, G.A., and ten Hompel, M. (2021, October 18). Logistic Activity Recognition Challenge (LARa)\u2014A Motion Capture and Inertial Measurement Dataset. Available online: https:\/\/doi.org\/10.5281\/zenodo.3862782."},{"key":"ref_18","unstructured":"Maurice, P., Malais\u00e9, A., Ivaldi, S., Rochel, O., Amiot, C., Paris, N., Richard, G.J., and Fritzsche, L. (2021, October 18). AndyData-Lab-onePerson. Available online: https:\/\/doi.org\/10.5281\/zenodo.3254403."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1177\/0278364919882089","article-title":"Human movement and ergonomics: An industry-oriented dataset for collaborative robotics","volume":"38","author":"Maurice","year":"2019","journal-title":"Int. J. Robot. Res."},{"key":"ref_20","unstructured":"Mandery, C., Terlemez, O., Do, M., Vahrenkamp, N., and Asfour, T. (2021, October 18). KIT Whole-Body Human Motion Database. Available online: http:\/\/motion-database.humanoids.kit.edu\/."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Mandery, C., Terlemez, O., Do, M., Vahrenkamp, N., and Asfour, T. (2015, January 27\u201331). The KIT whole-body human motion database. Proceedings of the 2015 International Conference on Advanced Robotics (ICAR), Istanbul, Turkey.","DOI":"10.1109\/ICAR.2015.7251476"},{"key":"ref_22","unstructured":"Sztyler, T. (2021, October 18). DataSet\u2014Daily Log (ADL). Available online: http:\/\/sensor.informatik.uni-mannheim.de\/#dataset_dailylog."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1007\/978-3-662-53401-4_8","article-title":"Self-tracking Reloaded: Applying Process Mining to Personalized Health Care from Labeled Sensor Data","volume":"Volume 9930","author":"Koutny","year":"2016","journal-title":"Transactions on Petri Nets and Other Models of Concurrency XI"},{"key":"ref_24","unstructured":"Sztyler, T. (2021, October 18). RealWorld. Available online: https:\/\/sensor.informatik.uni-mannheim.de\/#dataset_realworld."},{"key":"ref_25","unstructured":"Vaizman, Y., Ellis, K., and Lanckriet, G. (2021, October 18). The ExtraSensory Dataset. Available online: http:\/\/extrasensory.ucsd.edu\/."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/j.patcog.2017.12.024","article-title":"Efficient dense labelling of human activity sequences from wearables using fully convolutional networks","volume":"78","author":"Yao","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Grzeszick, R., Lenk, J.M., Rueda, F.M., Fink, G.A., Feldhorst, S., and ten Hompel, M. (2017, January 21\u201322). Deep neural network based human activity recognition for the order picking process. Proceedings of the 4th International Workshop on Sensor-Based Activity Recognition and Interaction, Rostock, Germany.","DOI":"10.1145\/3134230.3134231"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ronao, C.A., and Cho, S.B. (2015, January 11). Deep convolutional neural networks for human activity recognition with smartphone sensors. Proceedings of the International Conference on Neural Information Processing, Istanbul, Turkey.","DOI":"10.1007\/978-3-319-26561-2_6"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TPAMI.2013.140","article-title":"Attribute-based classification for zero-shot visual object categorization","volume":"36","author":"Lampert","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cheng, H.T., Griss, M., Davis, P., Li, J., and You, D. (2013, January 8\u201312). Towards zero-shot learning for human activity recognition using semantic attribute sequence model. Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Zurich, Switzerland.","DOI":"10.1145\/2493432.2493511"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rueda, F.M., and Fink, G.A. (2018). Learning Attribute Representation for Human Activity Recognition. arXiv.","DOI":"10.1109\/ICPR.2018.8545146"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.procs.2017.06.071","article-title":"Recognizing grabbing actions from inertial and video sensor data in a warehouse scenario","volume":"110","author":"Diete","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_33","unstructured":"L\u00fcdtke, S., Moya Rueda, F., Ahmed, W., Fink, G.A., and Kirste, T. (2021). Human Activity Recognition using Attribute-Based Neural Networks and Context Information. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kr\u00fcger, F., Nyolt, M., Yordanova, K., Hein, A., and Kirste, T. (2014). Computational state space models for activity and intention recognition. A feasibility study. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0109381"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"L\u00fcdtke, S., Schr\u00f6der, M., Bader, S., Kersting, K., and Kirste, T. (2018, January 13\u201319). Lifted filtering via exchangeable decomposition. Proceedings of the 27th International Joint Conference on Artificial Intelligence, Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/703"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Riboni, D., Sztyler, T., Civitarese, G., and Stuckenschmidt, H. (2016, January 12\u201316). Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.","DOI":"10.1145\/2971648.2971691"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s10209-019-00664-z","article-title":"Context awareness in healthcare: A systematic literature review","volume":"19","author":"Gubert","year":"2020","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Batista, E., Moncusi, M.A., L\u00f3pez-Aguilar, P., Mart\u00ednez-Ballest\u00e9, A., and Solanas, A. (2021). Sensors for Context-Aware Smart Healthcare: A Security Perspective. Sensors, 21.","DOI":"10.3390\/s21206886"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Avsar, H., Altermann, E., Reining, C., Rueda, F.M., Fink, G.A., and ten Hompel, M. (2021, January 22\u201326). Benchmarking Annotation Procedures for Multi-channel Time Series HAR Dataset. Proceedings of the 2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), Kassel, Germany.","DOI":"10.1109\/PerComWorkshops51409.2021.9431062"},{"key":"ref_40","unstructured":"R Core Team (2020). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_41","unstructured":"Chen, T., He, T., Benesty, M., Khotilovich, V., Tang, Y., Cho, H., Chen, K., Mitchell, R., Cano, I., and Zhou, T. (2021, October 10). Xgboost: Extreme Gradient Boosting; R package version 1.5.0.2; 2021. Available online: https:\/\/cran.r-project.org\/web\/packages\/xgboost\/vignettes\/xgboost.pdf."},{"key":"ref_42","first-page":"18","article-title":"Classification and Regression by randomForest","volume":"2","author":"Liaw","year":"2002","journal-title":"R News"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/134\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:53:29Z","timestamp":1760169209000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/134"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,25]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22010134"],"URL":"https:\/\/doi.org\/10.3390\/s22010134","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,25]]}}}