{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:24:18Z","timestamp":1740122658845,"version":"3.37.3"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"23","license":[{"start":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T00:00:00Z","timestamp":1697846400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T00:00:00Z","timestamp":1697846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>One of the main challenges in the industry is having trained and efficient operators in manufacturing lines. Smart adaptive guidance systems are developed that offer assistance to the operator during assembly. Depending on the operator\u2019s level of execution, the system should be able to serve a different guidance response. This paper investigates the assessment and classification of the operator\u2019s functional state using observed task execution times. Five different classifiers are studied for operator functional state classification on task execution time series. The experiments are based on an industry case and the ground truth is provided by an expert rule-based system. Three classification scenarios are defined that segment the problem on the level of the task, the individual, or the team. Furthermore, the investigation includes the evaluation of four distinct window-size configurations. The examination of how these scenarios and window-sizes influence the studied dataset across diverse classifiers reveals that achieving enhanced accuracy necessitates a larger input dimension. In this context, Convolutional Neural Networks predominantly exhibit superior performance compared to alternative classifiers. Careful attention needs to be paid to performance over classes and skills, but results confirm the validity of the approach for data-driven operator functional state classification.<\/jats:p>","DOI":"10.1007\/s10489-023-05059-5","type":"journal-article","created":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T09:02:14Z","timestamp":1697878934000},"page":"29140-29152","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Data-driven operator functional state classification in smart manufacturing"],"prefix":"10.1007","volume":"53","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6641-3452","authenticated-orcid":false,"given":"Fatemeh","family":"Besharati\u00a0Moghaddam","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angel J.","family":"Lopez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Casper","family":"Van\u00a0Gheluwe","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stijn","family":"De\u00a0Vuyst","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sidharta","family":"Gautama","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,10,21]]},"reference":[{"key":"5059_CR1","doi-asserted-by":"crossref","unstructured":"Aamir M, Zaidi SMA (2021) Clustering based semi-supervised machine learning for ddos attack classification. J King Saud Univ - Comput Inf Sci 33(4):436\u2013446","DOI":"10.1016\/j.jksuci.2019.02.003"},{"issue":"106","key":"5059_CR2","first-page":"551","volume":"212","author":"G Anand","year":"2021","unstructured":"Anand G, Nayak R (2021) Delta: Deep local pattern representation for time-series clustering and classification using visual perception. Knowl-Based Syst 212(106):551","journal-title":"Knowl-Based Syst"},{"key":"5059_CR3","unstructured":"ARKITE (2015) Arkite company official website. https:\/\/arkite.com\/. Accessed 2015"},{"key":"5059_CR4","unstructured":"Bader S, Aehnelt M (2014) Tracking assembly processes and providing assistance in smart factories. In: ICAART (1), pp 161\u2013168"},{"issue":"1","key":"5059_CR5","first-page":"55","volume":"6","author":"A Bagnasco","year":"2003","unstructured":"Bagnasco A, Chirico M, Parodi G et al (2003) A model for an open and flexible e-training platform to encourage companies\u2019 learning culture and meet employees\u2019 learning needs. J Educ Techno Soc 6(1):55\u201363","journal-title":"J Educ Techno Soc"},{"key":"5059_CR6","volume-title":"Pattern recognition and machine learning","author":"CM Bishop","year":"2006","unstructured":"Bishop CM, Nasrabadi NM (2006) Pattern recognition and machine learning, vol 4. Springer, New York"},{"key":"5059_CR7","unstructured":"Breque M, De\u00a0Nul L, Petridis A (2021) Industry 5.0: Towards more sustainable, resilient and human-centric industry. Res Innov, Eur Commission"},{"issue":"3","key":"5059_CR8","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1016\/0301-0511(95)05161-9","volume":"42","author":"EA Byrne","year":"1996","unstructured":"Byrne EA, Parasuraman R (1996) Psychophysiology and adaptive automation. Biol Psychol 42(3):249\u2013268","journal-title":"Biol Psychol"},{"issue":"3","key":"5059_CR9","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1016\/j.cmpb.2011.01.003","volume":"107","author":"J Cannon","year":"2012","unstructured":"Cannon J, Krokhmal PA, Chen Y et al (2012) Detection of temporal changes in psychophysiological data using statistical process control methods. Comput Methods Programs Biomed 107(3):367\u2013381","journal-title":"Comput Methods Programs Biomed"},{"issue":"3","key":"5059_CR10","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1016\/j.bspc.2010.03.005","volume":"5","author":"JA Cannon","year":"2010","unstructured":"Cannon JA, Krokhmal PA, Lenth RV et al (2010) An algorithm for online detection of temporal changes in operator cognitive state using real-time psychophysiological data. Biomed Signal Process Control 5(3):229\u2013236","journal-title":"Biomed Signal Process Control"},{"key":"5059_CR11","doi-asserted-by":"crossref","unstructured":"Ding L, Fang W, Luo H et al (2018) A deep hybrid learning model to detect unsafe behavior: Integrating convolution neural networks and long short-term memory. Autom Constr 86:118\u2013124","DOI":"10.1016\/j.autcon.2017.11.002"},{"issue":"101","key":"5059_CR12","first-page":"987","volume":"66","author":"M Drouot","year":"2021","unstructured":"Drouot M, Le Bigot N, Bolloc\u2019h J et al (2021) The visual impact of augmented reality during an assembly task. Displays 66(101):987","journal-title":"Displays"},{"issue":"1","key":"5059_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2379776.2379788","volume":"45","author":"P Esling","year":"2012","unstructured":"Esling P, Agon C (2012) Time-series data mining. ACM Comput Surv 45(1):1\u201334","journal-title":"ACM Comput Surv"},{"issue":"15","key":"5059_CR14","doi-asserted-by":"publisher","first-page":"5075","DOI":"10.3390\/app10155075","volume":"10","author":"P Fang","year":"2020","unstructured":"Fang P, Zhang X, Wei P et al (2020) The classification performance and mechanism of machine learning algorithms in winter wheat mapping using sentinel-2 10 m resolution imagery. Appl Sci 10(15):5075","journal-title":"Appl Sci"},{"issue":"4","key":"5059_CR15","doi-asserted-by":"publisher","first-page":"917","DOI":"10.1007\/s10618-019-00619-1","volume":"33","author":"HI Fawaz","year":"2019","unstructured":"Fawaz HI, Forestier G, Weber J et al (2019) Deep learning for time series classification: a review. Data Min Knowl Discov 33(4):917\u2013963","journal-title":"Data Min Knowl Discov"},{"key":"5059_CR16","unstructured":"Figgis J, Blackwell A, Alderson A et al (2001) What convinces enterprises to value training and learning and what does not? National Centre for Vocational Education Research"},{"issue":"113","key":"5059_CR17","first-page":"829","volume":"162","author":"Z Geler","year":"2020","unstructured":"Geler Z, Kurbalija V, Ivanovi\u0107 M et al (2020) Weighted knn and constrained elastic distances for time-series classification. Expert Syst Appl 162(113):829","journal-title":"Expert Syst Appl"},{"issue":"4","key":"5059_CR18","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1016\/0360-8352(90)90016-F","volume":"18","author":"A Genaidy","year":"1990","unstructured":"Genaidy A, Agrawal A, Mital A (1990) Computerized predetermined motion-time systems in manufacturing industries. Comput Ind Eng 18(4):571\u2013584","journal-title":"Comput Ind Eng"},{"key":"5059_CR19","unstructured":"G\u00e9ron A (2022) Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow. \" O\u2019Reilly Media, Inc.\""},{"issue":"2","key":"5059_CR20","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/s11257-010-9073-5","volume":"20","author":"A Ghazarian","year":"2010","unstructured":"Ghazarian A, Noorhosseini SM (2010) Automatic detection of users\u2019 skill levels using high-frequency user interface events. User Model User-Adapt Interact 20(2):109\u2013146","journal-title":"User Model User-Adapt Interact"},{"issue":"4","key":"5059_CR21","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1016\/j.patrec.2005.08.011","volume":"27","author":"PO Gislason","year":"2006","unstructured":"Gislason PO, Benediktsson JA, Sveinsson JR (2006) Random forests for land cover classification. Pattern Recognit Lett 27(4):294\u2013300","journal-title":"Pattern Recognit Lett"},{"key":"5059_CR22","unstructured":"Goodfellow I, Bengio Y, Courville A (2017) Deep learning (adaptive computation and machine learning series). Cambridge Massachusetts pp 321\u2013359"},{"key":"5059_CR23","unstructured":"Gulli A, Pal S (2017) Deep learning with Keras. Packt Publishing Ltd"},{"key":"5059_CR24","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The elements of statistical learning: data mining, inference, and prediction","author":"T Hastie","year":"2009","unstructured":"Hastie T, Tibshirani R, Friedman JH et al (2009) The elements of statistical learning: data mining, inference, and prediction, vol 2. Springer, New York"},{"key":"5059_CR25","volume-title":"Operator functional state: the assessment and prediction of human performance degradation in complex tasks,","author":"GRJ Hockey","year":"2003","unstructured":"Hockey GRJ (2003) Operator functional state: the assessment and prediction of human performance degradation in complex tasks, vol 355. IOS Press"},{"key":"5059_CR26","doi-asserted-by":"crossref","unstructured":"Hoon GK, Min GK, Wong O et al (2015) Classifly: Classification of experts by their expertise on the fly. In: 2015 IEEE\/WIC\/ACM international conference on web intelligence and intelligent agent technology (WI-IAT), IEEE, pp 245\u2013246","DOI":"10.1109\/WI-IAT.2015.63"},{"issue":"107","key":"5059_CR27","first-page":"024","volume":"97","author":"BK Iwana","year":"2020","unstructured":"Iwana BK, Uchida S (2020) Time series classification using local distance-based features in multi-modal fusion networks. Pattern Recognit 97(107):024","journal-title":"Pattern Recognit"},{"key":"5059_CR28","doi-asserted-by":"crossref","unstructured":"Knoch S, Herbig N, Ponpathirkoottam S et al (2018) Enhancing process data in manual assembly workflows. In: International Conference on Business Process Management, Springer, pp 269\u2013280","DOI":"10.1007\/978-3-030-11641-5_21"},{"issue":"770","key":"5059_CR29","first-page":"000","volume":"12","author":"A Kostenko","year":"2022","unstructured":"Kostenko A, Rauffet P, Coppin G (2022) Supervised classification of operator functional state based on physiological data: Application to drones swarm piloting. Front Psychol 12(770):000","journal-title":"Front Psychol"},{"issue":"103","key":"5059_CR30","first-page":"577","volume":"116","author":"K Kourou","year":"2020","unstructured":"Kourou K, Rigas G, Papaloukas C et al (2020) Cancer classification from time series microarray data through regulatory dynamic bayesian networks. Comput Biol Med 116(103):577","journal-title":"Comput Biol Med"},{"key":"5059_CR31","doi-asserted-by":"crossref","unstructured":"Liang Z, Wang H (2021) Efficient class-specific shapelets learning for interpretable time series classification. Inf Sci 570:428\u2013450","DOI":"10.1016\/j.ins.2021.03.063"},{"key":"5059_CR32","doi-asserted-by":"crossref","unstructured":"Moghaddam FB, Lopez AJ, De\u00a0Vuyst S et al (2021) Operator\u2019s experience-level classification based on micro-assembly steps for smart factories. In: 2021 IEEE 8th international conference on industrial engineering and applications (ICIEA), IEEE, pp 142\u2013148","DOI":"10.1109\/ICIEA52957.2021.9436710"},{"issue":"3\u20134","key":"5059_CR33","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1016\/j.physa.2003.12.021","volume":"336","author":"R Muirhead","year":"2004","unstructured":"Muirhead R, Puff R (2004) A bayesian classification of heart rate variability data. Phys A: Stat Mech Appl 336(3\u20134):503\u2013513","journal-title":"Phys A: Stat Mech Appl"},{"key":"5059_CR34","unstructured":"Murphy KP (2012) Machine learning: a probabilistic perspective. MIT press"},{"key":"5059_CR35","volume-title":"Neural networks and deep learning","author":"MA Nielsen","year":"2015","unstructured":"Nielsen MA (2015) Neural networks and deep learning, vol 25. Determination press, San Francisco, CA, USA"},{"key":"5059_CR36","unstructured":"Pedregosa F, Varoquaux G, Gramfort A et al (2011) Scikit-learn: Machine learning in Python. J Mach Learn Res 12:2825\u20132830"},{"key":"5059_CR37","unstructured":"Raschka S, Mirjalili V (2017) Python machine learning: machine learning and deep learning with python. Packt Publishing Ltd"},{"key":"5059_CR38","doi-asserted-by":"crossref","unstructured":"Sinanc D, Demirezen U, Sa\u011f\u0131ro\u011flu \u015e et al (2021) Explainable credit card fraud detection with image conversion. Advances in distributed computing and artificial intelligence pp 63\u201376","DOI":"10.14201\/ADCAIJ20211016376"},{"key":"5059_CR39","unstructured":"Stanton N, Salmon PM, Rafferty LA (2013) Human factors methods: a practical guide for engineering and design. Ashgate Publishing, Ltd"},{"key":"5059_CR40","doi-asserted-by":"crossref","unstructured":"Tran TM, Le XMT, Nguyen HT et al (2019) A novel non-parametric method for time series classification based on k-nearest neighbors and dynamic time warping barycenter averaging. Eng Appl Artif Intell 78:173\u2013185","DOI":"10.1016\/j.engappai.2018.11.009"},{"issue":"1","key":"5059_CR41","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/j.cirp.2019.04.052","volume":"68","author":"M Urgo","year":"2019","unstructured":"Urgo M, Tarabini M, Tolio T (2019) A human modelling and monitoring approach to support the execution of manufacturing operations. CIRP Ann 68(1):5\u20138","journal-title":"CIRP Ann"},{"issue":"106","key":"5059_CR42","first-page":"934","volume":"220","author":"Z Xiao","year":"2021","unstructured":"Xiao Z, Xu X, Zhang H et al (2021) A new multi-process collaborative architecture for time series classification. Knowl-Based Syst 220(106):934","journal-title":"Knowl-Based Syst"},{"issue":"1","key":"5059_CR43","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.cmpb.2013.09.007","volume":"113","author":"Z Yin","year":"2014","unstructured":"Yin Z, Zhang J (2014) Operator functional state classification using least-square support vector machine based recursive feature elimination technique. Comput Methods Programs Biomed 113(1):101\u2013115","journal-title":"Comput Methods Programs Biomed"},{"issue":"102","key":"5059_CR44","first-page":"607","volume":"121","author":"Y Zhao","year":"2021","unstructured":"Zhao Y, Yang J, Bao Y et al (2021) Trustworthy authorization method for security in industrial internet of things. Ad Hoc Netw 121(102):607","journal-title":"Ad Hoc Netw"},{"key":"5059_CR45","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1016\/j.procir.2021.11.187","volume":"104","author":"V Zogopoulos","year":"2021","unstructured":"Zogopoulos V, Birem M, De Geest R et al (2021) Image-based state tracking in augmented reality supported assembly operations. Procedia CIRP 104:1113\u20131118","journal-title":"Procedia CIRP"},{"key":"5059_CR46","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/j.neucom.2019.08.023","volume":"367","author":"X Zou","year":"2019","unstructured":"Zou X, Wang Z, Li Q et al (2019) Integration of residual network and convolutional neural network along with various activation functions and global pooling for time series classification. Neurocomputing 367:39\u201345","journal-title":"Neurocomputing"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-05059-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-023-05059-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-05059-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T14:26:15Z","timestamp":1701267975000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-023-05059-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,21]]},"references-count":46,"journal-issue":{"issue":"23","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["5059"],"URL":"https:\/\/doi.org\/10.1007\/s10489-023-05059-5","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"type":"print","value":"0924-669X"},{"type":"electronic","value":"1573-7497"}],"subject":[],"published":{"date-parts":[[2023,10,21]]},"assertion":[{"value":"27 September 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest\/Competing interests"}},{"value":"All the authors participate in preparing the paper, read and approved the final manuscript to be sent to the journal for publication.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval, Consent to participate, Consent for publication"}}]}}