{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T10:22:06Z","timestamp":1776334926439,"version":"3.51.2"},"reference-count":44,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,1,4]],"date-time":"2019-01-04T00:00:00Z","timestamp":1546560000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Many logistics companies adopt a manual order picking system. In related research, the effect of emotion and engagement on work efficiency and human errors was verified. However, related research has not established a method to predict emotion and engagement during work with high exercise intensity. Therefore, important variables for predicting the emotion and engagement during work with high exercise intensity are not clear. In this study, to clarify the mechanism of occurrence of emotion and engagement during order picking. Then, we clarify the explanatory variables which are important in predicting the emotion and engagement during work with high exercise intensity. We conducted verification experiments. We compared the accuracy of estimating human emotion and engagement by inputting pulse wave, eye movements, and movements to deep neural networks. We showed that emotion and engagement during order picking can be predicted from the behavior of the worker with an accuracy of error rate of 0.12 or less. Moreover, we have constructed a psychological model based on the questionnaire results and show that the work efficiency of workers is improved by giving them clear targets.<\/jats:p>","DOI":"10.3390\/s19010165","type":"journal-article","created":{"date-parts":[[2019,1,4]],"date-time":"2019-01-04T11:34:26Z","timestamp":1546601666000},"page":"165","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Predicting Emotion and Engagement of Workers in Order Picking Based on Behavior and Pulse Waves Acquired by Wearable Devices"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5895-3312","authenticated-orcid":false,"given":"Yusuke","family":"Kajiwara","sequence":"first","affiliation":[{"name":"Department of Production Systems Engineering and Sciences, Komatsu University, Shichomachi Nu1-3, Komatsu, Ishikawa 923-8511, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Toshihiko","family":"Shimauchi","sequence":"additional","affiliation":[{"name":"Department of Creative Community, Komatsu College, Shichomachi Nu1-3, Komatsu, Ishikawa 923-8511, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haruhiko","family":"Kimura","sequence":"additional","affiliation":[{"name":"Department of Production Systems Engineering and Sciences, Komatsu University, Shichomachi Nu1-3, Komatsu, Ishikawa 923-8511, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.ijpe.2009.05.016","article-title":"Design of the optimal feeding policy in an assembly system","volume":"121","author":"Battini","year":"2009","journal-title":"Int. J. Prod. Econ."},{"key":"ref_2","unstructured":"Tompkins, J.A., White, Y.A., Bozer, E.H., and Tanchoco, J.M.A. (2010). Facilities Planning, Wiley. [4th ed.]."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Thayer, R.E. (1990). The Biopsychology of Mood and Arousal, Oxford University Press.","DOI":"10.1093\/oso\/9780195068276.001.0001"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/02678370802393649","article-title":"Work engagement: An emerging concept in occupational health psychology","volume":"22","author":"Bakker","year":"2008","journal-title":"Work Stress"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"R941","DOI":"10.1016\/j.cub.2011.10.030","article-title":"The optimism bias","volume":"21","author":"Sharot","year":"2011","journal-title":"Curr. Biol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6508","DOI":"10.1073\/pnas.0409174102","article-title":"Positive affect and health-related neuroendocrine, cardiovascular, and inflammatory processes","volume":"102","author":"Steptoe","year":"2005","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_7","first-page":"3","article-title":"The crucial importance of employee engagement","volume":"14","author":"Woodruffe","year":"2006","journal-title":"Hum. Resour. Manag. Int. Dig."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1037\/a0017537","article-title":"Workaholism among medical residents: It is the combination of working excessively and compulsively that counts","volume":"16","author":"Schaufeli","year":"2009","journal-title":"Int. J. Stress Manag."},{"key":"ref_9","unstructured":"White, B. (2011). Employee Engagement Report, Blessing White. Retrieved."},{"key":"ref_10","first-page":"47","article-title":"Job satisfaction and motivation: How do we inspire employees?","volume":"26","author":"Alshallah","year":"2004","journal-title":"Radiol. Manag."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"412","DOI":"10.3109\/01612840.2012.762958","article-title":"Barriers to treatment engagement for depression among Latinas","volume":"34","author":"Caplan","year":"2013","journal-title":"Issues Ment. Health Nurs."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1123\/jsep.18.1.17","article-title":"Development and validation of a scale to measure optimal experience: The Flow State Scale","volume":"18","author":"Jackson","year":"1996","journal-title":"J. Sport Exerc. Psychol."},{"key":"ref_14","first-page":"55","article-title":"A Technique for the Measurement of Attitudes","volume":"140","author":"Likert","year":"1932","journal-title":"Arch. Psychol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1037\/0022-3514.54.6.1063","article-title":"Development and validation of brief measures of positive and negative affect: The PANAS scales","volume":"54","author":"Watson","year":"1988","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_16","unstructured":"Mahnke, R., Benlian, A., and Hess, T. (2014). Flow Experience in Information Systems Research: Revisiting its Conceptualization, Conditions, and Effects. ICIS."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1002\/mar.20564","article-title":"Consumer decision making on the web: A theoretical analysis and research guidelines","volume":"29","author":"Punj","year":"2012","journal-title":"Psychol. Mark."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1120","DOI":"10.1002\/job.1783","article-title":"Crafting a job on a daily basis: Contextual correlates and the link to work engage-ment","volume":"33","author":"Petrou","year":"2012","journal-title":"J. Organ. Behav."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"453","DOI":"10.2307\/3069359","article-title":"Locus of control and well-being at work: How generalizable arewestern findings?","volume":"45","author":"Spector","year":"2002","journal-title":"Acad. Manag. J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1177\/0146167200266002","article-title":"Daily well-being: The role of autonomy, competence, and relatedness","volume":"26","author":"Reis","year":"2000","journal-title":"Personal. Soc. Psychol. Bull."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1348\/096317908X357903","article-title":"Flow at work: An experience samplingapproach","volume":"82","author":"Fullagar","year":"2009","journal-title":"J. Occup. Organ. Psychol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/T-AFFC.2012.35","article-title":"Classifier-based learning of nonlinear feature manifold for visualization of emotional speech prosody","volume":"4","author":"Vayrynen","year":"2013","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4304\/jmm.1.5.1-8","article-title":"Spontaneous emotional facial expression detection","volume":"1","author":"Zeng","year":"2006","journal-title":"J. Multimedia"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1109\/TBME.2009.2038487","article-title":"A wearable sensor for unobtrusive, long-term assessment of electrodermal activity","volume":"57","author":"Poh","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1016\/j.biopsycho.2010.03.010","article-title":"Autonomic nervous system activity in emotion: A review","volume":"84","author":"Kreibig","year":"2010","journal-title":"Biol. Psychol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1109\/TITB.2011.2169804","article-title":"Development and evaluation of an ambulatory stress monitor based on wearable sensors","volume":"16","author":"Choi","year":"2012","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Cannon, W.B. (1929). Bodily Changes in Pain, Hunger, Fear and Rage, D. Appleton & Company. [2nd ed.].","DOI":"10.1097\/00007611-192909000-00037"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Van Den Broek, E.L., Lis\u00fd, V., Janssen, J.H., Westerink, J.H., Schut, M.H., and Tuinenbreijer, K. (January 2009). Affective man-machine interface: Unveiling human emotions through biosignals. International Joint Conference on Biomedical Engineering Systems and Technologies, Springer.","DOI":"10.1007\/978-3-642-11721-3_2"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/T-AFFC.2011.25","article-title":"A multimodal database for affect recognition and implicit tagging","volume":"3","author":"Soleymani","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_30","unstructured":"Schmidt, P., Reiss, A., Duerichen, R., and Van Laerhoven, K. (arXiv, 2018). Wearable affect and stress recognition: A review, arXiv."},{"key":"ref_31","first-page":"1473","article-title":"Prediction of Future Mood Using Majority Vote Based on Certainty Factor","volume":"30","author":"Kajiwara","year":"2018","journal-title":"Sens. Mater."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Oviatt, S. (2006). Human-centered design meets cognitive load theory: Designing interfaces that help people think. Proceedings of the 14th ACM international conference on Multimedia, ACM.","DOI":"10.1145\/1180639.1180831"},{"key":"ref_33","first-page":"1","article-title":"Figuring out Distraction Degree from Working Memory Consumption for Pedestrian Safety","volume":"6","author":"Uemura","year":"2017","journal-title":"Int. J. Internet Things"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2229","DOI":"10.3758\/s13414-015-0957-7","article-title":"Statistical learning modulates the direction of the first head movement in a large-scale search task","volume":"77","author":"Won","year":"2015","journal-title":"Atten. Percept. Psychophys."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1037\/xge0000271","article-title":"Pupil dilation patterns spontaneously synchronize across individuals during shared attention","volume":"146","author":"Kang","year":"2017","journal-title":"J. Exp. Psychol. Gen."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1167\/17.8.4","article-title":"Saccadic eye movements do not disrupt the deployment of feature-based attention","volume":"17","author":"Kalogeropoulou","year":"2017","journal-title":"J. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Nikolin, S., Boonstra, T.W., Loo, C.K., and Martin, D. (2017). Combined effect of prefrontal transcranial direct current stimulation and a working memory task on heart rate variability. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0181833"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"McDuff, D., Gontarek, S., and Picard, R. (2014). Remote measurement of cognitive stress via heart rate variability. Conf. Proc. IEEE Eng. Med. Biol. Soc., 2957\u20132960.","DOI":"10.1109\/EMBC.2014.6944243"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1126\/science.1736359","article-title":"Working memory","volume":"255","author":"Baddeley","year":"1992","journal-title":"Science"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ferreira, E., Ferreira, D., Kim, S., Siirtola, P., R\u00f6ning, J., Forlizzi, J.F., and Dey, A.K. (2014, January 9\u201312). Assessing real-time cognitive load based on psycho-physiological measures for younger and older adults. Proceedings of the 2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB), Orlando, FL, USA.","DOI":"10.1109\/CCMB.2014.7020692"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Solovey, E.T., Zec, M., Garcia Perez, E.A., Reimer, B., and Mehler, B. (2014). Classifying driver workload using physiological and driving performance data: Two field studies. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM.","DOI":"10.1145\/2556288.2557068"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000006","article-title":"Learning deep architectures for AI","volume":"2","author":"Bengio","year":"2009","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_43","unstructured":"Csikszentmihalyi, M. (1997). Flow and the Psychology of Discovery and Invention, HarperPerennial."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/1\/165\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:23:40Z","timestamp":1760185420000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/1\/165"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,4]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["s19010165"],"URL":"https:\/\/doi.org\/10.3390\/s19010165","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,4]]}}}