{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T14:39:10Z","timestamp":1778251150910,"version":"3.51.4"},"reference-count":47,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,2,1]],"date-time":"2023-02-01T00:00:00Z","timestamp":1675209600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This study aims to predict emotions using biosignals collected via wrist-worn sensor and evaluate the performance of different prediction models. Two dimensions of emotions were considered: valence and arousal. The data collected by the sensor were used in conjunction with target values obtained from questionnaires. A variety of classification and regression models were compared, including Long Short-Term Memory (LSTM) models. Additionally, the effects of different normalization methods and the impact of using different sensors were studied, and the way in which the results differed between the study subjects was analyzed. The results revealed that regression models generally performed better than classification models, with LSTM regression models achieving the best results. The normalization method called baseline reduction was found to be the most effective, and when used with an LSTM-based regression model it achieved high accuracy in detecting valence (mean square error = 0.43 and R2-score = 0.71) and arousal (mean square error = 0.59 and R2-score = 0.81). Moreover, it was found that even if all biosignals were not used in the training phase, reliable models could be obtained; in fact, for certain study subjects the best results were obtained using only a few of the sensors.<\/jats:p>","DOI":"10.3390\/s23031598","type":"journal-article","created":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T01:53:54Z","timestamp":1675302834000},"page":"1598","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Predicting Emotion with Biosignals: A Comparison of Classification and Regression Models for Estimating Valence and Arousal Level Using Wearable Sensors"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5995-5421","authenticated-orcid":false,"given":"Pekka","family":"Siirtola","sequence":"first","affiliation":[{"name":"Biomimetics and Intelligent Systems Group, University of Oulu, P.O. Box 4500, FI-90014 Oulu, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5215-6889","authenticated-orcid":false,"given":"Satu","family":"Tamminen","sequence":"additional","affiliation":[{"name":"Biomimetics and Intelligent Systems Group, University of Oulu, P.O. Box 4500, FI-90014 Oulu, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0051-0268","authenticated-orcid":false,"given":"Gunjan","family":"Chandra","sequence":"additional","affiliation":[{"name":"Biomimetics and Intelligent Systems Group, University of Oulu, P.O. Box 4500, FI-90014 Oulu, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anusha","family":"Ihalapathirana","sequence":"additional","affiliation":[{"name":"Biomimetics and Intelligent Systems Group, University of Oulu, P.O. Box 4500, FI-90014 Oulu, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9993-8602","authenticated-orcid":false,"given":"Juha","family":"R\u00f6ning","sequence":"additional","affiliation":[{"name":"Biomimetics and Intelligent Systems Group, University of Oulu, P.O. Box 4500, FI-90014 Oulu, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zenonos, A., Khan, A., Kalogridis, G., Vatsikas, S., Lewis, T., and Sooriyabandara, M. (2016, January 14\u201318). HealthyOffice: Mood recognition at work using smartphones and wearable sensors. Proceedings of the 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), Sydney, Australia.","DOI":"10.1109\/PERCOMW.2016.7457166"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s11257-010-9078-0","article-title":"Towards affective camera control in games","volume":"20","author":"Yannakakis","year":"2010","journal-title":"User Model. User-Adapt. Interact."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gjoreski, M., Gjoreski, H., Lu\u0161trek, M., and Gams, M. (2016, January 12\u201316). Continuous Stress Detection Using a Wrist Device: In Laboratory and Real Life. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp \u201916), Heidelberg, Germany.","DOI":"10.1145\/2968219.2968306"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Siirtola, P. (2019, January 11\u201313). Continuous stress detection using the sensors of commercial smartwatch. Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2019 ACM International Symposium on Wearable Computers, London, UK.","DOI":"10.1145\/3341162.3344831"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Schmidt, P., Reiss, A., D\u00fcrichen, R., and Laerhoven, K.V. (2019). Wearable-Based Affect Recognition\u2014A Review. Sensors, 19.","DOI":"10.3390\/s19194079"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103139","DOI":"10.1016\/j.jbi.2019.103139","article-title":"Stress detection in daily life scenarios using smart phones and wearable sensors: A survey","volume":"92","author":"Can","year":"2019","journal-title":"J. Biomed. Inform."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1037\/0033-295X.110.1.145","article-title":"Core affect and the psychological construction of emotion","volume":"110","author":"Russell","year":"2003","journal-title":"Psychol. Rev."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"W\u00f6llmer, M., Eyben, F., Reiter, S., Schuller, B., Cox, C., Douglas-Cowie, E., and Cowie, R. (2008, January 22\u201326). Abandoning emotion classes-towards continuous emotion recognition with modelling of long-range dependencies. Proceedings of the 9th Interspeech 2008 Incorp. 12th Australasian International Conference on Speech Science and Technology SST 2008, Brisbane, Australia.","DOI":"10.21437\/Interspeech.2008-192"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mitenkova, A., Kossaifi, J., Panagakis, Y., and Pantic, M. (2019, January 14\u201318). Valence and arousal estimation in-the-wild with tensor methods. Proceedings of the 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019), Lille, France.","DOI":"10.1109\/FG.2019.8756619"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/TAFFC.2017.2781732","article-title":"Automatic ECG-Based Emotion Recognition in Music Listening","volume":"11","author":"Hsu","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1109\/TAFFC.2019.2954118","article-title":"Multiple instance learning for emotion recognition using physiological signals","volume":"13","author":"Romeo","year":"2019","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Li, F., Shirahama, K., Nisar, M.A., Huang, X., and Grzegorzek, M. (2020). Deep Transfer Learning for Time Series Data Based on Sensor Modality Classification. Sensors, 20.","DOI":"10.3390\/s20154271"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhao, B., Wang, Z., Yu, Z., and Guo, B. (2018, January 8\u201312). EmotionSense: Emotion recognition based on wearable wristband. Proceedings of the 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld\/SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI), Guangzhou, China.","DOI":"10.1109\/SmartWorld.2018.00091"},{"key":"ref_15","first-page":"1","article-title":"Recognizing emotional states with wearables while playing a serious game","volume":"70","author":"Yee","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhang, T., El Ali, A., Wang, C., Hanjalic, A., and Cesar, P. (2020). Corrnet: Fine-grained emotion recognition for video watching using wearable physiological sensors. Sensors, 21.","DOI":"10.3390\/s21010052"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"04018050","DOI":"10.1061\/(ASCE)CO.1943-7862.0001506","article-title":"Measuring workers\u2019 emotional state during construction tasks using wearable EEG","volume":"144","author":"Hwang","year":"2018","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Grundlehner, B., Brown, L., Penders, J., and Gyselinckx, B. (2009, January 3\u20135). The Design and Analysis of a Real-Time, Continuous Arousal Monitor. Proceedings of the 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks, Berkeley, CA, USA.","DOI":"10.1109\/BSN.2009.21"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nirjhar, E.H., Behzadan, A., and Chaspari, T. (2020, January 4\u20138). Exploring Bio-Behavioral Signal Trajectories of State Anxiety During Public Speaking. Proceedings of the ICASSP 2020\u20142020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9054160"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Siirtola, P., and R\u00f6ning, J. (2020). Comparison of Regression and Classification Models for User-Independent and Personal Stress Detection. Sensors, 20.","DOI":"10.3390\/s20164402"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1109\/TITS.2005.848368","article-title":"Detecting stress during real-world driving tasks using physiological sensors","volume":"6","author":"Healey","year":"2005","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_22","unstructured":"El Haouij, N. (2018). Biosignals for Driver\u2019s Stress Level Assessment: Functional Variable Selection and Fractal Characterization. [Ph.D. Thesis, Universit\u00e9 Paris-Saclay (ComUE)]."},{"key":"ref_23","unstructured":"Vos, G., Trinh, K., Sarnyai, Z., and Azghadi, M.R. (2022). Ensemble Machine Learning Model Trained on a New Synthesized Dataset Generalizes Well for Stress Prediction Using Wearable Devices. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Schmidt, P., Reiss, A., Duerichen, R., Marberger, C., and Van Laerhoven, K. (2018, January 16\u201320). Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection. Proceedings of the ACM 2018 on International Conference on Multimodal Interaction, Boulder, CO, USA.","DOI":"10.1145\/3242969.3242985"},{"key":"ref_25","unstructured":"(2021, January 07). Empatica E4. Available online: https:\/\/www.empatica.com\/e4-wristband."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1037\/0022-3514.54.6.1063","article-title":"Development and validation of brief measures of positive and negative affect: The PANAS scales","volume":"54","author":"Watson","year":"1988","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.2044-8260.1992.tb00997.x","article-title":"The development of a six-item short-form of the state scale of the Spielberger State\u2014Trait Anxiety Inventory (STAI)","volume":"31","author":"Marteau","year":"1992","journal-title":"Br. J. Clin. Psychol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/0005-7916(94)90063-9","article-title":"Measuring emotion: The self-assessment manikin and the semantic differential","volume":"25","author":"Bradley","year":"1994","journal-title":"J. Behav. Ther. Exp. Psychiatry"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mishra, V., Pope, G., Lord, S., Lewia, S., Lowens, B., Caine, K., Sen, S., Halter, R., and Kotz, D. (2018, January 8\u201312). The case for a commodity hardware solution for stress detection. Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Singapore.","DOI":"10.1145\/3267305.3267538"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Boucsein, W. (2012). Electrodermal Activity, Springer Science & Business Media.","DOI":"10.1007\/978-1-4614-1126-0"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41597-022-01643-5","article-title":"A multidevice and multimodal dataset for human energy expenditure estimation using wearable devices","volume":"9","author":"Gashi","year":"2022","journal-title":"Sci. Data"},{"key":"ref_32","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3361562","article-title":"Continuous detection of physiological stress with commodity hardware","volume":"1","author":"Mishra","year":"2020","journal-title":"ACM Trans. Comput. Healthc."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"103325","DOI":"10.1109\/ACCESS.2021.3093216","article-title":"Cognitive Load Monitoring with Wearables\u2013Lessons Learned From a Machine Learning Challenge","volume":"9","author":"Gjoreski","year":"2021","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bock, M., H\u00f6lzemann, A., Moeller, M., and Van Laerhoven, K. (2021, January 21\u201326). Improving Deep Learning for HAR with Shallow LSTMs. Proceedings of the 2021 International Symposium on Wearable Computers, Virtual Event.","DOI":"10.1145\/3460421.3480419"},{"key":"ref_37","first-page":"1612","article-title":"A short introduction to boosting","volume":"14","author":"Freund","year":"1999","journal-title":"J.-Jpn. Soc. Artif. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_40","first-page":"52","article-title":"Lightgbm: A highly efficient gradient boosting decision tree","volume":"30","author":"Ke","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013). An Introduction to Statistical Learning, Springer.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ma, Y., Liu, D., and Cai, L. (2020). Deep learning-based upper limb functional assessment using a single kinect v2 sensor. Sensors, 20.","DOI":"10.3390\/s20071903"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Schmidt, P., Reiss, A., D\u00fcrichen, R., and Van Laerhoven, K. (2018, January 8\u201312). Labelling Affective States \u201cin the Wild\u201d Practical Guidelines and Lessons Learned. Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Singapore.","DOI":"10.1145\/3267305.3267551"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Siirtola, P., Peltonen, E., Koskim\u00e4ki, H., M\u00f6nttinen, H., R\u00f6ning, J., and Pirttikangas, S. (2019, January 17\u201321). Wrist-worn Wearable Sensors to Understand Insides of the Human Body: Data Quality and Quantity. Proceedings of the 5th ACM Workshop on Wearable Systems and Applications, Seoul, Republic of Korea.","DOI":"10.1145\/3325424.3329663"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jbi.2017.08.006","article-title":"Monitoring stress with a wrist device using context","volume":"73","author":"Gjoreski","year":"2017","journal-title":"J. Biomed. Inform."},{"key":"ref_46","first-page":"3","article-title":"The Problem of Normalization and a Normalized Similarity Measure by Online Data","volume":"4","author":"Attig","year":"2011","journal-title":"Trans. Case Based Reason."},{"key":"ref_47","unstructured":"Siirtola, P., Koskim\u00e4ki, H., and R\u00f6ning, J. (2018, January 25\u201327). Personalizing human activity recognition models using incremental learning. Proceedings of the ESANN, Bruges, Belgium."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1598\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:21:12Z","timestamp":1760120472000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1598"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,1]]},"references-count":47,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23031598"],"URL":"https:\/\/doi.org\/10.3390\/s23031598","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,1]]}}}