{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T17:11:37Z","timestamp":1785604297107,"version":"3.56.0"},"reference-count":54,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,2,4]],"date-time":"2020-02-04T00:00:00Z","timestamp":1580774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010665","name":"H2020 Marie Sk\u0142odowska-Curie Actions","doi-asserted-by":"publisher","award":["722022"],"award-info":[{"award-number":["722022"]}],"id":[{"id":"10.13039\/100010665","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004401","name":"Devlet Planlama \u00d6rg\u00fct\u00fc","doi-asserted-by":"publisher","award":["TAM DPT2007K120610."],"award-info":[{"award-number":["TAM DPT2007K120610."]}],"id":[{"id":"10.13039\/501100004401","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Chronic stress leads to poor well-being, and it has effects on life quality and health. Society may have significant benefits from an automatic daily life stress detection system using unobtrusive wearable devices using physiological signals. However, the performance of these systems is not sufficiently accurate when they are used in unrestricted daily life compared to the systems tested in controlled real-life and laboratory conditions. To test our stress level detection system that preprocesses noisy physiological signals, extracts features, and applies machine learning classification techniques, we used a laboratory experiment and ecological momentary assessment based data collection with smartwatches in daily life. We investigated the effect of different labeling techniques and different training and test environments. In the laboratory environments, we had more controlled situations, and we could validate the perceived stress from self-reports. When machine learning models were trained in the laboratory instead of training them with the data coming from daily life, the accuracy of the system when tested in daily life improved significantly. The subjectivity effect coming from the self-reports in daily life could be eliminated. Our system obtained higher stress level detection accuracy results compared to most of the previous daily life studies.<\/jats:p>","DOI":"10.3390\/s20030838","type":"journal-article","created":{"date-parts":[[2020,2,5]],"date-time":"2020-02-05T03:18:48Z","timestamp":1580872728000},"page":"838","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":54,"title":["How Laboratory Experiments Can Be Exploited for Monitoring Stress in the Wild: A Bridge Between Laboratory and Daily Life"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6614-0183","authenticated-orcid":false,"given":"Yekta Said","family":"Can","sequence":"first","affiliation":[{"name":"Computer Engineering Department, Bogazici University, Bebek, 34342 Istanbul, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dilara","family":"Gokay","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, Bogazici University, Bebek, 34342 Istanbul, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dilruba Reyyan","family":"K\u0131l\u0131\u00e7","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, Bogazici University, Bebek, 34342 Istanbul, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8130-3841","authenticated-orcid":false,"given":"Deniz","family":"Ekiz","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, Bogazici University, Bebek, 34342 Istanbul, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7228-4725","authenticated-orcid":false,"given":"Niaz","family":"Chalabianloo","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, Bogazici University, Bebek, 34342 Istanbul, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cem","family":"Ersoy","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, Bogazici University, Bebek, 34342 Istanbul, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,4]]},"reference":[{"key":"ref_1","unstructured":"Andreassi, J.L. (2010). Psychophysiology: Human Behavior and Physiological Response, Psychology Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.ijpsycho.2012.08.012","article-title":"Heart rate variability is associated with emotion recognition: Direct evidence for a relationship between the autonomic nervous system and social cognition","volume":"86","author":"Quintana","year":"2012","journal-title":"Int. J. Psychophysiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1111\/j.1469-8986.1997.tb02140.x","article-title":"Heart rate variability: Origins, methods, and interpretive caveats","volume":"34","author":"Berntson","year":"1997","journal-title":"Psychophysiology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1177\/107385840200800209","article-title":"Electrodermal responses: What happens in the brain","volume":"8","author":"Critchley","year":"2002","journal-title":"Neuroscientist"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1109\/TBME.2009.2038487","article-title":"A wearable sensor for unobtrusive, long-term assessment of electrodermal activity","volume":"57","author":"Poh","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2025","DOI":"10.1007\/s11135-011-9640-9","article-title":"Determinants of social desirability bias in sensitive surveys: A literature review","volume":"47","author":"Krumpal","year":"2013","journal-title":"Qual. Quant."},{"key":"ref_7","unstructured":"Northrup, D.A. (1997). The Problem of the Self-Report in Survey Research, Institute for Social Research, York University."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liapis, A., Katsanos, C., Sotiropoulos, D., Xenos, M., and Karousos, N. (2015, January 1\u20133). Stress Recognition in Human-Computer Interaction Using Physiological and Self-Reported Data: A Study of Gender Differences. Proceedings of the 19th Panhellenic Conference on Informatics, Athens, Greece.","DOI":"10.1145\/2801948.2801964"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1016\/j.cmpb.2012.07.003","article-title":"Elsarticle-template-1-numObjective measures, sensors and computational techniques for stress recognition and classification: A survey","volume":"108","author":"Sharma","year":"2012","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1146\/annurev-clinpsy-032816-044949","article-title":"Personal sensing: Understanding mental health using ubiquitous sensors and machine learning","volume":"13","author":"Mohr","year":"2017","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/MMUL.2016.38","article-title":"Automating the Recognition of Stress and Emotion: From Lab to Real-World Impact","volume":"23","author":"Picard","year":"2016","journal-title":"IEEE MultiMedia"},{"key":"ref_12","first-page":"195","article-title":"A review on wearable photoplethysmography sensors and their potential future applications in health care","volume":"4","author":"Ghamari","year":"2018","journal-title":"Int. J. Biosens. Bioelectron."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1109\/TITB.2009.2036164","article-title":"Discriminating stress from cognitive load using a wearable EDA device","volume":"14","author":"Setz","year":"2009","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zubair, M., Yoon, C., Kim, H., Kim, J., and Kim, J. (2015, January 24\u201327). Smart wearable band for stress detection. Proceedings of the 2015 5th International Conference on IT Convergence and Security (ICITCS), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICITCS.2015.7293017"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Castaldo, R., Montesinos, L., Melillo, P., Massaro, S., and Pecchia, L. (2017). To What Extent Can We Shorten HRV Analysis in Wearable Sensing? A Case Study on Mental Stress Detection. EMBEC & NBC 2017, Springer.","DOI":"10.1007\/978-981-10-5122-7_161"},{"key":"ref_16","unstructured":"Abouelenien, M., Burzo, M., and Mihalcea, R. (July, January 29). Human acute stress detection via integration of physiological signals and thermal imaging. Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Corfu Island, Greece."},{"key":"ref_17","first-page":"S271","article-title":"Real time stress detection system based on EEG signals","volume":"1","author":"Vanitha","year":"2016","journal-title":"Biomed. Res."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Can, Y.S., Chalabianloo, N., Ekiz, D., and Ersoy, C. (2019). Continuous Stress Detection Using Wearable Sensors in Real Life: Algorithmic Programming Contest Case Study. Sensors, 19.","DOI":"10.3390\/s19081849"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sandulescu, V., Andrews, S., Ellis, D., Bellotto, N., and Mozos, O.M. (2015, January 1\u20135). Stress detection using wearable physiological sensors. Proceedings of the International Work-Conference on the Interplay Between Natural and Artificial Computation, Elche, Spain.","DOI":"10.1007\/978-3-319-18914-7_55"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Tivatansakul, S., and Ohkura, M. (2015, January 25\u201329). Improvement of emotional healthcare system with stress detection from ECG signal. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.","DOI":"10.1109\/EMBC.2015.7319953"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1109\/TMSCS.2017.2703613","article-title":"Keep the Stress Away with SoDA: Stress Detection and Alleviation System","volume":"3","author":"Akmandor","year":"2017","journal-title":"IEEE Trans. Multi-Scale Comput. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/TAFFC.2016.2592504","article-title":"Individuals\u2019 stress assessment using human-smartphone interaction analysis","volume":"9","author":"Ciman","year":"2016","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hovsepian, K., Al\u2019Absi, M., Ertin, E., Kamarck, T., Nakajima, M., and Kumar, S. (2015, January 7\u201311). cStress: Towards a Gold Standard for Continuous Stress Assessment in the Mobile Environment. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Osaka, Japan.","DOI":"10.1145\/2750858.2807526"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1007\/s00779-017-1108-z","article-title":"Unobtrusive stress detection on the basis of smartphone usage data","volume":"22","author":"Vildjiounaite","year":"2018","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mishra, V., Hao, T., Sun, S., Walter, K.N., Ball, M.J., Chen, C.H., and Zhu, X. (2018, January 8\u201312). Investigating the Role of Context in Perceived Stress Detection in the Wild. Proceedings of the 2018 ACM International Joint Conference and 2018  International Symposium on Pervasive and Ubiquitous Computing and Wearable  Computers,  Singapore.","DOI":"10.1145\/3267305.3267537"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jbi.2017.08.006","article-title":"Monitoring stress with a wrist device using context","volume":"73","author":"Gjoreski","year":"2017","journal-title":"J. Biomed. Inform."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1550147718803298","DOI":"10.1177\/1550147718803298","article-title":"Photoplethysmography based psychological stress detection with pulse rate variability feature differences and elastic net","volume":"14","author":"Li","year":"2018","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lin, W.H., Wu, D., Li, C., Zhang, H., and Zhang, Y.T. (2014, January 15\u201317). Comparison of heart rate variability from PPG with that from ECG. Proceedings of the International Conference on Health Informatics, Verona, Italy.","DOI":"10.1007\/978-3-319-03005-0_54"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bolanos, M., Nazeran, H., and Haltiwanger, E. (September, January 30). Comparison of heart rate variability signal features derived from electrocardiography and photoplethysmography in healthy individuals. Proceedings of the 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, New York, NY, USA.","DOI":"10.1109\/IEMBS.2006.260607"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1080\/03091900701781317","article-title":"Assessment of heart rate variability derived from finger-tip photoplethysmography as compared to electrocardiography","volume":"32","author":"Selvaraj","year":"2008","journal-title":"J. Med. Eng. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Billeci, L., Tonacci, A., Brunori, E., Raso, R., Calderoni, S., Maestro, S., and Morales, M.A. (2019). Autonomic nervous system response during light physical activity in adolescents with anorexia nervosa measured by wearable devices. Sensors, 19.","DOI":"10.3390\/s19122820"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1038\/s41746-018-0074-9","article-title":"Large-scale wearable data reveal digital phenotypes for daily-life stress detection","volume":"1","author":"Smets","year":"2018","journal-title":"NPJ Digit. Med."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103139","DOI":"10.1016\/j.jbi.2019.103139","article-title":"Stress detection in daily life scenarios using smart phones and wearable sensors: A survey","volume":"92","author":"Can","year":"2019","journal-title":"J. Biomed. Inform."},{"key":"ref_34","unstructured":"Giannakakis, G., Grigoriadis, D., Giannakaki, K., Simantiraki, O., Roniotis, A., and Tsiknakis, M. (2019). Review on psychological stress detection using biosignals. IEEE Trans. Affect. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1159\/000119004","article-title":"The \u2018Trier Social Stress Test\u2019\u2014A tool for investigating psychobiological stress responses in a laboratory setting","volume":"28","author":"Kirschbaum","year":"1993","journal-title":"Neuropsychobiology"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"385","DOI":"10.2307\/2136404","article-title":"A global measure of perceived stress","volume":"24","author":"Cohen","year":"1983","journal-title":"J. Health Soc. Behav."},{"key":"ref_37","unstructured":"Plarre, K., Raij, A., Hossain, S.M., Ali, A.A., Nakajima, M., Al\u2019absi, M., Ertin, E., Kamarck, T., Kumar, S., and Scott, M. (2011, January 12\u201314). Continuous inference of psychological stress from sensory measurements collected in the natural environment. Proceedings of the 10th ACM\/IEEE International Conference on Information Processing in Sensor Networks, Chicago, IL, USA."},{"key":"ref_38","unstructured":"(2019, December 10). AppleWatch Series 5\u2014Apple. Available online: https:\/\/www.apple.com\/newsroom\/2019\/09\/apple-unveils-apple-watch-series-5."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1146\/annurev.clinpsy.3.022806.091415","article-title":"Ecological Momentary Assessment","volume":"4","author":"Shiffman","year":"2008","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"ref_40","unstructured":"(2018, December 05). Empatica. Available online: https:\/\/ec.europa.eu\/research\/participants\/documents\/downloadPublic\/Zjc3emJFS1pUazFRWVZ3RzVDTStGL2R3Z0tJamw2N29nZlZ2RG96c2l2MWNhNXhxVU9tTUZRPT0=\/attachment\/VFEyQTQ4M3ptUWZXRzJwcjZDUWRSMHlVRmFDUkJoS3A=."},{"key":"ref_41","unstructured":"(2018, December 05). Understanding the Stress Response. Available online: https:\/\/www.mentalhealth.org.nz\/assets\/Working-Well\/FS-understanding-stress-reponse.pdf."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1007\/s00779-011-0466-1","article-title":"Monitoring of Mental Workload Levels During an Everyday Life Office-work Scenario","volume":"17","author":"Cinaz","year":"2013","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Vander Sloten, J., Verdonck, P., Nyssen, M., and Haueisen, J. (2009, January 7\u201312). Kubios HRV\u2014A Software for Advanced Heart Rate Variability Analysis. Proceedings of the 4th European Conference of the International Federation for Medical and Biological Engineering, Munich, Germany.","DOI":"10.1007\/978-3-540-89208-3"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Taylor, S., Jaques, N., Chen, W., Fedor, S., Sano, A., and Picard, R. (2015, January 25\u201329). Automatic identification of artifacts in electrodermal activity data. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milano, Italy.","DOI":"10.1109\/EMBC.2015.7318762"},{"key":"ref_45","first-page":"797","article-title":"cvxEDA: A Convex Optimization Approach to Electrodermal Activity Processing","volume":"63","author":"Greco","year":"2016","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Gjoreski, M., Gjoreski, H., Lu\u0161trek, M., and Gams, M. (2016, January 12\u201326). Continuous Stress Detection Using a Wrist Device: In Laboratory and Real Life. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, Heidelberg, Germany.","DOI":"10.1145\/2968219.2968306"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.jbi.2015.11.007","article-title":"Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review","volume":"59","author":"Alberdi","year":"2016","journal-title":"J. Biomed. Inform."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1080\/03091900410001662350","article-title":"Sampling frequency of the RR interval time series for spectral analysis of heart rate variability","volume":"28","author":"Singh","year":"2004","journal-title":"J. Med. Eng. Technol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1109\/TKDE.2003.1245283","article-title":"Benchmarking attribute selection techniques for discrete class data mining","volume":"15","author":"Hall","year":"2003","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_50","unstructured":"Holmes, G., Donkin, A., and Witten, I.H. (1994, January 18\u201320). WEKA: A machine learning workbench. Proceedings of the ANZIIS\u201994\u2014Australian New Zealnd Intelligent Information Systems Conference, Adelaide, Australia."},{"key":"ref_51","first-page":"25","article-title":"Handling imbalanced datasets: A review","volume":"30","author":"Kotsiantis","year":"2006","journal-title":"Gests Int. Trans. Comput. Sci. Eng."},{"key":"ref_52","first-page":"191","article-title":"Ridge estimators in logistic regression","volume":"41","year":"1992","journal-title":"J. R. Stat. Soc. Ser. Appl. Stat."},{"key":"ref_53","unstructured":"Eibe, F., Hall, M., and Witten, I. (2016). The WEKA Workbench. Online Appendix for Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, Elsevier."},{"key":"ref_54","unstructured":"(2019, December 05). PSS-14, Available online: http:\/\/www.ebserh.gov.br\/sites\/default\/files\/concurso\/arqconc\/2019-12\/MINUTA%20EDITAL%20NORMATIVO_02_%20PSS%2014.2019-%20HUAP-UFF-1_ajustado%2025nov2019.pdf."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/838\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:54:41Z","timestamp":1760172881000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/838"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,4]]},"references-count":54,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20030838"],"URL":"https:\/\/doi.org\/10.3390\/s20030838","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,4]]}}}