{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T22:40:32Z","timestamp":1774392032769,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2017,10,24]],"date-time":"2017-10-24T00:00:00Z","timestamp":1508803200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Virtual reality (VR) is a computer technique that creates an artificial environment composed of realistic images, sounds, and other sensations. Many researchers have used VR devices to generate various stimuli, and have utilized them to perform experiments or to provide treatment. In this study, the participants performed mental tasks using a VR device while physiological signals were measured: a photoplethysmogram (PPG), electrodermal activity (EDA), and skin temperature (SKT). In general, stress is an important factor that can influence the autonomic nervous system (ANS). Heart-rate variability (HRV) is known to be related to ANS activity, so we used an HRV derived from the PPG peak interval. In addition, the peak characteristics of the skin conductance (SC) from EDA and SKT variation can also reflect ANS activity; we utilized them as well. Then, we applied a kernel-based extreme-learning machine (K-ELM) to correctly classify the stress levels induced by the VR task to reflect five different levels of stress situations: baseline, mild stress, moderate stress, severe stress, and recovery. Twelve healthy subjects voluntarily participated in the study. Three physiological signals were measured in stress environment generated by VR device. As a result, the average classification accuracy was over 95% using K-ELM and the integrated feature (IT = HRV + SC + SKT). In addition, the proposed algorithm can embed a microcontroller chip since K-ELM algorithm have very short computation time. Therefore, a compact wearable device classifying stress levels using physiological signals can be developed.<\/jats:p>","DOI":"10.3390\/s17102435","type":"journal-article","created":{"date-parts":[[2017,10,24]],"date-time":"2017-10-24T10:39:18Z","timestamp":1508841558000},"page":"2435","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":127,"title":["Detection of Stress Levels from Biosignals Measured in Virtual Reality Environments Using a Kernel-Based Extreme Learning Machine"],"prefix":"10.3390","volume":"17","author":[{"given":"Dongrae","family":"Cho","sequence":"first","affiliation":[{"name":"Department of Biomedical Science and Engineering (BMSE), Institute of Integrated Technology (IIT), Gwangju Institute of Science and Technology, Gwangju 61005, Korea"}]},{"given":"Jinsil","family":"Ham","sequence":"additional","affiliation":[{"name":"Department of Biomedical Science and Engineering (BMSE), Institute of Integrated Technology (IIT), Gwangju Institute of Science and Technology, Gwangju 61005, Korea"}]},{"given":"Jooyoung","family":"Oh","sequence":"additional","affiliation":[{"name":"Department of Biomedical Science and Engineering (BMSE), Institute of Integrated Technology (IIT), Gwangju Institute of Science and Technology, Gwangju 61005, Korea"}]},{"given":"Jeanho","family":"Park","sequence":"additional","affiliation":[{"name":"Research Institute of Industrial Technology Convergence, Korea Institute of Industrial Technology, Ansan 15588, Korea"}]},{"given":"Sayup","family":"Kim","sequence":"additional","affiliation":[{"name":"Research Institute of Industrial Technology Convergence, Korea Institute of Industrial Technology, Ansan 15588, Korea"}]},{"given":"Nak-Kyu","family":"Lee","sequence":"additional","affiliation":[{"name":"Research Institute of Industrial Technology Convergence, Korea Institute of Industrial Technology, Ansan 15588, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7233-5833","authenticated-orcid":false,"given":"Boreom","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Biomedical Science and Engineering (BMSE), Institute of Integrated Technology (IIT), Gwangju Institute of Science and Technology, Gwangju 61005, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2017,10,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1207\/S15327965PLI1302_01","article-title":"Immersive virtual environment technology as a methodological tool for social psychology","volume":"13","author":"Blascovich","year":"2002","journal-title":"Psychol. Inq."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"617","DOI":"10.4088\/JCP.v62n0808","article-title":"Virtual reality exposure therapy for Vietnam veterans with posttraumatic stress disorder","volume":"62","author":"Rothbaum","year":"2001","journal-title":"J. Clin. Psychiatry"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/s10484-005-6378-y","article-title":"Stimulation of cortisol during mental task performance in a provocative virtual environment","volume":"30","author":"Bullinger","year":"2005","journal-title":"Appl. Psychophysiol. Biofeedback"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1016\/j.ijpsycho.2012.07.105","article-title":"Innovative technologies and methodologies based on integration of virtual reality and wearable systems for psychological stress treatment","volume":"85","author":"Crifaci","year":"2012","journal-title":"Int. J. Psychophysiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1016\/j.psyneuen.2010.04.003","article-title":"Cardiovascular and cortisol reactivity and habituation to a virtual reality version of the Trier Social Stress Test: A pilot study","volume":"35","author":"Jonsson","year":"2010","journal-title":"Psychoneuroendocrinology"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1109\/TBME.2007.891164","article-title":"EEG-based assessment of driver cognitive responses in a dynamic virtual-reality driving environment","volume":"54","author":"Lin","year":"2007","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/978-3-319-49655-9_16","article-title":"Assessing the Emotional State of Job Applicants Through a Virtual Reality Simulation: A Psycho-Physiological Study","volume":"181","author":"Villani","year":"2017","journal-title":"eHealth 360\u00b0"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cannon, W.B. (1929). Bodily Changes in Pain, Hunger, Fear and Rage, D. Appleton and Company.","DOI":"10.1097\/00007611-192909000-00037"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1208","DOI":"10.1126\/science.6612338","article-title":"Autonomic nervous system activity distinguishes among emotions","volume":"221","author":"Ekman","year":"1983","journal-title":"Science"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1038\/nrendo.2009.106","article-title":"Stress and disorders of the stress system","volume":"5","author":"Chrousos","year":"2009","journal-title":"Nat. Rev. Endocrinol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1126\/science.6143403","article-title":"Stress hormones: Their interaction and regulation","volume":"224","author":"Axelrod","year":"1984","journal-title":"Science"},{"key":"ref_12","unstructured":"Sun, F., Kuo, C., Cheng, H., Buthpitiya, S., Collins, P., and Griss, M. (2010). Activity-aware Mental Stress Detection Using Physiological Sensors. International Conference on Mobile Computing Applications, and Services, Springer."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.ijpsycho.2009.09.003","article-title":"Effects of explicit and implicit perseverative cognition on cardiac recovery after cognitive stress","volume":"74","author":"Verkuil","year":"2009","journal-title":"Int. J. Psychophysiol."},{"key":"ref_14","unstructured":"Webster, J.G. (1995). Medical Instrumentation: Application and Design, Wiley."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s10916-008-9186-0","article-title":"Non-constrained blood pressure monitoring using ECG and PPG for personal healthcare","volume":"33","author":"Yoon","year":"2009","journal-title":"J. Med. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1111\/j.1542-474X.1996.tb00275.x","article-title":"Heart rate variability","volume":"1","author":"Malik","year":"1996","journal-title":"Ann. Noninvasive Electrocardiol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.physbeh.2007.01.007","article-title":"Heart rate variability as a measure of autonomic regulation of cardiac activity for assessing stress and welfare in farm animals\u2014A review","volume":"92","author":"Langbein","year":"2007","journal-title":"Physiol. Behav."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bakker, J., Pechenizkiy, M., and Sidorova, N. (2011, January 11). What\u2019s your current stress level? Detection of stress patterns from GSR sensor data. Proceedings of the 2011 IEEE 11th International Conference on Data Mining Workshops (ICDMW), Washington, DC, USA.","DOI":"10.1109\/ICDMW.2011.178"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/S0167-8760(96)00713-1","article-title":"Decomposing skin conductance into tonic and phasic components","volume":"25","author":"Lim","year":"1997","journal-title":"Int. J. Psychophysiol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1152\/japplphysiol.90509.2008","article-title":"Acute norepinephrine reuptake inhibition decreases performance in normal and high ambient temperature","volume":"105","author":"Roelands","year":"2008","journal-title":"J. Appl. Physiol."},{"key":"ref_21","unstructured":"Johannes, S., R\u00fcdiger, P., Marc, S., and Manfred, R. (2016, January 20\u201324). Towards Flexible Mobile Data Collection in Healthcare. Proceedings of the 29th IEEE International Symposium on Computer-Based Medical Systems (CBMS 2016), Dublin, Ireland."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1109\/TITB.2012.2231312","article-title":"A low-complexity ECG feature extraction algorithm for mobile healthcare applications","volume":"17","author":"Mazomenos","year":"2013","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_23","unstructured":"Thyagaraju, P., and Varma, R. (2016). Design and Development of a Physiological Stress Monitoring\/Alert System Using a Wristband, Florida Institute Technology."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"394","DOI":"10.3390\/s150100394","article-title":"A real-time pinch-to-zoom motion detection by means of a surface EMG-based human-computer interface","volume":"15","author":"Kim","year":"2014","journal-title":"Sensors"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.artmed.2011.06.004","article-title":"Automatic sleep scoring: A search for an optimal combination of measures","volume":"53","year":"2011","journal-title":"Artif. Intell. Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TNSRE.2016.2618937","article-title":"EEG-based Prediction of Epileptic Seizures Using Phase Synchronization Elicited from Noise-Assisted Multivariate Empirical Mode Decomposition","volume":"25","author":"Cho","year":"2016","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s13042-011-0019-y","article-title":"Extreme learning machines: A survey","volume":"2","author":"Huang","year":"2011","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.neucom.2005.12.126","article-title":"Extreme learning machine: Theory and applications","volume":"70","author":"Huang","year":"2006","journal-title":"Neurocomputing"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1016\/j.janxdis.2010.02.001","article-title":"The relationship between job-anxiety and trait-anxiety-A differential diagnostic investigation with the Job-Anxiety-Scale and the State-Trait-Anxiety-Inventory","volume":"24","author":"Muschalla","year":"2010","journal-title":"J. Anxiety Disord."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1093\/occmed\/kqs140","article-title":"Clinical stress assessment using a visual analogue scale","volume":"62","author":"Lesage","year":"2012","journal-title":"Occup. Med."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1016\/j.compbiomed.2009.10.006","article-title":"Adaptive threshold method for the peak detection of photoplethysmographic waveform","volume":"39","author":"Shin","year":"2009","journal-title":"Comput. Biol. Med."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.cmpb.2017.06.018","article-title":"Heart rate variability metrics for fine-grained stress level assessment","volume":"148","author":"Pereira","year":"2017","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"017004","DOI":"10.1088\/2057-1976\/3\/1\/017004","article-title":"Validation of a low intrusiveness heart rate sensor for stress assessment","volume":"3","author":"Pereira","year":"2017","journal-title":"Biomed. Phys. Eng. Express"},{"key":"ref_34","unstructured":"Clifford, G. (2002). Signal Processing Methods for Heart Rate Variability, University of Oxford."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2039","DOI":"10.1152\/ajpheart.2000.278.6.H2039","article-title":"Physiological time-series analysis using approximate entropy and sample entropy","volume":"278","author":"Richman","year":"2000","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1900","DOI":"10.1109\/TBME.2006.889772","article-title":"Use of sample entropy approach to study heart rate variability in obstructive sleep apnea syndrome","volume":"54","author":"Sahakian","year":"2007","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1186\/1475-925X-10-96","article-title":"Nonlinear Heart Rate Variability features for real-life stress detection. Case study: Students under stress due to university examination","volume":"10","author":"Melillo","year":"2011","journal-title":"Biomed. Eng. Online"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.jneumeth.2005.02.001","article-title":"Separating individual skin conductance responses in a short interstimulus-interval paradigm","volume":"146","author":"Alexander","year":"2005","journal-title":"J. Neurosci. Methods"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.jneumeth.2010.04.028","article-title":"A continuous measure of phasic electrodermal activity","volume":"190","author":"Benedek","year":"2010","journal-title":"J. Neurosci. Methods"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"520","DOI":"10.3109\/10253890.2013.807243","article-title":"The effect of stress on core and peripheral body temperature in humans","volume":"16","author":"Vinkers","year":"2013","journal-title":"Stress"},{"key":"ref_41","unstructured":"Haykin, S. (2009). Neural Networks and Learning Machines, Prentice-Hall."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, B., Rong, X., and Li, Y. (2014). An improved kernel based extreme learning machine for robot execution failures. Sci. World J., 2014.","DOI":"10.1155\/2014\/906546"},{"key":"ref_43","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Rao, C.R., and Mitra, S.K. (1972). Generalized Inverse of Matrices and Its Applications, Wiley.","DOI":"10.1525\/9780520325883-032"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/10\/2435\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:48:22Z","timestamp":1760208502000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/10\/2435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,24]]},"references-count":44,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2017,10]]}},"alternative-id":["s17102435"],"URL":"https:\/\/doi.org\/10.3390\/s17102435","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,24]]}}}