{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T16:31:56Z","timestamp":1781281916928,"version":"3.54.1"},"reference-count":49,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T00:00:00Z","timestamp":1600300800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Stress is subjective and is manifested differently from one person to another. Thus, the performance of generic classification models that classify stress status is crude. Building a person-specific model leads to a reliable classification, but it requires the collection of new data to train a new model for every individual and needs periodic upgrades because stress is dynamic. In this paper, a new binary classification (called stressed and non-stressed) approach is proposed for a subject\u2019s stress state in which the inter-beat intervals extracted from a photoplethysomogram (PPG) were transferred to spatial images and then to frequency domain images according to the number of consecutive. Then, the convolution neural network (CNN) was used to train and validate the classification accuracy of the person\u2019s stress state. Three types of classification models were built: person-specific models, generic classification models, and calibrated-generic classification models. The average classification accuracies achieved by person-specific models using spatial images and frequency domain images were 99.9%, 100%, and 99.8%, and 99.68%, 98.97%, and 96.4% for the training, validation, and test, respectively. By combining 20% of the samples collected from test subjects into the training data, the calibrated generic models\u2019 accuracy was improved and outperformed the generic performance across both the spatial and frequency domain images. The average classification accuracy of 99.6%, 99.9%, and 88.1%, and 99.2%, 97.4%, and 87.6% were obtained for the training set, validation set, and test set, respectively, using the calibrated generic classification-based method for the series of inter-beat interval (IBI) spatial and frequency domain images. The main contribution of this study is the use of the frequency domain images that are generated from the spatial domain images of the IBI extracted from the PPG signal to classify the stress state of the individual by building person-specific models and calibrated generic models.<\/jats:p>","DOI":"10.3390\/s20185312","type":"journal-article","created":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T08:29:43Z","timestamp":1600331383000},"page":"5312","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Stress Classification Using Photoplethysmogram-Based Spatial and Frequency Domain Images"],"prefix":"10.3390","volume":"20","author":[{"given":"Sami","family":"Elzeiny","sequence":"first","affiliation":[{"name":"Information &amp; Computing Technology, College of Science &amp; Engineering, Hamad Bin Khalifa University, P.O. Box: 34110, Education City, Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marwa","family":"Qaraqe","sequence":"additional","affiliation":[{"name":"Information &amp; Computing Technology, College of Science &amp; Engineering, Hamad Bin Khalifa University, P.O. Box: 34110, Education City, Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Can, Y.S., Chalabianloo, N., Ekiz, D., and Ersoy, C. (2019). Continuous Stress Detection Using Wearable Sensors in Real Life: Algorithmic Programming Contest Case Study. Sensors, 19.","DOI":"10.3390\/s19081849"},{"key":"ref_2","unstructured":"American Psychological Assocuation (2020, August 12). Fact Sheet: Health Disparities and Stress. Available online: https:\/\/www.apa.org\/topics\/health-disparities\/fact-sheet-stress."},{"key":"ref_3","unstructured":"Center For Studies on Human Stress (CSHS) (2020, August 12). Acute Vs. Chronic Stress. Available online: https:\/\/humanstress.ca\/stress\/understand-your-stress\/acute-vs-chronic-stress\/."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.cmpb.2017.06.018","article-title":"Heart rate variability metrics for fine-grained stress level assessment","volume":"148","author":"Pereira","year":"2017","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_5","unstructured":"World Health Organization (2020, July 03). Mental health in the workplace. Available online: https:\/\/www.who.int\/mental_health\/in_the_workplace\/en\/."},{"key":"ref_6","unstructured":"(2020, July 03). American Psychological Association. Available online: Https:\/\/www.apa.org\/topics\/stress\/."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"374","DOI":"10.5455\/medarh.2013.67.374-377","article-title":"Salivary cortisol levels as a biological marker of stress reaction","volume":"67","author":"Bozovic","year":"2013","journal-title":"Med. Arch."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.psyneuen.2008.10.026","article-title":"Salivary cortisol as a biomarker in stress research","volume":"34","author":"Hellhammer","year":"2009","journal-title":"Psychoneuroendocrinology"},{"key":"ref_9","unstructured":"Mert, S., Mudassir, R., Mohammad Reza, A., Sediqeh, S., Iman, H., and Ali, C. (2019, January 19\u201322). Psychological Stress Detection Using Photoplethysmography. Proceedings of the 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Chicago, IL, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Li, F., Xu, P., Zheng, S., Chen, W., Yan, Y., Lu, S., and Liu, Z. (2018). Photoplethysmography based psychological stress detection with pulse rate variability feature differences and elastic net. Int. J. Distrib. Sens. Netw., 14.","DOI":"10.1177\/1550147718803298"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"054001","DOI":"10.1088\/1361-6579\/aabe6a","article-title":"Assessing mental stress from the photoplethysmogram: A numerical study","volume":"39","author":"Charlton","year":"2018","journal-title":"Physiol. Meas."},{"key":"ref_12","first-page":"2945","article-title":"Can PPG be used for HRV analysis?","volume":"2016","author":"Pinheiro","year":"2016","journal-title":"Conf. Proc. IEEE Eng. Med. Biol. Soc."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zangr\u00f3niz, R., Mart\u00ednez-Rodrigo, A., L\u00f3pez, M.T., Pastor, J.M., and Fern\u00e1ndez-Caballero, A. (2018). Estimation of Mental Distress from Photoplethysmography. Appl. Sci., 8.","DOI":"10.3390\/app8010069"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, Y.T. (2014). Comparison of Heart Rate Variability from PPG with That from ECG. The International Conference on Health Informatics, Springer. IFMBE Proceedings.","DOI":"10.1007\/978-3-319-03005-0"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yoo, K., and Hyung, W. (2011, January 14\u201317). Mental stress assessment based on pulse photoplethysmography. Proceedings of the International Symposium on Consumer Electronics, ISCE, Singapore.","DOI":"10.1109\/ISCE.2011.5973841"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e10140","DOI":"10.2196\/10140","article-title":"Instant Stress: Detection of Perceived Mental Stress Through Smartphone Photoplethysmography and Thermal Imaging","volume":"6","author":"Cho","year":"2019","journal-title":"Jmir Ment. Health"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jbi.2017.08.006","article-title":"Monitoring stress with a wrist device using context","volume":"73","author":"Gjoreski","year":"2017","journal-title":"J. Biomed. Inform."},{"key":"ref_18","unstructured":"Bo\u017eidara, C., Martin, G., Jure, \u0160., Pavel, M., and Mitja, L. (2017, January 18\u201322). Monitoring Physical Activity and Mental Stress Using Wrist-Worn Device and a Smartphone. Proceedings of the Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2017, Skopje, North Macedonia. Part III."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Edirisooriya, Y.L., Rathnayake, N.A., Ariyasena, T.D., Thelijjagoda, S., Jayawickrama, N.D., and Chamindi, D.I. (2019, January 18\u201320). Smartphone-based Approach to Enhance Mindfulness Among Undergraduates with Stress. Proceedings of the 2019 14th Conference on Industrial and Information Systems (ICIIS), Industrial and Information Systems (ICIIS), Kandy, Sri Lanka.","DOI":"10.1109\/ICIIS47346.2019.9063251"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, F., Wang, Y., Wang, J., Xiong, H., Zhao, J., and Zhang, D. (2019, January 19\u201323). Assessing Mental Stress Based on Smartphone Sensing Data: An Empirical Study. Proceedings of the 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld\/SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI), Leicester, UK.","DOI":"10.1109\/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00200"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Seo, W., Kim, N., Kim, S., Lee, C., and Park, S.M. (2019). Deep ECG-Respiration Network (DeepER Net) for Recognizing Mental Stress. Sensors, 19.","DOI":"10.3390\/s19133021"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cho, Y., Bianchi-Berthouze, N., and Julier, S.J. (2017, January 23\u201326). DeepBreath: Deep Learning of Breathing Patterns for Automatic Stress Recognition using Low-Cost Thermal Imaging in Unconstrained Settings. Proceedings of the 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), San Antonio, TX, USA.","DOI":"10.1109\/ACII.2017.8273639"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cho, H.M., Park, H., Dong, S.Y., and Youn, I. (2019). Ambulatory and Laboratory Stress Detection Based on Raw Electrocardiogram Signals Using a Convolutional Neural Network. Sensors, 19.","DOI":"10.3390\/s19204408"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5397814","DOI":"10.1155\/2019\/5397814","article-title":"A Multichannel Convolutional Neural Network Architecture for the Detection of the State of Mind Using Physiological Signals from Wearable Devices","volume":"2019","author":"Chakraborty","year":"2019","journal-title":"J. Healthc. Eng."},{"key":"ref_25","unstructured":"Guan, B., Zhang, J., Sethares, W.A., Kijowski, R., and Liu, F. (2019). SpecNet: Spectral Domain Convolutional Neural Network. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Pratt, H., Williams, B., Coenen, F., and Zheng, Y. (2017). September. Fcnn: Fourier convolutional neural networks. Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Springer.","DOI":"10.1007\/978-3-319-71249-9_47"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"53731","DOI":"10.1109\/ACCESS.2019.2912273","article-title":"Spectrum Analysis of EEG Signals Using CNN to Model Patient\u2019s Consciousness Level Based on Anesthesiologists\u2019 Experience","volume":"79","author":"Liu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_28","unstructured":"Franzen, F., and Chunrong, Y. (2019, January 24\u201326). visualizing image classification in fourier domain. Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1080\/01431160600746456","article-title":"A survey of image classification methods and techniques for improving classification performance","volume":"28","author":"Lu","year":"2007","journal-title":"Int. J. Remote. Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1366\/000370203321165151","article-title":"Classification of Fourier Transform Infrared Microscopic Imaging Data of Human Breast Cells by Cluster Analysis and Artificial Neural Networks","volume":"57","author":"Zhang","year":"2003","journal-title":"Appl. Spectrosc."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.cobeha.2016.11.016","article-title":"Individual differences in stress susceptibility and stress inhibitory mechanisms","volume":"14","author":"Ebner","year":"2017","journal-title":"Curr. Opin. Behav. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/s00213-010-1879-7","article-title":"Individual differences in biological stress responses moderate the contribution of early peer victimization to subsequent depressive symptoms","volume":"214","author":"Rudolph","year":"2011","journal-title":"Psychopharmacology"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Nkurikiyeyezu, K., Yokokubo, A., and Lopez, G. (2019). The Effect of Person-Specific Biometrics in Improving Generic Stress Predictive Models. arXiv.","DOI":"10.18494\/SAM.2020.2650"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Gjoreski, M., Gjoreski, H., Lutrek, M., and Gams, M. (2015, January 15\u201317). Automatic Detection of Perceived Stress in Campus Students Using Smartphones. Proceedings of the 2015 International Conference on Intelligent Environments, Prague, Czech Republic.","DOI":"10.1109\/IE.2015.27"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Huang, J., Luo, X., and Peng, X. (2020). A Novel Classification Method for a Driver\u2019s Cognitive Stress Level by Transferring Interbeat Intervals of the ECG Signal to Pictures. Sensors, 20.","DOI":"10.3390\/s20051340"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Schmidt, P., Reiss, A., D\u00fcrichen, R., Marberger, C., and Laerhoven, K.V. (2018, January 16\u201320). Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection. Proceedings of the 20th ACM International Conference on Multimodal Interaction, Boulder, CO, USA.","DOI":"10.1145\/3242969.3242985"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1159\/000119004","article-title":"The \u2018Trier Social Stress Test\u2019\u2013A Tool for Investigating Psychobiological Stress Responses in a Laboratory Setting","volume":"28","author":"Kirschbaum","year":"1993","journal-title":"Neuropsychobiology"},{"key":"ref_38","first-page":"3238","article-title":"The Trier Social Stress Test protocol for inducing psychological stress","volume":"28","author":"Birkett","year":"1993","journal-title":"J. Vis. Exp. JoVE"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Koskim\u00e4ki, H., M\u00f6nttinen, H., Siirtola, P., Huttunen, H.L., Halonen, R., and R\u00f6ning, J. (2017, January 11). Early detection of migraine attacks based on wearable sensors: Experiences of data collection using Empatica E4. Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, Maui, HI, USA.","DOI":"10.1145\/3123024.3124434"},{"key":"ref_40","unstructured":"Empatica (2020, July 04). E4 Data-IBI Expected Signal. Available online: https:\/\/support.empatica.com\/hc\/en-us\/articles\/360030058011-E4-data-IBI-expected-signal."},{"key":"ref_41","first-page":"6525","article-title":"Inter-Beat Interval Estimation from Facial Video Based on Reliability of BVP Signals","volume":"2019","author":"Maki","year":"2019","journal-title":"Conf. Proc. IEEE Eng. Med. Biol. Soc."},{"key":"ref_42","unstructured":"Stuchi, J.A., Boccato, L., and Attux, R. (2020). Frequency learning for image classification. arXiv."},{"key":"ref_43","unstructured":"Florian, F. (2018). Image Classification in the Frequency Domain with Neural Networks and Absolute Value DCT. International Conference on Image and Signal Processing, Springer."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/j.procs.2018.05.069","article-title":"Conceptual Understanding of Convolutional Neural Network- A Deep Learning Approach","volume":"132","author":"Indolia","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.icte.2018.10.005","article-title":"Diabetes detection using deep learning algorithms","volume":"4","author":"Swapna","year":"2018","journal-title":"ICT Express"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1016\/j.procs.2018.05.041","article-title":"Automated detection of diabetes using CNN and CNN-LSTM network and heart rate signals","volume":"132","author":"Swapna","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Co\u015fkun, M., U\u00e7ar, A., Yildirim, \u00d6., and Demir, Y. (2017, January 15\u201317). Face Recognition Based on Convolutional Neural Network. Proceedings of the 2017 International Conference on Modern Electrical and Energy Systems (MEES), Kremenchuk, Ukraine.","DOI":"10.1109\/MEES.2017.8248937"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"032110","DOI":"10.1088\/1755-1315\/170\/3\/032110","article-title":"Research on Face Recognition Based on CNN","volume":"170","author":"Wang","year":"2018","journal-title":"Iop Conf. Ser. Earth Environ. Sci."},{"key":"ref_49","first-page":"258","article-title":"Emotional analysis using image processing","volume":"7","author":"Prakash","year":"2019","journal-title":"Int. J. Recent Technol. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5312\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:10:49Z","timestamp":1760177449000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5312"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,17]]},"references-count":49,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185312"],"URL":"https:\/\/doi.org\/10.3390\/s20185312","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,17]]}}}