{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T17:43:33Z","timestamp":1784655813267,"version":"3.55.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>In the last decade, a lot of attention has been given to develop artificial intelligence (AI) solutions for mental health using machine learning. To build trust in AI applications, it is crucial for AI systems to provide for practitioners and patients the reasons behind the AI decisions. This is referred to as Explainable AI. While there has been significant progress in developing stress prediction models, little work has been done to develop explainable AI for mental health.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>In this work, we address this gap by designing an explanatory AI report for stress prediction from wearable sensors. Because medical practitioners and patients are likely to be familiar with blood test reports, we modeled the look and feel of the explanatory AI on those of a standard blood test report. The report includes stress prediction and the physiological signals related to stressful episodes. In addition to the new design for explaining AI in mental health, the work includes the following contributions: Methods to automatically generate different components of the report, an approach for evaluating and validating the accuracies of the explanations, and a collection of ground truth of relationships between physiological measurements and stress prediction.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Test results showed that the explanations were consistent with ground truth. The reference intervals for stress versus non-stress were quite distinctive with little variation. In addition to the quantitative evaluations, a qualitative survey, conducted by three expert psychiatrists confirmed the usefulness of the explanation report in understanding the different aspects of the AI system.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>In this work, we have provided a new design for explainable AI used in stress prediction based on physiological measurements. Based on the report, users and medical practitioners can determine what biological features have the most impact on the prediction of stress in addition to any health-related abnormalities. The effectiveness of the explainable AI report was evaluated using a quantitative and a qualitative assessment. The stress prediction accuracy was shown to be comparable to state-of-the-art. The contributions of each physiological signal to the stress prediction was shown to correlate with ground truth. In addition to these quantitative evaluations, a qualitative survey with psychiatrists confirmed the confidence and effectiveness of the explanation report in the stress made by the AI system. Future work includes the addition of more explanatory features related to other emotional states of the patient, such as sadness, relaxation, anxiousness, or happiness.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-022-01772-2","type":"journal-article","created":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T16:02:49Z","timestamp":1644595369000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":40,"title":["Medically-oriented design for explainable AI for stress prediction from physiological measurements"],"prefix":"10.1186","volume":"22","author":[{"given":"Dalia","family":"Jaber","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hazem","family":"Hajj","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fadi","family":"Maalouf","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wassim","family":"El-Hajj","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,2,11]]},"reference":[{"key":"1772_CR1","doi-asserted-by":"crossref","unstructured":"Wijsman J, Grundlehner B, Liu H, Hermens H, Penders J. Towards mental stress detection using wearable physiological sensors. In: 2011 Annual international conference of the IEEE engineering in medicine and biology society. IEEE; 2011. pp. 1798\u2013801.","DOI":"10.1109\/IEMBS.2011.6090512"},{"issue":"10","key":"1772_CR2","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1109\/MC.2015.316","volume":"48","author":"R Sioni","year":"2015","unstructured":"Sioni R, Chittaro L. Stress detection using physiological sensors. Computer. 2015;48(10):26\u201333.","journal-title":"Computer"},{"issue":"3","key":"1772_CR3","doi-asserted-by":"publisher","first-page":"634","DOI":"10.1109\/TIM.2017.2779329","volume":"67","author":"M Choi","year":"2017","unstructured":"Choi M, Koo G, Seo M, Kim SW. Wearable device-based system to monitor a driver\u2019s stress, fatigue, and drowsiness. IEEE Trans Instrum Meas. 2017;67(3):634\u201345.","journal-title":"IEEE Trans Instrum Meas"},{"key":"1772_CR4","doi-asserted-by":"crossref","unstructured":"Ghaderi A, Frounchi J, Farnam A. Machine learning-based signal processing using physiological signals for stress detection. In: 2015 22nd Iranian conference on biomedical engineering (ICBME). IEEE; 2015. pp. 93\u20138.","DOI":"10.1109\/ICBME.2015.7404123"},{"key":"1772_CR5","unstructured":"Regulation P. General data protection regulation. Intouch. 2018."},{"issue":"5","key":"1772_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3236009","volume":"51","author":"R Guidotti","year":"2018","unstructured":"Guidotti R, Monreale A, Ruggieri S, Turini F, Giannotti F, Pedreschi D. A survey of methods for explaining black box models. ACM Comput Surv (CSUR). 2018;51(5):1\u201342.","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"1772_CR7","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C. Why should i trust you?\u201d explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining; 2016. pp. 1135\u201344.","DOI":"10.1145\/2939672.2939778"},{"key":"1772_CR8","unstructured":"Lundberg S, Lee S-I. A unified approach to interpreting model predictions. 2017. arXiv:1705.07874."},{"key":"1772_CR9","doi-asserted-by":"crossref","unstructured":"Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. In: European conference on computer vision. Springer; 2014. pp. 818\u201333.","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"1772_CR10","doi-asserted-by":"crossref","unstructured":"Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. pp. 2921\u20139.","DOI":"10.1109\/CVPR.2016.319"},{"issue":"7","key":"1772_CR11","first-page":"0130140","volume":"10","author":"S Bach","year":"2015","unstructured":"Bach S, Binder A, Montavon G, Klauschen F, M\u00fcller K-R, Samek W. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE. 2015;10(7):0130140.","journal-title":"PLoS ONE"},{"key":"1772_CR12","unstructured":"Shrikumar A, Greenside P, Kundaje A. Learning important features through propagating activation differences. In: International conference on machine learning. PMLR; 2017. pp. 3145\u20133153."},{"key":"1772_CR13","unstructured":"Centers HT. Health and wellness testing example results. https:\/\/www.healthtestingcenters.com\/health-and-wellness-testing-example-results."},{"issue":"1","key":"1772_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-56847-4","volume":"10","author":"L Wang","year":"2020","unstructured":"Wang L, Lin ZQ, Wong A. Covid-net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest x-ray images. Sci Rep. 2020;10(1):1\u201312.","journal-title":"Sci Rep"},{"key":"1772_CR15","doi-asserted-by":"crossref","unstructured":"Pereira S, Meier R, Alves V, Reyes M, Silva CA. Automatic brain tumor grading from MRI data using convolutional neural networks and quality assessment. In: Understanding and interpreting machine learning in medical image computing applications. Springer; 2018. pp. 106\u201314.","DOI":"10.1007\/978-3-030-02628-8_12"},{"key":"1772_CR16","doi-asserted-by":"crossref","unstructured":"Couteaux V, Nempont O, Pizaine G, Bloch I. Towards interpretability of segmentation networks by analyzing deepdreams. In: Interpretability of machine intelligence in medical image computing and multimodal learning for clinical decision support. Springer; 2019. pp. 56\u201363.","DOI":"10.1007\/978-3-030-33850-3_7"},{"issue":"10","key":"1772_CR17","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1038\/s41551-018-0304-0","volume":"2","author":"SM Lundberg","year":"2018","unstructured":"Lundberg SM, Nair B, Vavilala MS, Horibe M, Eisses MJ, Adams T, Liston DE, Low DK-W, Newman S-F, Kim J, et al. Explainable machine-learning predictions for the prevention of hypoxaemia during surgery. Nat Biomed Eng. 2018;2(10):749\u201360.","journal-title":"Nat Biomed Eng"},{"key":"1772_CR18","doi-asserted-by":"crossref","unstructured":"Shapley LS. A value for n-person games. In: Classics in game theory; 1997. p. 69.","DOI":"10.2307\/j.ctv173f1fh.12"},{"issue":"1","key":"1772_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-020-01332-6","volume":"20","author":"J Amann","year":"2020","unstructured":"Amann J, Blasimme A, Vayena E, Frey D, Madai VI. Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med Inform Decis Mak. 2020;20(1):1\u20139.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"1772_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-020-01276-x","volume":"20","author":"AJ Barda","year":"2020","unstructured":"Barda AJ, Horvat CM, Hochheiser H. A qualitative research framework for the design of user-centered displays of explanations for machine learning model predictions in healthcare. BMC Med Inform Decis Mak. 2020;20(1):1\u201316.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"4","key":"1772_CR21","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1109\/JBHI.2015.2446195","volume":"20","author":"E Garcia-Ceja","year":"2015","unstructured":"Garcia-Ceja E, Osmani V, Mayora O. Automatic stress detection in working environments from smartphones\u2019 accelerometer data: a first step. IEEE J Biomed Health Inform. 2015;20(4):1053\u201360.","journal-title":"IEEE J Biomed Health Inform"},{"issue":"9","key":"1772_CR22","doi-asserted-by":"publisher","first-page":"43571","DOI":"10.1371\/journal.pone.0043571","volume":"7","author":"D Giakoumis","year":"2012","unstructured":"Giakoumis D, Drosou A, Cipresso P, Tzovaras D, Hassapis G, Gaggioli A, Riva G. Using activity-related behavioural features towards more effective automatic stress detection. PLoS ONE. 2012;7(9):43571.","journal-title":"PLoS ONE"},{"key":"1772_CR23","doi-asserted-by":"crossref","unstructured":"Sun F-T, Kuo C, Cheng H-T, Buthpitiya S, Collins P, Griss M. Activity-aware mental stress detection using physiological sensors. In: International conference on mobile computing, applications, and services. Springer; 2010. pp. 282\u2013301.","DOI":"10.1007\/978-3-642-29336-8_16"},{"issue":"18","key":"1772_CR24","doi-asserted-by":"publisher","first-page":"13376","DOI":"10.1016\/j.eswa.2012.05.065","volume":"39","author":"D Carneiro","year":"2012","unstructured":"Carneiro D, Castillo JC, Novais P, Fern\u00e1ndez-Caballero A, Neves J. Multimodal behavioral analysis for non-invasive stress detection. Expert Syst Appl. 2012;39(18):13376\u201389.","journal-title":"Expert Syst Appl"},{"key":"1772_CR25","doi-asserted-by":"crossref","unstructured":"Bogomolov A, Lepri B, Ferron M, Pianesi F, Pentland AS. Pervasive stress recognition for sustainable living. In: 2014 IEEE international conference on pervasive computing and communication workshops (PERCOM WORKSHOPS). IEEE; 2014. pp. 345\u201350.","DOI":"10.1109\/PerComW.2014.6815230"},{"key":"1772_CR26","doi-asserted-by":"crossref","unstructured":"Bauer G, Lukowicz P. Can smartphones detect stress-related changes in the behaviour of individuals? In: 2012 IEEE international conference on pervasive computing and communications workshops. IEEE; 2012. pp. 423\u20136.","DOI":"10.1109\/PerComW.2012.6197525"},{"issue":"11","key":"1772_CR27","first-page":"1","volume":"20","author":"R Li","year":"2020","unstructured":"Li R, Liu Z. Stress detection using deep neural networks. BMC Med Inform Decis Mak. 2020;20(11):1\u201310.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1772_CR28","doi-asserted-by":"crossref","unstructured":"Schmidt P, Reiss A, Duerichen R, Marberger C, Van\u00a0Laerhoven K. Introducing wesad, a multimodal dataset for wearable stress and affect detection. In: Proceedings of the 20th ACM international conference on multimodal interaction; 2018. pp. 400\u20138.","DOI":"10.1145\/3242969.3242985"},{"key":"1772_CR29","doi-asserted-by":"crossref","unstructured":"Acerbi G, Rovini E, Betti S, Tirri A, R\u00f3nai JF, Sirianni A, Agrimi J, Eusebi L, Cavallo F. A wearable system for stress detection through physiological data analysis. In: Italian forum of ambient assisted living. Springer; 2016. pp. 31\u201350.","DOI":"10.1007\/978-3-319-54283-6_3"},{"issue":"4","key":"1772_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2485984.2485987","volume":"12","author":"J Wijsman","year":"2013","unstructured":"Wijsman J, Grundlehner B, Penders J, Hermens H. Trapezius muscle EMG as predictor of mental stress. ACM Trans Embedded Comput Syst (TECS). 2013;12(4):1\u201320.","journal-title":"ACM Trans Embedded Comput Syst (TECS)"},{"key":"1772_CR31","doi-asserted-by":"crossref","unstructured":"Widjaja D, Orini M, Vlemincx E, Van\u00a0Huffel S. Cardiorespiratory dynamic response to mental stress: a multivariate time-frequency analysis. In: Computational and mathematical methods in medicine, vol. 2013; 2013.","DOI":"10.1155\/2013\/451857"},{"issue":"6","key":"1772_CR32","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1111\/j.1469-8986.1980.tb02293.x","volume":"17","author":"WM Suess","year":"1980","unstructured":"Suess WM, Alexander AB, Smith DD, Sweeney HW, Marion RJ. The effects of psychological stress on respiration: a preliminary study of anxiety and hyperventilation. Psychophysiology. 1980;17(6):535\u201340.","journal-title":"Psychophysiology"},{"key":"1772_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3758\/s13428-020-01516-y","volume":"53","author":"D Makowski","year":"2021","unstructured":"Makowski D, Pham T, Lau ZJ, Brammer JC, Lespinasse F, Pham H, Sch\u00f6lzel C, Chen SA. Neurokit2: a python toolbox for neurophysiological signal processing. Behav Res Methods. 2021;53:1\u20138.","journal-title":"Behav Res Methods"},{"key":"1772_CR34","unstructured":"Carreiras C, Alves AP, Louren\u00e7o A, Canento F, Silva H, Fred A, et al. BioSPPy: biosignal processing in python. 2015. [Online; accessed 25-May-2020]. https:\/\/github.com\/PIA-Group\/BioSPPy\/."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01772-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-022-01772-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01772-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T16:04:43Z","timestamp":1644595483000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-022-01772-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,11]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1772"],"URL":"https:\/\/doi.org\/10.1186\/s12911-022-01772-2","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,11]]},"assertion":[{"value":"2 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"38"}}