{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T19:45:56Z","timestamp":1793043956903,"version":"4.5.0"},"reference-count":61,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T00:00:00Z","timestamp":1765238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>Mental health disorders, such as depression, anxiety, and borderline personality disorder (BPD), are common, often begin early, and can cause profound impairment. Traditional assessments rely heavily on subjective reports and clinical observation, which can be inconsistent and biased. Recent advances in AI offer a promising complement by analyzing objective, observable cues from speech, language, facial expressions, physiological signals, and digital behavior. Explainable AI ensures these patterns remain interpretable and clinically meaningful. A synthesis of 24 recent systematic and scoping reviews shows that depression is linked to self-focused negative language, slowed and monotonous speech, reduced facial expressivity, disrupted sleep and activity, and altered phone or online behavior. Anxiety disorders present with negative language bias, monotone speech with pauses, physiological hyperarousal, and avoidance-related behaviors. BPD exhibits more complex patterns, including impersonal or externally focused language, speech dysregulation, paradoxical facial expressions, autonomic dysregulation, and socially ambivalent behaviors. Some cues, like reduced heart rate variability and flattened speech, appear across conditions, suggesting shared transdiagnostic mechanisms, while BPD\u2019s interpersonal and emotional ambivalence stands out. These findings highlight the potential of observable, digitally measurable cues to complement traditional assessments, enabling earlier detection, ongoing monitoring, and more personalized interventions in psychiatry.<\/jats:p>","DOI":"10.3389\/frai.2025.1696448","type":"journal-article","created":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T06:29:15Z","timestamp":1765261755000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Multimodal observable cues in mood, anxiety, and borderline personality disorders: a review of reviews to inform explainable AI in mental health"],"prefix":"10.3389","volume":"8","author":[{"given":"Grega","family":"Mo\u010dnik","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ana","family":"Rehberger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"\u017dan","family":"Smogavc","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Izidor","family":"Mlakar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ur\u0161ka","family":"Smrke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sara","family":"Mo\u010dnik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,12,9]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1038\/s41746-023-00828-5","article-title":"Systematic review and meta-analysis of performance of wearable artificial intelligence in detecting and predicting depression","volume":"6","author":"Abd-Alrazaq","year":"2023","journal-title":"NPJ Digit Med."},{"key":"ref2","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.psychres.2019.07.005","article-title":"Heterogeneity in psychiatric diagnostic classification","volume":"279","author":"Allsopp","year":"2019","journal-title":"Psychiatry Res."},{"key":"ref3","doi-asserted-by":"publisher","first-page":"310","DOI":"10.1186\/s12911-020-01332-6","article-title":"Explainability for artificial intelligence in healthcare: a multidisciplinary perspective","volume":"20","author":"Amann","year":"2020","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"439","DOI":"10.31128\/AJGP-12-22-6630","article-title":"Making decisions: Bias in artificial intelligence and data-driven diagnostic tools","volume":"52","author":"Aquino","year":"2023","journal-title":"Aust. J. Gen. Pract."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1080\/1364557032000119616","article-title":"Scoping studies: towards a methodological framework","volume":"8","author":"Arksey","year":"2005","journal-title":"Int. J. Soc. Res. Methodol."},{"key":"ref6","doi-asserted-by":"publisher","first-page":"434","DOI":"10.3390\/diagnostics15040434","article-title":"Artificial intelligence in psychiatry: a review of biological and behavioral data analyses","volume":"15","author":"Baydili","year":"2025","journal-title":"Diagnostics"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"e2530","DOI":"10.7717\/peerj-cs.2530","article-title":"AI in dermatology: a comprehensive review into skin cancer detection","volume":"10","author":"Behara","year":"2024","journal-title":"PeerJ Comput. Sci."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1080\/03007995.2022.2038487","article-title":"An insight into diagnosis of depression using machine learning techniques: a systematic review","volume":"38","author":"Bhadra","year":"2022","journal-title":"Curr. Med. Res. Opin."},{"key":"ref9","doi-asserted-by":"publisher","first-page":"23","DOI":"10.3390\/youth2010003","article-title":"Smartphone use and mental health among youth: it is time to develop smartphone-specific screen time guidelines","volume":"2","author":"Brodersen","year":"2022","journal-title":"Youth."},{"key":"ref10","doi-asserted-by":"publisher","first-page":"e46778","DOI":"10.2196\/46778","article-title":"Digital phenotyping for monitoring mental disorders: systematic review","volume":"25","author":"Bufano","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref11","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1038\/s41398-024-02873-4","article-title":"Multimodal digital assessment of depression with actigraphy and app in Hong Kong Chinese","volume":"14","author":"Chen","year":"2024","journal-title":"Transl. Psychiatry"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10462-024-10712-7","article-title":"Artificial intelligence and multimodal data fusion for smart healthcare: topic modeling and bibliometrics","volume":"57","author":"Chen","year":"2024","journal-title":"Artif. Intell. Rev."},{"key":"ref13","doi-asserted-by":"publisher","first-page":"24705470211000338","DOI":"10.1177\/24705470211000338","article-title":"Stress markers for mental states and biotypes of depression and anxiety: a scoping review and preliminary illustrative analysis","volume":"5","author":"Chesnut","year":"2021","journal-title":"Chronic Stress."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"e40689","DOI":"10.2196\/40689","article-title":"Digital phenotyping for stress, anxiety, and mild depression: systematic literature review","volume":"12","author":"Choi","year":"2024","journal-title":"JMIR Mhealth Uhealth"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1038\/s41380-022-01770-w","article-title":"The impact of pharmacological and non-pharmacological interventions on physical health outcomes in people with mood disorders across the lifespan: an umbrella review of the evidence from randomised controlled trials","volume":"28","author":"Croatto","year":"2023","journal-title":"Mol. Psychiatry"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3589784","article-title":"Detecting mental distresses using social behavior analysis in the context of COVID-19: a survey","volume":"55","author":"Dhelim","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"1412","DOI":"10.1093\/jamia\/ocz043","article-title":"Digital biomarkers from geolocation data in bipolar disorder and schizophrenia: a systematic review","volume":"26","author":"Fraccaro","year":"2019","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref18","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1007\/s41347-021-00199-2","article-title":"A scoping review of sensors, wearables, and remote monitoring for behavioral health: uses, outcomes, clinical competencies, and research directions","volume":"6","author":"Hilty","year":"2021","journal-title":"J. Technol. Behav. Sci."},{"key":"ref19","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1038\/s41568-018-0016-5","article-title":"Artificial intelligence in radiology","volume":"18","author":"Hosny","year":"2018","journal-title":"Nat. Rev. Cancer"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"348","DOI":"10.3390\/s24020348","article-title":"Machine learning for multimodal mental health detection: a systematic review of passive sensing approaches","volume":"24","author":"Khoo","year":"2024","journal-title":"Sensors"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"e3388","DOI":"10.1002\/smi.3388","article-title":"Physiological correlates of anxiety in childhood and adolescence: a systematic review and meta-analysis","volume":"40","author":"Ko","year":"2024","journal-title":"Stress. Health"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"100094","DOI":"10.1016\/j.pmip.2022.100094","article-title":"Multimodal phenotyping of psychiatric disorders from social interaction: protocol of a clinical multicenter prospective study","author":"K\u00f6nig","year":"2022","journal-title":"Person. Med. Psychiatry"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1038\/s41386-020-0767-z","article-title":"Deep learning for small and big data in psychiatry","volume":"46","author":"Koppe","year":"2021","journal-title":"Neuropsychopharmacology"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"856","DOI":"10.1016\/j.bpsc.2021.02.001","article-title":"Artificial intelligence for mental health care: clinical applications, barriers, facilitators, and artificial wisdom","volume":"6","author":"Lee","year":"2021","journal-title":"Biol. Psychiatry"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1186\/1748-5908-5-69","article-title":"Scoping studies: advancing the methodology","volume":"5","author":"Levac","year":"2010","journal-title":"Implementation Sci."},{"key":"ref26","doi-asserted-by":"publisher","first-page":"515","DOI":"10.1016\/j.cell.2024.11.012","article-title":"Digital phenotyping from wearables using AI characterizes psychiatric disorders and identifies genetic associations","volume":"188","author":"Liu","year":"2025","journal-title":"Cell"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"1417253","DOI":"10.3389\/fpsyt.2024.1417253","article-title":"An historical overview of artificial intelligence for diagnosis of major depressive disorder","volume":"15","author":"Liu","year":"2024","journal-title":"Front. Psych."},{"key":"ref28","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1002\/lio2.354","article-title":"Automated assessment of psychiatric disorders using speech: a systematic review","volume":"5","author":"Low","year":"2020","journal-title":"Laryngoscope Investig Otol."},{"key":"ref29","doi-asserted-by":"publisher","first-page":"895860","DOI":"10.3389\/fpsyt.2022.895860","article-title":"Digital phenotype of mood disorders: a conceptual and critical review. Front","volume":"13","author":"Maatoug","year":"2022","journal-title":"Psychiatry"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"1397557","DOI":"10.3389\/fdgth.2024.1397557","article-title":"Continuous remote monitoring of neurophysiologic immersion accurately predicts mood","volume":"6","author":"Merritt","year":"2024","journal-title":"Front. Digit Health"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"1345916","DOI":"10.3389\/fpsyt.2024.1345916","article-title":"Beyond clinical observations: a scoping review of AI-detectable observable cues in borderline personality disorder","volume":"15","author":"Mo\u010dnik","year":"2024","journal-title":"Front. Psych."},{"key":"ref32","doi-asserted-by":"publisher","first-page":"104278","DOI":"10.1016\/j.jbi.2022.104278","article-title":"Digital phenotyping of mental health using multimodal sensing of multiple situations of interest: a systematic literature review","volume":"138","author":"Moura","year":"2023","journal-title":"J. Biomed. Inform."},{"key":"ref33","doi-asserted-by":"publisher","first-page":"76","DOI":"10.3389\/fpsyt.2020.00076","article-title":"The heterogeneity of mental health assessment","volume":"11","author":"Newson","year":"2020","journal-title":"Front. Psych."},{"key":"ref34","doi-asserted-by":"publisher","first-page":"e44502","DOI":"10.2196\/44502","article-title":"Digital phenotyping: data-driven psychiatry to redefine mental health","volume":"25","author":"Oudin","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref35","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1109\/TAFFC.2017.2724035","article-title":"Automatic assessment of depression based on visual cues: a systematic review","volume":"10","author":"Pampouchidou","year":"2019","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref36","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1111\/jcpp.12381","article-title":"Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents","volume":"56","author":"Polanczyk","year":"2015","journal-title":"J. Child Psychol. Psychiatry"},{"key":"ref37","doi-asserted-by":"crossref","DOI":"10.1007\/7854_2018_58","article-title":"Biomarkers in neuropsychiatry: a Prospect for the twenty-first century?","volume-title":"Biomarkers in psychiatry [internet]","author":"Pratt","year":"2018"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"e803","DOI":"10.1038\/tp.2016.73","article-title":"Guidelines for reporting articles on psychiatry and heart rate variability (GRAPH): recommendations to advance research communication","volume":"6","author":"Quintana","year":"2016","journal-title":"Transl. Psychiatry"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"e165","DOI":"10.2196\/mhealth.9691","article-title":"Correlations between objective behavioral features collected from Mobile and wearable devices and depressive mood symptoms in patients with affective disorders: systematic review","volume":"6","author":"Rohani","year":"2018","journal-title":"JMIR Mhealth Uhealth"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1016\/j.jad.2021.08.052","article-title":"Portable technologies for digital phenotyping of bipolar disorder: a systematic review","volume":"295","author":"Saccaro","year":"2021","journal-title":"J. Affect. Disord."},{"key":"ref41","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1038\/s44184-024-00112-8","article-title":"Harnessing multimodal approaches for depression detection using large language models and facial expressions","volume":"3","author":"Sadeghi","year":"2024","journal-title":"NPJ Mental Health Res."},{"key":"ref42","article-title":"Multimodal machine learning in mental health: a survey of data, algorithms, and challenges","volume-title":"arXiv","author":"Sahili","year":"2024"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3588433","article-title":"Representation Bias in data: a survey on identification and resolution techniques","volume":"55","author":"Shahbazi","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref44","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1186\/s12938-022-00985-w","article-title":"Association between mental illness and blood pressure variability: a systematic review","volume":"21","author":"Shahimi","year":"2022","journal-title":"Biomed. Eng. Online"},{"key":"ref45","first-page":"662811","article-title":"Environmental, and smartphone-based passive sensing for mental health monitoring","volume-title":"Front. Digit Health","author":"Sheikh","year":"2021"},{"key":"ref46","doi-asserted-by":"publisher","first-page":"5984","DOI":"10.3390\/ijerph20115984","article-title":"A systematic review of location data for depression prediction","volume":"20","author":"Shin","year":"2023","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"ref47","doi-asserted-by":"publisher","first-page":"20552076241261920","DOI":"10.1177\/20552076241261920","article-title":"Use of voice features from smartphones for monitoring depressive disorders: scoping review","volume":"10","author":"Shin","year":"2024","journal-title":"Digit Health"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"e30439","DOI":"10.2196\/30439","article-title":"Language, speech, and facial expression features for artificial intelligence\u2013based detection of Cancer survivors\u2019 depression: scoping Meta-review","volume":"8","author":"Smrke","year":"2021","journal-title":"JMIR Ment Health."},{"key":"ref49","doi-asserted-by":"publisher","first-page":"20552076241297006","DOI":"10.1177\/20552076241297006","article-title":"Decoding anxiety: a scoping review of observable cues","volume":"10","author":"Smrke","year":"2024","journal-title":"Digit Health."},{"key":"ref50","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1038\/s41380-021-01161-7","article-title":"Age at onset of mental disorders worldwide: large-scale meta-analysis of 192 epidemiological studies","volume":"27","author":"Solmi","year":"2022","journal-title":"Mol. Psychiatry"},{"key":"ref51","doi-asserted-by":"publisher","first-page":"956","DOI":"10.1080\/0144929X.2023.2196573","article-title":"Nuanced relationships between indices of smartphone use and psychological distress: distinguishing problematic smartphone use, phone checking, and screen time","volume":"43","author":"Tng","year":"2024","journal-title":"Behav. Inform. Technol."},{"key":"ref52","doi-asserted-by":"publisher","first-page":"467","DOI":"10.7326\/M18-0850","article-title":"PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation","volume":"169","author":"Tricco","year":"2018","journal-title":"Ann. Intern. Med."},{"key":"ref53","doi-asserted-by":"publisher","first-page":"1355734","DOI":"10.3389\/fpsyg.2024.1355734","article-title":"Linguistic markers for major depressive disorder: a cross-sectional study using an automated procedure","volume":"15","author":"Trifu","year":"2024","journal-title":"Front. Psychol."},{"key":"ref54","doi-asserted-by":"publisher","first-page":"e20240095","DOI":"10.1002\/INMD.20240095","article-title":"Integrating emotion dynamics in mental health: a trimodal framework combining ecological momentary assessment, physiological measurements, and speech emotion recognition","volume":"3","author":"Wang","year":"2025","journal-title":"Interdiscip. Med."},{"key":"ref55","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1038\/s41746-025-01945-z","article-title":"Enabling secure and self determined health data sharing and consent management","volume":"8","author":"Welzel","year":"2025","journal-title":"NPJ Digit Med."},{"key":"ref56","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1186\/s12888-022-04013-y","article-title":"Exploring the digital footprint of depression: a PRISMA systematic literature review of the empirical evidence","volume":"22","author":"Zarate","year":"2022","journal-title":"BMC Psychiatry"},{"key":"ref57","doi-asserted-by":"publisher","first-page":"1547968","DOI":"10.3389\/fonc.2025.1547968","article-title":"Editorial: artificial intelligence and imaging for oncology","volume":"15","author":"Zhou","year":"2025","journal-title":"Front. Oncol."},{"key":"ref58","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1007\/s11192-020-03387-8","article-title":"A tale of two databases: the use of web of science and Scopus in academic papers","volume":"123","author":"Zhu","year":"2020","journal-title":"Scientometrics"},{"key":"ref59","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1016\/j.jad.2024.03.163","article-title":"Digital biomarkers in depression: a systematic review and call for standardization and harmonization of feature engineering","volume":"356","author":"Zierer","year":"2024","journal-title":"J. Affect. Disord."},{"key":"ref60","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1002\/wps.21191","article-title":"The value and limitations of self-administered questionnaires in clinical practice and epidemiological studies","volume":"23","author":"Zimmerman","year":"2024","journal-title":"World Psychiatry"},{"key":"ref61","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.comppsych.2014.09.007","article-title":"How many different ways do patients meet the diagnostic criteria for major depressive disorder?","volume":"56","author":"Zimmerman","year":"2015","journal-title":"Compr. Psychiatry"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1696448\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T06:29:16Z","timestamp":1765261756000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1696448\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,9]]},"references-count":61,"alternative-id":["10.3389\/frai.2025.1696448"],"URL":"https:\/\/doi.org\/10.3389\/frai.2025.1696448","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,9]]},"article-number":"1696448"}}