{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T20:04:45Z","timestamp":1789589085205,"version":"build-2803163510"},"reference-count":54,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Suicide assessments have historically privileged verbal report by the patient, despite the fact that nonverbal behaviors of patients and their clinicians may convey important affective and interpersonal information about suicide risk. Recent advances in computational science enable efficient characterization of rich nonverbal data.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to use automated coding to test whether facial action and head motion exhibited by young adults and their clinical interviewers during a widely used suicide assessment can identify suicidal participants.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n Participants were a diverse sample of 66 young adults (age: mean 21.32, SD 2.11 years) recruited from the community, half of whom engaged in past-year suicidal behavior (ie, suicidal participants) and half of whom had no history of suicidality (ie, nonsuicidal participants). Facial action units, head pose, and eye and mouth opening of both participants and clinical interviewers were extracted from the first 3 minutes of a face-to-face, video-recorded Columbia-Suicide Severity Rating Scale (C-SSRS) using the Python-Based Automated Facial Affect Recognition (PyAFAR) software. Nonverbal behaviors of suicidal versus nonsuicidal participants and their interviewers were compared using 2-tailed independent samples\n t<\/jats:italic>\n tests and Mann-Whitney\n U<\/jats:italic>\n tests. Binary classification algorithms were then used to test how well these nonverbal behaviors together predicted group membership. Exploratory post hoc analyses assessed whether any nonverbal behaviors at baseline were associated with suicidal participants\u2019 ideation severity or suicidal behavior 3 months later.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Nonverbal behaviors of participants and particularly their clinical interviewers differentiated suicidal versus nonsuicidal young adults at baseline. Suicidal participants demonstrated elevated velocity in opening and closing of eyes and mouth (\n P<\/jats:italic>\n =.004). Interviewers of suicidal participants showed less animated head movement (\n P<\/jats:italic>\n =.02), elevated velocity of eye opening and closing (\n P<\/jats:italic>\n =.02), and ambivalent smiling patterns (\n P<\/jats:italic>\n s=.01-.046). Overall, interviewer nonverbal behaviors predicted group membership with greater accuracy than participant behaviors, correctly identifying 81% (27\/33) versus 59% (19\/33) of suicidal young adults. Finally, interviewer smiling occurrence was associated with suicidal participants\u2019 ideation severity (\n P<\/jats:italic>\n =.04) and suicidal behavior (\n P<\/jats:italic>\n =.02) 3 months later, while explicit measures, including interviewers\u2019 clinical ratings and participants\u2019 own self-reported ideation severity at baseline, were not.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This study demonstrates the importance of attending to nonverbal channels of communication in suicide assessments, especially those of the clinical interviewer. It also highlights the potential for automated coding to detect clinically meaningful information efficiently and objectively.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/85589","type":"journal-article","created":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T19:21:56Z","timestamp":1789586516000},"page":"e85589-e85589","source":"Crossref","is-referenced-by-count":0,"title":["Using Automated Coding of Nonverbal Behavior During a Suicide Assessment to Inform Risk Detection: Mixed Cross-Sectional and Exploratory Prospective Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0534-019X","authenticated-orcid":false,"given":"Ilana","family":"Gratch","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3111-3126","authenticated-orcid":false,"given":"Simon M","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5265-5012","authenticated-orcid":false,"given":"Yutong","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6575-1513","authenticated-orcid":false,"given":"Alexander","family":"Grattery","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9393-1116","authenticated-orcid":false,"given":"Jeffrey","family":"Cohn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3225-1798","authenticated-orcid":false,"given":"Da-eun (Ellen)","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2887-3853","authenticated-orcid":false,"given":"Beatrice","family":"Beebe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3598-4092","authenticated-orcid":false,"given":"Christine B","family":"Cha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,9,16]]},"reference":[{"issue":"1","key":"R1","doi-asserted-by":"publisher","first-page":"14","DOI":"10.4088\/jcp.v64n0105","article-title":"Clinical correlates of inpatient suicide","volume":"64","author":"Busch","journal-title":"J Clin Psychiatry"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1016\/j.genhosppsych.2021.07.009","article-title":"How common is recent denial of suicidal ideation among ideators, attempters, and suicide decedents? A literature review","volume":"72","author":"Obegi","journal-title":"Gen Hosp Psychiatry"},{"issue":"2","key":"R3","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1037\/pap0000378","article-title":"States of mind preceding a near-lethal suicide attempt: a mixed methods study","volume":"39","author":"Tillman","journal-title":"Psychoanalytic Psychology"},{"issue":"1","key":"R4","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1002\/da.23043","article-title":"Detecting suicidal thoughts: the power of ecological momentary assessment","volume":"38","author":"Gratch","journal-title":"Depress Anxiety"},{"issue":"4","key":"R5","first-page":"16","volume":"105","author":"Gratch","journal-title":"R I Med J (2013)"},{"issue":"1","key":"R6","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1177\/00030651221086622","article-title":"The psychoanalytic study of suicide, part I: an integration of contemporary theory and research","volume":"70","author":"Schechter","journal-title":"J Am Psychoanal Assoc"},{"issue":"10","key":"R7","doi-asserted-by":"publisher","first-page":"1382","DOI":"10.1002\/jclp.22440","article-title":"\u201cAre You Having Thoughts of Suicide?\u201d Examining experiences with disclosing and denying suicidal ideation","volume":"73","author":"Hom","journal-title":"J Clin Psychol"},{"issue":"5","key":"R8","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1007\/s10802-021-00878-x","article-title":"Exploring adolescent experiences with disclosing self-injurious thoughts and behaviors across settings","volume":"50","author":"Fox","journal-title":"Res Child Adolesc Psychopathol"},{"issue":"1","key":"R9","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1080\/10503307.2018.1543977","article-title":"\u201cIt is never okay to talk about suicide\u201d: patients\u2019 reasons for concealing suicidal ideation in psychotherapy","volume":"30","author":"Blanchard","journal-title":"Psychother Res"},{"issue":"10461","key":"R10","doi-asserted-by":"publisher","first-page":"1445","DOI":"10.1016\/S0140-6736(24)01121-8","article-title":"The Lancet commission on self-harm","volume":"404","author":"Moran","journal-title":"Lancet"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2023.102302","article-title":"Mental imagery of suicide and non-suicidal self-injury: a meta-analysis and systematic review","volume":"103","author":"Lawrence","journal-title":"Clin Psychol Rev"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2024.1406675","article-title":"A suicide attentional bias as implicit cognitive marker of suicide vulnerability in a high-risk sample","volume":"15","author":"Br\u00fcdern","journal-title":"Front Psychiatry"},{"issue":"4","key":"R13","doi-asserted-by":"publisher","first-page":"511","DOI":"10.1177\/0956797610364762","article-title":"Measuring the suicidal mind: implicit cognition predicts suicidal behavior","volume":"21","author":"Nock","journal-title":"Psychol Sci"},{"issue":"6","key":"R14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11920-017-0781-y","article-title":"Biomarkers of suicide attempt behavior: towards a biological model of risk","volume":"19","author":"Sudol","journal-title":"Curr Psychiatry Rep"},{"issue":"12","key":"R15","doi-asserted-by":"publisher","first-page":"2209","DOI":"10.1016\/j.pec.2018.08.013","article-title":"Measuring nonverbal behavior in clinical interactions: a pragmatic guide","volume":"101","author":"Blanch-Hartigan","journal-title":"Patient Educ Couns"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.2196\/37225","article-title":"Digital phenotyping for differential diagnosis of major depressive episode: narrative review","volume":"10","author":"Ettore","journal-title":"JMIR Ment Health"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1007\/BF01115465","article-title":"Measuring facial movement","volume":"1","author":"Ekman","journal-title":"J Nonverbal Behav"},{"key":"R18","doi-asserted-by":"crossref","unstructured":"Ekman P Rosenberg EL . What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). 2nd ed. Oxford University Press; 2005. [doi: 10.1093\/acprof:oso\/9780195179644.001.0001] ISBN: 9780199847044","DOI":"10.1093\/acprof:oso\/9780195179644.001.0001"},{"key":"R19","unstructured":"Heller M Haynal-Reymond V Haynal A Archinard M . Can faces reveal suicide attempt risks? In: Heller M , editor. The Flesh of the Soul: The Body We Work With. Peter Lang; 2001:243-268. ISBN: 9783906764986"},{"key":"R20","doi-asserted-by":"crossref","unstructured":"Laksana E Baltrusaitis T Morency LP Pestian JP . Investigating facial behavior indicators of suicidal ideation. Presented at: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017); May 30 to Jun 3, 2017:770-777; Washington, DC, USA. [doi: 10.1109\/FG.2017.96]","DOI":"10.1109\/FG.2017.96"},{"key":"R21","unstructured":"Gratch I . Detecting suicidal thoughts and behaviors: the verbal and nonverbal in suicide assessments with adolescents and young adults [PhD thesis]. Teachers College, Columbia University; 2025. [doi: 10.7916\/w9c0-4c41]"},{"issue":"6","key":"R22","doi-asserted-by":"publisher","DOI":"10.2196\/25199","article-title":"Validation of visual and auditory digital markers of suicidality in acutely suicidal psychiatric inpatients: proof-of-concept study","volume":"23","author":"Galatzer-Levy","journal-title":"J Med Internet Res"},{"key":"R23","doi-asserted-by":"crossref","unstructured":"Gahalawat M Fernandez Rojas R Guha T Subramanian R Goecke R . Explainable depression detection via head motion patterns. Presented at: ICMI \u201923: Proceedings of the 25th International Conference on Multimodal Interaction; Oct 9-13, 2023; Paris, France. [doi: 10.1145\/3577190.3614130]","DOI":"10.1145\/3577190.3614130"},{"issue":"4","key":"R24","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1037\/pap0000305","article-title":"Infant research and adult treatment revisited: cocreating self- and interactive regulation","volume":"37","author":"Beebe","journal-title":"Psychoanalytic Psychology"},{"issue":"3","key":"R25","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1016\/s0022-3956(00)00011-x","article-title":"Doctor\u2019s and patients\u2019 facial expressions and suicide reattempt risk assessment","volume":"34","author":"Archinard","journal-title":"J Psychiatr Res"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"Scherer S Pestian J Morency LP . Investigating the speech characteristics of suicidal adolescents. Presented at: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing; May 26-31, 2013:709-713; Vancouver, BC, Canada. [doi: 10.1109\/ICASSP.2013.6637740]","DOI":"10.1109\/ICASSP.2013.6637740"},{"key":"R27","doi-asserted-by":"crossref","unstructured":"Hinduja S Ertugrul IO Bilalpur M Messinger DS Cohn JF . PyAFAR: python-based automated facial action recognition library for use in infants and adults. Presented at: 2023 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW); Sep 10-13, 2023:1-3; Cambridge, MA, USA. [doi: 10.1109\/ACIIW59127.2023.10388108]","DOI":"10.1109\/ACIIW59127.2023.10388108"},{"issue":"2","key":"R28","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1109\/tbiom.2020.2977225","article-title":"Crossing domains for AU coding: perspectives, approaches, and measures","volume":"2","author":"Ertugrul","journal-title":"IEEE Trans Biom Behav Identity Sci"},{"issue":"12","key":"R29","doi-asserted-by":"publisher","first-page":"1266","DOI":"10.1176\/appi.ajp.2011.10111704","article-title":"The Columbia-suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults","volume":"168","author":"Posner","journal-title":"Am J Psychiatry"},{"issue":"2","key":"R30","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1037\/0033-2909.111.2.256","article-title":"Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis","volume":"111","author":"Ambady","journal-title":"Psychol Bull"},{"key":"R31","doi-asserted-by":"crossref","unstructured":"Ertugrul IO Jeni LA Ding W Cohn JF . AFAR: a deep learning based tool for automated facial affect recognition. Presented at: 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019); May 14-18, 2019:1; Lille, France. [doi: 10.1109\/FG.2019.8756623]","DOI":"10.1109\/FG.2019.8756623"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.03.067","article-title":"Time series feature extraction on basis of scalable hypothesis tests (tsfresh \u2013 a Python package)","volume":"307","author":"Christ","journal-title":"Neurocomputing"},{"key":"R33","doi-asserted-by":"crossref","unstructured":"Hinduja S Darzi A Ertugrul IO et al. Multimodal prediction of obsessive-compulsive disorder, comorbid depression, and energy of deep brain stimulation. TechRxiv. Preprint posted online on Jan 26, 2024. [doi: 10.36227\/techrxiv.23256119.v2]","DOI":"10.36227\/techrxiv.23256119.v3"},{"issue":"4","key":"R34","doi-asserted-by":"publisher","DOI":"10.3390\/jcm12041644","article-title":"Predicting vasovagal reactions to needles from facial action units","volume":"12","author":"Rudokaite","journal-title":"J Clin Med"},{"key":"R35","doi-asserted-by":"crossref","unstructured":"Hammal Z Cohn JF . Intra- and interpersonal functions of head motion in emotion communication. Presented at: RFMIR \u201914: Proceedings of the 2014 Workshop on Roadmapping the Future of Multimodal Interaction Research including Business Opportunities and Challenges; Nov 16, 2014:19-22; Istanbul Turkey. Nov 16, 2014.[doi: 10.1145\/2666253.2666258]","DOI":"10.1145\/2666253.2666258"},{"key":"R36","unstructured":"Reynolds WM . Suicidal Ideation Questionnaire. Mapi Research Trust ePROVIDE. 1988. URL: https:\/\/eprovide.mapi-trust.org\/instruments\/suicidal-ideation-questionnaire [Accessed 01-09-2026]"},{"issue":"5","key":"R37","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1016\/s0006-3223(02)01866-8","article-title":"The 16-Item quick inventory of depressive symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression","volume":"54","author":"Rush","journal-title":"Biol Psychiatry"},{"key":"R38","unstructured":"Girard J . Agreement package in R. GitHub. 2022. URL: https:\/\/github.com\/jmgirard\/agreement [Accessed 26-08-2026]"},{"issue":"7825","key":"R39","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array programming with NumPy","volume":"585","author":"Harris","journal-title":"Nature"},{"issue":"3","key":"R40","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: fundamental algorithms for scientific computing in Python","volume":"17","author":"Virtanen","journal-title":"Nat Methods"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195","article-title":"Scikit-learn: machine learning in python","volume":"12","author":"Pedregosa","journal-title":"J Mach Learn Res"},{"key":"R42","unstructured":"Gratch I Cha CB . Nonverbal behaviors exhibited during suicide assessments: a machine learning-based approach: preregistration. Open Science Framework. 2023. URL: https:\/\/osf.io\/2jfm3\/resources [Accessed 26-08-2026]"},{"key":"R43","doi-asserted-by":"crossref","unstructured":"Liu S Lu C Alghowinem S Gotoh L Breazeal C Park HW . Explainable AI for suicide risk assessment using eye activities and head gestures. arXiv. Preprint posted online on Jun 10, 2022. [doi: 10.48550\/arXiv.2206.07522]","DOI":"10.1007\/978-3-031-05643-7_11"},{"issue":"7","key":"R44","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1038\/nn.2138","article-title":"Expressing fear enhances sensory acquisition","volume":"11","author":"Susskind","journal-title":"Nat Neurosci"},{"issue":"5","key":"R45","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1002\/imhj.20191","article-title":"Six-week postpartum maternal depressive symptoms and 4-month mother-infant self- and interactive contingency","volume":"29","author":"Beebe","journal-title":"Infant Ment Health J"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2014.00979","article-title":"Nonverbal synchrony of head- and body-movement in psychotherapy: different signals have different associations with outcome","volume":"5","author":"Ramseyer","journal-title":"Front Psychol"},{"key":"R47","doi-asserted-by":"crossref","unstructured":"Samanta A Guha T . On the role of head motion in affective expression. Presented at: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); Mar 5-9, 2017:2886-2890; New Orleans, LA. [doi: 10.1109\/ICASSP.2017.7952684]","DOI":"10.1109\/ICASSP.2017.7952684"},{"issue":"3","key":"R48","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/j.pain.2009.04.009","article-title":"The smile of pain","volume":"145","author":"Kunz","journal-title":"Pain"},{"issue":"1","key":"R49","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1007\/s42761-020-00030-w","article-title":"Reconsidering the Duchenne smile: formalizing and testing hypotheses about eye constriction and positive emotion","volume":"2","author":"Girard","journal-title":"Affec Sci"},{"issue":"2","key":"R50","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/0191-8869(96)00050-5","article-title":"How do you look when feeling anxious? facial displays of anxiety","volume":"21","author":"Harrigan","journal-title":"Pers Individ Dif"},{"key":"R51","unstructured":"Bollas C . The Shadow of the Object: Psychoanalysis of the Unthought Known. University Press; 1987. ISBN: 9780231185073"},{"issue":"3","key":"R52","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1080\/00332747.1994.11024685","article-title":"Calculated risks in the treatment of intractably suicidal patients","volume":"57","author":"Maltsberger","journal-title":"Psychiatry"},{"issue":"2","key":"R53","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1080\/00107530.1998.10746360","article-title":"Awareness, insight, and learning","volume":"34","author":"Levenson","journal-title":"Contemp Psychoanal"},{"issue":"1","key":"R54","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/S0962-1849(05)80049-6","article-title":"Nonverbal behavior in clinician\u2014patient interaction","volume":"4","author":"Hall","journal-title":"Applied and Preventive Psychology"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T19:22:02Z","timestamp":1789586522000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e85589"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,16]]},"references-count":54,"URL":"https:\/\/doi.org\/10.2196\/85589","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,16]]},"article-number":"v10i1e85589"}}