{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T01:43:01Z","timestamp":1775871781909,"version":"3.50.1"},"reference-count":55,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T00:00:00Z","timestamp":1721174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["UL1TR003142"],"award-info":[{"award-number":["UL1TR003142"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library Of Medicine","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01LM013362"],"award-info":[{"award-number":["R01LM013362"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Catharine van Tussenbroek Fund"},{"name":"Prins Bernhard Cultuur Fund"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>This study aims to explore and develop tools for early identification of depression concerns among cancer patients by leveraging the novel data source of messages sent through a secure patient portal.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We developed classifiers based on logistic regression (LR), support vector machines (SVMs), and 2 Bidirectional Encoder Representations from Transformers (BERT) models (original and Reddit-pretrained) on 6600 patient messages from a cancer center (2009-2022), annotated by a panel of healthcare professionals. Performance was compared using AUROC scores, and model fairness and explainability were examined. We also examined correlations between model predictions and depression diagnosis and treatment.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>BERT and RedditBERT attained AUROC scores of 0.88 and 0.86, respectively, compared to 0.79 for LR and 0.83 for SVM. BERT showed bigger differences in performance across sex, race, and ethnicity than RedditBERT. Patients who sent messages classified as concerning had a higher chance of receiving a depression diagnosis, a prescription for antidepressants, or a referral to the psycho-oncologist. Explanations from BERT and RedditBERT differed, with no clear preference from annotators.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>We show the potential of BERT and RedditBERT in identifying depression concerns in messages from cancer patients. Performance disparities across demographic groups highlight the need for careful consideration of potential biases. Further research is needed to address biases, evaluate real-world impacts, and ensure responsible integration into clinical settings.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>This work represents a significant methodological advancement in the early identification of depression concerns among cancer patients. Our work contributes to a route to reduce clinical burden while enhancing overall patient care, leveraging BERT-based models.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae188","type":"journal-article","created":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T19:20:51Z","timestamp":1721244051000},"page":"2255-2262","source":"Crossref","is-referenced-by-count":11,"title":["Applying natural language processing to patient messages to identify depression concerns in cancer patients"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2917-0842","authenticated-orcid":false,"given":"Marieke M","family":"van Buchem","sequence":"first","affiliation":[{"name":"Department of Medicine (Biomedical Informatics), Stanford University , Stanford, CA 94305, United States"},{"name":"Clinical Artificial Intelligence Implementation and Research Lab (CAIRELab), Leiden University Medical Center , Leiden 2333ZN, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anne A H","family":"de Hond","sequence":"additional","affiliation":[{"name":"Department of Medicine (Biomedical Informatics), Stanford University , Stanford, CA 94305, United States"},{"name":"Julius Centre for Health Sciences and Primary Care, University Medical Center , Utrecht 3584CX, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Claudio","family":"Fanconi","sequence":"additional","affiliation":[{"name":"Department of Medicine (Biomedical Informatics), Stanford University , Stanford, CA 94305, United States"},{"name":"Department of Information Technology and Electrical Engineering, ETH Z\u00fcrich , Z\u00fcrich 8092, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vaibhavi","family":"Shah","sequence":"additional","affiliation":[{"name":"Department of Medicine (Biomedical Informatics), Stanford University , Stanford, CA 94305, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Max","family":"Schuessler","sequence":"additional","affiliation":[{"name":"Department of Biomedical Data Science, Stanford University , Stanford, CA 94305, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ilse M J","family":"Kant","sequence":"additional","affiliation":[{"name":"Department of Digital Health, University Medical Center Utrecht , Utrecht 3584CX, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ewout W","family":"Steyerberg","sequence":"additional","affiliation":[{"name":"Clinical Artificial Intelligence Implementation and Research Lab (CAIRELab), Leiden University Medical Center , Leiden 2333ZN, The Netherlands"},{"name":"Department of Biomedical Data Sciences, Leiden University Medical Center , Leiden 2333ZN, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6553-3455","authenticated-orcid":false,"given":"Tina","family":"Hernandez-Boussard","sequence":"additional","affiliation":[{"name":"Department of Medicine (Biomedical Informatics), Stanford University , Stanford, CA 94305, United States"},{"name":"Department of Biomedical Data Science, Stanford University , Stanford, CA 94305, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,7,17]]},"reference":[{"issue":"2-3","key":"2024092007523658900_ocae188-B1","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/j.jad.2012.03.025","article-title":"Anxiety and depression after cancer diagnosis: prevalence rates by cancer type, gender, and age","volume":"141","author":"Linden","year":"2012","journal-title":"J Affect Disord"},{"issue":"4","key":"2024092007523658900_ocae188-B2","doi-asserted-by":"crossref","first-page":"1509","DOI":"10.3892\/ol.2015.2944","article-title":"Depression in cancer patients: pathogenesis, implications and treatment (Review)","volume":"9","author":"Smith","year":"2015","journal-title":"Oncol Lett"},{"key":"2024092007523658900_ocae188-B3","doi-asserted-by":"crossref","first-page":"k1415","DOI":"10.1136\/bmj.k1415","article-title":"Depression and anxiety in patients with cancer","volume":"361","author":"Pitman","year":"2018","journal-title":"BMJ"},{"issue":"9238","key":"2024092007523658900_ocae188-B4","doi-asserted-by":"crossref","first-page":"1326","DOI":"10.1016\/S0140-6736(00)02821-X","article-title":"Depression and degree of acceptance of adjuvant cytotoxic drugs","volume":"356","author":"Colleoni","year":"2000","journal-title":"Lancet"},{"issue":"5","key":"2024092007523658900_ocae188-B5","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/S0885-3924(96)00181-9","article-title":"Depressive symptoms and quality of life in home-care-assisted cancer patients","volume":"12","author":"Grassi","year":"1996","journal-title":"J Pain Symptom Manage"},{"key":"2024092007523658900_ocae188-B6","first-page":"51873","article-title":"Substance abuse and mental health services administration; mental health and substance abuse emergency response criteria. Interim final rule","volume":"66","author":"HHS SA and MHSA (SAMHSA)","year":"2001","journal-title":"Fed Regist"},{"issue":"5","key":"2024092007523658900_ocae188-B7","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/S2215-0366(14)70313-X","article-title":"Prevalence, associations, and adequacy of treatment of major depression in patients with cancer: a cross-sectional analysis of routinely collected clinical data","volume":"1","author":"Walker","year":"2014","journal-title":"Lancet Psychiatry"},{"key":"2024092007523658900_ocae188-B8","doi-asserted-by":"crossref","first-page":"e86","DOI":"10.1017\/S2045796019000866","article-title":"Mental health care in oncology. Contemporary perspective on the psychosocial burden of cancer and evidence-based interventions","volume":"29","author":"Caruso","year":"2020","journal-title":"Epidemiol Psychiatr Sci"},{"issue":"2","key":"2024092007523658900_ocae188-B9","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/S1470-2045(11)70002-X","article-title":"Prevalence of depression, anxiety, and adjustment disorder in oncological, haematological, and palliative-care settings: a meta-analysis of 94 interview-based studies","volume":"12","author":"Mitchell","year":"2011","journal-title":"Lancet Oncol"},{"issue":"2","key":"2024092007523658900_ocae188-B10","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.jad.2011.12.043","article-title":"Meta-analysis of screening and case finding tools for depression in cancer: evidence based recommendations for clinical practice on behalf of the depression in cancer care consensus group","volume":"140","author":"Mitchell","year":"2012","journal-title":"J Affect Disord"},{"issue":"3","key":"2024092007523658900_ocae188-B11","doi-asserted-by":"crossref","first-page":"285","DOI":"10.3390\/healthcare11030285","article-title":"A review of machine learning and deep learning approaches on mental health diagnosis","volume":"11","author":"Iyortsuun","year":"2023","journal-title":"Healthcare"},{"key":"2024092007523658900_ocae188-B12","doi-asserted-by":"crossref","first-page":"113474","DOI":"10.1016\/j.psychres.2020.113474","article-title":"Prediction of depression among medical check-ups of 433,190 patients: a nationwide population-based study","volume":"293","author":"Cho","year":"2020","journal-title":"Psychiatry Res"},{"issue":"7","key":"2024092007523658900_ocae188-B13","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1377\/hlthaff.2018.05509","article-title":"Physicians\u2019 well-being linked to in-basket messages generated by algorithms in electronic health records","volume":"38","author":"Tai-Seale","year":"2019","journal-title":"Health Aff (Millwood)"},{"issue":"4","key":"2024092007523658900_ocae188-B14","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1093\/jamia\/ocz220","article-title":"Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians","volume":"27","author":"Adler-Milstein","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"12","key":"2024092007523658900_ocae188-B15","doi-asserted-by":"crossref","first-page":"e1918287","DOI":"10.1001\/jamanetworkopen.2019.18287","article-title":"Primary care physicians\u2019 experiences with and strategies for managing electronic messages","volume":"2","author":"Lieu","year":"2019","journal-title":"JAMA Netw Open"},{"issue":"11","key":"2024092007523658900_ocae188-B16","doi-asserted-by":"crossref","first-page":"444","DOI":"10.3390\/info12110444","article-title":"Investigating machine learning & natural language processing techniques applied for predicting depression disorder from online support forums: a systematic literature review","volume":"12","author":"Arachchige","year":"2021","journal-title":"Information"},{"issue":"1","key":"2024092007523658900_ocae188-B17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3569580","article-title":"Depression detection from social media text analysis using natural language processing techniques and hybrid deep learning model","volume":"23","author":"Tejaswini","year":"2022","journal-title":"ACM Trans Asian Low-Resour Lang Inf Process"},{"key":"2024092007523658900_ocae188-B18","first-page":"1","author":"Katchapakirin","year":"2018"},{"key":"2024092007523658900_ocae188-B19","first-page":"13","author":"Asad","year":"2019"},{"issue":"9","key":"2024092007523658900_ocae188-B20","doi-asserted-by":"crossref","first-page":"e36118","DOI":"10.2196\/36118","article-title":"Detection of depression severity using Bengali social media posts on mental health: study using natural language processing techniques","volume":"6","author":"Kabir","year":"2022","journal-title":"JMIR Form Res"},{"key":"2024092007523658900_ocae188-B21","first-page":"1","author":"Dessai","year":"2022"},{"key":"2024092007523658900_ocae188-B22","first-page":"436","author":"Haque"},{"issue":"7","key":"2024092007523658900_ocae188-B23","doi-asserted-by":"crossref","first-page":"e28754","DOI":"10.2196\/28754","article-title":"Depression detection on Reddit with an emotion-based attention network: algorithm development and validation","volume":"9","author":"Ren","year":"2021","journal-title":"JMIR Med Inform"},{"key":"2024092007523658900_ocae188-B24","doi-asserted-by":"crossref","first-page":"1150227","DOI":"10.3389\/fpsyg.2023.1150227","article-title":"Mental health at different stages of cancer survival: a natural language processing study of Reddit posts","volume":"14","author":"Podina","year":"2023","journal-title":"Front Psychol"},{"key":"2024092007523658900_ocae188-B25","author":"Chen"},{"issue":"1","key":"2024092007523658900_ocae188-B26","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1609\/icwsm.v8i1.14526","article-title":"Mental health discourse on Reddit: self-disclosure, social support, and anonymity","volume":"8","author":"Choudhury","year":"2014","journal-title":"ICWSM"},{"issue":"CSCW","key":"2024092007523658900_ocae188-B27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3359237","article-title":"Self-declared throwaway accounts on Reddit: how platform affordances and shared norms enable parenting disclosure and support","volume":"3","author":"Ammari","year":"2019","journal-title":"Proc ACM Hum-Comput Interact"},{"issue":"4","key":"2024092007523658900_ocae188-B28","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1016\/j.mcpdig.2023.09.001","article-title":"Building a natural language processing artificial intelligence to predict suicide-related events based on patient portal message data","volume":"1","author":"Bhandarkar","year":"2023","journal-title":"Mayo Clin Proc Digit Heal"},{"key":"2024092007523658900_ocae188-B29","first-page":"4171","author":"Devlin","year":"2019"},{"key":"2024092007523658900_ocae188-B30","doi-asserted-by":"crossref","first-page":"101328","DOI":"10.1016\/j.tranon.2021.101328","article-title":"Factors associated with and risk factors for depression in cancer patients\u2014a systematic literature review","volume":"16","author":"Riedl","year":"2022","journal-title":"Transl Oncol"},{"key":"2024092007523658900_ocae188-B31","doi-asserted-by":"crossref","first-page":"e51925","DOI":"10.2196\/51925","article-title":"Predicting depression risk in patients with cancer using multimodal data: algorithm development study","volume":"12","author":"Hond","year":"2024","journal-title":"JMIR Med Inform"},{"key":"2024092007523658900_ocae188-B32","first-page":"1597","author":"Sousa","year":"2019"},{"issue":"7","key":"2024092007523658900_ocae188-B33","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1093\/jamia\/ocab014","article-title":"Extracting postmarketing adverse events from safety reports in the vaccine adverse event reporting system (VAERS) using deep learning","volume":"28","author":"Du","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2024092007523658900_ocae188-B34","doi-asserted-by":"crossref","first-page":"1208","DOI":"10.1093\/jamia\/ocac040","article-title":"CancerBERT: a cancer domain-specific language model for extracting breast cancer phenotypes from electronic health records","volume":"29","author":"Zhou","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2024092007523658900_ocae188-B35","first-page":"790","author":"Lamproudis","year":"2021"},{"key":"2024092007523658900_ocae188-B36","volume-title":"Bioinformatics","author":"Lee","year":"2020"},{"key":"2024092007523658900_ocae188-B37","first-page":"8342","author":"Gururangan","year":"2020"},{"key":"2024092007523658900_ocae188-B38","first-page":"72","author":"Alsentzer","year":"2019"},{"key":"2024092007523658900_ocae188-B39","first-page":"558","author":"Chakrabarty","year":"2019"},{"key":"2024092007523658900_ocae188-B40","volume-title":"AMIA Jt Summits Transl Sci Proc","author":"Fanconi","year":"2023"},{"key":"2024092007523658900_ocae188-B41","author":"Huang","year":"2020"},{"key":"2024092007523658900_ocae188-B42","first-page":"97","author":"Ribeiro","year":"2016"},{"key":"2024092007523658900_ocae188-B43","first-page":"37","author":"Peng","year":"2021"},{"key":"2024092007523658900_ocae188-B44","first-page":"7184","author":"Ji","year":"2022"},{"issue":"2","key":"2024092007523658900_ocae188-B45","doi-asserted-by":"crossref","first-page":"e0000016","DOI":"10.1371\/journal.pdig.0000016","article-title":"To explain or not to explain?\u2014artificial intelligence explainability in clinical decision support systems","volume":"1","author":"Amann","year":"2022","journal-title":"PLOS Digit Health"},{"key":"2024092007523658900_ocae188-B46","doi-asserted-by":"crossref","first-page":"103839","DOI":"10.1016\/j.artint.2022.103839","article-title":"Assessing the communication gap between AI models and healthcare professionals: explainability, utility and trust in AI-driven clinical decision-making","volume":"316","author":"Wysocki","year":"2023","journal-title":"Artif Intell"},{"key":"2024092007523658900_ocae188-B47","first-page":"14067","author":"Fanconi","year":"2023"},{"key":"2024092007523658900_ocae188-B48","author":"Reddit.com. Advertising\u2014Audience\u2014Reddit","year":"2021"},{"issue":"7","key":"2024092007523658900_ocae188-B49","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1056\/NEJMsr1809937","article-title":"The \u201cAll of Us\u201d research program","volume":"381","author":"Investigators A of URP","year":"2019","journal-title":"N Engl J Med"},{"key":"2024092007523658900_ocae188-B50","first-page":"107","author":"Homan"},{"key":"2024092007523658900_ocae188-B51","first-page":"89","author":"Mowery"},{"issue":"1","key":"2024092007523658900_ocae188-B52","doi-asserted-by":"crossref","first-page":"8","DOI":"10.3390\/biomedinformatics4010002","article-title":"Supporting the demand on mental health services with AI-based conversational large language models (LLMs)","volume":"4","author":"Lai","year":"2023","journal-title":"BioMedInformatics"},{"issue":"3","key":"2024092007523658900_ocae188-B53","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.gande.2023.07.004","article-title":"Embracing the future of physician-patient communication: GPT-4 in gastroenterology","volume":"1","author":"Nashwan","year":"2023","journal-title":"Gastroenterol Endosc"},{"issue":"8","key":"2024092007523658900_ocae188-B54","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","article-title":"Large language models in medicine","volume":"29","author":"Thirunavukarasu","year":"2023","journal-title":"Nat Med"},{"key":"2024092007523658900_ocae188-B55","doi-asserted-by":"crossref","first-page":"104512","DOI":"10.1016\/j.ebiom.2023.104512","article-title":"Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine","volume":"90","author":"Harrer","year":"2023","journal-title":"eBioMedicine"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/10\/2255\/59206313\/ocae188.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/10\/2255\/59206313\/ocae188.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T07:53:15Z","timestamp":1726818795000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/10\/2255\/7715991"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,17]]},"references-count":55,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,7,17]]},"published-print":{"date-parts":[[2024,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae188","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,10]]},"published":{"date-parts":[[2024,7,17]]}}}