{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T14:55:33Z","timestamp":1776092133440,"version":"3.50.1"},"reference-count":41,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2023,5,18]],"date-time":"2023-05-18T00:00:00Z","timestamp":1684368000000},"content-version":"vor","delay-in-days":16,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000056","name":"National Institute of Nursing Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000056","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["1R01NR020868"],"award-info":[{"award-number":["1R01NR020868"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01MH125027"],"award-info":[{"award-number":["R01MH125027"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Center on Homelessness"},{"name":"Department of Veterans Affairs Homeless Programs Office"},{"DOI":"10.13039\/100000738","name":"US Department of Veterans Affairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000738","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,7,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Evictions are important social and behavioral determinants of health. Evictions are associated with a cascade of negative events that can lead to unemployment, housing insecurity\/homelessness, long-term poverty, and mental health problems. In this study, we developed a natural language processing system to automatically detect eviction status from electronic health record (EHR) notes.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We first defined eviction status (eviction presence and eviction period) and then annotated eviction status in 5000 EHR notes from the Veterans Health Administration (VHA). We developed a novel model, KIRESH, that has shown to substantially outperform other state-of-the-art models such as fine-tuning pretrained language models like BioBERT and Bio_ClinicalBERT. Moreover, we designed a novel prompt to further improve the model performance by using the intrinsic connection between the 2 subtasks of eviction presence and period prediction. Finally, we used the Temperature Scaling-based Calibration on our KIRESH-Prompt method to avoid overconfidence issues arising from the imbalance dataset.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>KIRESH-Prompt substantially outperformed strong baseline models including fine-tuning the Bio_ClinicalBERT model to achieve 0.74672 MCC, 0.71153 Macro-F1, and 0.83396 Micro-F1 in predicting eviction period and 0.66827 MCC, 0.62734 Macro-F1, and 0.7863 Micro-F1 in predicting eviction presence. We also conducted additional experiments on a benchmark social determinants of health (SBDH) dataset to demonstrate the generalizability of our methods.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion and Future Work<\/jats:title>\n                  <jats:p>KIRESH-Prompt has substantially improved eviction status classification. We plan to deploy KIRESH-Prompt to the VHA EHRs as an eviction surveillance system to help address the US Veterans\u2019 housing insecurity.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad081","type":"journal-article","created":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T08:31:45Z","timestamp":1684485105000},"page":"1429-1437","source":"Crossref","is-referenced-by-count":15,"title":["Automated identification of eviction status from electronic health record notes"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5707-8410","authenticated-orcid":false,"given":"Zonghai","family":"Yao","sequence":"first","affiliation":[{"name":"Manning College of Information and Computer Sciences, University of Massachusetts Amherst , Amherst, Massachusetts, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0329-648X","authenticated-orcid":false,"given":"Jack","family":"Tsai","sequence":"additional","affiliation":[{"name":"National Center on Homelessness among Veterans, U.S. Department of Veterans Affairs Homeless Programs Office , Washington, District of Columbia, USA"},{"name":"School of Public Health, University of Texas Health Science Center at Houston , Houston, Texas, USA"},{"name":"Department of Psychiatry, Yale University School of Medicine , New Haven, Connecticut, USA"}]},{"given":"Weisong","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of Massachusetts Medical School , Worcester, Massachusetts, USA"},{"name":"Center for Biomedical and Health Research in Data Sciences, Miner School of Computer and Information Sciences, University of Massachusetts Lowell , Lowell, Massachusetts, USA"},{"name":"Center for Healthcare Organization and Implementation Research, VA Bedford Health Care , Bedford, Massachusetts, USA"}]},{"given":"David A","family":"Levy","sequence":"additional","affiliation":[{"name":"Center for Biomedical and Health Research in Data Sciences, Miner School of Computer and Information Sciences, University of Massachusetts Lowell , Lowell, Massachusetts, USA"}]},{"given":"Emily","family":"Druhl","sequence":"additional","affiliation":[{"name":"Center for Healthcare Organization and Implementation Research, VA Bedford Health Care , Bedford, Massachusetts, USA"}]},{"given":"Joel I","family":"Reisman","sequence":"additional","affiliation":[{"name":"Center for Healthcare Organization and Implementation Research, VA Bedford Health Care , Bedford, Massachusetts, USA"}]},{"given":"Hong","family":"Yu","sequence":"additional","affiliation":[{"name":"Manning College of Information and Computer Sciences, University of Massachusetts Amherst , Amherst, Massachusetts, USA"},{"name":"Department of Medicine, University of Massachusetts Medical School , Worcester, Massachusetts, USA"},{"name":"Center for Biomedical and Health Research in Data Sciences, Miner School of Computer and Information Sciences, University of Massachusetts Lowell , Lowell, Massachusetts, USA"},{"name":"Center for Healthcare Organization and Implementation Research, VA Bedford Health Care , Bedford, Massachusetts, USA"}]}],"member":"286","published-online":{"date-parts":[[2023,5,2]]},"reference":[{"key":"2024050200152060600_ocad081-B1","volume-title":"Evicted: Poverty and Profit in the American City","author":"Desmond","year":"2016"},{"issue":"3","key":"2024050200152060600_ocad081-B2","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1111\/hsc.12619","article-title":"Systematic review of psychosocial factors associated with evictions","volume":"27","author":"Tsai","year":"2019","journal-title":"Health Soc Care Community"},{"issue":"1","key":"2024050200152060600_ocad081-B3","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1093\/sf\/sov044","article-title":"Eviction\u2019s fallout: housing, hardship, and health","volume":"94","author":"Desmond","year":"2015","journal-title":"Social Forces"},{"issue":"8","key":"2024050200152060600_ocad081-B4","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.2105\/AJPH.2011.300139","article-title":"US housing insecurity and the health of very young children","volume":"101","author":"Cutts","year":"2011","journal-title":"Am J Public Health"},{"issue":"2","key":"2024050200152060600_ocad081-B5","first-page":"229","article-title":"Homelessness and health","volume":"164","author":"Hwang","year":"2001","journal-title":"Can Med Assoc J"},{"key":"2024050200152060600_ocad081-B6","first-page":"1","author":"Chen","year":"2019"},{"issue":"2","key":"2024050200152060600_ocad081-B7","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1111\/j.2517-6161.1958.tb00292.x","article-title":"The regression analysis of binary sequences","volume":"20","author":"Cox","year":"1958","journal-title":"J R Stat Soc B Methodol"},{"issue":"4","key":"2024050200152060600_ocad081-B8","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2020","journal-title":"Bioinformatics"},{"key":"2024050200152060600_ocad081-B9","first-page":"72","author":"Alsentzer"},{"key":"2024050200152060600_ocad081-B10","volume-title":"Social Determinants of Health: The Ripple Effect","author":"Schrag","year":"2018"},{"issue":"3","key":"2024050200152060600_ocad081-B11","doi-asserted-by":"crossref","first-page":"e233079","DOI":"10.1001\/jamanetworkopen.2023.3079","article-title":"Associations between natural language processing-enriched social determinants of health and suicide death among US veterans","volume":"6","author":"Mitra","year":"2023","journal-title":"JAMA Netw Open"},{"issue":"1","key":"2024050200152060600_ocad081-B12","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1197\/jamia.M2408","article-title":"Identifying patient smoking status from medical discharge records","volume":"15","author":"Uzuner","year":"2008","journal-title":"J Am Med Inform Assoc"},{"key":"2024050200152060600_ocad081-B13","first-page":"41","author":"Alzoubi","year":"2018"},{"issue":"1","key":"2024050200152060600_ocad081-B14","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1197\/jamia.M2440","article-title":"Using implicit information to identify smoking status in smoke-blind medical discharge summaries","volume":"15","author":"Wicentowski","year":"2008","journal-title":"J Am Med Inform Assoc"},{"key":"2024050200152060600_ocad081-B15","author":"Carrero","year":"2006"},{"key":"2024050200152060600_ocad081-B16","author":"Pedersen","year":"2006"},{"key":"2024050200152060600_ocad081-B17","first-page":"147","author":"Jonnagaddala","year":"2015"},{"key":"2024050200152060600_ocad081-B18","first-page":"1056","author":"Topaz","year":"2019"},{"key":"2024050200152060600_ocad081-B19","author":"Mikolov","year":"2013"},{"key":"2024050200152060600_ocad081-B20","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.ins.2019.12.031","article-title":"Phrase2Vec: phrase embedding based on parsing","volume":"517","author":"Wu","year":"2020","journal-title":"Inf Sci"},{"key":"2024050200152060600_ocad081-B21","first-page":"537","author":"Gundlapalli","year":"2013"},{"key":"2024050200152060600_ocad081-B22","first-page":"391","author":"Ahsan","year":"2021"},{"key":"2024050200152060600_ocad081-B23","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.socscimed.2017.01.010","article-title":"The threat of home eviction and its effects on health through the equity lens: a systematic review","volume":"175","author":"V\u00e1squez-Vera","year":"2017","journal-title":"Soc Sci Med"},{"key":"2024050200152060600_ocad081-B24","first-page":"589","author":"Gundlapalli","year":"2014"},{"key":"2024050200152060600_ocad081-B25","volume-title":"Housing Insecurity, Homelessness and Populism: Evidence from the UK","author":"Fetzer","year":"2019"},{"key":"2024050200152060600_ocad081-B26","doi-asserted-by":"publisher","DOI":"10.1080\/10511482.2023.2186749"},{"issue":"1","key":"2024050200152060600_ocad081-B27","first-page":"3","article-title":"Supervised machine learning: a review of classification techniques","volume":"160","author":"Kotsiantis","year":"2007","journal-title":"Emerg Artif Intell Appl Comput Eng"},{"key":"2024050200152060600_ocad081-B28","author":"Radford","year":"2018."},{"key":"2024050200152060600_ocad081-B29","first-page":"2227","author":"Peters","year":"2018"},{"key":"2024050200152060600_ocad081-B30","author":"Devlin","year":"2018"},{"key":"2024050200152060600_ocad081-B31","first-page":"11733","author":"Kwon"},{"key":"2024050200152060600_ocad081-B32","first-page":"2517","author":"Yao"},{"key":"2024050200152060600_ocad081-B33","first-page":"1321","author":"Guo","year":"2017"},{"key":"2024050200152060600_ocad081-B34","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1162\/tacl_a_00407","article-title":"How can we know when language models know? On the calibration of language models for question answering","volume":"9","author":"Jiang","year":"2021","journal-title":"Trans Assoc Comput Linguist"},{"key":"2024050200152060600_ocad081-B35","first-page":"1486","author":"Frenkel","year":"2021"},{"issue":"5\u20136","key":"2024050200152060600_ocad081-B36","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.compbiolchem.2004.09.006","article-title":"Comparing two K-category assignments by a K-category correlation coefficient","volume":"28","author":"Gorodkin","year":"2004","journal-title":"Comput Biol Chem"},{"key":"2024050200152060600_ocad081-B37","author":"Naeini","year":"2015"},{"issue":"6","key":"2024050200152060600_ocad081-B38","doi-asserted-by":"crossref","first-page":"1759","DOI":"10.1007\/s11606-019-05447-z","article-title":"Social determinants and military veterans\u2019 suicide ideation and attempt: a cross-sectional analysis of electronic health record data","volume":"35","author":"Blosnich","year":"2020","journal-title":"J Gen Intern Med"},{"issue":"9619","key":"2024050200152060600_ocad081-B39","doi-asserted-by":"crossref","first-page":"1211","DOI":"10.1016\/S0140-6736(08)60528-0","article-title":"Public-sector health-care reforms that work? A case study of the US Veterans Health Administration","volume":"371","author":"Oliver","year":"2008","journal-title":"Lancet"},{"issue":"4","key":"2024050200152060600_ocad081-B40","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1037\/a0020431","article-title":"A model for home-based psychology from the Veterans Health Administration","volume":"41","author":"Hicken","year":"2010","journal-title":"Prof Psychol Res Pr"},{"issue":"7","key":"2024050200152060600_ocad081-B41","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1377\/hlthaff.2014.0054","article-title":"Insights from advanced analytics at the Veterans Health Administration","volume":"33","author":"Fihn","year":"2014","journal-title":"Health Aff (Millwood)"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/8\/1429\/50908605\/ocad081.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/8\/1429\/50908605\/ocad081.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,2]],"date-time":"2024-05-02T00:15:53Z","timestamp":1714608953000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/8\/1429\/7172838"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,2]]},"references-count":41,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,5,2]]},"published-print":{"date-parts":[[2023,7,19]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad081","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,8,1]]},"published":{"date-parts":[[2023,5,2]]}}}