{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T23:40:08Z","timestamp":1773013208509,"version":"3.50.1"},"reference-count":25,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,5,24]],"date-time":"2023-05-24T00:00:00Z","timestamp":1684886400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100007181","name":"Quality Enhancement Research Initiative","doi-asserted-by":"publisher","award":["21-285"],"award-info":[{"award-number":["21-285"]}],"id":[{"id":"10.13039\/100007181","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Measuring long-term housing outcomes is important for evaluating the impacts of services for individuals with homeless experience. However, assessing long-term housing status using traditional methods is challenging. The Veterans Affairs (VA) Electronic Health Record (EHR) provides detailed data for a large population of patients with homeless experiences and contains several indicators of housing instability, including structured data elements (e.g., diagnosis codes) and free-text clinical narratives. However, the validity of each of these data elements for measuring housing stability over time is not well-studied.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We compared VA EHR indicators of housing instability, including information extracted from clinical notes using natural language processing (NLP), with patient-reported housing outcomes in a cohort of homeless-experienced Veterans.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>NLP achieved higher sensitivity and specificity than standard diagnosis codes for detecting episodes of unstable housing. Other structured data elements in the VA EHR showed promising performance, particularly when combined with NLP.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Evaluation efforts and research studies assessing longitudinal housing outcomes should incorporate multiple data sources of documentation to achieve optimal performance.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frai.2023.1187501","type":"journal-article","created":{"date-parts":[[2023,5,24]],"date-time":"2023-05-24T05:14:55Z","timestamp":1684905295000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Assessing longitudinal housing status using Electronic Health Record data: a comparison of natural language processing, structured data, and patient-reported history"],"prefix":"10.3389","volume":"6","author":[{"given":"Alec B.","family":"Chapman","sequence":"first","affiliation":[]},{"given":"Kristina","family":"Cordasco","sequence":"additional","affiliation":[]},{"given":"Stephanie","family":"Chassman","sequence":"additional","affiliation":[]},{"given":"Talia","family":"Panadero","sequence":"additional","affiliation":[]},{"given":"Dylan","family":"Agans","sequence":"additional","affiliation":[]},{"given":"Nicholas","family":"Jackson","sequence":"additional","affiliation":[]},{"given":"Kimberly","family":"Clair","sequence":"additional","affiliation":[]},{"given":"Richard","family":"Nelson","sequence":"additional","affiliation":[]},{"given":"Ann Elizabeth","family":"Montgomery","sequence":"additional","affiliation":[]},{"given":"Jack","family":"Tsai","sequence":"additional","affiliation":[]},{"given":"Erin","family":"Finley","sequence":"additional","affiliation":[]},{"given":"Sonya","family":"Gabrielian","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,5,24]]},"reference":[{"key":"B1","author":"Blow","year":"2004","journal-title":"Care for Veterans with Psychosis in the Veterans Health Administration, FY"},{"key":"B2","unstructured":"Secondary Use of EHR: sata Quality Issues and Informatics Opportunities15\n            BotsisT.\n            HartvigsenG.\n            ChenF.\n            WengC.\n          21347133AMIA Jt. Summits Transl. Sci. Proc20102010"},{"key":"B3","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1093\/JAMIAOPEN\/OOAC114","article-title":"Development and evaluation of an interoperable natural language processing system for identifying pneumonia across clinical settings of care and institutions","volume":"5","author":"Chapman","year":"2022","journal-title":"JAMIA Open"},{"key":"B4","doi-asserted-by":"publisher","first-page":"103903","DOI":"10.1016\/j.jbi.2021.103903","article-title":"ReHouSED: a novel measurement of veteran housing stability using natural language processing","volume":"122","author":"Chapman","year":"2021","journal-title":"J. Biomed. Inform"},{"key":"B5","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1186\/s13326-019-0198-0","article-title":"Moonstone: a novel natural language processing system for inferring social risk from clinical narratives","volume":"10","author":"Conway","year":"2019","journal-title":"J. Biomed. Semant"},{"key":"B6","unstructured":"Launching into clinical space with medspaCy: a new clinical text processing toolkit in Python\n            EyreH.\n            ChapmanA. B.\n            andPetersonK. S\n          35308962AMIA Annu. Symp. Proc.2021"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/S13012-022-01236-1\/TABLES\/5","article-title":"Comparing two implementation strategies for implementing and sustaining a case management practice serving homeless-experienced veterans: a protocol for a type 3 hybrid cluster-randomized trial","volume":"17","author":"Gabrielian","year":"2022","journal-title":"Implement. Sci"},{"key":"B8","doi-asserted-by":"publisher","first-page":"R56","DOI":"10.1093\/hmg\/ddy114","article-title":"The next generation of precision medicine: observational studies, electronic health records, biobanks and continuous monitoring","volume":"27","author":"Glicksberg","year":"2018","journal-title":"Hum Mol. Genet"},{"key":"B9","first-page":"537","article-title":"Using natural language processing on the free text of clinical documents to screen for evidence of homelessness among US veterans. AMIA","volume":"2013","author":"Gundlapalli","year":"2013","journal-title":"Annual Symposium proceedings \/ AMIA Symposium AMIA Symposium"},{"key":"B10","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1001\/jama.2015.8207","article-title":"Military misconduct and homelessness among US veterans separated from active duty, 2001\u20132012","volume":"314","author":"Gundlapalli","year":"2015","journal-title":"JAMA\u2014J. Am. Med. Assoc"},{"key":"B11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/jamiaopen\/ooac006","article-title":"Development and assessment of a natural language processing model to identify residential instability in electronic health records' unstructured data: a comparison of 3 integrated healthcare delivery systems","volume":"5","author":"Hatef","year":"2022","journal-title":"JAMIA Open"},{"key":"B12","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1097\/00005053-200003000-00002","article-title":"critical time intervention with mentally ill homeless men: impact on psychiatric symptoms","volume":"188","author":"Herman","year":"2000","journal-title":"J. Nerv. Ment. Dis"},{"key":"B13","unstructured":"Analysis of longitudinal data with irregular, outcome-dependent follow-up791813\n            LinH.\n            ScharfsteinD. O.\n            RosenheckR. A.\n          26237289J. Royal. Stat. Soc. Series B662004"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1515\/ijb-2020-0144","article-title":"Summarizing the extent of visit irregularity in longitudinal data","volume":"3","author":"Lokku","year":"2021","journal-title":"Int. J. Biostatist"},{"key":"B15","doi-asserted-by":"publisher","first-page":"ocad012","DOI":"10.1093\/jamia\/ocad012","article-title":"The 2022 n2c2\/UW shared task on extracting social determinants of health","volume":"2023","author":"Lybarger","year":"2023","journal-title":"J. Am. Med. Informat. Assoc"},{"key":"B16","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1002\/jcop","article-title":"Measuring homelessness and residential stability: the residential time-line follow-back inventory. i","volume":"38","author":"Mendelson","year":"2010","journal-title":"Commun. Psychol"},{"key":"B17","unstructured":"Universal Screening for Homelessness Risk for Homelessness in the Veterans Health Administration.\n            MontgomeryA. E.\n            FargoJ. D.\n            ByrneT. H.\n            KaneV.\n            CulhaneD. P\n          241480322022"},{"key":"B18","doi-asserted-by":"publisher","first-page":"5352","DOI":"10.1111\/1475-6773.13054","article-title":"Costs associated with health care services accessed through VA and in the community through medicare for veterans experiencing homelessness","volume":"53","author":"Nelson","year":"2018","journal-title":"Health Serv. Res"},{"key":"B19","year":"2004","journal-title":"ICD-10 : International Statistical Classification of Diseases and Related Health Problems : Tenth Revision"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0132664","article-title":"Identifying homelessness among veterans using VA administrative data: opportunities to expand detection criteria","volume":"10","author":"Peterson","year":"2015","journal-title":"PLoS ONE"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2992","DOI":"10.1177\/0962280214536537","article-title":"Longitudinal data subject to irregular observation: a review of methods with a focus on visit processes, assumptions, and study design","volume":"25","author":"Pullenayegum","year":"2016","journal-title":"Stat. Methods Med. Res"},{"key":"B22","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1093\/epirev\/mxac010","article-title":"Randomized trials with repeatedly measured outcomes: handling irregular and potentially informative assessment times","volume":"44","author":"Pullenayegum","year":"2022","journal-title":"Epidemiol. Rev"},{"key":"B23","doi-asserted-by":"publisher","first-page":"e0279973","DOI":"10.1371\/journal.pone.0279973","article-title":"Developing an operational definition of housing instability and homelessness in Veterans Health Administration's medical records","volume":"17","author":"Tsai","year":"2022","journal-title":"PLoS ONE"},{"key":"B24","doi-asserted-by":"publisher","first-page":"237","DOI":"10.4137\/CIN.S40604","article-title":"Comparison of three information sources for smoking information in electronic health records","volume":"15","author":"Wang","year":"2016","journal-title":"Cancer Inform"},{"key":"B25","doi-asserted-by":"publisher","first-page":"7","DOI":"10.13063\/2327-9214.1035","article-title":"Strategies for handling missing data in electronic health record derived data","volume":"1","author":"Wells","year":"2013","journal-title":"eGEMs Gen. Evid. Methods Imp. Patient Outcomes"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1187501\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,24]],"date-time":"2023-05-24T05:15:00Z","timestamp":1684905300000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1187501\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,24]]},"references-count":25,"alternative-id":["10.3389\/frai.2023.1187501"],"URL":"https:\/\/doi.org\/10.3389\/frai.2023.1187501","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,24]]},"article-number":"1187501"}}