{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T23:01:55Z","timestamp":1792882915954,"version":"4.5.0"},"reference-count":59,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,8,27]],"date-time":"2021-08-27T00:00:00Z","timestamp":1630022400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:p><jats:bold>Introduction:<\/jats:bold> Despite the growing efforts to standardize coding for social determinants of health (SDOH), they are infrequently captured in electronic health records (EHRs). Most SDOH variables are still captured in the unstructured fields (i.e., free-text) of EHRs. In this study we attempt to evaluate a practical text mining approach (i.e., advanced pattern matching techniques) in identifying phrases referring to housing issues, an important SDOH domain affecting value-based healthcare providers, using EHR of a large multispecialty medical group in the New England region, United States. To present how this approach would help the health systems to address the SDOH challenges of their patients we assess the demographic and clinical characteristics of patients with and without housing issues and briefly look into the patterns of healthcare utilization among the study population and for those with and without housing challenges.<\/jats:p><jats:p><jats:bold>Methods:<\/jats:bold> We identified five categories of housing issues [i.e., homelessness current (HC), homelessness history (HH), homelessness addressed (HA), housing instability (HI), and building quality (BQ)] and developed several phrases addressing each one through collaboration with SDOH experts, consulting the literature, and reviewing existing coding standards. We developed pattern-matching algorithms (i.e., advanced regular expressions), and then applied them in the selected EHR. We assessed the text mining approach for recall (sensitivity) and precision (positive predictive value) after comparing the identified phrases with manually annotated free-text for different housing issues.<\/jats:p><jats:p><jats:bold>Results:<\/jats:bold> The study dataset included EHR structured data for a total of 20,342 patients and 2,564,344 free-text clinical notes. The mean (SD) age in the study population was 75.96 (7.51). Additionally, 58.78% of the cohort were female. BQ and HI were the most frequent housing issues documented in EHR free-text notes and HH was the least frequent one. The regular expression methodology, when compared to manual annotation, had a high level of precision (positive predictive value) at phrase, note, and patient levels (96.36, 95.00, and 94.44%, respectively) across different categories of housing issues, but the recall (sensitivity) rate was relatively low (30.11, 32.20, and 41.46%, respectively).<\/jats:p><jats:p><jats:bold>Conclusion:<\/jats:bold> Results of this study can be used to advance the research in this domain, to assess the potential value of EHR's free-text in identifying patients with a high risk of housing issues, to improve patient care and outcomes, and to eventually mitigate socioeconomic disparities across individuals and communities.<\/jats:p>","DOI":"10.3389\/fpubh.2021.697501","type":"journal-article","created":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T15:30:23Z","timestamp":1630942223000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Measuring the Value of a Practical Text Mining Approach to Identify Patients With Housing Issues in the Free-Text Notes in Electronic Health Record: Findings of a Retrospective Cohort Study"],"prefix":"10.3389","volume":"9","author":[{"given":"Elham","family":"Hatef","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gurmehar","family":"Singh Deol","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Masoud","family":"Rouhizadeh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashley","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katyusha","family":"Eibensteiner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Craig B.","family":"Monsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roman","family":"Bratslaver","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Margaret","family":"Senese","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hadi","family":"Kharrazi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2021,8,27]]},"reference":[{"key":"B1","unstructured":"Hospital Adoption of Electronic Health Record Technology to Meet Meaningful Use Objectives: 2008-20122013"},{"key":"B2","unstructured":"Office-Based Physician Electronic Health Record Adoption. Health IT Quick-Stat #502016"},{"key":"B3","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1056\/NEJMp1006114","article-title":"The meaningful use regulation for electronic health records","volume":"363","author":"Blumenthal","year":"2010","journal-title":"N Engl J Med."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1709","DOI":"10.1001\/jama.2010.1497","article-title":"Meaningful use of electronic health records: the road ahead","volume":"304","author":"Jha","year":"2010","journal-title":"JAMA."},{"key":"B5","first-page":"SP117","article-title":"Progress toward meaningful use: hospitals' adoption of electronic health records","volume":"17","author":"Jha","year":"2011","journal-title":"Am J Manag Care."},{"key":"B6","unstructured":"Meaningful Use Definition & Objectives"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1499","DOI":"10.1111\/jgs.15411","article-title":"The value of unstructured electronic health record data in geriatric syndrome case identification","volume":"66","author":"Kharrazi","year":"2018","journal-title":"J Am Geriatr Soc."},{"key":"B8","doi-asserted-by":"publisher","first-page":"1110","DOI":"10.1111\/1475-6773.12670","article-title":"Hospital readmission and social risk factors identified from physician notes","volume":"53","author":"Navathe","year":"2018","journal-title":"Health Serv Res."},{"key":"B9","doi-asserted-by":"publisher","first-page":"237","DOI":"10.4137\/CIN.S40604","article-title":"Comparison of three information sources for smoking information in electronic health records","volume":"2016","author":"Liwei","year":"2016","journal-title":"Cancer Inform"},{"key":"B10","doi-asserted-by":"publisher","first-page":"810","DOI":"10.1097\/MLR.0000000000000764","article-title":"ICD social codes: an underutilized resource for tracking social needs","volume":"55","author":"Torres","year":"2017","journal-title":"Med Care."},{"key":"B11","doi-asserted-by":"publisher","first-page":"e25","DOI":"10.2196\/medinform.8240","article-title":"Optimizing the use of electronic health records to identify high-risk psychosocial determinants of health","volume":"5","author":"Oreskovic","year":"2017","journal-title":"JMIR Med Inform."},{"key":"B12","doi-asserted-by":"publisher","first-page":"921","DOI":"10.1093\/jamia\/ocv035","article-title":"Informatics to support the IOM social and behavioral domains and measures","volume":"22","author":"Hripcsak","year":"2015","journal-title":"J Am Med Inform Assoc."},{"key":"B13","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1377\/hlthaff.2017.1252","article-title":"Integrating data on social determinants of health into electronic health records","volume":"37","author":"Cantor","year":"2018","journal-title":"Health Affairs."},{"key":"B14","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1093\/jamiaopen\/ooy051","article-title":"Documenting social determinants of health-related clinical activities using standardized medical vocabularies","volume":"2","author":"Arons","year":"2019","journal-title":"JAMIA Open."},{"key":"B15","unstructured":"RegenstriefInstitute\n          LOINC2018"},{"key":"B16","volume-title":"A Guide to Using Data From Johns Hopkins Epic Electronic Health Record for Behavioral, Social and Systems Science Research","author":"Kharrazi","year":"2018"},{"key":"B17","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1016\/j.addbeh.2017.10.009","article-title":"Electronic medical record reminders and smoking cessation activities in primary care","volume":"77","author":"Bae","year":"2018","journal-title":"Addict Behav."},{"key":"B18","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1186\/s12877-017-0645-7","article-title":"Comparing clinician descriptions of frailty and geriatric syndromes using electronic health records: a retrospective cohort study","volume":"17","author":"Anzaldi","year":"2017","journal-title":"BMC Geriatr."},{"key":"B19","doi-asserted-by":"publisher","first-page":"1223","DOI":"10.1377\/hlthaff.2018.0039","article-title":"Social determinants as public goods: a new approach to financing key investments in healthy communities","volume":"37","author":"Nichols","year":"2018","journal-title":"Health Affairs."},{"key":"B20","doi-asserted-by":"publisher","first-page":"1424","DOI":"10.1001\/jamainternmed.2017.3317","article-title":"Social determinants of health in managed care payment formulas","volume":"177","author":"Ash","year":"2017","journal-title":"JAMA Intern Med."},{"key":"B21","unstructured":"The Accountable Health Communities Health-Related Social Needs Screening Tool. AHC Screening Tool2019"},{"key":"B22","unstructured":"Using Standardized Social Determinants of Health Screening Questions to Identify and Assist Patients With Unmet Health-Related Resource Needs in North Carolina. SDOH Screening Tool2018"},{"key":"B23","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1097\/JAC.0000000000000221","article-title":"How 6 organizations developed tools and processes for social determinants of health screening in primary care: an overview","volume":"41","author":"LaForge","year":"2018","journal-title":"J Ambul Care Manage."},{"key":"B24","unstructured":"BreslinE\n            LambertinoA\n            HeaphyD\n            DreyfusT\n          Medicaid and Social Determinants of Health: Adjusting Payment and Measuring Health Outcomes2017"},{"key":"B25","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1056\/NEJMp1512532","article-title":"Accountable health communities\u2014addressing social needs through medicare and medicaid","volume":"347","author":"Alley","year":"2019","journal-title":"New Eng J Med."},{"key":"B26","unstructured":"2019"},{"key":"B27","unstructured":"2019"},{"key":"B28","unstructured":"The Protocol for Responding to and Assessing Patients' Assets, Risks, and Experiences (PRAPARE)2019"},{"key":"B29","unstructured":"The Johns Hopkins ACG"},{"key":"B30","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1016\/0021-9681(87)90171-8","article-title":"A new method of classifying prognostic comorbidity in longitudinal studies: development and validation","volume":"40","author":"Charlson","year":"1987","journal-title":"J Chronic Dis."},{"key":"B31","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1097\/00005650-199801000-00004","article-title":"Comorbidity measures for use with administrative data","volume":"36","author":"Elixhauser","year":"1998","journal-title":"Med Care."},{"key":"B32","doi-asserted-by":"publisher","first-page":"698","DOI":"10.1097\/MLR.0000000000000735","article-title":"Identifying increased risk of readmission and in-hospital mortality using hospital administrative data: the AHRQ elixhauser comorbidity index","volume":"55","author":"Moore","year":"2017","journal-title":"Med Care."},{"key":"B33","doi-asserted-by":"publisher","first-page":"626","DOI":"10.1097\/MLR.0b013e31819432e5","article-title":"A modification of the elixhauser comorbidity measures into a point system for hospital death using administrative data","volume":"47","author":"van Walraven","year":"2009","journal-title":"Med Care."},{"key":"B34","doi-asserted-by":"publisher","first-page":"789","DOI":"10.1097\/MLR.0000000000000754","article-title":"Comparing population-based risk-stratification model performance using demographic, diagnosis and medication data extracted from outpatient electronic health records versus administrative claims","volume":"55","author":"Kharrazi","year":"2017","journal-title":"Med Care."},{"key":"B35","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1097\/MLR.0000000000000849","article-title":"A practical comparison between the predictive power of population-based risk stratification models using data from electronic health records versus","volume":"56","author":"Kharrazi","year":"2018","journal-title":"Med Care."},{"key":"B36","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1097\/MLR.0000000000000865","article-title":"Defining and assessing geriatric risk factors and associated health care utilization among older adults using claims and electronic health records","volume":"56","author":"Kan","year":"2018","journal-title":"Med Care."},{"key":"B37","doi-asserted-by":"publisher","first-page":"1052","DOI":"10.1097\/MLR.0000000000000825","article-title":"Evaluating the impact of prescription fill rates on risk stratification model performance","volume":"55","author":"Chang","year":"2017","journal-title":"Med Care."},{"key":"B38","first-page":"e190","article-title":"Assessing markers from ambulatory laboratory tests for predicting high-risk patients","volume":"24","author":"Lemke","year":"2018","journal-title":"Am J Manag Care."},{"key":"B39","doi-asserted-by":"publisher","first-page":"1042","DOI":"10.1097\/MLR.0000000000001001","article-title":"Assessing the impact of body mass index information on the performance of risk adjustment models in predicting health care costs and utilization","volume":"56","author":"Kharrazi","year":"2018","journal-title":"Med Care."},{"key":"B40","doi-asserted-by":"publisher","first-page":"e10458","DOI":"10.2196\/10458","article-title":"Forecasting the maturation of electronic health record functions among US hospitals: retrospective analysis and predictive model","volume":"20","author":"Kharrazi","year":"2018","journal-title":"J Med Internet Res."},{"key":"B41","doi-asserted-by":"publisher","first-page":"2174","DOI":"10.1377\/hlthaff.2015.0992","article-title":"Electronic health record adoption in US hospitals: progress continues, but challenges persist","volume":"34","author":"Adler-Milstein","year":"2015","journal-title":"Health Aff."},{"key":"B42","first-page":"e409","article-title":"Assessing electronic health record implementation challenges using item response theory","volume":"22","author":"Chan","year":"2016","journal-title":"Am J Manag Care."},{"key":"B43","doi-asserted-by":"publisher","first-page":"976","DOI":"10.1007\/s11606-014-2883-0","article-title":"Prospective EHR-based clinical trials: the challenge of missing data","volume":"29","author":"Kharrazi","year":"2014","journal-title":"J Gen Intern Med."},{"key":"B44","doi-asserted-by":"publisher","first-page":"e13039","DOI":"10.2196\/13039","article-title":"Extraction of geriatric syndromes from electronic health record clinical notes: assessment of statistical natural language processing methods","volume":"7","author":"Chen","year":"2019","journal-title":"JMIR Med Inform."},{"key":"B45","doi-asserted-by":"publisher","first-page":"199","DOI":"10.15265\/IY-2015-012","article-title":"Public health and epidemiology informatics: recent research and trends in the United States","volume":"10","author":"Dixon","year":"2015","journal-title":"Yearb Med Inform."},{"key":"B46","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1055\/s-0038-1667081","article-title":"Public and population health informatics: the bridging of big data to benefit communities","volume":"27","author":"Gamache","year":"2018","journal-title":"Yearb Med Inform."},{"key":"B47","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.13063\/2327-9214.1117","article-title":"IT-enabled community health interventions: challenges, opportunities, and future directions","volume":"2","author":"Kharrazi","year":"2014","journal-title":"EGEMS."},{"key":"B48","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1093\/jamia\/ocv210","article-title":"A proposed national research and development agenda for population health informatics: summary recommendations from a national expert workshop","volume":"24","author":"Kharrazi","year":"2017","journal-title":"J Am Med Inform Assoc."},{"key":"B49","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1089\/pop.2017.0112","article-title":"A population health measurement framework: evidence-based metrics for assessing community-level population health in the global budget context","volume":"21","author":"Hatef","year":"2018","journal-title":"Popul Health Manag."},{"key":"B50","doi-asserted-by":"publisher","first-page":"e195","DOI":"10.5210\/ojphi.v9i3.8129","article-title":"A state-wide health it infrastructure for population health: building a community-wide electronic platform for maryland's all-payer global budget","volume":"9","author":"Hatef","year":"2017","journal-title":"Online J Public Health Inform."},{"key":"B51","doi-asserted-by":"crossref","DOI":"10.1016\/B978-0-12-803135-3.00030-X","article-title":"Use of HIEs for value-based care delivery: a case study of Maryland's HIE","volume-title":"Health Information Exchange: Navigating and Managing a Network of Health Information Systems","author":"Kharrazi","year":"2016"},{"key":"B52","doi-asserted-by":"publisher","first-page":"1050","DOI":"10.1097\/ACM.0000000000004071","article-title":"Social and behavioral variables in the electronic health record: a path forward to increase data quality and utility","volume":"96","author":"Lasser","year":"2021","journal-title":"Acad Med."},{"key":"B53","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1089\/pop.2020.0043","article-title":"Assessing the impact of social needs and social determinants of health on health care utilization: using patient- and community-level data","volume":"24","author":"Hatef","year":"2021","journal-title":"Popul Health Manag."},{"key":"B54","doi-asserted-by":"publisher","first-page":"e18084","DOI":"10.2196\/18084","article-title":"Including social and behavioral determinants in predictive models: trends, challenges, and opportunities","volume":"8","author":"Tan","year":"2020","journal-title":"JMIR Med Inform."},{"key":"B55","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/s13326-019-0198-0","article-title":"Moonstone: a novel natural language processing system for inferring social risk from clinical narratives","volume":"10","author":"Conway","year":"2019","journal-title":"J Biomed Semantics."},{"key":"B56","doi-asserted-by":"publisher","first-page":"1456","DOI":"10.3233\/SHTI190482","article-title":"Identifying patients with significant problems related to social determinants of health with natural language processing","volume":"264","author":"Dorr","year":"2019","journal-title":"Stud Health Technol Inform."},{"key":"B57","doi-asserted-by":"publisher","first-page":"103091","DOI":"10.1016\/j.jbi.2018.12.005","article-title":"A systematic approach for developing a corpus of patient reported adverse drug events: a case study for SSRI and SNRI medications","volume":"90","author":"Zolnoori","year":"2019","journal-title":"J Biomed Inform."},{"key":"B58","doi-asserted-by":"publisher","first-page":"e10726","DOI":"10.2196\/10726","article-title":"Identifying the underlying factors associated with patients' attitudes toward antidepressants: qualitative and quantitative analysis of patient drug reviews","volume":"5","author":"Zolnoori","year":"2018","journal-title":"JMIR Ment Health."},{"key":"B59","doi-asserted-by":"publisher","first-page":"173","DOI":"10.3233\/SHTI200145","article-title":"Discovering new social determinants of health concepts from unstructured data: framework and evaluation","volume":"270","author":"Bettencourt-Silva","year":"2020","journal-title":"Stud Health Technol Inform."}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2021.697501\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T15:30:38Z","timestamp":1630942238000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2021.697501\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,27]]},"references-count":59,"alternative-id":["10.3389\/fpubh.2021.697501"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2021.697501","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,27]]},"article-number":"697501"}}