{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T19:06:22Z","timestamp":1775934382696,"version":"3.50.1"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T00:00:00Z","timestamp":1680480000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100013382","name":"Institute of Translational Health Sciences","doi-asserted-by":"publisher","award":["UL1 TR002319"],"award-info":[{"award-number":["UL1 TR002319"]}],"id":[{"id":"10.13039\/100013382","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R13LM013127"],"award-info":[{"award-number":["R13LM013127"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NLM Biomedical and Health Informatics Training Program","award":["T15LM007442"],"award-info":[{"award-number":["T15LM007442"]}]},{"name":"Seattle Flu Study through the Brotman Baty Institute"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,7,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The n2c2\/UW SDOH Challenge explores the extraction of social determinant of health (SDOH) information from clinical notes. The objectives include the advancement of natural language processing (NLP) information extraction techniques for SDOH and clinical information more broadly. This article presents the shared task, data, participating teams, performance results, and considerations for future work.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>The task used the Social History Annotated Corpus (SHAC), which consists of clinical text with detailed event-based annotations for SDOH events, such as alcohol, drug, tobacco, employment, and living situation. Each SDOH event is characterized through attributes related to status, extent, and temporality. The task includes 3 subtasks related to information extraction (Subtask A), generalizability (Subtask B), and learning transfer (Subtask C). In addressing this task, participants utilized a range of techniques, including rules, knowledge bases, n-grams, word embeddings, and pretrained language models (LM).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>A total of 15 teams participated, and the top teams utilized pretrained deep learning LM. The top team across all subtasks used a sequence-to-sequence approach achieving 0.901 F1 for Subtask A, 0.774 F1 Subtask B, and 0.889 F1 for Subtask C.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Similar to many NLP tasks and domains, pretrained LM yielded the best performance, including generalizability and learning transfer. An error analysis indicates extraction performance varies by SDOH, with lower performance achieved for conditions, like substance use and homelessness, which increase health risks (risk factors) and higher performance achieved for conditions, like substance abstinence and living with family, which reduce health risks (protective factors).<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad012","type":"journal-article","created":{"date-parts":[[2023,2,16]],"date-time":"2023-02-16T15:28:42Z","timestamp":1676561322000},"page":"1367-1378","source":"Crossref","is-referenced-by-count":40,"title":["The 2022 n2c2\/UW shared task on extracting social determinants of health"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5798-2664","authenticated-orcid":false,"given":"Kevin","family":"Lybarger","sequence":"first","affiliation":[{"name":"Department of Information Sciences and Technology, George Mason University , Fairfax, Virginia, USA"}]},{"given":"Meliha","family":"Yetisgen","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics & Medical Education, University of Washington , Seattle, Washington, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8011-9850","authenticated-orcid":false,"given":"\u00d6zlem","family":"Uzuner","sequence":"additional","affiliation":[{"name":"Department of Information Sciences and Technology, George Mason University , Fairfax, Virginia, USA"}]}],"member":"286","published-online":{"date-parts":[[2023,4,3]]},"reference":[{"key":"2023071909393363300_ocad012-B1","author":"Social Determinants of Health","year":"2021"},{"issue":"2","key":"2023071909393363300_ocad012-B2","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1111\/1468-0009.12390","article-title":"Meanings and misunderstandings: a social determinants of health lexicon for health care systems","volume":"97","author":"Alderwick","year":"2019","journal-title":"Milbank Q"},{"key":"2023071909393363300_ocad012-B3","doi-asserted-by":"crossref","first-page":"18","DOI":"10.7812\/TPP\/18-095","article-title":"Toward addressing social determinants of health: a health care system strategy","volume":"22","author":"Friedman","year":"2018","journal-title":"Perm J"},{"issue":"8","key":"2023071909393363300_ocad012-B4","doi-asserted-by":"crossref","first-page":"577","DOI":"10.7326\/M17-2441","article-title":"Addressing social determinants to improve patient care and promote health equity: an American College of Physicians Position Paper","volume":"168","author":"Daniel","year":"2018","journal-title":"Ann Intern Med"},{"issue":"8","key":"2023071909393363300_ocad012-B5","doi-asserted-by":"crossref","first-page":"596","DOI":"10.7326\/M18-0335","article-title":"Determined action needed on social determinants","volume":"168","author":"Himmelstein","year":"2018","journal-title":"Ann Intern Med"},{"issue":"2","key":"2023071909393363300_ocad012-B6","doi-asserted-by":"crossref","first-page":"139","DOI":"10.21106\/ijma.236","article-title":"Social determinants of health in the United States: addressing major health inequality trends for the nation, 1935-2016","volume":"6","author":"Singh","year":"2017","journal-title":"Int J MCH AIDS"},{"issue":"25","key":"2023071909393363300_ocad012-B7","first-page":"625","article-title":"Annual smoking-attributable mortality, years of potential life lost, and productivity losses\u2013United States, 1997-2001","volume":"54","author":"Centers for Disease Control and Prevention","year":"2005","journal-title":"MMWR Morb Mortal Wkly Rep"},{"issue":"9810","key":"2023071909393363300_ocad012-B8","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/S0140-6736(11)61138-0","article-title":"Extent of illicit drug use and dependence, and their contribution to the global burden of disease","volume":"379","author":"Degenhardt","year":"2012","journal-title":"Lancet"},{"key":"2023071909393363300_ocad012-B9","author":"World Heal Organization","year":"2019"},{"issue":"3 Suppl","key":"2023071909393363300_ocad012-B10","doi-asserted-by":"crossref","first-page":"S39","DOI":"10.1353\/pbm.2003.0049","article-title":"Social isolation and health, with an emphasis on underlying mechanisms","volume":"46","author":"Cacioppo","year":"2003","journal-title":"Perspect Biol Med"},{"issue":"1669","key":"2023071909393363300_ocad012-B11","doi-asserted-by":"crossref","first-page":"20140114","DOI":"10.1098\/rstb.2014.0114","article-title":"Perceived social isolation, evolutionary fitness and health outcomes: a lifespan approach","volume":"370","author":"Hawkley","year":"2015","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"3","key":"2023071909393363300_ocad012-B12","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1606\/1044-3894.2016.97.21","article-title":"Homelessness history impacts on health outcomes and economic and risk behavior intermediaries: new insights from population data","volume":"97","author":"Oppenheimer","year":"2016","journal-title":"Fam Soc"},{"key":"2023071909393363300_ocad012-B13","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1111\/j.1749-6632.2009.05338.x","article-title":"Work and its role in shaping the social gradient in health","volume":"1186","author":"Clougherty","year":"2010","journal-title":"Ann N Y Acad Sci"},{"issue":"1","key":"2023071909393363300_ocad012-B14","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1146\/annurev.pu.17.050196.002313","article-title":"Health and unemployment","volume":"17","author":"Dooley","year":"1996","journal-title":"Annu Rev Public Health"},{"issue":"1","key":"2023071909393363300_ocad012-B15","doi-asserted-by":"crossref","first-page":"e10046","DOI":"10.1002\/lrh2.10046","article-title":"Leveraging the learning health care model to improve equity in the age of genomic medicine","volume":"2","author":"Blizinsky","year":"2018","journal-title":"Learn Health Syst"},{"issue":"5","key":"2023071909393363300_ocad012-B16","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1016\/j.jbi.2009.08.007","article-title":"What can natural language processing do for clinical decision support?","volume":"42","author":"Demner-Fushman","year":"2009","journal-title":"J Biomed Inform"},{"issue":"6","key":"2023071909393363300_ocad012-B17","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1038\/nrg3208","article-title":"Mining electronic health records: towards better research applications and clinical care","volume":"13","author":"Jensen","year":"2012","journal-title":"Nat Rev Genet"},{"issue":"2","key":"2023071909393363300_ocad012-B18","doi-asserted-by":"crossref","first-page":"1110","DOI":"10.1111\/1475-6773.12670","article-title":"Hospital readmission and social risk factors identified from physician notes","volume":"53","author":"Navathe","year":"2018","journal-title":"Health Serv Res"},{"issue":"3","key":"2023071909393363300_ocad012-B19","doi-asserted-by":"crossref","first-page":"e13802","DOI":"10.2196\/13802","article-title":"Assessing the availability of data on social and behavioral determinants in structured and unstructured electronic health records: a retrospective analysis of a multilevel health care system","volume":"7","author":"Hatef","year":"2019","journal-title":"JMIR Med Inform"},{"issue":"12","key":"2023071909393363300_ocad012-B20","doi-asserted-by":"crossref","first-page":"2716","DOI":"10.1093\/jamia\/ocab170","article-title":"Extracting social determinants of health from electronic health records using natural language processing: a systematic review","volume":"28","author":"Patra","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2023071909393363300_ocad012-B21","doi-asserted-by":"crossref","first-page":"103631","DOI":"10.1016\/j.jbi.2020.103631","article-title":"Annotating social determinants of health using active learning, and characterizing determinants using neural event extraction","volume":"113","author":"Lybarger","year":"2021","journal-title":"J Biomed Inform"},{"issue":"1","key":"2023071909393363300_ocad012-B22","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1197\/jamia.M2408","article-title":"Identifying patient smoking status from medical discharge records","volume":"15","author":"Uzuner","year":"2008","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2023071909393363300_ocad012-B23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0192360","article-title":"Comparing deep learning and concept extraction based methods for patient phenotyping from clinical narratives","volume":"13","author":"Gehrmann","year":"2018","journal-title":"PLoS One"},{"key":"2023071909393363300_ocad012-B24","first-page":"422","volume-title":"AMIA Annu Symp Proc","author":"Feller","year":"2018"},{"key":"2023071909393363300_ocad012-B25","doi-asserted-by":"crossref","first-page":"103903","DOI":"10.1016\/j.jbi.2021.103903","article-title":"ReHouSED: A novel measurement of Veteran housing stability using natural language processing","volume":"122","author":"Chapman","year":"2021","journal-title":"J Biomed Inform"},{"key":"2023071909393363300_ocad012-B26","first-page":"1225","article-title":"A study of social and behavioral determinants of health in lung cancer patients using transformers-based natural language processing models","volume":"2021","author":"Yu","year":"2021","journal-title":"AMIA Annu Symp Proc"},{"key":"2023071909393363300_ocad012-B27","doi-asserted-by":"crossref","first-page":"778463","DOI":"10.3389\/fpubh.2022.778463","article-title":"Assessing the documentation of social determinants of health for lung cancer patients in clinical narratives","volume":"10","author":"Yu","year":"2022","journal-title":"Front Public Health"},{"key":"2023071909393363300_ocad012-B28","doi-asserted-by":"crossref","first-page":"103984","DOI":"10.1016\/j.jbi.2021.103984","article-title":"Classifying social determinants of health from unstructured electronic health records using deep learning-based natural language processing","volume":"127","author":"Han","year":"2022","journal-title":"J Biomed Inform"},{"key":"2023071909393363300_ocad012-B29","first-page":"2121","article-title":"Automated extraction of substance use information from clinical texts","volume":"2015","author":"Wang","year":"2015","journal-title":"AMIA Annu Symp Proc"},{"key":"2023071909393363300_ocad012-B30","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/978-3-319-59758-4_18","article-title":"Automatic identification of substance abuse from social history in clinical text","author":"Yetisgen","year":"2017","journal-title":"Artif Intell Med"},{"key":"2023071909393363300_ocad012-B31","doi-asserted-by":"crossref","first-page":"103851","DOI":"10.1016\/j.jbi.2021.103851","article-title":"Adaptation of an NLP system to a new healthcare environment to identify social determinants of health","volume":"120","author":"Reeves","year":"2021","journal-title":"J Biomed Inform"},{"key":"2023071909393363300_ocad012-B32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.34133\/2021\/9759016","article-title":"Social and behavioral determinants of health in the era of artificial intelligence with electronic health records: a scoping review","volume":"2021","author":"Bompelli","year":"2021","journal-title":"Health Data Sci"},{"key":"2023071909393363300_ocad012-B33","first-page":"1","article-title":"Using natural language processing to examine social determinants of health in prehospital pediatric encounters and associations with EMS transport decisions","author":"Lowery","year":"2022","journal-title":"Prehosp Emerg Care"},{"key":"2023071909393363300_ocad012-B34","first-page":"102","author":"Stenetorp","year":"2012"},{"key":"2023071909393363300_ocad012-B35","doi-asserted-by":"crossref","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Sci Data"},{"issue":"12","key":"2023071909393363300_ocad012-B36","doi-asserted-by":"crossref","first-page":"2661","DOI":"10.1093\/jamia\/ocab207","article-title":"Transferability of neural network clinical deidentification systems","volume":"28","author":"Lee","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2023071909393363300_ocad012-B37","doi-asserted-by":"publisher","first-page":"72","DOI":"10.18653\/v1\/W19-1909","author":"Alsentzer","year":"2019"},{"issue":"4","key":"2023071909393363300_ocad012-B38","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2020","journal-title":"Bioinformatics"},{"issue":"140","key":"2023071909393363300_ocad012-B39","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J Mach Learn Res"},{"issue":"Database issue","key":"2023071909393363300_ocad012-B40","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The unified medical language system (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res"},{"key":"2023071909393363300_ocad012-B41","first-page":"1218","author":"Zhuang","year":"2021"},{"key":"2023071909393363300_ocad012-B42","author":"Mikolov","year":"2013"},{"key":"2023071909393363300_ocad012-B43","doi-asserted-by":"publisher","first-page":"4171","DOI":"10.18653\/v1\/N19-1423","author":"Devlin","year":"2019"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/8\/1367\/50908661\/ocad012.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/8\/1367\/50908661\/ocad012.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,19]],"date-time":"2023-07-19T10:28:49Z","timestamp":1689762529000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/8\/1367\/7043152"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,3]]},"references-count":43,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,4,3]]},"published-print":{"date-parts":[[2023,7,19]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad012","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,8,1]]},"published":{"date-parts":[[2023,4,3]]}}}