{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"Research Square"}],"indexed":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T17:08:22Z","timestamp":1788800902940,"version":"build-2803163510"},"posted":{"date-parts":[[2026,4,1]]},"group-title":"In Review","reference-count":25,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T00:00:00Z","timestamp":1775001600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2026,3,17]]},"abstract":"<title>Abstract<\/title>\n                <p>Background\n Retrospective studies investigating primary sclerosing cholangitis (PSC) have been limited by the absence of a PSC-specific diagnostic code. In 2018, a new PSC-specific ICD-10 code was introduced.\nAims\n We aimed to validate the new ICD-10 code and compare it to other methods of identifying patients with PSC.\nMethods\n All gastroenterology\/hepatology and primary clinic notes and discharge summaries were extracted from UCSF Epic Clarity database and potential PSC patients were identified using natural language processing (NLP). PSC diagnosis was determined by physician adjudication through chart review. LASSO regression was used to develop and internally validate a PSC prediction model. Separately, we tested large language model\u2019s (LLM) ability to distinguish PSC from non-PSC patients.\nResults\n Among 867 patients identified using NLP, 226 (26%) patients were adjudicated to have a true PSC diagnosis. The LASSO model selected ICD-10 code, alkaline phosphatase\u2009&gt;\u2009120 IU\/L, ursodiol use, inflammatory bowel disease, and history of cholangitis. ICD-10 code alone had a c-statistic of 0.87, sensitivity 87.6%, and PPV 68.8%. The LASSO model had a c-statistic of 0.92, sensitivity 87.4%, and PPV 70.7%. LLM had a c-statistic 0.77, sensitivity 91.7%, and PPV 51.0%.\nConclusions\n The PSC-specific ICD-10 code had excellent discriminatory capacity for identifying patients with PSC. While an optimized PSC prediction algorithm had slightly improved test characteristics, ICD-10 code alone was sufficient in identifying patients with PSC, supporting the use of the ICD-10 code in future database studies of PSC. In contrast, LLM had inferior discrimination compared to either ICD-10 code or the prediction model.<\/p>","DOI":"10.21203\/rs.3.rs-9152968\/v1","type":"posted-content","created":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T10:33:13Z","timestamp":1775039593000},"source":"Crossref","is-referenced-by-count":0,"title":["Identification of primary sclerosing cholangitis: ICD-10 code validation and comparison with a large language model approach"],"prefix":"10.21203","author":[{"given":"Melinda","family":"Wang","sequence":"first","affiliation":[{"name":"University of California-San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mai","family":"Dao","sequence":"additional","affiliation":[{"name":"University of California-San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Molly","family":"Delk","sequence":"additional","affiliation":[{"name":"Tulane University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cynthia","family":"Fenton","sequence":"additional","affiliation":[{"name":"University of California-San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michelle Y.","family":"Li","sequence":"additional","affiliation":[{"name":"University of California-San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica B.","family":"Rubin","sequence":"additional","affiliation":[{"name":"University of California-San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jin","family":"Ge","sequence":"additional","affiliation":[{"name":"University of California-San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer C.","family":"Lai","sequence":"additional","affiliation":[{"name":"University of California-San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Li","sequence":"additional","affiliation":[{"name":"University of California-San Francisco"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","reference":[{"issue":"5","key":"ref1","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.1016\/j.jhep.2011.10.025","article-title":"Epidemiology of primary sclerosing cholangitis and primary biliary cirrhosis: a systematic review","volume":"56","author":"Boonstra K","year":"2012","unstructured":"Boonstra K, Beuers U, Ponsioen CY. Epidemiology of primary sclerosing cholangitis and primary biliary cirrhosis: a systematic review. Journal of hepatology. 2012;56(5):1181\u20138.","journal-title":"Journal of hepatology"},{"issue":"10139","key":"ref2","doi-asserted-by":"crossref","first-page":"2547","DOI":"10.1016\/S0140-6736(18)30300-3","article-title":"Primary sclerosing cholangitis","volume":"391","author":"Dyson JK","year":"2018","unstructured":"Dyson JK, Beuers U, Jones DE, Lohse AW, Hudson M. Primary sclerosing cholangitis. The Lancet. 2018;391(10139):2547\u201359.","journal-title":"The Lancet"},{"issue":"2","key":"ref3","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1002\/hep.23294","article-title":"Diagnosis and management of primary sclerosing cholangitis","volume":"51","author":"Chapman R","year":"2010","unstructured":"Chapman R, Fevery J, Kalloo A, Nagorney DM, Boberg KM, Shneider B, et al. Diagnosis and management of primary sclerosing cholangitis. Hepatology. 2010;51(2):660\u201378.","journal-title":"Hepatology"},{"issue":"9","key":"ref4","doi-asserted-by":"crossref","first-page":"2194","DOI":"10.1111\/liv.12775","article-title":"Health\u2010related quality of life among patients with primary sclerosing cholangitis","volume":"35","author":"Haapam\u00e4ki J","year":"2015","unstructured":"Haapam\u00e4ki J, Tenca A, Sintonen H, Barner-Rasmussen N, F\u00e4rkkil\u00e4 MA. Health\u2010related quality of life among patients with primary sclerosing cholangitis. Liver international. 2015;35(9):2194\u2013201.","journal-title":"Liver international"},{"key":"ref5","first-page":"S338-S9","article-title":"Health-related quality of life in patients with primary sclerosing cholangitis: a longitudinal population-based cohort study","volume":"77","author":"Mol B","year":"2022","unstructured":"Mol B, van Munster K, Bogaards J, Weersma R, Inderson A, de Groof J, et al. Health-related quality of life in patients with primary sclerosing cholangitis: a longitudinal population-based cohort study. Journal of Hepatology. 2022;77:S338-S9.","journal-title":"Journal of Hepatology"},{"issue":"8","key":"ref6","doi-asserted-by":"crossref","first-page":"1687","DOI":"10.1016\/j.cgh.2021.08.039","article-title":"Epidemiology, natural history, and outcomes of primary sclerosing cholangitis: a systematic review of population-based studies","volume":"20","author":"Trivedi PJ","year":"2022","unstructured":"Trivedi PJ, Bowlus CL, Yimam KK, Razavi H, Estes C. Epidemiology, natural history, and outcomes of primary sclerosing cholangitis: a systematic review of population-based studies. Clinical Gastroenterology and Hepatology. 2022;20(8):1687\u2013700. e4.","journal-title":"Clinical Gastroenterology and Hepatology"},{"key":"ref7","first-page":"1","article-title":"The prevalence, incidence and natural history of primary sclerosing cholangitis in an ethnically diverse population","volume":"11","author":"Toy E","year":"2011","unstructured":"Toy E, Balasubramanian S, Selmi C, Li C-S, Bowlus CL. The prevalence, incidence and natural history of primary sclerosing cholangitis in an ethnically diverse population. BMC gastroenterology. 2011;11:1\u20137.","journal-title":"BMC gastroenterology"},{"key":"ref8","article-title":"Leveraging a new ICD-10 diagnosis code to characterize hospitalized patients with primary sclerosing cholangitis","author":"Wang M","year":"2022","unstructured":"Wang M, Auerbach A, Oreper SM, Hohmann SF, Lai JC, Rubin JB. Leveraging a new ICD-10 diagnosis code to characterize hospitalized patients with primary sclerosing cholangitis. Clinical Gastroenterology and Hepatology. 2022.","journal-title":"Clinical Gastroenterology and Hepatology"},{"issue":"10","key":"ref9","doi-asserted-by":"crossref","first-page":"2418","DOI":"10.1111\/liv.15007","article-title":"Global incidence, prevalence and features of primary sclerosing cholangitis: a systematic review and meta-analysis","volume":"41","author":"Mehta TI","year":"2021","unstructured":"Mehta TI, Weissman S, Fung BM, Sotiriadis J, Lindor KD, Tabibian JH. Global incidence, prevalence and features of primary sclerosing cholangitis: a systematic review and meta-analysis. Liver international. 2021;41(10):2418\u201326.","journal-title":"Liver international"},{"issue":"5","key":"ref10","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1111\/j.1478-3231.2011.02484.x","article-title":"Validity of administrative data for the diagnosis of primary sclerosing cholangitis: a population-based study","volume":"31","author":"Molodecky NA","year":"2011","unstructured":"Molodecky NA, Myers RP, Barkema HW, Quan H, Kaplan GG. Validity of administrative data for the diagnosis of primary sclerosing cholangitis: a population-based study. Liver International. 2011;31(5):712\u201320.","journal-title":"Liver International"},{"issue":"6","key":"ref11","doi-asserted-by":"crossref","first-page":"1764","DOI":"10.1053\/j.gastro.2021.07.046","article-title":"Defining primary sclerosing cholangitis: results from an international primary sclerosing cholangitis study group consensus process","volume":"161","author":"Ponsioen CY","year":"2021","unstructured":"Ponsioen CY, Assis DN, Boberg KM, Bowlus CL, Deneau M, Thorburn D, et al. Defining primary sclerosing cholangitis: results from an international primary sclerosing cholangitis study group consensus process. Gastroenterology. 2021;161(6):1764\u201375. e5.","journal-title":"Gastroenterology"},{"issue":"11","key":"ref12","doi-asserted-by":"crossref","first-page":"1324","DOI":"10.1002\/lt.22161","article-title":"Primary sclerosing cholangitis in genetically diverse populations listed for liver transplantation: unique clinical and human leukocyte antigen associations","volume":"16","author":"Bowlus CL","year":"2010","unstructured":"Bowlus CL, Li CS, Karlsen TH, Lie BA, Selmi C. Primary sclerosing cholangitis in genetically diverse populations listed for liver transplantation: unique clinical and human leukocyte antigen associations. Liver Transplantation. 2010;16(11):1324\u201330.","journal-title":"Liver Transplantation"},{"issue":"11","key":"ref13","doi-asserted-by":"crossref","first-page":"2703","DOI":"10.1111\/liv.15008","article-title":"Racial differences in primary sclerosing cholangitis mortality is associated with community socioeconomic status","volume":"41","author":"Are VS","year":"2021","unstructured":"Are VS, Vilar-Gomez E, Gromski MA, Akisik F, Lammert C, Ghabril M, et al. Racial differences in primary sclerosing cholangitis mortality is associated with community socioeconomic status. Liver International. 2021;41(11):2703\u201311.","journal-title":"Liver International"},{"issue":"10","key":"ref14","doi-asserted-by":"crossref","first-page":"2692","DOI":"10.1016\/j.cgh.2022.09.001","article-title":"Leveraging a new ICD-10 diagnosis code to characterize hospitalized patients with primary sclerosing cholangitis","volume":"21","author":"Wang M","year":"2023","unstructured":"Wang M, Auerbach A, Oreper SM, Hohmann SF, Lai JC, Rubin JB. Leveraging a new ICD-10 diagnosis code to characterize hospitalized patients with primary sclerosing cholangitis. Clinical Gastroenterology and Hepatology. 2023;21(10):2692\u20134.","journal-title":"Clinical Gastroenterology and Hepatology"},{"issue":"1","key":"ref15","doi-asserted-by":"crossref","first-page":"101901","DOI":"10.1016\/j.aohep.2025.101901","article-title":"Racial differences in primary sclerosing cholangitis: A retrospective cohort study leveraging a new ICD-10 code","volume":"30","author":"Wang M","year":"2025","unstructured":"Wang M, Harris A, McCulloch CE, Wadhwani SI, Lai JC, Rubin JB. Racial differences in primary sclerosing cholangitis: A retrospective cohort study leveraging a new ICD-10 code. Annals of Hepatology. 2025;30(1):101901.","journal-title":"Annals of Hepatology"},{"issue":"6","key":"ref16","doi-asserted-by":"crossref","first-page":"1753","DOI":"10.1097\/HEP.0000000000001115","article-title":"Evaluating the positive predictive value of code-based identification of cirrhosis and its complications utilizing GPT-4","volume":"81","author":"Far AT","year":"2025","unstructured":"Far AT, Bastani A, Lee A, Gologorskaya O, Huang CY, Pletcher MJ, et al. Evaluating the positive predictive value of code-based identification of cirrhosis and its complications utilizing GPT-4. Hepatology. 2025;81(6):1753\u201363.","journal-title":"Hepatology"},{"key":"ref17","doi-asserted-by":"crossref","first-page":"e72984","DOI":"10.2196\/72984","article-title":"Large Language Model Symptom Identification From Clinical Text: Multicenter Study","volume":"27","author":"McMurry AJ","year":"2025","unstructured":"McMurry AJ, Phelan D, Dixon BE, Geva A, Gottlieb D, Jones JR, et al. Large Language Model Symptom Identification From Clinical Text: Multicenter Study. J Med Internet Res. 2025;27:e72984.","journal-title":"J Med Internet Res"},{"key":"ref18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v033.i01","article-title":"Regularization paths for generalized linear models via coordinate descent","volume":"33","author":"Friedman JH","year":"2010","unstructured":"Friedman JH, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. Journal of statistical software. 2010;33:1\u201322.","journal-title":"Journal of statistical software"},{"key":"ref19","doi-asserted-by":"crossref","first-page":"1076788","DOI":"10.3389\/fgstr.2022.1076788","article-title":"Primary sclerosing cholangitis and pancreatic cancer: a retrospective cohort study of United States veterans","volume":"1","author":"Nguyen A","year":"2023","unstructured":"Nguyen A, Torabi Sagvand B, Alizadeh M, Nguyen C, Scott W, von Rosenvinge EC. Primary sclerosing cholangitis and pancreatic cancer: a retrospective cohort study of United States veterans. Frontiers in Gastroenterology. 2023;1:1076788.","journal-title":"Frontiers in Gastroenterology"},{"issue":"2","key":"ref20","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1097\/MEG.0000000000000532","article-title":"Primary sclerosing cholangitis associated with inflammatory bowel disease: an update","volume":"28","author":"Rossi RE","year":"2016","unstructured":"Rossi RE, Conte D, Massironi S. Primary sclerosing cholangitis associated with inflammatory bowel disease: an update. European journal of gastroenterology & hepatology. 2016;28(2):123\u201331.","journal-title":"European journal of gastroenterology & hepatology"},{"issue":"1","key":"ref21","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1136\/gut.2004.046615","article-title":"PSC-IBD: a unique form of inflammatory bowel disease associated with primary sclerosing cholangitis","volume":"54","author":"Loftus E","year":"2005","unstructured":"Loftus E, Harewood G, Loftus C, Tremaine W, Harmsen W, Zinsmeister A, et al. PSC-IBD: a unique form of inflammatory bowel disease associated with primary sclerosing cholangitis. Gut. 2005;54(1):91\u20136.","journal-title":"Gut"},{"issue":"3","key":"ref22","doi-asserted-by":"crossref","first-page":"808","DOI":"10.1002\/hep.23082","article-title":"High-dose ursodeoxycholic acid for the treatment of primary sclerosing cholangitis","volume":"50","author":"Lindor KD","year":"2009","unstructured":"Lindor KD, Kowdley KV, Luketic VA, Harrison ME, McCashland T, Befeler AS, et al. High-dose ursodeoxycholic acid for the treatment of primary sclerosing cholangitis. Hepatology. 2009;50(3):808\u201314.","journal-title":"Hepatology"},{"key":"ref23","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.coph.2021.11.003","article-title":"Emerging drugs for the treatment of primary sclerosing cholangitis","volume":"62","author":"Abbas N","year":"2022","unstructured":"Abbas N, Quraishi MN, Trivedi P. Emerging drugs for the treatment of primary sclerosing cholangitis. Current opinion in pharmacology. 2022;62:23\u201335.","journal-title":"Current opinion in pharmacology"},{"issue":"2","key":"ref24","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.jhep.2010.09.002","article-title":"Overlap syndromes: The International Autoimmune Hepatitis Group (IAIHG) position statement on a controversial issue","volume":"54","author":"Boberg KM","year":"2011","unstructured":"Boberg KM, Chapman RW, Hirschfield GM, Lohse AW, Manns MP, Schrumpf E. Overlap syndromes: The International Autoimmune Hepatitis Group (IAIHG) position statement on a controversial issue. Journal of Hepatology. 2011;54(2):374\u201385.","journal-title":"Journal of Hepatology"},{"issue":"3","key":"ref25","article-title":"Small duct primary sclerosing cholangitis: an underdiagnosed cause of chronic liver disease and cirrhosis","volume":"12","author":"Deliwala S","year":"2020","unstructured":"Deliwala S, Sundus S, Haykal T, Elbedawi MM, Bachuwa G. Small duct primary sclerosing cholangitis: an underdiagnosed cause of chronic liver disease and cirrhosis. Cureus. 2020;12(3).","journal-title":"Cureus"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/www.researchsquare.com\/article\/rs-9152968\/v1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.researchsquare.com\/article\/rs-9152968\/v1.html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T16:16:45Z","timestamp":1788797805000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.researchsquare.com\/article\/rs-9152968\/v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,1]]},"references-count":25,"URL":"https:\/\/doi.org\/10.21203\/rs.3.rs-9152968\/v1","relation":{"is-preprint-of":[{"id-type":"doi","id":"10.1007\/s10620-026-10216-0","asserted-by":"subject"}]},"subject":[],"published":{"date-parts":[[2026,4,1]]},"subtype":"preprint"}}