{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T01:41:13Z","timestamp":1789436473224,"version":"build-2803163510"},"reference-count":39,"publisher":"American Society of Clinical Oncology (ASCO)","issue":"1","content-domain":{"domain":["ascopubs.org"],"crossmark-restriction":true},"short-container-title":["JCO Clin Cancer Inform"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:sec>\n                    <jats:title>PURPOSE<\/jats:title>\n                    <jats:p>Radiology reports are stored as plain text in most electronic health records, rendering the data computationally inaccessible. Large language models are powerful tools for analyzing unstructured text but relatively untested in urologic oncology. We aimed to develop a pipeline to extract data from plain text prostate magnetic resonance imaging (MRI) reports using GPT4.0 and compare the accuracy to manually abstracted data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>We developed a data pipeline using a secure, enterprise-wide deployment of OpenAI's GPT-4.0 to automatically extract data elements from prostate MRI report text when presented with prostate MRI reports. Identical prompts and reports were sent multiple times to determine response variability. We extracted 15 data elements per report and compared accuracy to a manually abstracted gold standard.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>\n                      Across 424 prostate MRI reports, GPT-4.0 response accuracy was consistently above 95%. Individual field accuracies were 98.3% (96.3%-99.3%) for prostate-specific antigen density, 97.4% (95.4%-98.7%) for extracapsular extension, and 98.1% (96.3%-99.2%) for TNM stage, and had a median of 98.1% (96.3%-99.2%), a mean of 97.2% (95.2%-98.3%), and a range of 99.8% (98.7%-100.0%) for number of suspicious lesions to 87.7% (84.2%-90.7%) for identification of lesion location in the base of the prostate. Response variability over five repeated runs ranged from 0.14% to 3.61%, differed based on the data element extracted (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .001), and was inversely correlated with accuracy (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .001). In disagreements between manual and GPT-4.0 extracted data, GPT-4.0 responses were more often deemed correct by an additional reviewer.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSION<\/jats:title>\n                    <jats:p>GPT-4.0 had high accuracy with low variability in extracting data points from prostate cancer MRI reports with low upfront programming requirements. This represents an effective tool to expedite medical data extraction for clinical and research use cases.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1200\/cci-24-00334","type":"journal-article","created":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T21:00:15Z","timestamp":1767819615000},"update-policy":"https:\/\/doi.org\/10.1200\/crossmark","source":"Crossref","is-referenced-by-count":3,"title":["Generative Artificial Intelligence Successfully Automates Data Extraction From Unstructured Magnetic Resonance Imaging Reports: Feasibility in Prostate Cancer Care"],"prefix":"10.1200","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0975-0812","authenticated-orcid":true,"given":"Anobel Y.","family":"Odisho","sequence":"first","affiliation":[{"name":"Department of Urology, University of California, San Francisco, San Francisco, CA"},{"name":"Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8033-2598","authenticated-orcid":true,"given":"Andrew W.","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Urology, University of California, San Francisco, San Francisco, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1877-3725","authenticated-orcid":true,"given":"William A.","family":"Pace","sequence":"additional","affiliation":[{"name":"Department of Urology, University of California, San Francisco, San Francisco, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-6467-0758","authenticated-orcid":true,"given":"Marvin N.","family":"Carlisle","sequence":"additional","affiliation":[{"name":"Department of Urology, University of California, San Francisco, San Francisco, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-7155-381X","authenticated-orcid":true,"given":"Robert","family":"Krumm","sequence":"additional","affiliation":[{"name":"Department of Urology, University of California, San Francisco, San Francisco, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1852-8260","authenticated-orcid":true,"given":"Janet E.","family":"Cowan","sequence":"additional","affiliation":[{"name":"Department of Urology, University of California, San Francisco, San Francisco, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1086-4334","authenticated-orcid":true,"given":"Peter R.","family":"Carroll","sequence":"additional","affiliation":[{"name":"Department of Urology, University of California, San Francisco, San Francisco, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4339-6685","authenticated-orcid":true,"given":"Matthew R.","family":"Cooperberg","sequence":"additional","affiliation":[{"name":"Department of Urology, University of California, San Francisco, San Francisco, CA"},{"name":"Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"233","reference":[{"key":"e_1_3_6_2_2","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooaa029"},{"key":"e_1_3_6_3_2","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooab085"},{"key":"e_1_3_6_4_2","doi-asserted-by":"publisher","DOI":"10.1136\/jclinpath-2016-203872"},{"key":"e_1_3_6_5_2","article-title":"Automating the capture of structured pathology data for prostate cancer clinical care and research","author":"Odisho AY","unstructured":"Odisho AY, Bridge M, Webb M, et al: Automating the capture of structured pathology data for prostate cancer clinical care and research. JCO Clin Cancer Inform 10.1200\/CCI.18.00084","journal-title":"JCO Clin Cancer Inform"},{"key":"e_1_3_6_6_2","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooae044"},{"key":"e_1_3_6_7_2","doi-asserted-by":"publisher","DOI":"10.1089\/end.2023.0690"},{"key":"e_1_3_6_8_2","first-page":"1292","article-title":"A review of the opportunities and challenges with large language models in radiology: The road ahead","volume":"46","author":"Soni N","year":"2025","unstructured":"Soni N, Ora M, Agarwal A, et al: A review of the opportunities and challenges with large language models in radiology: The road ahead. AJNR Am J Neuroradiol 46:1292-1299, 2025","journal-title":"AJNR Am J Neuroradiol"},{"key":"e_1_3_6_9_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-023-00958-w"},{"key":"e_1_3_6_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00234-023-03252-4"},{"key":"e_1_3_6_11_2","article-title":"Development of a liver disease-specific large language model chat interface using retrieval augmented generation","author":"Ge J","unstructured":"Ge J, Sun S, Owens J, et al: Development of a liver disease-specific large language model chat interface using retrieval augmented generation. medRxiv. 10.1101\/2023.11.10.23298364","journal-title":"medRxiv"},{"key":"e_1_3_6_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmi.2023.11.002"},{"key":"e_1_3_6_13_2","first-page":"11588","article-title":"Emergence of artificial generative intelligence and its potential impact on urology","volume":"30","author":"Javid M","year":"2023","unstructured":"Javid M, Reddiboina M, Bhandari M: Emergence of artificial generative intelligence and its potential impact on urology. Can J Urol 30:11588-11598, 2023","journal-title":"Can J Urol"},{"key":"e_1_3_6_14_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.231362"},{"key":"e_1_3_6_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejrad.2024.111458"},{"key":"e_1_3_6_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-023-10384-x"},{"key":"e_1_3_6_17_2","article-title":"Human-level information extraction from clinical reports with fine-tuned language models","author":"Liu L","unstructured":"Liu L, Lian L, Hao Y, et al. Human-level information extraction from clinical reports with fine-tuned language models. medRxiv 10.1101\/2024.11.18.24317466","journal-title":"medRxiv"},{"key":"e_1_3_6_18_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.JU.0001110124.33114.43.03"},{"key":"e_1_3_6_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.euf.2024.01.009"},{"key":"e_1_3_6_20_2","doi-asserted-by":"publisher","DOI":"10.1097\/JCMA.0000000000001064"},{"key":"e_1_3_6_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.urology.2025.03.027"},{"key":"e_1_3_6_22_2","doi-asserted-by":"publisher","DOI":"10.2196\/56500"},{"key":"e_1_3_6_23_2","doi-asserted-by":"publisher","DOI":"10.1097\/JS9.0000000000001312"},{"key":"e_1_3_6_24_2","doi-asserted-by":"publisher","DOI":"10.5435\/JAAOS-D-23-00474"},{"key":"e_1_3_6_25_2","first-page":"e58936","article-title":"Exploring the role of ChatGPT in cardiology: A systematic review of the current literature","volume":"16","author":"Sharma A","year":"2024","unstructured":"Sharma A, Medapalli T, Alexandrou M, et al: Exploring the role of ChatGPT in cardiology: A systematic review of the current literature. Cureus 16:e58936, 2024","journal-title":"Cureus"},{"key":"e_1_3_6_26_2","unstructured":"Odisho A Liu A Pace WA et al: Odisho-UCSF-Lab\/llm_api_report_extraction. GitHub: Odisho-UCSF-Lab. 2024. https:\/\/github.com\/odisho-ucsf-lab\/llm_api_report_extraction"},{"key":"e_1_3_6_27_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-45563-x"},{"key":"e_1_3_6_28_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.232561"},{"key":"e_1_3_6_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-013-9616-5"},{"key":"e_1_3_6_30_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.JU.0001110124.33114.43.04"},{"key":"e_1_3_6_31_2","doi-asserted-by":"publisher","DOI":"10.1097\/UPJ.0000000000000599"},{"key":"e_1_3_6_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-023-09977-3"},{"key":"e_1_3_6_33_2","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocad133"},{"key":"e_1_3_6_34_2","doi-asserted-by":"publisher","DOI":"10.1148\/ryai.230364"},{"key":"e_1_3_6_35_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.230725"},{"key":"e_1_3_6_36_2","doi-asserted-by":"publisher","DOI":"10.1053\/j.gastro.2023.12.019"},{"key":"e_1_3_6_37_2","doi-asserted-by":"publisher","DOI":"10.1002\/path.6232"},{"key":"e_1_3_6_38_2","doi-asserted-by":"publisher","DOI":"10.2214\/AJR.23.30651"},{"key":"e_1_3_6_39_2","doi-asserted-by":"publisher","DOI":"10.3390\/cancers16132402"},{"key":"e_1_3_6_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2025.04.1226"}],"container-title":["JCO Clinical Cancer Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ascopubs.org\/doi\/pdfdirect\/10.1200\/CCI-24-00334","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T21:32:06Z","timestamp":1775165526000},"score":1,"resource":{"primary":{"URL":"https:\/\/ascopubs.org\/doi\/10.1200\/CCI-24-00334"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1200\/CCI-24-00334"],"URL":"https:\/\/doi.org\/10.1200\/cci-24-00334","relation":{},"ISSN":["2473-4276"],"issn-type":[{"value":"2473-4276","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]},"assertion":[{"value":"2024-12-31","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-07","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-18","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2400334"}}