{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T20:58:19Z","timestamp":1785358699701,"version":"3.55.0"},"reference-count":28,"publisher":"American Society of Clinical Oncology (ASCO)","issue":"3","content-domain":{"domain":["ascopubs.org"],"crossmark-restriction":true},"short-container-title":["JCO Clin Cancer Inform"],"published-print":{"date-parts":[[2026,7]]},"abstract":"<jats:sec>\n                    <jats:title>PURPOSE<\/jats:title>\n                    <jats:p>Manual chart review (MR) of electronic health records (EHRs) is time-consuming, error-prone, and limits the reproducibility and scalability of real-world data (RWD) research. Automation and standardization using natural language processing (NLP) could improve efficiency and scalability. CTcue is an NLP-based software platform designed to extract structured and unstructured data from EHRs. This study evaluated the accuracy and efficiency of CTcue versus MR in patients with early-stage resectable non\u2013small cell lung cancer (NSCLC).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>Included were all patients with stage I to III NSCLC who underwent lung resections between January 2018 and December 2021 at the Leiden University Medical Center, the Netherlands. Demographics, tumor characteristics, treatment, and outcomes were collected. CTcue performance was compared with MR using weighted F1-scores, accuracy, precision, and recall for categorical variables and Bland-Altman analysis for continuous variables.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>Eighty-five patients (70.2% of patients from the manual cohort) were identified by both methods and included in the comparison. CTcue achieved weighted F1-scores &gt;0.85 for seven of 15 categorical variables, including sex, tumor location, and deceased status, although some scores were based on low number of observations in both cohorts. Lower performance was observed for variables with varying terminology in documentation, such as Eastern Cooperative Oncology Group status and pathological N-stage. Continuous variables showed negligible mean differences, indicating good agreement. Survival outcomes were identical in both data sets.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSION<\/jats:title>\n                    <jats:p>CTcue performance for patient selection was lower than anticipated. However, it enables accurate, efficient extraction of structured and unstructured EHR data in early-stage NSCLC. Manual validation remains necessary for variables with varying terminology. Further development of artificial intelligence-based tools\u2014particularly for free-text data extraction\u2014will be crucial to enhance the accuracy and scalability of future RWD research.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1200\/cci-25-00383","type":"journal-article","created":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T20:00:11Z","timestamp":1785355211000},"update-policy":"https:\/\/doi.org\/10.1200\/crossmark","source":"Crossref","is-referenced-by-count":0,"title":["Validation of a Text-Mining Tool for Extracting Routine Clinical Care Data in Early-Stage Resectable Non\u2013Small Cell Lung Cancer"],"prefix":"10.1200","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6279-6310","authenticated-orcid":true,"given":"Hanieh","family":"Abedian Kalkhoran","sequence":"first","affiliation":[{"name":"Department of Clinical Pharmacy and Toxicology, Leiden University Medical Center, Leiden, the Netherlands"},{"name":"Department of Pharmacy, Haga Teaching Hospital, The Hague, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-5498-8981","authenticated-orcid":true,"given":"Tobias","family":"Martinot","sequence":"additional","affiliation":[{"name":"Department of Pathology, Leiden University Medical Centre, Leiden, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-1952-424X","authenticated-orcid":true,"given":"Lydia H.N.","family":"Schonewille","sequence":"additional","affiliation":[{"name":"Department of Pulmonology, Leiden University Medical Centre, Leiden, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melek","family":"Huyuk","sequence":"additional","affiliation":[{"name":"Department of Pulmonology, Leiden University Medical Centre, Leiden, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2682-3948","authenticated-orcid":true,"given":"Michiel H.J.","family":"Huigen","sequence":"additional","affiliation":[{"name":"Department of Pathology, Leiden University Medical Centre, Leiden, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7085-1383","authenticated-orcid":true,"given":"Henk-Jan","family":"Guchelaar","sequence":"additional","affiliation":[{"name":"Department of Clinical Pharmacy and Toxicology, Leiden University Medical Center, Leiden, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danielle","family":"Cohen","sequence":"additional","affiliation":[{"name":"Department of Pathology, Leiden University Medical Centre, Leiden, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7329-6995","authenticated-orcid":true,"given":"Egbert F.","family":"Smit","sequence":"additional","affiliation":[{"name":"Department of Pulmonology, Leiden University Medical Centre, Leiden, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6080-6183","authenticated-orcid":true,"given":"Juliette","family":"Zwaveling","sequence":"additional","affiliation":[{"name":"Department of Clinical Pharmacy and Toxicology, Leiden University Medical Center, Leiden, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"233","reference":[{"key":"e_1_3_5_2_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13063-015-1023-4"},{"key":"e_1_3_5_3_2","doi-asserted-by":"publisher","DOI":"10.1002\/ijc.32800"},{"key":"e_1_3_5_4_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2017.73.7916"},{"key":"e_1_3_5_5_2","doi-asserted-by":"publisher","DOI":"10.1002\/cncr.21907"},{"key":"e_1_3_5_6_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-024-03352-5"},{"key":"e_1_3_5_7_2","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.3355"},{"key":"e_1_3_5_8_2","doi-asserted-by":"publisher","DOI":"10.1111\/cts.13903"},{"key":"e_1_3_5_9_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-024-59475-9"},{"key":"e_1_3_5_10_2","article-title":"Automatic classification of tumor response from radiology reports with rule-based natural language processing integrated into the clinical oncology workflow","author":"Laurent G","unstructured":"Laurent G, Craynest F, Thobois M, et al: Automatic classification of tumor response from radiology reports with rule-based natural language processing integrated into the clinical oncology workflow. JCO Clin Cancer Inform 10.1200\/CCI.22.00139","journal-title":"JCO Clin Cancer Inform"},{"key":"e_1_3_5_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.arth.2020.09.055"},{"key":"e_1_3_5_12_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2021-100464"},{"key":"e_1_3_5_13_2","doi-asserted-by":"publisher","DOI":"10.2196\/25113"},{"key":"e_1_3_5_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.clon.2025.103805"},{"key":"e_1_3_5_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-009-9215-7"},{"key":"e_1_3_5_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-024-02070-2"},{"key":"e_1_3_5_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00520-022-07343-5"},{"key":"e_1_3_5_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12471-023-01806-y"},{"key":"e_1_3_5_19_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-023-10701-z"},{"key":"e_1_3_5_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cllc.2025.07.009"},{"key":"e_1_3_5_21_2","doi-asserted-by":"publisher","DOI":"10.3390\/cancers14215426"},{"key":"e_1_3_5_22_2","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.1966"},{"key":"e_1_3_5_23_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41523-021-00280-2"},{"key":"e_1_3_5_24_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0784-1"},{"key":"e_1_3_5_25_2","first-page":"1c","article-title":"Impact of electronic health record systems on information integrity: Quality and safety implications","volume":"10","author":"Bowman S","year":"2013","unstructured":"Bowman S: Impact of electronic health record systems on information integrity: Quality and safety implications. Perspect Health Inf Manag 10:1c, 2013","journal-title":"Perspect Health Inf Manag"},{"key":"e_1_3_5_26_2","article-title":"Development and portability of a text mining algorithm for capturing disease progression in electronic health records of patients with stage IV non-small cell lung cancer","author":"Verschueren MV","unstructured":"Verschueren MV, Abedian Kalkhoran H, Deenen M, et al: Development and portability of a text mining algorithm for capturing disease progression in electronic health records of patients with stage IV non-small cell lung cancer. JCO Clin Cancer Inform 10.1200\/CCI.24.00053","journal-title":"JCO Clin Cancer Inform"},{"key":"e_1_3_5_27_2","doi-asserted-by":"publisher","DOI":"10.7326\/ANNALS-25-00739"},{"key":"e_1_3_5_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00428-025-04337-6"},{"key":"e_1_3_5_29_2","doi-asserted-by":"publisher","DOI":"10.1038\/s43856-025-00808-8"}],"container-title":["JCO Clinical Cancer Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ascopubs.org\/doi\/pdfdirect\/10.1200\/CCI-25-00383","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T20:00:12Z","timestamp":1785355212000},"score":1,"resource":{"primary":{"URL":"https:\/\/ascopubs.org\/doi\/10.1200\/CCI-25-00383"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7]]},"references-count":28,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,7]]}},"alternative-id":["10.1200\/CCI-25-00383"],"URL":"https:\/\/doi.org\/10.1200\/cci-25-00383","relation":{},"ISSN":["2473-4276"],"issn-type":[{"value":"2473-4276","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7]]},"assertion":[{"value":"2025-12-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-30","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2500383"}}