{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T07:03:51Z","timestamp":1769756631404,"version":"3.49.0"},"reference-count":17,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T00:00:00Z","timestamp":1705017600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T00:00:00Z","timestamp":1705017600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Digit Imaging. Inform. med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Natural language processing (NLP) can be used to process and structure free text, such as (free text) radiological reports. In radiology, it is important that reports are complete and accurate for clinical staging of, for instance, pulmonary oncology. A computed tomography (CT) or positron emission tomography (PET)-CT scan is of great importance in tumor staging, and NLP may be of additional value to the radiological report when used in the staging process as it may be able to extract the T and N stage of the 8th tumor\u2013node\u2013metastasis (TNM) classification system. The purpose of this study is to evaluate a new TN algorithm (TN-PET-CT) by adding a layer of metabolic activity to an already existing rule-based NLP algorithm (TN-CT). This new TN-PET-CT algorithm is capable of staging chest CT examinations as well as PET-CT scans. The study design made it possible to perform a subgroup analysis to test the external validation of the prior TN-CT algorithm. For information extraction and matching, pyContextNLP, SpaCy, and regular expressions were used. Overall TN accuracy score of the TN-PET-CT algorithm was 0.73 and 0.62 in the training and validation set (<jats:italic>N<\/jats:italic>\u2009=\u200963, <jats:italic>N<\/jats:italic>\u2009=\u2009100). The external validation of the TN-CT classifier (<jats:italic>N<\/jats:italic>\u2009=\u200965) was 0.72. Overall, it is possible to adjust the TN-CT algorithm into a TN-PET-CT algorithm. However, outcomes highly depend on the accuracy of the report, the used vocabulary, and its context to express, for example, uncertainty. This is true for both the adjusted PET-CT algorithm and for the CT algorithm when applied in another hospital.<\/jats:p>","DOI":"10.1007\/s10278-023-00913-x","type":"journal-article","created":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T18:02:28Z","timestamp":1705082548000},"page":"3-12","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Natural Language Processing Algorithm Used for Staging Pulmonary Oncology from Free-Text Radiological Reports: \u201cIncluding PET-CT and Validation Towards Clinical Use\u201d"],"prefix":"10.1007","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3379-7290","authenticated-orcid":false,"given":"J. Martijn","family":"Nobel","sequence":"first","affiliation":[]},{"given":"Sander","family":"Puts","sequence":"additional","affiliation":[]},{"given":"Jasenko","family":"Krdzalic","sequence":"additional","affiliation":[]},{"given":"Karen M. L.","family":"Zegers","sequence":"additional","affiliation":[]},{"given":"Marc B. I.","family":"Lobbes","sequence":"additional","affiliation":[]},{"given":"Simon G.","family":"F.\u00a0Robben","sequence":"additional","affiliation":[]},{"given":"Andr\u00e9 L. A. J.","family":"Dekker","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,1,12]]},"reference":[{"key":"913_CR1","doi-asserted-by":"publisher","unstructured":"Detterbeck FC, Boffa DJ, Kim AW, Tanoue LT. The Eighth Edition Lung Cancer Stage Classification. Chest. 2017;151(1):193\u2013203. doi: https:\/\/doi.org\/10.1016\/j.chest.2016.10.010","DOI":"10.1016\/j.chest.2016.10.010"},{"issue":"11","key":"913_CR2","doi-asserted-by":"publisher","first-page":"1015","DOI":"10.1016\/j.crad.2011.05.013","volume":"66","author":"A Wallis","year":"2011","unstructured":"Wallis A, McCoubrie P. The radiology report - are we getting the message across? Clin Radiol. 2011;66(11):1015-22. doi: https:\/\/doi.org\/10.1016\/j.crad.2011.05.013.","journal-title":"Clin Radiol."},{"key":"913_CR3","unstructured":"Langlotz CP. The radiology report: a guide to thoughtful communication for radiologists and other medical professionals. CreateSpace Independent Publishing Platform; 2015."},{"key":"913_CR4","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1007\/s13244-018-0596-3","volume":"9","author":"AP Brady","year":"2018","unstructured":"Brady, AP. Radiology reporting - from Hemingway to HAL?\u00a0Insights Imaging. 2018;9:237\u2013246. doi: https:\/\/doi.org\/10.1007\/s13244-018-0596-3.","journal-title":"Insights Imaging."},{"issue":"5","key":"913_CR5","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1016\/j.jacr.2019.12.026","volume":"17","author":"V Sorin","year":"2020","unstructured":"Sorin V, Barash Y, Konen E, Klang E. Deep Learning for Natural Language Processing in Radiology-Fundamentals and a Systematic Review. J Am Coll Radiol. 2020;17(5):639-648. doi: https:\/\/doi.org\/10.1016\/j.jacr.2019.12.026.","journal-title":"J Am Coll Radiol."},{"key":"913_CR6","first-page":"1305","volume":"2020","author":"JT Wu","year":"2021","unstructured":"Wu JT, Syed A, Ahmad H, Pillai A, Gur Y, Jadhav A, et al. AI Accelerated Human-in-the-loop Structuring of Radiology Reports.\u00a0AMIA Annu Symp Proc. 2021;2020:1305-1314.","journal-title":"AMIA Annu Symp Proc."},{"issue":"6","key":"913_CR7","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1001\/jamaoncol.2016.0213","volume":"2","author":"W Yim","year":"2016","unstructured":"Yim W, Yetisgen M, Harris WP, Kwan SW. Natural Language Processing in Oncology:\u00a0A Review.\u00a0JAMA Oncol.\u00a02016;2(6):797\u2013804. doi: https:\/\/doi.org\/10.1001\/jamaoncol.2016.0213.","journal-title":"JAMA Oncol."},{"issue":"2","key":"913_CR8","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1148\/radiol.16142770","volume":"279","author":"E Pons","year":"2016","unstructured":"Pons E, Braun LM, Hunink MG, Kors JA. Natural Language Processing in Radiology: A Systematic Review. Radiology. 2016;279(2):329-43. doi: https:\/\/doi.org\/10.1148\/radiol.16142770.","journal-title":"Radiology."},{"issue":"1","key":"913_CR9","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1186\/s12911-021-01533-7","volume":"21","author":"A Casey","year":"2021","unstructured":"Casey A, Davidson E, Poon M, Dong H, Duma D, Grivas A, et al. A systematic review of natural language processing applied to radiology reports. BMC Med Inform Decis Mak. 2021;21(1):179. doi: https:\/\/doi.org\/10.1186\/s12911-021-01533-7.","journal-title":"BMC Med Inform Decis Mak."},{"issue":"12","key":"913_CR10","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1080\/0284186X.2020.1819563","volume":"59","author":"OQ Groot","year":"2020","unstructured":"Groot OQ, Bongers MER, Karhade AV, Kapoor ND, Fenn BP, Kim J, et al.\u00a0Natural language processing for automated quantification of bone metastases reported in free-text bone scintigraphy reports. Acta Oncologica. 2020;59(12):1455-1460. doi:\u00a0https:\/\/doi.org\/10.1080\/0284186X.2020.1819563.","journal-title":"Acta Oncologica."},{"issue":"5","key":"913_CR11","doi-asserted-by":"publisher","first-page":"1902","DOI":"10.1016\/j.chest.2021.05.048","volume":"160","author":"C Zheng","year":"2021","unstructured":"Zheng C, Huang BZ, Agazaryan AA, Creekmur B, Osuj T, Gould MK. Natural Language Processing to Identify Pulmonary Nodules and Extract Nodule Characteristics From Radiology Reports. Chest. 2021;160(5):1902-1914. doi: https:\/\/doi.org\/10.1016\/j.chest.2021.05.048.","journal-title":"Chest."},{"issue":"9","key":"913_CR12","doi-asserted-by":"publisher","first-page":"3114","DOI":"10.21037\/jtd.2017.08.13","volume":"9","author":"SE Beyer","year":"2017","unstructured":"Beyer SE, McKee BJ, Regis SM, McKee AB, Flacke S, El Saadawi G, et al. Automatic Lung-RADS\u2122 classification with a natural language processing system. J Thorac Dis. 2017;9(9):3114-3122. doi: https:\/\/doi.org\/10.21037\/jtd.2017.08.13.","journal-title":"J Thorac Dis."},{"issue":"4","key":"913_CR13","doi-asserted-by":"publisher","first-page":"1002","DOI":"10.1007\/s10278-020-00327-z","volume":"33","author":"JM Nobel","year":"2020","unstructured":"Nobel JM, Puts S, Bakers FCH, Robben SGF, Dekker ALAJ. Natural language processing in Dutch free text radiology reports: challenges in a small language area staging pulmonary oncology. J Digit Imaging. 2020;33(4):1002-1008. doi: https:\/\/doi.org\/10.1007\/s10278-020-00327-z.","journal-title":"J Digit Imaging."},{"issue":"1","key":"913_CR14","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1186\/s13244-021-01018-1","volume":"12","author":"JM Nobel","year":"2021","unstructured":"Nobel JM, Puts S, Weiss J, Aerts HJWL, Mak RH, Robben SGF, et al. T-staging pulmonary oncology from radiological reports using natural language processing: translating into a multi-language setting. Insights Imaging. 2021;12(1):77. doi: https:\/\/doi.org\/10.1186\/s13244-021-01018-1.","journal-title":"Insights Imaging."},{"key":"913_CR15","doi-asserted-by":"publisher","DOI":"10.2196\/38125","volume":"7","author":"S Puts","year":"2023","unstructured":"Puts S, Nobel M, Zegers C, Bermejo I, Robben S, Dekker A. How Natural Language Processing Can Aid With Pulmonary Oncology Tumor Node Metastasis Staging From Free-Text Radiology Reports: Algorithm Development and Validation. JMIR Form Res. 2023;7:e38125. doi: https:\/\/doi.org\/10.2196\/38125.","journal-title":"JMIR Form Res."},{"issue":"7","key":"913_CR16","doi-asserted-by":"publisher","first-page":"896","DOI":"10.1016\/j.jacr.2020.12.031","volume":"18","author":"N Kapoor","year":"2021","unstructured":"Kapoor N, Lacson R, Cochon L, Hammer M, Ip I, Boland G, et al. Radiologist Variation in the Rates of Follow-up Imaging Recommendations Made for Pulmonary Nodules. J Am Coll Radiol. 2021;18(7):896-905. doi: https:\/\/doi.org\/10.1016\/j.jacr.2020.12.031.","journal-title":"J Am Coll Radiol."},{"issue":"5","key":"913_CR17","doi-asserted-by":"publisher","first-page":"1194","DOI":"10.1007\/s10278-020-00379-1","volume":"33","author":"AL Callen","year":"2020","unstructured":"Callen AL, Dupont SM, Price A, Laguna B, McCoy D, Do B, et al. Between Always and Never: Evaluating Uncertainty in Radiology Reports Using Natural Language Processing. J Digit Imaging. 2020;33(5):1194-1201. doi: https:\/\/doi.org\/10.1007\/s10278-020-00379-1.","journal-title":"J Digit Imaging."}],"container-title":["Journal of Imaging Informatics in Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-023-00913-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10278-023-00913-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-023-00913-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T15:16:12Z","timestamp":1709306172000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10278-023-00913-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,12]]},"references-count":17,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["913"],"URL":"https:\/\/doi.org\/10.1007\/s10278-023-00913-x","relation":{},"ISSN":["2948-2933"],"issn-type":[{"value":"2948-2933","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,12]]},"assertion":[{"value":"22 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 August 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 September 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 January 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This is an observational study. The Maastricht UMC\u2009+\u2009Research Ethics Committee has confirmed that no ethical approval is required.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}]}}