{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T13:46:22Z","timestamp":1776433582559,"version":"3.51.2"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2023,11,20]],"date-time":"2023-11-20T00:00:00Z","timestamp":1700438400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,20]],"date-time":"2023-11-20T00:00:00Z","timestamp":1700438400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008375","name":"University of Basel","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008375","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Eur Radiol"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Objectives<\/jats:title>\n                <jats:p>To automatically label chest radiographs and chest CTs regarding the detection of pulmonary infection in the report text, to calculate the number needed to image (NNI) and to investigate if these labels correlate with regional epidemiological infection data.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Materials and methods<\/jats:title>\n                <jats:p>All chest imaging reports performed in the emergency room between 01\/2012 and 06\/2022 were included (64,046 radiographs; 27,705 CTs). Using a regular expression-based text search algorithm, reports were labeled positive\/negative for pulmonary infection if described.<\/jats:p>\n                <jats:p>Data for regional weekly influenza-like illness (ILI) consultations (10\/2013\u20133\/2022), COVID-19 cases, and hospitalization (2\/2020\u20136\/2022) were matched with report labels based on calendar date. Positive rate for pulmonary infection detection, NNI, and the correlation with influenza\/COVID-19 data were calculated.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Between 1\/2012 and 2\/2020, a 10.8\u201316.8% per year positive rate for detecting pulmonary infections on chest radiographs was found (NNI 6.0\u20139.3). A clear and significant seasonal change in mean monthly detection counts (102.3 winter; 61.5 summer; <jats:italic>p\u00a0<\/jats:italic>&lt; .001) correlated moderately with regional ILI consultations (weekly data <jats:italic>r\u00a0<\/jats:italic>= 0.45; <jats:italic>p\u00a0<\/jats:italic>&lt; .001).<\/jats:p>\n                <jats:p>For 2020\u20132021, monthly pulmonary infection counts detected by chest CT increased to 64\u2013234 (23.0\u201326.7% per year positive rate, NNI 3.7\u20134.3) compared with 14\u201394 (22.4\u201326.7% positive rate, NNI 3.7\u20134.4) for 2012\u20132019. Regional COVID-19 epidemic waves correlated moderately with the positive pulmonary infection CT curve for 2020\u20132022 (weekly new cases: <jats:italic>r\u00a0<\/jats:italic>= 0.53; hospitalizations: <jats:italic>r\u00a0<\/jats:italic>= 0.65; <jats:italic>p\u00a0<\/jats:italic>&lt; .001).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Text mining of radiology reports allows to automatically extract diagnoses. It provides a metric to calculate the number needed to image and to track the trend of diagnoses in real time, i.e., seasonality and epidemic course of pulmonary infections.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Clinical relevance<\/jats:title>\n                <jats:p>Digitally labeling radiology reports represent previously neglected data and may assist in automated disease tracking, in the assessment of physicians\u2019 clinical reasoning for ordering radiology examinations and serve as actionable data for hospital workflow optimization.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Key Points<\/jats:title>\n                <jats:p>\u2022 <jats:italic>Radiology reports, commonly not machine readable, can be automatically labeled with the contained diagnoses using a regular-expression based text search algorithm.<\/jats:italic><\/jats:p>\n                <jats:p>\u2022 <jats:italic>Chest radiograph reports positive for pulmonary infection moderately correlated with regional influenza-like illness consultations (weekly data; r = 0.45; p &lt; .001) and chest CT reports with the course of the regional COVID-19 pandemic (new cases: r = 0.53; hospitalizations: r = 0.65; p &lt; 0.001).<\/jats:italic><\/jats:p>\n                <jats:p>\u2022 <jats:italic>Rendering radiology reports into data labels provides a metric for automated disease tracking, the assessment of ordering physicians clinical reasoning and can serve as actionable data for workflow optimization.<\/jats:italic><\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s00330-023-10424-6","type":"journal-article","created":{"date-parts":[[2023,11,20]],"date-time":"2023-11-20T07:02:31Z","timestamp":1700463751000},"page":"3624-3634","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Turning radiology reports into epidemiological data to track seasonal pulmonary infections and the COVID-19 pandemic"],"prefix":"10.1007","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9949-0545","authenticated-orcid":false,"given":"Tobias","family":"Heye","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Segeroth","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabian","family":"Franzeck","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan","family":"Vosshenrich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,11,20]]},"reference":[{"key":"10424_CR1","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.artmed.2015.09.007","volume":"66","author":"S Hassanpour","year":"2016","unstructured":"Hassanpour S, Langlotz CP (2016) Information extraction from multi-institutional radiology reports. Artif Intell Med 66:29\u201339. https:\/\/doi.org\/10.1016\/j.artmed.2015.09.007","journal-title":"Artif Intell Med"},{"key":"10424_CR2","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1148\/radiol.16142770","volume":"279","author":"E Pons","year":"2016","unstructured":"Pons E, Braun LMMM, Hunink MGMM, Kors JA (2016) Natural language processing in radiology: a systematic review. Radiology 279:329\u2013343. https:\/\/doi.org\/10.1148\/radiol.16142770","journal-title":"Radiology"},{"key":"10424_CR3","unstructured":"International Classification of Diseases. https:\/\/en.wikipedia.org\/wiki\/International_Classification_of_Diseases. Accessed 14 Sep 2023"},{"key":"10424_CR4","doi-asserted-by":"publisher","unstructured":"Plurad D, Green D, Demetriades D, Rhee P (2007) The increasing use of chest computed tomography for trauma: is it being overutilized? J Trauma 62: https:\/\/doi.org\/10.1097\/TA.0b013e31802bf009","DOI":"10.1097\/TA.0b013e31802bf009"},{"key":"10424_CR5","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1001\/jama.2018.20295","volume":"321","author":"O Oren","year":"2019","unstructured":"Oren O, Kebebew E, Ioannidis JPA (2019) Curbing unnecessary and wasted diagnostic imaging. JAMA 321:245. https:\/\/doi.org\/10.1001\/jama.2018.20295","journal-title":"JAMA"},{"key":"10424_CR6","doi-asserted-by":"publisher","unstructured":"Davenport MS (2023) Incidental findings and low-value care. AJR Am J Roentgenol. https:\/\/doi.org\/10.2214\/ajr.22.28926","DOI":"10.2214\/ajr.22.28926"},{"key":"10424_CR7","doi-asserted-by":"publisher","first-page":"1015","DOI":"10.1007\/s00330-022-09121-7","volume":"33","author":"S Ersoydan","year":"2023","unstructured":"Ersoydan S, Yakar D, Kasalak \u00d6, Kwee TC (2023) Did medical doctors who order abdominal CT scans during on-call hours truly become worse at clinical reasoning? Yes, they did. Eur Radiol 33:1015\u20131021. https:\/\/doi.org\/10.1007\/s00330-022-09121-7","journal-title":"Eur Radiol"},{"key":"10424_CR8","doi-asserted-by":"publisher","first-page":"E79","DOI":"10.3174\/AJNR.A5276","volume":"38","author":"S Haller","year":"2017","unstructured":"Haller S (2017) The concept of \u201cNumber Needed to Image.\u201d AJNR Am J Neuroradiol 38:E79. https:\/\/doi.org\/10.3174\/AJNR.A5276","journal-title":"AJNR Am J Neuroradiol"},{"key":"10424_CR9","doi-asserted-by":"publisher","first-page":"1012","DOI":"10.1038\/nature07634","volume":"457","author":"J Ginsberg","year":"2009","unstructured":"Ginsberg J, Mohebbi MH, Patel RS et al (2009) Detecting influenza epidemics using search engine query data. Nature 457:1012\u20131014. https:\/\/doi.org\/10.1038\/nature07634","journal-title":"Nature"},{"key":"10424_CR10","doi-asserted-by":"publisher","unstructured":"Santillana M, Zhang DW, Althouse BM, Ayers JW (2014) What can digital disease detection learn from (an external revision to) Google flu trends? Am J Prev Med 47: https:\/\/doi.org\/10.1016\/j.amepre.2014.05.020","DOI":"10.1016\/j.amepre.2014.05.020"},{"key":"10424_CR11","doi-asserted-by":"publisher","first-page":"1203","DOI":"10.1126\/science.1248506","volume":"343","author":"D Lazer","year":"2014","unstructured":"Lazer D, Kennedy R, King G, Vespignani A (2014) The parable of google flu: traps in big data analysis. Science 343:1203\u20131205. https:\/\/doi.org\/10.1126\/science.1248506","journal-title":"Science"},{"key":"10424_CR12","doi-asserted-by":"publisher","first-page":"1961","DOI":"10.1001\/archinternmed.2009.360","volume":"169","author":"WB Hall","year":"2009","unstructured":"Hall WB, Truitt SG, Scheunemann LP et al (2009) The prevalence of clinically relevant incidental findings on chest computed tomographic angiograms ordered to diagnose pulmonary embolism. Arch Intern Med 169:1961\u20131965. https:\/\/doi.org\/10.1001\/archinternmed.2009.360","journal-title":"Arch Intern Med"},{"key":"10424_CR13","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1148\/radiol.15141208","volume":"276","author":"RM Dunne","year":"2015","unstructured":"Dunne RM, Ip IK, Abbett S et al (2015) Effect of evidence-based clinical decision support on the use and yield of CT pulmonary angiographic imaging in hospitalized patients. Radiology 276:167\u2013174. https:\/\/doi.org\/10.1148\/radiol.15141208","journal-title":"Radiology"},{"key":"10424_CR14","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1148\/radiol.11110951","volume":"262","author":"AS Raja","year":"2012","unstructured":"Raja AS, Ip IK, Prevedello LM et al (2012) Effect of computerized clinical decision support on the use and yield of CT pulmonary angiography in the emergency department. Radiology 262:468\u2013474. https:\/\/doi.org\/10.1148\/radiol.11110951","journal-title":"Radiology"},{"key":"10424_CR15","doi-asserted-by":"publisher","unstructured":"Raja AS, Ip IK, Dunne RM et al (2015) Effects of Performance feedback reports on adherence to evidence- based guidelines in use of CT for evaluation of pulmonary embolism in the emergency department: a randomized trial. AJR Am J Roentgenol 205:936\u2013940. https:\/\/doi.org\/10.2214\/AJR.15.14677","DOI":"10.2214\/AJR.15.14677"},{"key":"10424_CR16","doi-asserted-by":"publisher","unstructured":"Cury RC, Megyeri I, Lindsey T, et al (2021) Natural language processing and machine learning for detection of respiratory illness by chest CT imaging and tracking of COVID-19 pandemic in the US. Radiol Cardiothorac Imaging 3: https:\/\/doi.org\/10.1148\/RYCT.2021200596","DOI":"10.1148\/RYCT.2021200596"},{"key":"10424_CR17","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1006\/JBIN.2001.1029","volume":"34","author":"WW Chapman","year":"2001","unstructured":"Chapman WW, Bridewell W, Hanbury P et al (2001) A simple algorithm for identifying negated findings and diseases in discharge summaries. J Biomed Inform 34:301\u2013310. https:\/\/doi.org\/10.1006\/JBIN.2001.1029","journal-title":"J Biomed Inform"},{"key":"10424_CR18","unstructured":"Sentinella reporting system - Swiss Federal Office of Public Health, Communicable Disease Division. https:\/\/www.bag.admin.ch\/bag\/de\/home\/krankheiten\/infektionskrankheiten-bekaempfen\/meldesysteme-infektionskrankheiten\/sentinella-meldesystem.html. Accessed\u00a001\/05\/2023."},{"key":"10424_CR19","unstructured":"COVID-\u206019 Switzerland - Swiss Federal Office of Public Health. https:\/\/www.covid19.admin.ch\/en\/overview. Accessed\u00a001\/05\/2023."},{"key":"10424_CR20","doi-asserted-by":"crossref","unstructured":"Myers L, Sirois MJ (2006) Spearman correlation coefficients, differences between. In: Encyclopedia of Statistical Sciences. John Wiley & Sons, Ltd","DOI":"10.1002\/0471667196.ess5050.pub2"},{"key":"10424_CR21","doi-asserted-by":"publisher","unstructured":"Virtanen P, Gommers R, Oliphant TE, et al (2020) SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat Methods 17: https:\/\/doi.org\/10.1038\/s41592-019-0686-2","DOI":"10.1038\/s41592-019-0686-2"},{"key":"10424_CR22","doi-asserted-by":"publisher","unstructured":"Stewart C, Smith-Bindman R (2021) It is time to inform patients of medical imaging risks. JAMA Netw Open 4:e2129681.\u00a0https:\/\/doi.org\/10.1001\/jamanetworkopen.2021.29681","DOI":"10.1001\/jamanetworkopen.2021.29681"},{"key":"10424_CR23","doi-asserted-by":"publisher","unstructured":"Salastekar NV, Duszak R, Santavicca S et al (2023) Utilization of chest and abdominopelvic CT for traumatic injury from 2011 to 2018: evaluation using a national commercial database. AJR Am J Roentgenol 220:265\u2013271. https:\/\/doi.org\/10.2214\/AJR.22.27991","DOI":"10.2214\/AJR.22.27991"},{"key":"10424_CR24","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.ejim.2023.02.022","volume":"111","author":"RV Kopparam","year":"2023","unstructured":"Kopparam RV, Redberg RF (2023) The environmental impact of unnecessary imaging: why less is more. Eur J Intern Med 111:35\u201336. https:\/\/doi.org\/10.1016\/j.ejim.2023.02.022","journal-title":"Eur J Intern Med"},{"key":"10424_CR25","doi-asserted-by":"publisher","unstructured":"Van Vugt SF, Verheij TJM, De Jong PA, et al (2013) Diagnosing pneumonia in patients with acute cough: clinical judgment compared to chest radiography. Eur Respir J 42: https:\/\/doi.org\/10.1183\/09031936.00111012","DOI":"10.1183\/09031936.00111012"},{"key":"10424_CR26","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1001\/jamacardio.2021.0064","volume":"6","author":"P-M Roy","year":"2021","unstructured":"Roy P-M, Friou E, Germeau B et al (2021) Derivation and validation of a 4-level clinical pretest probability score for suspected pulmonary embolism to safely decrease imaging testing. JAMA Cardiol 6:669. https:\/\/doi.org\/10.1001\/jamacardio.2021.0064","journal-title":"JAMA Cardiol"},{"key":"10424_CR27","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1377\/hlthaff.2011.0762","volume":"31","author":"S Larsson","year":"2012","unstructured":"Larsson S, Lawyer P, Garellick G et al (2012) Use of 13 disease registries in 5 countries demonstrates the potential to use outcome data to improve health care\u2019s value. Health Aff 31:220\u2013227. https:\/\/doi.org\/10.1377\/hlthaff.2011.0762","journal-title":"Health Aff"},{"key":"10424_CR28","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1093\/EURPUB\/CKV250","volume":"26","author":"M Herida","year":"2016","unstructured":"Herida M, Dervaux B, Desenclos JC (2016) Economic evaluations of public health surveillance systems: a systematic review. Eur J Public Health 26:674\u2013680. https:\/\/doi.org\/10.1093\/EURPUB\/CKV250","journal-title":"Eur J Public Health"},{"key":"10424_CR29","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1038\/s41586-021-03792-w","volume":"596","author":"A Telenti","year":"2021","unstructured":"Telenti A, Arvin A, Corey L et al (2021) After the pandemic: perspectives on the future trajectory of COVID-19. Nature 596:495\u2013504. https:\/\/doi.org\/10.1038\/s41586-021-03792-w","journal-title":"Nature"},{"key":"10424_CR30","doi-asserted-by":"publisher","first-page":"1981","DOI":"10.1056\/NEJMra2301725","volume":"388","author":"P Rajpurkar","year":"2023","unstructured":"Rajpurkar P, Lungren MP (2023) The current and future state of AI interpretation of medical images. N Engl J Med 388:1981\u20131990. https:\/\/doi.org\/10.1056\/NEJMra2301725","journal-title":"N Engl J Med"},{"key":"10424_CR31","doi-asserted-by":"publisher","first-page":"2115","DOI":"10.1007\/s00330-020-07306-6","volume":"31","author":"J Vosshenrich","year":"2021","unstructured":"Vosshenrich J, Nesic I, Cyriac J et al (2021) Revealing the most common reporting errors through data mining of the report proofreading process. Eur Radiol 31:2115\u20132125. https:\/\/doi.org\/10.1007\/s00330-020-07306-6","journal-title":"Eur Radiol"},{"key":"10424_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2022.05.011","author":"J Vosshenrich","year":"2022","unstructured":"Vosshenrich J, Brantner P, Cyriac J et al (2022) Quantifying the effects of structured reporting on report turnaround times and proofreading workload in neuroradiology. Acad Radiol. https:\/\/doi.org\/10.1016\/j.acra.2022.05.011","journal-title":"Acad Radiol"},{"key":"10424_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/S00330-023-10050-2\/FIGURES\/6","volume":"1","author":"J Vosshenrich","year":"2023","unstructured":"Vosshenrich J, Nesic I, Boll DT, Heye T (2023) Investigating the impact of structured reporting on the linguistic standardization of radiology reports through natural language processing over a 10-year period. Eur Radiol 1:1\u201311. https:\/\/doi.org\/10.1007\/S00330-023-10050-2\/FIGURES\/6","journal-title":"Eur Radiol"},{"key":"10424_CR34","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1007\/s10278-019-00237-9","volume":"32","author":"S Bozkurt","year":"2019","unstructured":"Bozkurt S, Alkim E, Banerjee I, Rubin DL (2019) Automated detection of measurements and their descriptors in radiology reports using a hybrid natural language processing algorithm. J Digit Imaging 32:544\u2013553. https:\/\/doi.org\/10.1007\/s10278-019-00237-9","journal-title":"J Digit Imaging"},{"key":"10424_CR35","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1148\/radiol.223312","volume":"307","author":"S Biswas","year":"2023","unstructured":"Biswas S (2023) ChatGPT and the future of medical writing. Radiology 307:3\u20135. https:\/\/doi.org\/10.1148\/radiol.223312","journal-title":"Radiology"}],"container-title":["European Radiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00330-023-10424-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00330-023-10424-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00330-023-10424-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,11]],"date-time":"2024-06-11T10:09:10Z","timestamp":1718100550000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00330-023-10424-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,20]]},"references-count":35,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["10424"],"URL":"https:\/\/doi.org\/10.1007\/s00330-023-10424-6","relation":{},"ISSN":["1432-1084"],"issn-type":[{"value":"1432-1084","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,20]]},"assertion":[{"value":"3 July 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 September 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 October 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 November 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The scientific guarantor of this publication is Tobias Heye.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Guarantor"}},{"value":"The authors of this manuscript declare no relationships with any companies, whose products or services may be related to the subject matter of the article.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"No complex statistical methods were necessary for this paper.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Statistics and biometry"}},{"value":"Written informed consent was waived by the Institutional Review Board.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}},{"value":"Institutional Review Board approval was obtained.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Study subjects or cohorts have not been previously reported, however data from this study was presented as a Research Presentation at the ECR 2022 in Vienna, Austria.","order":7,"name":"Ethics","group":{"name":"EthicsHeading","label":"Study subjects or cohorts overlap"}},{"value":"\u2022 retrospective\u2022 experimental\u2022 performed at one institution","order":8,"name":"Ethics","group":{"name":"EthicsHeading","label":"Methodology"}}]}}