{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T02:50:21Z","timestamp":1792551021296,"version":"4.5.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"11","license":[{"start":{"date-parts":[[2023,8,5]],"date-time":"2023-08-05T00:00:00Z","timestamp":1691193600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,5]],"date-time":"2023-08-05T00:00:00Z","timestamp":1691193600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008375","name":"University of Basel","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008375","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Eur Radiol"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Objectives<\/jats:title>\n                <jats:p>To investigate how a transition from free text to structured reporting affects reporting language with regard to standardization and distinguishability.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A total of 747,393 radiology reports dictated between January 2011 and June 2020 were retrospectively analyzed. The body and cardiothoracic imaging divisions introduced a reporting concept using standardized language and structured reporting templates in January 2016.<\/jats:p>\n                <jats:p>Reports were segmented by a natural language processing algorithm and converted into a 20-dimension document vector. For analysis, dimensionality was reduced to a 2D visualization with t-distributed stochastic neighbor embedding and matched with metadata. Linguistic standardization was assessed by comparing distinct report types\u2019 vector spreads (e.g., run-off MR angiography) between reporting standards. Changes in report type distinguishability (e.g., CT abdomen\/pelvis vs. MR abdomen) were measured by comparing the distance between their centroids.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Structured reports showed lower document vector spread (thus higher linguistic similarity) compared with free-text reports overall (21.9 [free-text] vs. 15.9 [structured];\u2009\u2212\u200927.4%; <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.001) and for most report types, e.g., run-off MR angiography (15.2 vs. 1.8;\u2009\u2212\u200988.2%; <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.001) or double-rule-out CT (26.8 vs. 10.0;\u2009\u2212\u200962.7%; <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.001). No changes were observed for reports continued to be written in free text, e.g., CT head reports (33.2 vs. 33.1;\u2009\u2212\u20090.3%; <jats:italic>p<\/jats:italic>\u2009=\u20091).<\/jats:p>\n                <jats:p>Distances between the report types\u2019 centroids increased with structured reporting (thus better linguistic distinguishability) overall (27.3 vs. 54.4;\u2009+\u200999.3\u2009\u00b1\u200998.4%) and for specific report types, e.g., CT abdomen\/pelvis vs. MR abdomen (13.7 vs. 37.2;\u2009+\u2009171.5%).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Structured reporting and the use of factual language yield more homogenous and standardized radiology reports on a linguistic level, tailored to specific reporting scenarios and imaging studies.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Clinical relevance<\/jats:title>\n                <jats:p>Information transmission to referring physicians, as well as automated report assessment and content extraction in big data analyses, may benefit from standardized reporting, due to consistent report organization and terminology used for pathologies and normal findings.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Key Points<\/jats:title>\n                <jats:p>\u2022 <jats:italic>Natural language processing and t-distributed stochastic neighbor embedding can transform radiology reports into numeric vectors, allowing the quantification of their linguistic standardization.<\/jats:italic><\/jats:p>\n                <jats:p>\u2022 <jats:italic>Structured reporting substantially increases reports\u2019 linguistic standardization (mean:\u2009\u2212\u200927.4% in vector spread) and distinguishability (mean:<\/jats:italic>\u2009+\u2009<jats:italic>99.3<\/jats:italic>\u2009\u00b1\u2009<jats:italic>98.4% increase in vector distance) compared with free-text reports.<\/jats:italic><\/jats:p>\n                <jats:p>\u2022 <jats:italic>Higher standardization and homogeneity outline potential benefits of structured reporting for information transmission and big data analyses.<\/jats:italic><\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s00330-023-10050-2","type":"journal-article","created":{"date-parts":[[2023,8,5]],"date-time":"2023-08-05T05:01:43Z","timestamp":1691211703000},"page":"7496-7506","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Investigating the impact of structured reporting on the linguistic standardization of radiology reports through natural language processing over a 10-year period"],"prefix":"10.1007","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3323-8472","authenticated-orcid":false,"given":"Jan","family":"Vosshenrich","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ivan","family":"Nesic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel T.","family":"Boll","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"Heye","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,8,5]]},"reference":[{"key":"10050_CR1","doi-asserted-by":"publisher","first-page":"490","DOI":"10.2214\/AJR.18.20368","volume":"212","author":"BR Herts","year":"2019","unstructured":"Herts BR, Gandhi NS, Schneider E et al (2019) How we do it: creating consistent structure and content in abdominal radiology report templates. AJR Am J Roentgenol 212:490\u2013496. https:\/\/doi.org\/10.2214\/AJR.18.20368","journal-title":"AJR Am J Roentgenol"},{"key":"10050_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s13244-017-0588-8","volume":"9","author":"European Society of Radiology (ESR)","year":"2018","unstructured":"European Society of Radiology (ESR) (2018) ESR paper on structured reporting in radiology. Insights Imaging 9:1\u20137. https:\/\/doi.org\/10.1007\/s13244-017-0588-8","journal-title":"Insights Imaging"},{"key":"10050_CR3","doi-asserted-by":"publisher","first-page":"642","DOI":"10.1148\/radiol.14141227","volume":"273","author":"TA Morgan","year":"2014","unstructured":"Morgan TA, Helibrun ME, Kahn CE (2014) Reporting initiative of the Radiological Society of North America: progress and new directions. Radiology 273:642\u2013645. https:\/\/doi.org\/10.1148\/radiol.14141227","journal-title":"Radiology"},{"key":"10050_CR4","doi-asserted-by":"publisher","first-page":"591","DOI":"10.2214\/ajr.176.3.1760591","volume":"176","author":"SS Naik","year":"2001","unstructured":"Naik SS, Hanbidge A, Wilson SR (2001) Radiology reports: examining radiologist and clinician preferences regarding style and content. Am J Roentgenol 176:591\u2013598. https:\/\/doi.org\/10.2214\/ajr.176.3.1760591","journal-title":"Am J Roentgenol"},{"key":"10050_CR5","doi-asserted-by":"publisher","first-page":"964","DOI":"10.2214\/AJR.18.19714","volume":"211","author":"T Heye","year":"2018","unstructured":"Heye T, Gysin V, Boll DT, Merkle EM (2018) JOURNAL CLUB: structured reporting: the voice of the customer in an ongoing debate about the future of radiology reporting. AJR Am J Roentgenol 211:964\u2013970. https:\/\/doi.org\/10.2214\/AJR.18.19714","journal-title":"AJR Am J Roentgenol"},{"key":"10050_CR6","doi-asserted-by":"publisher","first-page":"W243","DOI":"10.2214\/AJR.17.19269","volume":"210","author":"B Sureka","year":"2018","unstructured":"Sureka B, Garg P, Khera PS (2018) Seven C\u2019s of effective communication. AJR Am J Roentgenol 210:W243. https:\/\/doi.org\/10.2214\/AJR.17.19269","journal-title":"AJR Am J Roentgenol"},{"key":"10050_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/S13244-019-0831-6","volume":"11","author":"JM Nobel","year":"2020","unstructured":"Nobel JM, Kok EM, Robben SGF (2020) Redefining the structure of structured reporting in radiology. Insights Imaging 11:1\u20135. https:\/\/doi.org\/10.1186\/S13244-019-0831-6","journal-title":"Insights Imaging"},{"key":"10050_CR8","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.acra.2017.08.005","volume":"25","author":"D Ganeshan","year":"2018","unstructured":"Ganeshan D, Duong P-AT, Probyn L et al (2018) Structured reporting in radiology. Acad Radiol 25:66\u201373. https:\/\/doi.org\/10.1016\/j.acra.2017.08.005","journal-title":"Acad Radiol"},{"key":"10050_CR9","doi-asserted-by":"publisher","unstructured":"Pham AD, N\u00e9v\u00e9ol A, Lavergne T et al (2014) Natural language processing of radiology reports for the detection of thromboembolic diseases and clinically relevant incidental findings. BMC\u00a0Bioinformatics 15(1):266.\u00a0https:\/\/doi.org\/10.1186\/1471-2105-15-266","DOI":"10.1186\/1471-2105-15-266"},{"key":"10050_CR10","doi-asserted-by":"publisher","first-page":"1587","DOI":"10.1016\/J.JACR.2019.04.026","volume":"16","author":"SK Kang","year":"2019","unstructured":"Kang SK, Garry K, Chung R et al (2019) Natural language processing for identification of incidental pulmonary nodules in radiology reports. J Am Coll Radiol 16:1587\u20131594. https:\/\/doi.org\/10.1016\/J.JACR.2019.04.026","journal-title":"J Am Coll Radiol"},{"key":"10050_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacr.2017.04.032","author":"SL Ross","year":"2017","unstructured":"Ross SL, Ascher SM, Somwaru AS, Filice R (2017) Quantifying language before and after instituting structured CT reports. J Am Coll Radiol. https:\/\/doi.org\/10.1016\/j.jacr.2017.04.032","journal-title":"J Am Coll Radiol"},{"key":"10050_CR12","doi-asserted-by":"publisher","first-page":"1056","DOI":"10.1016\/j.jacr.2021.02.030","volume":"18","author":"AJ Marks","year":"2021","unstructured":"Marks AJ, Mishra A, Ormsby JW (2021) Hedging in radiology: a discussion on the ethical and financial implications on the US Health Care System. J Am Coll Radiol 18:1056. https:\/\/doi.org\/10.1016\/j.jacr.2021.02.030","journal-title":"J Am Coll Radiol"},{"key":"10050_CR13","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/j.jacr.2016.08.027","volume":"14","author":"JK Hoang","year":"2017","unstructured":"Hoang JK (2017) Do not hedge when there is certainty. J Am Coll Radiol 14:5","journal-title":"J Am Coll Radiol"},{"key":"10050_CR14","unstructured":"Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: 31st International Conference on Machine Learning, ICML 2014. pp 2931\u20132939.\u00a0http:\/\/proceedings.mlr.press\/v32\/le14.pdf"},{"key":"10050_CR15","doi-asserted-by":"publisher","unstructured":"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. In: 1st International Conference on Learning Representations, ICLR 2013 - Workshop Track Proceedings.\u00a0https:\/\/doi.org\/10.48550\/arXiv.1301.3781","DOI":"10.48550\/arXiv.1301.3781"},{"key":"10050_CR16","unstructured":"sklearn.manifold.TSNE \u2014 scikit-learn 1.0.2 documentation. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.manifold.TSNE.html.\u00a0Accessed 1 Sep 2022"},{"key":"10050_CR17","doi-asserted-by":"publisher","unstructured":"M\u00f6nch S, Andrisan T, Bernkopf K et al (2021) Structured reporting of brain MRI following mechanical thrombectomy in acute ischemic stroke patients. BMC Med Imaging\u00a021(1):91.\u00a0https:\/\/doi.org\/10.1186\/s12880-021-00621-4","DOI":"10.1186\/s12880-021-00621-4"},{"key":"10050_CR18","doi-asserted-by":"publisher","first-page":"959","DOI":"10.1097\/RCT.0000000000001209","volume":"45","author":"JE Spiro","year":"2021","unstructured":"Spiro JE, Ceelen F, Kneidinger N et al (2021) Structured reporting of computed tomography examinations in post-lung transplantation patients. J Comput Assist Tomogr 45:959\u2013963. https:\/\/doi.org\/10.1097\/RCT.0000000000001209","journal-title":"J Comput Assist Tomogr"},{"key":"10050_CR19","doi-asserted-by":"publisher","first-page":"464","DOI":"10.1148\/radiol.14140206","volume":"274","author":"OR Brook","year":"2015","unstructured":"Brook OR, Brook A, Vollmer CM et al (2015) Structured reporting of multiphasic CT for pancreatic cancer: potential effect on staging and surgical planning. Radiology 274:464\u2013472. https:\/\/doi.org\/10.1148\/radiol.14140206","journal-title":"Radiology"},{"key":"10050_CR20","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1097\/RLI.0000000000000336","volume":"52","author":"D N\u00f6renberg","year":"2017","unstructured":"N\u00f6renberg D, Sommer WH, Thasler W et al (2017) Structured reporting of rectal magnetic resonance imaging in suspected primary rectal cancer: potential benefits for surgical planning and interdisciplinary communication. Invest Radiol 52:232\u2013239. https:\/\/doi.org\/10.1097\/RLI.0000000000000336","journal-title":"Invest Radiol"},{"key":"10050_CR21","doi-asserted-by":"publisher","first-page":"704","DOI":"10.1007\/s00261-021-03353-9","volume":"47","author":"RF Malik","year":"2022","unstructured":"Malik RF, Hasanain A, Lafaro KJ et al (2022) Structured CT reporting of pancreatic ductal adenocarcinoma: impact on completeness of information and interdisciplinary communication for surgical planning. Abdom Radiol 47:704\u2013714. https:\/\/doi.org\/10.1007\/s00261-021-03353-9","journal-title":"Abdom Radiol"},{"key":"10050_CR22","doi-asserted-by":"publisher","first-page":"835","DOI":"10.2214\/AJR.19.21735","volume":"214","author":"DP Alper","year":"2020","unstructured":"Alper DP, Shinagare AB, Hashemi SR et al (2020) Effect of a report template-enabled quality improvement initiative on use of preferred phrases for communicating normal findings in structured abdominal CT and MRI reports. AJR Am J Roentgenol 214:835\u2013842. https:\/\/doi.org\/10.2214\/AJR.19.21735","journal-title":"AJR Am J Roentgenol"},{"key":"10050_CR23","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1007\/S00247-019-04345-0","volume":"49","author":"LAG Shea","year":"2019","unstructured":"Shea LAG, Towbin AJ (2019) The state of structured reporting: the nuance of standardized language. Pediatr Radiol 49:500\u2013508. https:\/\/doi.org\/10.1007\/S00247-019-04345-0","journal-title":"Pediatr Radiol"},{"key":"10050_CR24","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1016\/j.acra.2014.08.014","volume":"22","author":"DK Powell","year":"2015","unstructured":"Powell DK, Silberzweig JE (2015) State of structured reporting in radiology, a survey. Acad Radiol 22:226\u2013233. https:\/\/doi.org\/10.1016\/j.acra.2014.08.014","journal-title":"Acad Radiol"},{"key":"10050_CR25","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1148\/radiol.14132795","volume":"273","author":"RB Gunderman","year":"2014","unstructured":"Gunderman RB, McNeive LR (2014) Is structured reporting the answer? Radiology 273:7\u20139. https:\/\/doi.org\/10.1148\/radiol.14132795","journal-title":"Radiology"},{"key":"10050_CR26","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1016\/J.JACR.2016.09.037","volume":"14","author":"E Dickerson","year":"2017","unstructured":"Dickerson E, Davenport MS, Syed F et al (2017) Effect of template reporting of brain MRIs for multiple sclerosis on report thoroughness and neurologist-rated quality: results of a prospective quality improvement project. J Am Coll Radiol 14:371-379.e1. https:\/\/doi.org\/10.1016\/J.JACR.2016.09.037","journal-title":"J Am Coll Radiol"},{"key":"10050_CR27","doi-asserted-by":"publisher","first-page":"184","DOI":"10.2214\/AJR.21.26565","volume":"218","author":"MS Davenport","year":"2022","unstructured":"Davenport MS, Weinstein S (2022) What is it we do here? AJR Am J Roentgenol 218:184\u2013185. https:\/\/doi.org\/10.2214\/AJR.21.26565","journal-title":"AJR Am J Roentgenol"},{"key":"10050_CR28","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1148\/radiol.11101913","volume":"260","author":"LH Schwartz","year":"2011","unstructured":"Schwartz LH, Panicek DM, Berk AR et al (2011) Improving communication of diagnostic radiology findings through structured reporting. Radiology 260:174\u2013181. https:\/\/doi.org\/10.1148\/radiol.11101913","journal-title":"Radiology"},{"key":"10050_CR29","doi-asserted-by":"publisher","first-page":"964","DOI":"10.2214\/AJR.18.19714","volume":"211","author":"T Heye","year":"2018","unstructured":"Heye T, Gysin V, Boll DT, Merkle EM (2018) Structured reporting: the voice of the customer in an ongoing debate about the future of radiology reporting. Am J Roentgenol 211:964\u2013970. https:\/\/doi.org\/10.2214\/AJR.18.19714","journal-title":"Am J Roentgenol"},{"key":"10050_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/S13244-023-01408-7","volume":"14","author":"T Jorg","year":"2023","unstructured":"Jorg T, Halfmann MC, Arnhold G et al (2023) Implementation of structured reporting in clinical routine: a review of 7 years of institutional experience. Insights Imaging 14:1\u201310. https:\/\/doi.org\/10.1186\/S13244-023-01408-7","journal-title":"Insights Imaging"},{"key":"10050_CR31","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1016\/S1076-6332(03)80089-2","volume":"10","author":"R Khorasani","year":"2003","unstructured":"Khorasani R, Bates DW, Teeger S et al (2003) Is terminology used effectively to convey diagnostic certainty in radiology reports? Acad Radiol 10:685\u2013688. https:\/\/doi.org\/10.1016\/S1076-6332(03)80089-2","journal-title":"Acad Radiol"},{"key":"10050_CR32","doi-asserted-by":"publisher","unstructured":"Lee B, Whitehead MT (2017) Radiology reports: what YOU think you\u2019re saying and what THEY think you\u2019re saying. Curr Probl Diagn Radiol\u00a046(3):186\u2013195.\u00a0https:\/\/doi.org\/10.1067\/j.cpradiol.2016.11.005","DOI":"10.1067\/j.cpradiol.2016.11.005"},{"key":"10050_CR33","doi-asserted-by":"publisher","unstructured":"Nobel JM, Puts S, Weiss J et al (2021) T-staging pulmonary oncology from radiological reports using natural language processing: translating into a multi-language setting. Insights Imaging 12. https:\/\/doi.org\/10.1186\/S13244-021-01018-1","DOI":"10.1186\/S13244-021-01018-1"}],"container-title":["European Radiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00330-023-10050-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00330-023-10050-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00330-023-10050-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,24]],"date-time":"2023-10-24T17:13:11Z","timestamp":1698167591000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00330-023-10050-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,5]]},"references-count":33,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["10050"],"URL":"https:\/\/doi.org\/10.1007\/s00330-023-10050-2","relation":{},"ISSN":["1432-1084"],"issn-type":[{"value":"1432-1084","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,5]]},"assertion":[{"value":"4 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 May 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 June 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 August 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The scientific guarantor of this publication is Jan Vosshenrich.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Guarantor"}},{"value":"The authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"No complex statistical methods were necessary for this paper.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Statistics and biometry"}},{"value":"Written informed consent was not required for this study because no patient identifiers were used in any part of our retrospective study.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}},{"value":"Institutional Review Board approval was not required because no patient identifiers were used in any part of our retrospective study.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Study subjects or cohorts have not been previously reported.","order":7,"name":"Ethics","group":{"name":"EthicsHeading","label":"Study subjects or cohorts overlap"}},{"value":"\u2022 retrospective\u2022 experimental\u2022 performed at one institution","order":8,"name":"Ethics","group":{"name":"EthicsHeading","label":"Methodology"}}]}}