{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T14:46:12Z","timestamp":1758638772081},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T00:00:00Z","timestamp":1643932800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T00:00:00Z","timestamp":1643932800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"crossref","award":["5T32EB001631"],"award-info":[{"award-number":["5T32EB001631"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Imaging"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The comprehensiveness and maintenance of the American College of Radiology (ACR) Appropriateness Criteria (AC) makes it a unique resource for evidence-based clinical imaging decision support, but it is underutilized by clinicians. To facilitate the use of imaging recommendations, we develop a natural language processing (NLP) search algorithm that automatically matches clinical indications that physicians write into imaging orders to appropriate AC imaging recommendations.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We apply a hybrid model of semantic similarity from a sent2vec model trained on 223 million scientific sentences, combined with term frequency inverse document frequency features. AC documents are ranked based on their embeddings\u2019 cosine distance to query. For model testing, we compiled a dataset of simulated simple and complex indications for each AC document (n\u2009=\u2009410) and another with clinical indications from randomly sampled radiology reports (n\u2009=\u2009100). We compare our algorithm to a custom google search engine.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>On the simulated indications, our algorithm ranked ground truth documents as top 3 for 98% of simple queries and 85% of complex queries. Similarly, on the randomly sampled radiology report dataset, the algorithm ranked 86% of indications with a single match as top 3. Vague and distracting phrases present in the free-text indications were main sources of errors. Our algorithm provides more relevant results than a custom Google search engine, especially for complex queries.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>We have developed and evaluated an NLP algorithm that matches clinical indications to appropriate AC guidelines. This approach can be integrated into imaging ordering systems for automated access to guidelines.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12880-022-00740-6","type":"journal-article","created":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T16:13:28Z","timestamp":1643991208000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Clinical language search algorithm from free-text: facilitating appropriate imaging"],"prefix":"10.1186","volume":"22","author":[{"given":"Gunvant R.","family":"Chaudhari","sequence":"first","affiliation":[]},{"given":"Yeshwant R.","family":"Chillakuru","sequence":"additional","affiliation":[]},{"given":"Timothy L.","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Valentina","family":"Pedoia","sequence":"additional","affiliation":[]},{"given":"Thienkhai H.","family":"Vu","sequence":"additional","affiliation":[]},{"given":"Christopher P.","family":"Hess","sequence":"additional","affiliation":[]},{"given":"Youngho","family":"Seo","sequence":"additional","affiliation":[]},{"given":"Jae Ho","family":"Sohn","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,2,4]]},"reference":[{"issue":"1","key":"740_CR1","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1111\/jep.12635","volume":"23","author":"M Agapova","year":"2017","unstructured":"Agapova M, Bresnahan BB, Higashi M, Kessler L, Garrison LP, Devine B. A proposed approach for quantitative benefit-risk assessment in diagnostic radiology guideline development: the American College of Radiology appropriateness criteria example. J Eval Clin Pract. 2017;23(1):128\u201338.","journal-title":"J Eval Clin Pract"},{"key":"740_CR2","unstructured":"ACR Appropriateness Criteria Search [Internet]. ACR.org. [cited 2020 May 11]. Available from: https:\/\/acsearch.acr.org\/."},{"issue":"12","key":"740_CR3","doi-asserted-by":"publisher","first-page":"1606","DOI":"10.1016\/j.acra.2015.08.011","volume":"22","author":"B Kozak","year":"2015","unstructured":"Kozak B, Webb EM, Khan BK, Orozco NM, Straus CM, Naeger DM. Medical student usage of the American College of Radiology appropriateness criteria. Acad Radiol. 2015;22(12):1606\u201311.","journal-title":"Acad Radiol"},{"issue":"6","key":"740_CR4","doi-asserted-by":"publisher","first-page":"1581","DOI":"10.2214\/AJR.08.1622","volume":"192","author":"AB Bautista","year":"2009","unstructured":"Bautista AB, Burgos A, Nickel BJ, Yoon JJ, Tilara AA, Amorosa JK. Do clinicians use the American College of Radiology appropriateness criteria in the management of their patients? Am J Roentgenol. 2009;192(6):1581\u20135.","journal-title":"Am J Roentgenol"},{"key":"740_CR5","unstructured":"ACR Select-National Decision Support Company [Internet]. CareSelect. [cited 2020 Jan 15]. Available from: https:\/\/nationaldecisionsupport.com\/acrselect\/."},{"key":"740_CR6","unstructured":"Appropriateness Criteria [Internet]. [cited 2020 Nov 27]. Available from: https:\/\/acsearch.acr.org\/list."},{"issue":"4","key":"740_CR7","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1016\/j.jacc.2013.04.059","volume":"62","author":"FY Lin","year":"2013","unstructured":"Lin FY, Dunning AM, Narula J, Shaw LJ, Gransar H, Berman DS, et al. Impact of an automated multimodality point-of-order decision support tool on rates of appropriate testing and clinical decision making for individuals with suspected coronary artery disease: a prospective multicenter study. J Am Coll Cardiol. 2013;62(4):308\u201316.","journal-title":"J Am Coll Cardiol"},{"issue":"7","key":"740_CR8","doi-asserted-by":"publisher","first-page":"951","DOI":"10.1016\/j.jacr.2018.03.045","volume":"15","author":"TC Huber","year":"2018","unstructured":"Huber TC, Krishnaraj A, Patrie J, Gaskin CM. Impact of a commercially available clinical decision support program on provider ordering habits. J Am Coll Radiol. 2018;15(7):951\u20137.","journal-title":"J Am Coll Radiol"},{"issue":"2","key":"740_CR9","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1016\/j.jacr.2015.08.026","volume":"13","author":"AY Sheng","year":"2016","unstructured":"Sheng AY, Castro A, Lewiss RE. Awareness, utilization, and education of the ACR appropriateness criteria: a review and future directions. J Am Coll Radiol. 2016;13(2):131\u20136.","journal-title":"J Am Coll Radiol"},{"key":"740_CR10","doi-asserted-by":"publisher","first-page":"103396","DOI":"10.1016\/j.jbi.2020.103396","volume":"104","author":"NS Tawfik","year":"2020","unstructured":"Tawfik NS, Spruit MR. Evaluating sentence representations for biomedical text: Methods and experimental results. J Biomed Inform. 2020;104:103396.","journal-title":"J Biomed Inform."},{"key":"#cr-split#-740_CR11.1","doi-asserted-by":"crossref","unstructured":"Pagliardini M, Gupta P, Jaggi M. Unsupervised learning of sentence embeddings using compositional n-gram features. In: Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (Long Papers) [Internet]. New Orleans, Louisiana: Association for Computational Linguistics","DOI":"10.18653\/v1\/N18-1049"},{"key":"#cr-split#-740_CR11.2","unstructured":"2018 [cited 2020 Feb 4]. p. 528-40. Available from: https:\/\/www.aclweb.org\/anthology\/N18-1049."},{"issue":"W1","key":"740_CR12","doi-asserted-by":"publisher","first-page":"W594","DOI":"10.1093\/nar\/gkz289","volume":"47","author":"A Allot","year":"2019","unstructured":"Allot A, Chen Q, Kim S, Vera Alvarez R, Comeau DC, Wilbur WJ, et al. LitSense: making sense of biomedical literature at sentence level. Nucl Acids Res. 2019;47(W1):W594\u20139.","journal-title":"Nucl Acids Res"},{"key":"740_CR13","doi-asserted-by":"crossref","unstructured":"Yang X, Lo D, Xia X, Bao L, Sun J. Combining word embedding with information retrieval to recommend similar bug reports. In: 2016 IEEE 27th international symposium on software reliability engineering (ISSRE). 2016. p. 127\u201337.","DOI":"10.1109\/ISSRE.2016.33"},{"key":"740_CR14","doi-asserted-by":"crossref","unstructured":"Loper E, Bird S. NLTK: The natural language toolkit. [Internet]. 2002 May 17 [cited 2020 May 23]; Available from: http:\/\/arxiv.org\/abs\/cs\/0205028.","DOI":"10.3115\/1118108.1118117"},{"key":"740_CR15","unstructured":"Bell DJ. Medical abbreviations and acronyms (A) |Radiology reference article| radiopaedia.org [Internet]. Radiopaedia. [cited 2020 May 23]. Available from: https:\/\/radiopaedia.org\/articles\/medical-abbreviations-and-acronyms-a?lang=us."},{"key":"740_CR16","unstructured":"Mikolov T, Chen K, Corrado G, Dean J. Efficient Estimation of Word Representations in Vector Space. [Internet]. 2013 Sep 6 [cited 2020 May 21]; Available from: http:\/\/arxiv.org\/abs\/1301.3781."},{"issue":"1","key":"740_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2016.35","volume":"3","author":"AEW Johnson","year":"2016","unstructured":"Johnson AEW, Pollard TJ, Shen L, Lehman LH, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3(1):1\u20139.","journal-title":"Sci Data"},{"key":"740_CR18","doi-asserted-by":"crossref","unstructured":"Chen Q, Peng Y, Lu Z. BioSentVec: creating sentence embeddings for biomedical texts. 2019 IEEE international conference on healthcare informatics ICHI. 2019 Jun;1\u20135.","DOI":"10.1109\/ICHI.2019.8904728"},{"key":"740_CR19","unstructured":"Neto JL, Santos AD, Kaestner CAA, Alexandre N, Santos D, A CA, et al. Document clustering and text summarization. 2000."},{"key":"740_CR20","unstructured":"Tokunaga T, Makoto I. Text categorization based on weighted inverse document frequency. In: Special interest groups and information process society of Japan (SIG-IPSJ). 1994. p. 33\u20139."},{"key":"740_CR21","doi-asserted-by":"publisher","unstructured":"Cumulated gain-based evaluation of IR techniques | ACM Transactions on Information Systems [Internet]. [cited 2020 May 19]. Available from: https:\/\/doi.org\/10.1145\/582415.582418","DOI":"10.1145\/582415.582418"},{"key":"740_CR22","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. [Internet]. 2019 May 24 [cited 2020 May 21]; Available from: http:\/\/arxiv.org\/abs\/1810.04805."},{"key":"740_CR23","unstructured":"Liu H. Sentiment analysis of citations using Word2vec. [Internet]. 2017 Apr 1 [cited 2020 May 21]; Available from: http:\/\/arxiv.org\/abs\/1704.00177."},{"key":"740_CR24","unstructured":"Zhu W, Zhang W, Li G-Z, He C, Zhang L. A study of damp-heat syndrome classification using Word2vec and TF-IDF. In: 2016 IEEE international conference on bioinformatics and biomedicine (BIBM). 2016. p. 1415\u201320."},{"key":"740_CR25","doi-asserted-by":"crossref","unstructured":"Lilleberg J, Zhu Y, Zhang Y. Support vector machines and Word2vec for text classification with semantic features. In: 2015 IEEE 14th international conference on cognitive informatics cognitive computing (ICCI*CC). 2015. p. 136\u201340.","DOI":"10.1109\/ICCI-CC.2015.7259377"}],"container-title":["BMC Medical Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-022-00740-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12880-022-00740-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-022-00740-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T16:20:13Z","timestamp":1643991613000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedimaging.biomedcentral.com\/articles\/10.1186\/s12880-022-00740-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,4]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["740"],"URL":"https:\/\/doi.org\/10.1186\/s12880-022-00740-6","relation":{},"ISSN":["1471-2342"],"issn-type":[{"value":"1471-2342","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,4]]},"assertion":[{"value":"20 August 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The testing radiology reports data in this study was collected retrospectively following the University of California San Francisco\u2019s Institutional Review Board approval (reference #: 303383) and informed consent waiver. All methods were performed in accordance with the relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"18"}}