{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T05:54:15Z","timestamp":1783576455739,"version":"3.55.0"},"reference-count":48,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2021,4,21]],"date-time":"2021-04-21T00:00:00Z","timestamp":1618963200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004359","name":"Swedish Research Council","doi-asserted-by":"publisher","award":["VR-2016-03372"],"award-info":[{"award-number":["VR-2016-03372"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Digital Futures framework"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,7,30]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The study sought to assist practitioners in identifying and prioritizing radiography exams that are more likely to contain abnormalities, and provide them with a diagnosis in order to manage heavy workload more efficiently (eg, during a pandemic) or avoid mistakes due to tiredness.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>This article introduces RTEx, a novel framework for (1) ranking radiography exams based on their probability to be abnormal, (2) generating abnormality tags for abnormal exams, and (3) providing a diagnostic explanation in natural language for each abnormal exam. Our framework consists of deep learning and retrieval methods and is assessed on 2 publicly available datasets.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>For ranking, RTEx outperforms its competitors in terms of nDCG@k. The tagging component outperforms 2 strong competitor methods in terms of F1. Moreover, the diagnostic captioning component, which exploits the predicted tags to constrain the captioning process, outperforms 4 captioning competitors with respect to clinical precision and recall.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>RTEx prioritizes abnormal exams toward the improvement of the healthcare workflow by introducing a ranking method. Also, for each abnormal radiography exam RTEx generates a set of abnormality tags alongside a diagnostic text to explain the tags and guide the medical expert. Human evaluation of the produced text shows that employing the generated tags offers consistency to the clinical correctness and that the sentences of each text have high clinical accuracy.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>This is the first framework that successfully combines 3 tasks: ranking, tagging, and diagnostic captioning with focus on radiography exams that contain abnormalities.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab046","type":"journal-article","created":{"date-parts":[[2021,3,2]],"date-time":"2021-03-02T20:11:33Z","timestamp":1614715893000},"page":"1651-1659","source":"Crossref","is-referenced-by-count":8,"title":["RTEX: A novel framework for ranking, tagging, and explanatory diagnostic captioning of radiography exams"],"prefix":"10.1093","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0172-6917","authenticated-orcid":false,"given":"Vasiliki","family":"Kougia","sequence":"first","affiliation":[{"name":"Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Pavlopoulos","sequence":"additional","affiliation":[{"name":"Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Panagiotis","family":"Papapetrou","sequence":"additional","affiliation":[{"name":"Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Max","family":"Gordon","sequence":"additional","affiliation":[{"name":"Division of Orthopaedics, Department of Clinical Sciences, Danderyd Hospital, Karolinska Institutet, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,4,21]]},"reference":[{"key":"2021073020281054000_ocab046-B1","author":"Suetens","year":"2009"},{"key":"2021073020281054000_ocab046-B2","doi-asserted-by":"crossref","first-page":"4006","DOI":"10.1038\/ncomms5006","article-title":"Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach","volume":"5","author":"Aerts","year":"2014","journal-title":"Nat Commun"},{"issue":"5","key":"2021073020281054000_ocab046-B3","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.3758\/APP.72.5.1205","article-title":"Current perspectives in medical image perception","volume":"72","author":"Krupinski","year":"2010","journal-title":"Atten Percept Psychophys"},{"key":"2021073020281054000_ocab046-B4","doi-asserted-by":"crossref","first-page":"101878","DOI":"10.1016\/j.artmed.2020.101878","article-title":"Deep learning in generating radiology reports: a survey","volume":"106","author":"Monshi","year":"2020","journal-title":"Artif Intell Med"},{"key":"2021073020281054000_ocab046-B5","year":"2016"},{"key":"2021073020281054000_ocab046-B6","year":"2019"},{"key":"2021073020281054000_ocab046-B7","first-page":"2380","article-title":"Overview of the ImageCLEFmed 2019 concept detection task","author":"Pelka","year":"2019","journal-title":"CLEF2019 Working Notes"},{"issue":"1","key":"2021073020281054000_ocab046-B8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-42294-8","article-title":"Comparison of deep learning approaches for multi-label chest X-ray classification","volume":"9","author":"Baltruschat","year":"2019","journal-title":"Sci Rep"},{"key":"2021073020281054000_ocab046-B9","first-page":"2577","author":"Jing","year":"2018"},{"key":"2021073020281054000_ocab046-B10","first-page":"6666","author":"Li","year":"2019"},{"key":"2021073020281054000_ocab046-B11","author":"Liu"},{"key":"2021073020281054000_ocab046-B12","first-page":"26","author":"Kougia","year":"2019"},{"key":"2021073020281054000_ocab046-B13","first-page":"487","author":"Bluemke","year":"2020"},{"issue":"2","key":"2021073020281054000_ocab046-B14","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1093\/jamia\/ocv080","article-title":"Preparing a collection of radiology examinations for distribution and retrieval","volume":"23","author":"Demner-Fushman","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2021073020281054000_ocab046-B15","author":"Johnson"},{"issue":"4","key":"2021073020281054000_ocab046-B16","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1111\/j.1601-0825.2009.01615.x","article-title":"Triage screening for osteoporosis in dental clinics using panoramic radiographs","volume":"16","author":"Taguchi","year":"2010","journal-title":"Oral Dis"},{"issue":"2","key":"2021073020281054000_ocab046-B17","first-page":"89","article-title":"Automatic screening for tuberculosis in chest radiographs: a survey","volume":"3","author":"Jaeger","year":"2013","journal-title":"Quant Imaging Med Surg"},{"issue":"8","key":"2021073020281054000_ocab046-B18","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1016\/j.ijmedinf.2007.10.010","article-title":"Computer-aided diagnosis in chest radiography for detection of childhood pneumonia","volume":"77","author":"Oliveira","year":"2008","journal-title":"Int J Med Inform"},{"key":"2021073020281054000_ocab046-B19","first-page":"4700","author":"Huang","year":"2017"},{"key":"2021073020281054000_ocab046-B20","author":"Simonyan"},{"issue":"1","key":"2021073020281054000_ocab046-B21","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1038\/s41746-020-0273-z","article-title":"Automated abnormality classification of chest radiographs using deep convolutional neural networks","volume":"3","author":"Tang","year":"2020","journal-title":"NPJ Digit Med"},{"issue":"2","key":"2021073020281054000_ocab046-B22","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1148\/radiol.2018181422","article-title":"Assessment of convolutional neural networks for automated classification of chest radiographs","volume":"290","author":"Dunnmon","year":"2019","journal-title":"Radiology"},{"key":"2021073020281054000_ocab046-B23","author":"Karim"},{"issue":"5","key":"2021073020281054000_ocab046-B24","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1109\/TMI.2015.2482920","article-title":"Improving computer-aided detection using convolutional neural networks and random view aggregation","volume":"35","author":"Roth","year":"2016","journal-title":"IEEE Trans Med Imaging"},{"key":"2021073020281054000_ocab046-B25","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1007\/978-3-319-46726-9_31","article-title":"Recognizing end-diastole and end-systole frames via deep temporal regression network","author":"\u00a0Kong","year":"2016","journal-title":"Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016."},{"key":"2021073020281054000_ocab046-B26","author":"Eickhoff","year":"2017"},{"key":"2021073020281054000_ocab046-B27","author":"de Herrera","year":"2018"},{"key":"2021073020281054000_ocab046-B28","author":"Pelka","year":"2020"},{"key":"2021073020281054000_ocab046-B29","author":"Valavanis","year":"2017"},{"key":"2021073020281054000_ocab046-B30","author":"Pinho","year":"2018"},{"key":"2021073020281054000_ocab046-B31","author":"Kougia","year":"2019"},{"key":"2021073020281054000_ocab046-B32","author":"Karatzas","year":"2020"},{"key":"2021073020281054000_ocab046-B33","author":"Hasan","year":"2018"},{"key":"2021073020281054000_ocab046-B34","author":"Abacha","year":"2019"},{"key":"2021073020281054000_ocab046-B35","author":"Abacha","year":"2020"},{"key":"2021073020281054000_ocab046-B36","first-page":"1537","author":"Li","year":"2018"},{"key":"2021073020281054000_ocab046-B37","first-page":"721","author":"Yuan","year":"2019"},{"key":"2021073020281054000_ocab046-B38","first-page":"126","author":"Boag","year":"2019"},{"key":"2021073020281054000_ocab046-B39","author":"Rajpurkar"},{"key":"2021073020281054000_ocab046-B40","author":"Mork","year":"2013"},{"key":"2021073020281054000_ocab046-B41","first-page":"590","author":"Irvin","year":"2019"},{"key":"2021073020281054000_ocab046-B42","first-page":"3156","author":"Vinyals","year":"2015"},{"issue":"8","key":"2021073020281054000_ocab046-B43","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"2021073020281054000_ocab046-B44","author":"\u00a0Goodfellow","year":"2016"},{"key":"2021073020281054000_ocab046-B45","author":"Kingma"},{"key":"2021073020281054000_ocab046-B46","first-page":"311","author":"Papineni","year":"2002"},{"key":"2021073020281054000_ocab046-B47","first-page":"74","author":"Lin","year":"2004"},{"key":"2021073020281054000_ocab046-B48","author":"Lewis"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/8\/1651\/39502314\/ocab046.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/8\/1651\/39502314\/ocab046.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T23:19:26Z","timestamp":1627687166000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/8\/1651\/6242739"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,21]]},"references-count":48,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,4,21]]},"published-print":{"date-parts":[[2021,7,30]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab046","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,8,1]]},"published":{"date-parts":[[2021,4,21]]}}}