{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,20]],"date-time":"2026-11-20T01:06:24Z","timestamp":1795136784517,"version":"4.10.3"},"reference-count":69,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T00:00:00Z","timestamp":1678665600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T00:00:00Z","timestamp":1678665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The proposed model for automatic clinical image caption generation combines the analysis of radiological scans with structured patient information from the textual records. It uses two language models, the Show-Attend-Tell and the GPT-3, to generate comprehensive and descriptive radiology records. The generated textual summary contains essential information about pathologies found, their location, along with the 2D heatmaps that localize each pathology on the scans. The model has been tested on two medical datasets, the Open-I, MIMIC-CXR, and the general-purpose MS-COCO, and the results measured with natural language assessment metrics demonstrated its efficient applicability to chest X-ray image captioning.<\/jats:p>","DOI":"10.1038\/s41598-023-31223-5","type":"journal-article","created":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T13:03:03Z","timestamp":1678712583000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":105,"title":["Medical image captioning via generative pretrained transformers"],"prefix":"10.1038","volume":"13","author":[{"given":"Alexander","family":"Selivanov","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oleg Y.","family":"Rogov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniil","family":"Chesakov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Artem","family":"Shelmanov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irina","family":"Fedulova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dmitry V.","family":"Dylov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,3,13]]},"reference":[{"key":"31223_CR1","first-page":"590","volume":"33","author":"J Irvin","year":"2019","unstructured":"Irvin, J. et al. Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. Proc. AAAI Conf. Artif. Intell. 33, 590\u2013597 (2019).","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"31223_CR2","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1093\/jamia\/ocv080","volume":"23","author":"D Demner-Fushman","year":"2016","unstructured":"Demner-Fushman, D. et al. Preparing a collection of radiology examinations for distribution and retrieval. J. Am. Med. Inform. Assoc. 23, 304\u2013310 (2016).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"31223_CR3","first-page":"1","volume":"2018","author":"Y-H Chan","year":"2018","unstructured":"Chan, Y.-H. et al. Effective pneumothorax detection for chest X-ray images using local binary pattern and support vector machine. J. Healthc. Eng. 2018, 1\u201311 (2018).","journal-title":"J. Healthc. Eng."},{"key":"31223_CR4","doi-asserted-by":"crossref","unstructured":"Maghdid, H.\u00a0S. et\u00a0al. Diagnosing covid-19 pneumonia from X-ray and CT images using deep learning and transfer learning algorithms. In Multimodal Image Exploitation and Learning 2021 Vol. 11734, 117340E (International Society for Optics and Photonics, 2021).","DOI":"10.1117\/12.2588672"},{"key":"31223_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2020.101878","volume":"106","author":"MMA Monshi","year":"2020","unstructured":"Monshi, M. M. A., Poon, J. & Chung, V. Deep learning in generating radiology reports: A survey. Artif. Intell. Med. 106, 101878 (2020).","journal-title":"Artif. Intell. Med."},{"key":"31223_CR6","unstructured":"Garc\u00eda\u00a0Gilabert, J. Image Captioning using pre-trained GPT-2 models. Ph.D. thesis, Universitat Polit\u00e8cnica de Val\u00e8ncia (2022)."},{"key":"31223_CR7","doi-asserted-by":"crossref","unstructured":"Chen, J., Guo, H., Yi, K., Li, B. & Elhoseiny, M. Visualgpt: Data-efficient adaptation of pretrained language models for image captioning. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 18030\u201318040 (2022).","DOI":"10.1109\/CVPR52688.2022.01750"},{"key":"31223_CR8","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1038\/s41569-021-00527-2","volume":"18","author":"M Sermesant","year":"2021","unstructured":"Sermesant, M., Delingette, H., Cochet, H., Ja\u00efs, P. & Ayache, N. Applications of artificial intelligence in cardiovascular imaging. Nat. Rev. Cardiol. 18, 600\u2013609 (2021).","journal-title":"Nat. Rev. Cardiol."},{"key":"31223_CR9","doi-asserted-by":"publisher","first-page":"998","DOI":"10.1007\/s11547-021-01351-x","volume":"126","author":"M Gurgitano","year":"2021","unstructured":"Gurgitano, M. et al. Interventional radiology ex-machina: Impact of artificial intelligence on practice. La radiologia medica 126, 998\u20131006 (2021).","journal-title":"La radiologia medica"},{"key":"31223_CR10","doi-asserted-by":"crossref","unstructured":"Belikova, K., Rogov, O.\u00a0Y., Rybakov, A., Maslov, M.\u00a0V. & Dylov, D.\u00a0V. Deep negative volume segmentation. Sci. Rep. 11 (2021).","DOI":"10.1038\/s41598-021-95526-1"},{"key":"31223_CR11","doi-asserted-by":"crossref","unstructured":"Pavlopoulos, J., Kougia, V. & Androutsopoulos, I. A survey on biomedical image captioning. In Proceedings of the Second Workshop on Shortcomings in Vision and Language, 26\u201336 (Association for Computational Linguistics, 2019).","DOI":"10.18653\/v1\/W19-1803"},{"key":"31223_CR12","doi-asserted-by":"crossref","unstructured":"Vinyals, O., Toshev, A., Bengio, S. & Erhan, D. Show and tell: A neural image caption generator. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3156\u20133164 (2015).","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"31223_CR13","doi-asserted-by":"crossref","unstructured":"Shin, H.-C. et\u00a0al. Learning to read chest X-rays: Recurrent neural cascade model for automated image annotation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016).","DOI":"10.1109\/CVPR.2016.274"},{"key":"31223_CR14","unstructured":"Bahdanau, D., Cho, K. & Bengio, Y. Neural machine translation by jointly learning to align and translate. In 3rd International Conference on Learning Representations (ICLR) (2016)."},{"key":"31223_CR15","unstructured":"Xu, K. et\u00a0al. Show, attend and tell: Neural image caption generation with visual attention. In Proceedings of the 32nd International Conference on International Conference on Machine Learning Vol. 37, ICML\u201915, 2048-2057 (JMLR.org, 2015)."},{"key":"31223_CR16","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1109\/TPAMI.2016.2599174","volume":"39","author":"J Donahue","year":"2017","unstructured":"Donahue, J. et al. Long-term recurrent convolutional networks for visual recognition and description. IEEE Trans. Pattern Anal. Mach. Intell. 39, 677\u2013691 (2017).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"31223_CR17","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Xie, Y., Xing, F., McGough, M. & Yang, L. Mdnet: A semantically and visually interpretable medical image diagnosis network. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 3549\u20133557 (2017).","DOI":"10.1109\/CVPR.2017.378"},{"key":"31223_CR18","doi-asserted-by":"crossref","unstructured":"You, Q., Jin, H., Wang, Z., Fang, C. & Luo, J. Image captioning with semantic attention. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 4651\u20134659 (2016).","DOI":"10.1109\/CVPR.2016.503"},{"key":"31223_CR19","doi-asserted-by":"crossref","unstructured":"Wang, X., Peng, Y., Lu, L., Lu, Z. & Summers, R.\u00a0M. Tienet: Text-image embedding network for common thorax disease classification and reporting in chest X-rays. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018).","DOI":"10.1109\/CVPR.2018.00943"},{"key":"31223_CR20","doi-asserted-by":"crossref","unstructured":"Jing, B., Xie, P. & Xing, E. On the automatic generation of medical imaging reports. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics Vol. 1: Long Papers, 2577\u20132586 (Association for Computational Linguistics, 2018).","DOI":"10.18653\/v1\/P18-1240"},{"key":"31223_CR21","doi-asserted-by":"crossref","unstructured":"Wang, X. et\u00a0al. Chestx-ray8: Hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 3462\u20133471 (2017).","DOI":"10.1109\/CVPR.2017.369"},{"key":"31223_CR22","doi-asserted-by":"crossref","unstructured":"Rodin, I., Fedulova, I., Shelmanov, A. & Dylov, D.\u00a0V. Multitask and multimodal neural network model for interpretable analysis of x-ray images. In 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (IEEE, 2019).","DOI":"10.1109\/BIBM47256.2019.8983272"},{"key":"31223_CR23","doi-asserted-by":"crossref","unstructured":"Gale, W., Oakden-Rayner, L., Carneiro, G., Palmer, L.\u00a0J. & Bradley, A.\u00a0P. Producing radiologist-quality reports for interpretable deep learning. In 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) (IEEE, 2019).","DOI":"10.1109\/ISBI.2019.8759236"},{"key":"31223_CR24","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1007\/978-3-030-32226-7_80","volume-title":"Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2019","author":"J Yuan","year":"2019","unstructured":"Yuan, J., Liao, H., Luo, R. & Luo, J. Automatic radiology report generation based on multi-view image fusion and medical concept enrichment. In Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2019 (eds Shen, D. et al.) 721\u2013729 (Springer International Publishing, 2019)."},{"key":"31223_CR25","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1093\/jamia\/ocv080","volume":"23","author":"D Demner-Fushman","year":"2016","unstructured":"Demner-Fushman, D. et al. Preparing a collection of radiology examinations for distribution and retrieval. J. Am. Med. Inform. Assoc. 23, 304\u2013310 (2016).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"31223_CR26","first-page":"12910","volume":"34","author":"Y Zhang","year":"2020","unstructured":"Zhang, Y. et al. When radiology report generation meets knowledge graph. Proc. AAAI Conf. Artif. Intell. 34, 12910\u201312917 (2020).","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"31223_CR27","unstructured":"Rajpurkar, P. et\u00a0al. Chexnet: Radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv:1711.05225 (2017)."},{"key":"31223_CR28","doi-asserted-by":"publisher","first-page":"118571","DOI":"10.1109\/ACCESS.2021.3107163","volume":"9","author":"N Shvetsova","year":"2021","unstructured":"Shvetsova, N., Bakker, B., Fedulova, I., Schulz, H. & Dylov, D. V. Anomaly detection in medical imaging with deep perceptual autoencoders. IEEE Access 9, 118571\u2013118583 (2021).","journal-title":"IEEE Access"},{"key":"31223_CR29","first-page":"249","volume-title":"Proceedings of the 4th Machine Learning for Healthcare, Proceedings of Machine Learning Research","author":"G Liu","year":"2019","unstructured":"Liu, G. et al. Clinically accurate chest X-ray report generation. In Proceedings of the 4th Machine Learning for Healthcare, Proceedings of Machine Learning Research Vol. 106 (eds Doshi-Velez, F. et al.) 249\u2013269 (PMLR, 2019)."},{"key":"31223_CR30","unstructured":"Peng, Y. et\u00a0al. Negbio: A high-performance tool for negation and uncertainty detection in radiology reports. In AMIA Summits on Translational Science Proceedings Vol. 2017 (2017)."},{"key":"31223_CR31","doi-asserted-by":"crossref","unstructured":"Ni, J., Hsu, C.-N., Gentili, A. & McAuley, J. Learning visual-semantic embeddings for reporting abnormal findings on chest X-rays. In Findings of the Association for Computational Linguistics: EMNLP 2020, 1954\u20131960 (Association for Computational Linguistics, Online, 2020).","DOI":"10.18653\/v1\/2020.findings-emnlp.176"},{"key":"31223_CR32","doi-asserted-by":"crossref","unstructured":"Syeda-Mahmood, T. et\u00a0al. Chest X-ray report generation through fine-grained label learning. In Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2020, 561\u2013571 (Springer International Publishing, 2020).","DOI":"10.1007\/978-3-030-59713-9_54"},{"key":"31223_CR33","doi-asserted-by":"crossref","unstructured":"Liu, J. et\u00a0al. Align, attend and locate: Chest X-ray diagnosis via contrast induced attention network with limited supervision. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV) (2019).","DOI":"10.1109\/ICCV.2019.01073"},{"key":"31223_CR34","first-page":"136","volume-title":"Proceedings of the Third Conference on Medical Imaging with Deep Learning, Proceedings of Machine Learning Research","author":"JP Cohen","year":"2020","unstructured":"Cohen, J. P., Hashir, M., Brooks, R. & Bertrand, H. On the limits of cross-domain generalization in automated X-ray prediction. In Proceedings of the Third Conference on Medical Imaging with Deep Learning, Proceedings of Machine Learning Research (eds Arbel, T. et al.) 136\u2013155 (PMLR, 2020)."},{"key":"31223_CR35","unstructured":"Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Vol. 1 (Long and Short Papers), 4171\u20134186 (Association for Computational Linguistics, 2019)."},{"key":"31223_CR36","unstructured":"Ziegler, Z.\u00a0M., Melas-Kyriazi, L., Gehrmann, S. & Rush, A.\u00a0M. Encoder-agnostic adaptation for conditional language generation. arXiv:1908.06938 (2019)."},{"key":"31223_CR37","doi-asserted-by":"publisher","DOI":"10.1016\/j.imu.2021.100557","volume":"24","author":"O Alfarghaly","year":"2021","unstructured":"Alfarghaly, O., Khaled, R., Elkorany, A., Helal, M. & Fahmy, A. Automated radiology report generation using conditioned transformers. Inform. Med. Unlocked 24, 100557 (2021).","journal-title":"Inform. Med. Unlocked"},{"key":"31223_CR38","doi-asserted-by":"crossref","unstructured":"Chen, Z., Song, Y., Chang, T.-H. & Wan, X. Generating radiology reports via memory-driven transformer. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1439\u20131449 (Association for Computational Linguistics, Online, 2020).","DOI":"10.18653\/v1\/2020.emnlp-main.112"},{"key":"31223_CR39","doi-asserted-by":"crossref","unstructured":"Xiong, Y., Du, B. & Yan, P. Reinforced transformer for medical image captioning. In Machine Learning in Medical Imaging, 673\u2013680 (Springer International Publishing, 2019).","DOI":"10.1007\/978-3-030-32692-0_77"},{"key":"31223_CR40","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der\u00a0Maaten, L. & Weinberger, K.\u00a0Q. Densely connected convolutional networks. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2261\u20132269 (2017).","DOI":"10.1109\/CVPR.2017.243"},{"key":"31223_CR41","unstructured":"Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, 2015 (eds Bengio, Y. & LeCun, Y.) (Conference Track Proceedings, 2015)."},{"key":"31223_CR42","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2016).","DOI":"10.1109\/CVPR.2016.308"},{"key":"31223_CR43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"31223_CR44","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735\u20131780 (1997).","journal-title":"Neural Comput."},{"key":"31223_CR45","first-page":"1877","volume-title":"Advances in Neural Information Processing Systems","author":"T Brown","year":"2020","unstructured":"Brown, T. et al. Language models are few-shot learners. In Advances in Neural Information Processing Systems Vol. 33 (eds Larochelle, H. et al.) 1877\u20131901 (Curran Associates Inc, 2020)."},{"key":"31223_CR46","volume-title":"Advances in Neural Information Processing Systems","author":"A Vaswani","year":"2017","unstructured":"Vaswani, A. et al. Attention is all you need. In Advances in Neural Information Processing Systems Vol. 30 (eds Guyon, I. et al.) (Curran Associates Inc, 2017)."},{"key":"31223_CR47","unstructured":"Wolf, T. et\u00a0al. Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 38\u201345 (Association for Computational Linguistics, Online, 2020)."},{"key":"31223_CR48","doi-asserted-by":"crossref","unstructured":"Deng, J. et\u00a0al. Imagenet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, 248\u2013255 (IEEE, 2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"31223_CR49","first-page":"231","volume-title":"Proceedings of the 5th International Conference on Medical Imaging with Deep Learning, Proceedings of Machine Learning Research","author":"JP Cohen","year":"2022","unstructured":"Cohen, J. P. et al. Torchxrayvision: A library of chest X-ray datasets and models. In Proceedings of the 5th International Conference on Medical Imaging with Deep Learning, Proceedings of Machine Learning Research Vol. 172 (eds Konukoglu, E. et al.) 231\u2013249 (PMLR, 2022)."},{"key":"31223_CR50","doi-asserted-by":"crossref","unstructured":"Wiseman, S. & Rush, A.\u00a0M. Sequence-to-sequence learning as beam-search optimization. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 1296\u20131306 (Association for Computational Linguistics, 2016).","DOI":"10.18653\/v1\/D16-1137"},{"key":"31223_CR51","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T. & Zhu, W.-J. BLEU. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics\u2014ACL\u201902 (Association for Computational Linguistics, 2001).","DOI":"10.3115\/1073083.1073135"},{"key":"31223_CR52","unstructured":"Lin, C.-Y. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out, 74\u201381 (Association for Computational Linguistics, 2004)."},{"key":"31223_CR53","unstructured":"Banerjee, S. & Lavie, A. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization, 65\u201372 (Association for Computational Linguistics, 2005)."},{"key":"31223_CR54","doi-asserted-by":"crossref","unstructured":"Vedantam, R., Zitnick, C.\u00a0L. & Parikh, D. Cider: Consensus-based image description evaluation. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 4566\u20134575 (2015).","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"31223_CR55","doi-asserted-by":"crossref","unstructured":"Anderson, P., Fernando, B., Johnson, M. & Gould, S. SPICE: Semantic propositional image caption evaluation. In Computer Vision\u2014ECCV 2016, 382\u2013398 (Springer International Publishing, 2016).","DOI":"10.1007\/978-3-319-46454-1_24"},{"key":"31223_CR56","doi-asserted-by":"crossref","unstructured":"Fang, H. et\u00a0al. From captions to visual concepts and back. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2015).","DOI":"10.1109\/CVPR.2015.7298754"},{"key":"31223_CR57","doi-asserted-by":"crossref","unstructured":"Johnson, A. E.\u00a0W. et\u00a0al. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci. Data 6 (2019).","DOI":"10.1038\/s41597-019-0322-0"},{"key":"31223_CR58","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y. et\u00a0al. Microsoft COCO: Common objects in context. In Computer Vision\u2014ECCV 2014, 740\u2013755 (Springer International Publishing, 2014).","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"31223_CR59","doi-asserted-by":"crossref","unstructured":"Koziol, Q. et\u00a0al. HDF5. In Encyclopedia of Parallel Computing, 827\u2013833 (Springer US, 2011).","DOI":"10.1007\/978-0-387-09766-4_44"},{"key":"31223_CR60","doi-asserted-by":"crossref","unstructured":"Jing, B., Xie, P. & Xing, E. On the automatic generation of medical imaging reports. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics Vol. 1: Long Papers (Association for Computational Linguistics, 2018).","DOI":"10.18653\/v1\/P18-1240"},{"key":"31223_CR61","doi-asserted-by":"publisher","first-page":"267D","DOI":"10.1093\/nar\/gkh061","volume":"32","author":"O Bodenreider","year":"2004","unstructured":"Bodenreider, O. The unified medical language system (UMLS): Integrating biomedical terminology. Nucleic Acids Res. 32, 267D \u2013 270 (2004).","journal-title":"Nucleic Acids Res."},{"key":"31223_CR62","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2021.102083","volume":"117","author":"Z Kraljevic","year":"2021","unstructured":"Kraljevic, Z. et al. Multi-domain clinical natural language processing with MedCAT: The medical concept annotation toolkit. Artif. Intell. Med. 117, 102083 (2021).","journal-title":"Artif. Intell. Med."},{"key":"31223_CR63","doi-asserted-by":"publisher","unstructured":"Papineni, K., Roukos, S., Ward, T. & Zhu, W.-J. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL \u201902, 311\u2013318 (Association for Computational Linguistics, 2002). https:\/\/doi.org\/10.3115\/1073083.1073135.","DOI":"10.3115\/1073083.1073135"},{"key":"31223_CR64","doi-asserted-by":"crossref","unstructured":"Hunter, J.\u00a0D. Matplotlib: A 2d graphics environment. Comput. Sci. Eng. 9, 90\u201395. https:\/\/matplotlib.org\/stable\/index.html (2007).","DOI":"10.1109\/MCSE.2007.55"},{"key":"31223_CR65","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1109\/TPAMI.2016.2599174","volume":"39","author":"J Donahue","year":"2017","unstructured":"Donahue, J. et al. Long-term recurrent convolutional networks for visual recognition and description. IEEE Trans. Pattern Anal. Mach. Intell. 39, 677\u2013691 (2017).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"31223_CR66","doi-asserted-by":"crossref","unstructured":"Karpathy, A. & Fei-Fei, L. Deep visual-semantic alignments for generating image descriptions. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2015).","DOI":"10.1109\/CVPR.2015.7298932"},{"key":"31223_CR67","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.\u00a0R. et\u00a0al. Grad-cam: Visual explanations from deep networks via gradient-based localization. In 2017 IEEE International Conference on Computer Vision (ICCV), 618\u2013626 (2017).","DOI":"10.1109\/ICCV.2017.74"},{"key":"31223_CR68","doi-asserted-by":"crossref","unstructured":"Shelmanov, A. et\u00a0al. Active learning for sequence tagging with deep pre-trained models and bayesian uncertainty estimates. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (Association for Computational Linguistics, 2021).","DOI":"10.18653\/v1\/2021.eacl-main.145"},{"key":"31223_CR69","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198","volume":"2","author":"TH Kung","year":"2023","unstructured":"Kung, T. H. et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS Digit. Health 2, e0000198 (2023).","journal-title":"PLoS Digit. Health"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-31223-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-31223-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-31223-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T13:08:24Z","timestamp":1678712904000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-31223-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,13]]},"references-count":69,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["31223"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-31223-5","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2197859\/v1","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,13]]},"assertion":[{"value":"24 October 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"4171"}}