{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T20:32:00Z","timestamp":1784925120299,"version":"3.55.0"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,5,10]],"date-time":"2021-05-10T00:00:00Z","timestamp":1620604800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,10]],"date-time":"2021-05-10T00:00:00Z","timestamp":1620604800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Fast diagnosis and treatment of pneumothorax, a collapsed or dropped lung, is crucial to avoid fatalities. Pneumothorax is typically detected on a chest X-ray image through visual inspection by experienced radiologists. However, the detection rate is quite low due to the complexity of visual inspection for small lung collapses. Therefore, there is an urgent need for automated detection systems to assist radiologists. Although deep learning classifiers generally deliver high accuracy levels in many applications, they may not be useful in clinical practice due to the lack of high-quality and representative labeled image sets. Alternatively, searching in the archive of past cases to find matching images may serve as a \u201cvirtual second opinion\u201d through accessing the metadata of matched evidently diagnosed cases. To use image search as a triaging or diagnosis assistant, we must first tag all chest X-ray images with expressive identifiers, i.e., deep features. Then, given a query chest X-ray image, the majority vote among the top <jats:italic>k<\/jats:italic> retrieved images can provide a more explainable output. In this study, we searched in a repository with more than 550,000 chest X-ray images. We developed the Autoencoding Thorax Net (short <jats:italic>AutoThorax<\/jats:italic> -Net) for image search in chest radiographs. Experimental results show that image search based on <jats:italic>AutoThorax<\/jats:italic> -Net features can achieve high identification performance providing a path towards real-world deployment. We achieved 92% AUC accuracy for a semi-automated search in 194,608 images (pneumothorax and normal) and 82% AUC accuracy for fully automated search in 551,383 images (normal, pneumothorax and many other chest diseases).<\/jats:p>","DOI":"10.1038\/s41598-021-89194-4","type":"journal-article","created":{"date-parts":[[2021,5,10]],"date-time":"2021-05-10T10:04:16Z","timestamp":1620641056000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Searching for pneumothorax in x-ray images using autoencoded deep features"],"prefix":"10.1038","volume":"11","author":[{"given":"Antonio","family":"Sze-To","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abtin","family":"Riasatian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"H. R.","family":"Tizhoosh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,5,10]]},"reference":[{"key":"89194_CR1","doi-asserted-by":"publisher","first-page":"974","DOI":"10.1001\/jama.2017.10476","volume":"318","author":"JB Imran","year":"2017","unstructured":"Imran, J. B. & Eastman, A. L. Pneumothorax. JAMA 318, 974\u2013974 (2017).","journal-title":"JAMA"},{"key":"89194_CR2","first-page":"S372","volume":"6","author":"P Zarogoulidis","year":"2014","unstructured":"Zarogoulidis, P. et al. Pneumothorax: from definition to diagnosis and treatment. J. Thoracic Dis. 6, S372 (2014).","journal-title":"J. Thoracic Dis."},{"key":"89194_CR3","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1016\/j.jacr.2013.12.016","volume":"11","author":"PA Larson","year":"2014","unstructured":"Larson, P. A., Berland, L. L., Griffith, B., Kahn, C. E. Jr. & Liebscher, L. A. Actionable findings and the role of it support: report of the acr actionable reporting work group. J. Am. Coll. Radiol. 11, 552\u2013558 (2014).","journal-title":"J. Am. Coll. Radiol."},{"key":"89194_CR4","unstructured":"Goo\u00dfen, A. et al. Deep learning for pneumothorax detection and localization in chest radiographs. arXiv preprint arXiv:1907.07324 (2019)."},{"key":"89194_CR5","doi-asserted-by":"publisher","unstructured":"Blausen.com. Medical gallery of blausen medical 2014. WikiJournal Med 1, https:\/\/doi.org\/10.15347\/wjm\/2014.010 (2014).","DOI":"10.15347\/wjm\/2014.010"},{"key":"89194_CR6","doi-asserted-by":"crossref","unstructured":"Guendel, S. et al. Learning to recognize abnormalities in chest x-rays with location-aware dense networks. In Iberoamerican Congress on Pattern Recognition, 757\u2013765 (Springer, 2018).","DOI":"10.1007\/978-3-030-13469-3_88"},{"key":"89194_CR7","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1148\/radiol.2016150409","volume":"280","author":"BS Kelly","year":"2016","unstructured":"Kelly, B. S., Rainford, L. A., Darcy, S. P., Kavanagh, E. C. & Toomey, R. J. The development of expertise in radiology: in chest radiograph interpretation, \u201cexpert\u201d search pattern may predate \u201cexpert\u201d levels of diagnostic accuracy for pneumothorax identification. Radiology 280, 252\u2013260 (2016).","journal-title":"Radiology"},{"key":"89194_CR8","doi-asserted-by":"crossref","unstructured":"Mao, C., Yao, L., Pan, Y., Luo, Y. & Zeng, Z. Deep generative classifiers for thoracic disease diagnosis with chest x-ray images. In 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 1209\u20131214 (IEEE, 2018).","DOI":"10.1109\/BIBM.2018.8621107"},{"key":"89194_CR9","doi-asserted-by":"publisher","first-page":"9375","DOI":"10.1109\/ACCESS.2017.2788044","volume":"6","author":"J Ker","year":"2017","unstructured":"Ker, J., Wang, L., Rao, J. & Lim, T. Deep learning applications in medical image analysis. IEEE Access 6, 9375\u20139389 (2017).","journal-title":"IEEE Access"},{"key":"89194_CR10","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.jacr.2016.09.039","volume":"14","author":"SI Kamel","year":"2017","unstructured":"Kamel, S. I., Levin, D. C., Parker, L. & Rao, V. M. Utilization trends in noncardiac thoracic imaging, 2002\u20132014. J. Am. Coll. Radiol. 14, 337\u2013342 (2017).","journal-title":"J. Am. Coll. Radiol."},{"key":"89194_CR11","doi-asserted-by":"publisher","first-page":"e1002697","DOI":"10.1371\/journal.pmed.1002697","volume":"15","author":"AG Taylor","year":"2018","unstructured":"Taylor, A. G., Mielke, C. & Mongan, J. Automated detection of moderate and large pneumothorax on frontal chest x-rays using deep convolutional neural networks: a retrospective study. PLoS Med. 15, e1002697 (2018).","journal-title":"PLoS Med."},{"key":"89194_CR12","doi-asserted-by":"crossref","unstructured":"Bengio, Y. Learning Deep Architectures for AI (Now Publishers Inc, 2009).","DOI":"10.1561\/9781601982957"},{"key":"89194_CR13","doi-asserted-by":"crossref","unstructured":"Wang, X. et al. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2097\u20132106 (2017).","DOI":"10.1109\/CVPR.2017.369"},{"key":"89194_CR14","unstructured":"Rajpurkar, P. et al. Chexnet: radiologist-level pneumonia detection on chest x-rays with deep learning. arXiv preprint arXiv:1711.05225 (2017)."},{"key":"89194_CR15","unstructured":"Rubin, J. et al. Large scale automated reading of frontal and lateral chest x-rays using dual convolutional neural networks. arXiv preprint arXiv:1804.07839 (2018)."},{"key":"89194_CR16","doi-asserted-by":"crossref","unstructured":"Rajpurkar, P. et al. Deep learning for chest radiograph diagnosis: a retrospective comparison of the chexnext algorithm to practicing radiologists. PLoS Med. 15, e1002686 (2018).","DOI":"10.1371\/journal.pmed.1002686"},{"key":"89194_CR17","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1148\/radiol.2018181422","volume":"290","author":"JA Dunnmon","year":"2018","unstructured":"Dunnmon, J. A. et al. Assessment of convolutional neural networks for automated classification of chest radiographs. Radiology 290, 537\u2013544 (2018).","journal-title":"Radiology"},{"key":"89194_CR18","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1007\/s40134-019-0333-9","volume":"7","author":"Y Feng","year":"2019","unstructured":"Feng, Y., Teh, H. S. & Cai, Y. Deep learning for chest radiology: a review. Curr. Radiol. Reports 7, 24 (2019).","journal-title":"Curr. Radiol. Reports"},{"key":"89194_CR19","doi-asserted-by":"crossref","unstructured":"Irvin, J. et al. Chexpert: a large chest radiograph dataset with uncertainty labels and expert comparison. arXiv preprint arXiv:1901.07031 (2019).","DOI":"10.1609\/aaai.v33i01.3301590"},{"key":"89194_CR20","doi-asserted-by":"publisher","first-page":"6381","DOI":"10.1038\/s41598-019-42294-8","volume":"9","author":"IM Baltruschat","year":"2019","unstructured":"Baltruschat, I. M., Nickisch, H., Grass, M., Knopp, T. & Saalbach, A. Comparison of deep learning approaches for multi-label chest x-ray classification. Sci. Rep. 9, 6381 (2019).","journal-title":"Sci. Rep."},{"key":"89194_CR21","doi-asserted-by":"crossref","unstructured":"Rakshit, S., Saha, I., Wlasnowolski, M., Maulik, U. & Plewczynski, D. Deep learning for detection and localization of thoracic diseases using chest x-ray imagery. In International Conference on Artificial Intelligence and Soft Computing, 271\u2013282 (Springer, 2019).","DOI":"10.1007\/978-3-030-20915-5_25"},{"key":"89194_CR22","doi-asserted-by":"crossref","unstructured":"Sze-To, A. & Wang, Z. tchexnet: Detecting pneumothorax on chest x-ray images using deep transfer learning. In International Conference on Image Analysis and Recognition, 325\u2013332 (Springer, 2019).","DOI":"10.1007\/978-3-030-27272-2_28"},{"key":"89194_CR23","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"89194_CR24","doi-asserted-by":"crossref","unstructured":"Johnson, A. E. et al. Mimic-cxr: a large publicly available database of labeled chest radiographs. arXiv preprint arXiv:1901.07042 (2019).","DOI":"10.1038\/s41597-019-0322-0"},{"key":"89194_CR25","doi-asserted-by":"publisher","first-page":"496","DOI":"10.1109\/TMI.2014.2361481","volume":"34","author":"X Zhang","year":"2014","unstructured":"Zhang, X., Liu, W., Dundar, M., Badve, S. & Zhang, S. Towards large-scale histopathological image analysis: hashing-based image retrieval. IEEE Trans. Med. Imaging 34, 496\u2013506 (2014).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"89194_CR26","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L. & Weinberger, K. Q. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4700\u20134708 (2017).","DOI":"10.1109\/CVPR.2017.243"},{"key":"89194_CR27","unstructured":"Guan, Q. et al. Diagnose like a radiologist: attention guided convolutional neural network for thorax disease classification. arXiv preprint arXiv:1801.09927 (2018)."},{"key":"89194_CR28","unstructured":"Yao, L., Prosky, J., Poblenz, E., Covington, B. & Lyman, K. Weakly supervised medical diagnosis and localization from multiple resolutions. arXiv preprint arXiv:1803.07703 (2018)."},{"key":"89194_CR29","doi-asserted-by":"crossref","unstructured":"Yan, C., Yao, J., Li, R., Xu, Z. & Huang, J. Weakly supervised deep learning for thoracic disease classification and localization on chest x-rays. In Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, 103\u2013110 (ACM, 2018).","DOI":"10.1145\/3233547.3233573"},{"key":"89194_CR30","unstructured":"Zhou, W., Li, H. & Tian, Q. Recent advance in content-based image retrieval: a literature survey. arXiv preprint arXiv:1706.06064 (2017)."},{"key":"89194_CR31","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1007\/s13735-017-0135-x","volume":"6","author":"P Das","year":"2017","unstructured":"Das, P. & Neelima, A. An overview of approaches for content-based medical image retrieval. Int. J. Multimed. Inf. Retrieval 6, 271\u2013280 (2017).","journal-title":"Int. J. Multimed. Inf. Retrieval"},{"key":"89194_CR32","doi-asserted-by":"crossref","unstructured":"Camlica, Z., Tizhoosh, H. R. & Khalvati, F. Medical image classification via svm using lbp features from saliency-based folded data. In 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA), 128\u2013132 (IEEE, 2015).","DOI":"10.1109\/ICMLA.2015.131"},{"key":"89194_CR33","doi-asserted-by":"crossref","unstructured":"Wan, J. et al. Deep learning for content-based image retrieval: a comprehensive study. In Proceedings of the 22nd ACM international Conference on Multimedia, 157\u2013166 (ACM, 2014).","DOI":"10.1145\/2647868.2654948"},{"key":"89194_CR34","doi-asserted-by":"publisher","first-page":"2467","DOI":"10.1016\/j.neucom.2017.11.022","volume":"275","author":"M Tzelepi","year":"2018","unstructured":"Tzelepi, M. & Tefas, A. Deep convolutional learning for content based image retrieval. Neurocomputing 275, 2467\u20132478 (2018).","journal-title":"Neurocomputing"},{"key":"89194_CR35","doi-asserted-by":"crossref","unstructured":"Sklan, J. E., Plassard, A. J., Fabbri, D. & Landman, B. A. Toward content-based image retrieval with deep convolutional neural networks. In Medical Imaging 2015: Biomedical Applications in Molecular, Structural, and Functional Imaging, vol. 9417, 94172C (International Society for Optics and Photonics, 2015).","DOI":"10.1117\/12.2081551"},{"key":"89194_CR36","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.neucom.2017.05.025","volume":"266","author":"A Qayyum","year":"2017","unstructured":"Qayyum, A., Anwar, S. M., Awais, M. & Majid, M. Medical image retrieval using deep convolutional neural network. Neurocomputing 266, 8\u201320 (2017).","journal-title":"Neurocomputing"},{"key":"89194_CR37","doi-asserted-by":"crossref","unstructured":"Qiu, C., Cai, Y., Gao, X. & Cui, Y. Medical image retrieval based on the deep convolution network and hash coding. In 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), 1\u20136 (IEEE, 2017).","DOI":"10.1109\/CISP-BMEI.2017.8302194"},{"key":"89194_CR38","unstructured":"Chung, Y.-A. & Weng, W.-H. Learning deep representations of medical images using siamese cnns with application to content-based image retrieval. arXiv preprint arXiv:1711.08490 (2017)."},{"key":"89194_CR39","doi-asserted-by":"publisher","first-page":"462","DOI":"10.3390\/jcm8040462","volume":"8","author":"M Owais","year":"2019","unstructured":"Owais, M., Arsalan, M., Choi, J. & Park, K. R. Effective diagnosis and treatment through content-based medical image retrieval (cbmir) by using artificial intelligence. J. Clin. Med. 8, 462 (2019).","journal-title":"J. Clin. Med."},{"key":"89194_CR40","doi-asserted-by":"crossref","unstructured":"Mercioni, M. A. & Holban, S. A survey of distance metrics in clustering data mining techniques. In Proceedings of the 2019 3rd International Conference on Graphics and Signal Processing, 44\u201347 (2019).","DOI":"10.1145\/3338472.3338490"},{"key":"89194_CR41","first-page":"1929","volume":"15","author":"N Srivastava","year":"2014","unstructured":"Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I. & Salakhutdinov, R. Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929\u20131958 (2014).","journal-title":"J. Mach. Learn. Res."},{"key":"89194_CR42","first-page":"e215","volume":"101","author":"AL Goldberger","year":"2000","unstructured":"Goldberger, A. L. et al. Physiobank, physiotoolkit, and physionet: components of a new research resource for complex physiologic signals. Circulation 101, e215\u2013e220 (2000).","journal-title":"Circulation"},{"key":"89194_CR43","unstructured":"Abadi, M. et al. Tensorflow: a system for large-scale machine learning. In 12th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 16), 265\u2013283 (2016)."},{"key":"89194_CR44","unstructured":"Zhang, Y., Wu, H., Liu, H., Tong, L. & Wang, M. D. Mitigating the effect of dataset bias on training deep models for chest x-rays. arXiv preprint arXiv:1910.06745 (2019)."},{"key":"89194_CR45","doi-asserted-by":"crossref","unstructured":"Zech, J. R. et al. Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study. PLoS Med. 15(11), e1002683 (2018).","DOI":"10.1371\/journal.pmed.1002683"},{"key":"89194_CR46","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1002\/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3","volume":"3","author":"WJ Youden","year":"1950","unstructured":"Youden, W. J. Index for rating diagnostic tests. Cancer 3, 32\u201335 (1950).","journal-title":"Cancer"},{"key":"89194_CR47","unstructured":"Kingma, D. P. & Ba, J. Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"89194_CR48","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar, J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1\u201330 (2006).","journal-title":"J. Mach. Learn. Res."},{"key":"89194_CR49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-56847-4","volume":"10","author":"KK Bressem","year":"2020","unstructured":"Bressem, K. K. et al. Comparing different deep learning architectures for classification of chest radiographs. Sci. Rep. 10, 1\u201316 (2020).","journal-title":"Sci. Rep."},{"key":"89194_CR50","unstructured":"Yang, X. et al. Covid-ct-dataset: a ct scan dataset about covid-19 (2020). 2003.13865."},{"key":"89194_CR51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-56847-4","volume":"10","author":"TD Pham","year":"2020","unstructured":"Pham, T. D. A comprehensive study on classification of covid-19 on computed tomography with pretrained convolutional neural networks. Sci. Rep. 10, 1\u20138 (2020).","journal-title":"Sci. Rep."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-89194-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-89194-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-89194-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T07:47:47Z","timestamp":1670053667000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-89194-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,10]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["89194"],"URL":"https:\/\/doi.org\/10.1038\/s41598-021-89194-4","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,10]]},"assertion":[{"value":"11 May 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"9817"}}