{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T17:41:29Z","timestamp":1776879689043,"version":"3.51.2"},"reference-count":63,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006012","name":"Christian Doppler Forschungsgesellschaft","doi-asserted-by":"crossref","award":["501100006012"],"award-info":[{"award-number":["501100006012"]}],"id":[{"id":"10.13039\/501100006012","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006012","name":"Christian Doppler Forschungsgesellschaft","doi-asserted-by":"crossref","award":["501100006012"],"award-info":[{"award-number":["501100006012"]}],"id":[{"id":"10.13039\/501100006012","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006012","name":"Christian Doppler Forschungsgesellschaft","doi-asserted-by":"crossref","award":["501100006012"],"award-info":[{"award-number":["501100006012"]}],"id":[{"id":"10.13039\/501100006012","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006012","name":"Christian Doppler Forschungsgesellschaft","doi-asserted-by":"crossref","award":["501100006012"],"award-info":[{"award-number":["501100006012"]}],"id":[{"id":"10.13039\/501100006012","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Deep neural networks have been increasingly proposed for automated screening and diagnosis of retinal diseases from optical coherence tomography (OCT), but often provide high-confidence predictions on out-of-distribution (OOD) cases, compromising their clinical usage. With this in mind, we performed an in-depth comparative analysis of the state-of-the-art uncertainty estimation methods for OOD detection in retinal OCT imaging. The analysis was performed within the use-case of automated screening and staging of age-related macular degeneration (AMD), one of the leading causes of blindness worldwide, where we achieved a macro-average area under the curve (AUC) of 0.981 for AMD classification. We focus on a few-shot Outlier Exposure (OE) method and the detection of near-OOD cases that share pathomorphological characteristics with the inlier AMD classes. Scoring the OOD case based on the Cosine distance in the feature space from the penultimate network layer proved to be a robust approach for OOD detection, especially in combination with the OE. Using Cosine distance and only 8 outliers exposed per class, we were able to improve the near-OOD detection performance of the OE with Reject Bucket method by <jats:inline-formula><jats:alternatives><jats:tex-math>$$\\approx$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:mo>\u2248<\/mml:mo>\n                <\/mml:math><\/jats:alternatives><\/jats:inline-formula> 10% compared to without OE, reaching an AUC of 0.937. The Cosine distance served as a robust metric for OOD detection of both known and unknown classes and should thus be considered as an alternative to the reject bucket class probability in OE approaches, especially in the few-shot scenario. The inclusion of these methodologies did not come at the expense of classification performance, and can substantially improve the reliability and trustworthiness of the resulting deep learning-based diagnostic systems in the context of retinal OCT.<\/jats:p>","DOI":"10.1038\/s41598-023-43018-9","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T12:02:28Z","timestamp":1695816148000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Few-shot out-of-distribution detection for automated screening in retinal OCT images using deep learning"],"prefix":"10.1038","volume":"13","author":[{"given":"Teresa","family":"Ara\u00fajo","sequence":"first","affiliation":[]},{"given":"Guilherme","family":"Aresta","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7788-7311","authenticated-orcid":false,"given":"Ursula","family":"Schmidt-Erfurth","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9168-0894","authenticated-orcid":false,"given":"Hrvoje","family":"Bogunovi\u0107","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,9,27]]},"reference":[{"key":"43018_CR1","doi-asserted-by":"publisher","first-page":"1178","DOI":"10.1126\/science.1957169","volume":"254","author":"D Huang","year":"1991","unstructured":"Huang, D. et al. Optical coherence tomography. Science 254, 1178\u20131181. https:\/\/doi.org\/10.1126\/science.1957169 (1991).","journal-title":"Science"},{"key":"43018_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0237352","volume":"15","author":"E Midena","year":"2020","unstructured":"Midena, E. et al. Optical coherence tomography and color fundus photography in the screening of age-related macular degeneration: A comparative, population-based study. PLoS ONE 15, 1\u201310. https:\/\/doi.org\/10.1371\/journal.pone.0237352 (2020).","journal-title":"PLoS ONE"},{"key":"43018_CR3","doi-asserted-by":"publisher","first-page":"e106","DOI":"10.1016\/S2214-109X(13)70145-1","volume":"2","author":"WL Wong","year":"2014","unstructured":"Wong, W. L. et al. Global prevalence of age-related macular degeneration and disease burden projection for 2020 and 2040: A systematic review and meta-analysis. Lancet Glob. Health 2, e106\u2013e116. https:\/\/doi.org\/10.1016\/S2214-109X(13)70145-1 (2014).","journal-title":"Lancet Glob. Health"},{"key":"43018_CR4","doi-asserted-by":"publisher","first-page":"570","DOI":"10.1001\/jamaophthalmol.2017.0830","volume":"135","author":"DC Neely","year":"2017","unstructured":"Neely, D. C. et al. Prevalence of undiagnosed age-related macular degeneration in primary eye care. JAMA Ophthalmol. 135, 570\u2013575. https:\/\/doi.org\/10.1001\/jamaophthalmol.2017.0830 (2017).","journal-title":"JAMA Ophthalmol."},{"key":"43018_CR5","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1016\/j.survophthal.2012.01.006","volume":"57","author":"PA Keane","year":"2012","unstructured":"Keane, P. A. et al. Evaluation of age-related macular degeneration with optical coherence tomography. Surv. Ophthalmol. 57, 389\u2013414. https:\/\/doi.org\/10.1016\/j.survophthal.2012.01.006 (2012).","journal-title":"Surv. Ophthalmol."},{"key":"43018_CR6","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1016\/j.ajo.2003.11.026","volume":"137","author":"FG Holz","year":"2004","unstructured":"Holz, F. G., Pauleikhoff, D., Klein, R. & Bird, A. C. Pathogenesis of lesions in late age-related macular disease. Am. J. Ophthalmol. 137, 504\u2013510. https:\/\/doi.org\/10.1016\/j.ajo.2003.11.026 (2004).","journal-title":"Am. J. Ophthalmol."},{"key":"43018_CR7","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1109\/TMI.2019.2919951","volume":"39","author":"P Seebock","year":"2020","unstructured":"Seebock, P. et al. Exploiting epistemic uncertainty of anatomy segmentation for anomaly detection in retinal OCT. IEEE Trans. Med. Imaging 39, 87\u201398. https:\/\/doi.org\/10.1109\/TMI.2019.2919951 (2020).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"43018_CR8","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1136\/bjophthalmol-2014-305305","volume":"98","author":"G Trichonas","year":"2014","unstructured":"Trichonas, G. & Kaiser, P. K. Optical coherence tomography imaging of macular oedema. Br. J. Ophthalmol. 98, 24\u201329. https:\/\/doi.org\/10.1136\/bjophthalmol-2014-305305 (2014).","journal-title":"Br. J. Ophthalmol."},{"key":"43018_CR9","doi-asserted-by":"publisher","first-page":"939","DOI":"10.2147\/OPTH.S116539","volume":"10","author":"S Sivaprasad","year":"2016","unstructured":"Sivaprasad, S. & Oyetunde, S. Impact of injection therapy on retinal patients with diabetic macular edema or retinal vein occlusion. Clin. Ophthalmol. 10, 939\u2013946. https:\/\/doi.org\/10.2147\/OPTH.S116539 (2016).","journal-title":"Clin. Ophthalmol."},{"key":"43018_CR10","doi-asserted-by":"publisher","first-page":"474","DOI":"10.1080\/09273948.2019.1603313","volume":"27","author":"M Dysli","year":"2019","unstructured":"Dysli, M., R\u00fcckert, R. & Munk, M. R. Differentiation of underlying pathologies of macular edema using spectral domain optical coherence tomography (SD-OCT). Ocul. Immunol. Inflamm. 27, 474\u2013483. https:\/\/doi.org\/10.1080\/09273948.2019.1603313 (2019).","journal-title":"Ocul. Immunol. Inflamm."},{"key":"43018_CR11","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1016\/B978-0-323-46121-4.00068-6","volume-title":"Atlas of Retinal OCT Optical Coherence Tomography","author":"JS Duker","year":"2018","unstructured":"Duker, J. S. Stargardt Disease. In Atlas of Retinal OCT Optical Coherence Tomography 149\u2013151 (Elsevier, 2018)."},{"key":"43018_CR12","doi-asserted-by":"publisher","first-page":"1001","DOI":"10.1167\/iovs.16-20980","volume":"58","author":"M Lindner","year":"2017","unstructured":"Lindner, M. et al. Differential disease progression in atrophic age-related macular degeneration and late-onset stargardt disease. Investig. Opthalmol. Vis. Sci. 58, 1001. https:\/\/doi.org\/10.1167\/iovs.16-20980 (2017).","journal-title":"Investig. Opthalmol. Vis. Sci."},{"key":"43018_CR13","doi-asserted-by":"publisher","first-page":"771","DOI":"10.1038\/eye.2017.1","volume":"31","author":"B Foot","year":"2017","unstructured":"Foot, B. & MacEwen, C. Surveillance of sight loss due to delay in ophthalmic treatment or review: Frequency, cause and outcome. Eye 31, 771\u2013775. https:\/\/doi.org\/10.1038\/eye.2017.1 (2017).","journal-title":"Eye"},{"key":"43018_CR14","doi-asserted-by":"publisher","first-page":"2318","DOI":"10.1167\/iovs.16-20541","volume":"58","author":"FG Venhuizen","year":"2017","unstructured":"Venhuizen, F. G. et al. Automated staging of age-related macular degeneration using optical coherence tomography. Invest. Ophthalmol. Vis. Sci. 58, 2318\u20132328. https:\/\/doi.org\/10.1167\/iovs.16-20541 (2017).","journal-title":"Invest. Ophthalmol. Vis. Sci."},{"key":"43018_CR15","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","volume":"172","author":"DS Kermany","year":"2018","unstructured":"Kermany, D. S. et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172, 1122\u20131131. https:\/\/doi.org\/10.1016\/j.cell.2018.02.010 (2018).","journal-title":"Cell"},{"key":"43018_CR16","first-page":"1630","volume":"61","author":"C de Vente","year":"2020","unstructured":"de Vente, C. et al. Estimating uncertainty of deep neural networks for age-related macular degeneration grading using optical coherence tomography. Investig. Opthalmol. Vis. Sci. 61, 1630 (2020).","journal-title":"Investig. Opthalmol. Vis. Sci."},{"key":"43018_CR17","doi-asserted-by":"publisher","first-page":"1342","DOI":"10.1038\/s41591-018-0107-6","volume":"24","author":"J De Fauw","year":"2018","unstructured":"De Fauw, J. et al. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat. Med. 24, 1342\u20131350. https:\/\/doi.org\/10.1038\/s41591-018-0107-6 (2018).","journal-title":"Nat. Med."},{"key":"43018_CR18","doi-asserted-by":"publisher","unstructured":"Gal, Y. & Ghahramani, Z. Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. Proc. of the 33rd International Conference on Machine Learning, vol.\u00a048, https:\/\/doi.org\/10.1109\/TKDE.2015.2507132 (New York, 2016).","DOI":"10.1109\/TKDE.2015.2507132"},{"key":"43018_CR19","unstructured":"Lakshminarayanan, B., Pritzel, A. & Blundell, C. Simple and scalable predictive uncertainty estimation using deep ensembles. Proc. Advances in Neural Information Processing Systems (NIPS), 6405\u20136416 (2017)."},{"key":"43018_CR20","unstructured":"Lee, K., Lee, K., Lee, H. & Shin, J. A simple unified framework for detecting out-of-distribution samples and adversarial attacks. Proc. 32nd Conference on Neural Information Processing Systems (NIPS 2018), 7167\u20137177 (Montr\u00e9al, 2018)."},{"key":"43018_CR21","unstructured":"Liang, S., Li, Y. & Srikant, R. Enhancing the reliability of out-of-distribution image detection in neural networks. Proc. 6th International Conference on Learning Representations, ICLR 2018 1\u201315 (2018)."},{"key":"43018_CR22","unstructured":"Winkens, J. et\u00a0al. Contrastive Training for Improved Out-of-Distribution Detection. arXiv 1\u201318 (2020)."},{"key":"43018_CR23","unstructured":"Fort, S., Ren, J. & Lakshminarayanan, B. Exploring the Limits of Out-of-Distribution Detection. arXiv100 (2021)."},{"key":"43018_CR24","unstructured":"Ren, J. et\u00a0al. Likelihood ratios for out-of-distribution detection. Proc. Advances in Neural Information Processing Systems32 (2019)."},{"key":"43018_CR25","doi-asserted-by":"publisher","unstructured":"Zhang, H., Li, A., Guo, J. & Guo, Y. Hybrid Models for Open Set Recognition. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)12348 LNCS, 102\u2013117, https:\/\/doi.org\/10.1007\/978-3-030-58580-8_7 (2020).","DOI":"10.1007\/978-3-030-58580-8_7"},{"key":"43018_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102274","volume":"75","author":"A Guha Roy","year":"2022","unstructured":"Guha Roy, A. et al. Does your dermatology classifier know what it doesn\u2019t know? Detecting the long-tail of unseen conditions. Med. Image Anal. 75, 102274. https:\/\/doi.org\/10.1016\/j.media.2021.102274 (2022).","journal-title":"Med. Image Anal."},{"key":"43018_CR27","first-page":"1","volume":"1","author":"T Cao","year":"2020","unstructured":"Cao, T., Huang, C.-W., Hui, D.Y.-T. & Cohen, J. P. A benchmark of medical out of distribution detection. J. Mach. Learn. Biomed. Imag. 1, 1\u201348 (2020).","journal-title":"J. Mach. Learn. Biomed. Imag."},{"key":"43018_CR28","first-page":"122","volume-title":"UNSURE 2021, PIPPI 2021","author":"C Berger","year":"2021","unstructured":"Berger, C., Paschali, M. & Glocker, B. Confidence-Based Ouf-of-Distribution Detection\u202f: A Comparative Study and Analysis. In UNSURE 2021, PIPPI 2021 122\u2013132 (Springer International Publishing, 2021)."},{"key":"43018_CR29","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1016\/j.oret.2016.12.009","volume":"1","author":"CS Lee","year":"2017","unstructured":"Lee, C. S., Baughman, D. M. & Lee, A. Y. Deep learning is effective for classifying normal versus age-related macular degeneration OCT images. Ophthalmol. Retina 1, 322\u2013327. https:\/\/doi.org\/10.1016\/j.oret.2016.12.009 (2017).","journal-title":"Ophthalmol. Retina"},{"key":"43018_CR30","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/j.cmpb.2019.06.016","volume":"178","author":"O Perdomo","year":"2019","unstructured":"Perdomo, O. et al. Classification of diabetes-related retinal diseases using a deep learning approach in optical coherence tomography. Comput. Methods Programs Biomed. 178, 181\u2013189. https:\/\/doi.org\/10.1016\/j.cmpb.2019.06.016 (2019).","journal-title":"Comput. Methods Programs Biomed."},{"key":"43018_CR31","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1109\/JBHI.2018.2795545","volume":"23","author":"Y Rong","year":"2019","unstructured":"Rong, Y. et al. Surrogate-assisted retinal OCT image classification based on convolutional neural networks. IEEE J. Biomed. Health Inform. 23, 253\u2013263. https:\/\/doi.org\/10.1109\/JBHI.2018.2795545 (2019).","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"43018_CR32","doi-asserted-by":"publisher","first-page":"1024","DOI":"10.1109\/TMI.2017.2780115","volume":"37","author":"R Rasti","year":"2018","unstructured":"Rasti, R., Rabbani, H., Mehridehnavi, A. & Hajizadeh, F. Macular OCT classification using a multi-scale convolutional neural network ensemble. IEEE Trans. Med. Imag. 37, 1024\u20131034. https:\/\/doi.org\/10.1109\/TMI.2017.2780115 (2018).","journal-title":"IEEE Trans. Med. Imag."},{"key":"43018_CR33","doi-asserted-by":"publisher","first-page":"1959","DOI":"10.1109\/TMI.2019.2898414","volume":"38","author":"L Fang","year":"2019","unstructured":"Fang, L. et al. Attention to lesion: Lesion-aware convolutional neural network for retinal optical coherence tomography image classification. IEEE Trans. Med. Imag. 38, 1959\u20131970. https:\/\/doi.org\/10.1109\/TMI.2019.2898414 (2019).","journal-title":"IEEE Trans. Med. Imag."},{"key":"43018_CR34","doi-asserted-by":"publisher","unstructured":"Wu, J. et\u00a0al. AttenNet: Deep attention based retinal disease classification in OCT images. Proc. MultiMedia Modeling, 26th International Conference, MMM, vol. 281, 565\u2013576, https:\/\/doi.org\/10.1007\/978-3-030-37734-2_46 (Daejeon, 2020).","DOI":"10.1007\/978-3-030-37734-2_46"},{"key":"43018_CR35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12886-020-01382-4","volume":"20","author":"T Tsuji","year":"2020","unstructured":"Tsuji, T. et al. Classification of optical coherence tomography images using a capsule network. BMC Ophthalmol. 20, 1\u20139. https:\/\/doi.org\/10.1186\/s12886-020-01382-4 (2020).","journal-title":"BMC Ophthalmol."},{"key":"43018_CR36","doi-asserted-by":"publisher","first-page":"1037","DOI":"10.1109\/TMI.2018.2877080","volume":"38","author":"P Seebock","year":"2019","unstructured":"Seebock, P. et al. Unsupervised identification of disease marker candidates in retinal OCT imaging data. IEEE Trans. Med. Imag. 38, 1037\u20131047. https:\/\/doi.org\/10.1109\/TMI.2018.2877080 (2019).","journal-title":"IEEE Trans. Med. Imag."},{"key":"43018_CR37","unstructured":"Apostolopoulos, S., Ciller, C., De\u00a0Zanet, S.\u00a0I., Wolf, S. & Sznitman, R. RetiNet: Automatic AMD identification in OCT volumetric data. arXiv 1\u201314 (2016)."},{"key":"43018_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1117\/1.jbo.25.9.096004","volume":"25","author":"Y Sun","year":"2020","unstructured":"Sun, Y., Zhang, H. & Yao, X. Automatic diagnosis of macular diseases from OCT volume based on its two-dimensional feature map and convolutional neural network with attention mechanism. J. Biomed. Opt. 25, 1\u201315. https:\/\/doi.org\/10.1117\/1.jbo.25.9.096004 (2020).","journal-title":"J. Biomed. Opt."},{"key":"43018_CR39","first-page":"2118","volume":"62","author":"CD Vente","year":"2021","unstructured":"Vente, C. D. et al. Making AI transferable across OCT scanners from different vendors. Investig. Opthalmol. Vis. Sci. 62, 2118 (2021).","journal-title":"Investig. Opthalmol. Vis. Sci."},{"key":"43018_CR40","unstructured":"Kendall, A. & Gal, Y. What uncertainties do we need in Bayesian deep learning for computer vision? Proc. Advances in Neural Information Processing Systems (NIPS), 5575\u20135585 (Long Beach, 2017)."},{"key":"43018_CR41","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.inffus.2021.05.008","volume":"76","author":"M Abdar","year":"2021","unstructured":"Abdar, M. et al. A review of uncertainty quantification in deep learning: Techniques, applications and challenges. Inf. Fus. 76, 243\u2013297. https:\/\/doi.org\/10.1016\/j.inffus.2021.05.008 (2021).","journal-title":"Inf. Fus."},{"key":"43018_CR42","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2020.101715","volume":"63","author":"T Ara\u00fajo","year":"2020","unstructured":"Ara\u00fajo, T. et al. DR|GRADUATE: Uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images. Med. Image Anal. 63, 101715. https:\/\/doi.org\/10.1016\/j.media.2020.101715 (2020).","journal-title":"Med. Image Anal."},{"key":"43018_CR43","doi-asserted-by":"publisher","unstructured":"Ara\u00fajo, T., Aresta, G. & Bogunovic, H. Deep Dirichlet uncertainty for unsupervised out-of-distribution detection of eye fundus photographs in glaucoma screening. Proc. 2022 IEEE International Symposium on Biomedical Imaging Challenges (ISBIC), 1\u20135, https:\/\/doi.org\/10.1109\/ISBIC56247.2022.9854763 (IEEE, 2022).","DOI":"10.1109\/ISBIC56247.2022.9854763"},{"key":"43018_CR44","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-017-17876-z","volume":"7","author":"C Leibig","year":"2017","unstructured":"Leibig, C., Allken, V., Ayhan, M. S., Berens, P. & Wahl, S. Leveraging uncertainty information from deep neural networks for disease detection. Sci. Rep. 7, 1\u201314. https:\/\/doi.org\/10.1038\/s41598-017-17876-z (2017).","journal-title":"Sci. Rep."},{"key":"43018_CR45","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2019.101557","volume":"59","author":"T Nair","year":"2020","unstructured":"Nair, T., Precup, D., Arnold, D. L. & Arbel, T. Exploring uncertainty measures in deep networks for Multiple sclerosis lesion detection and segmentation. Med. Image Anal. 59, 101557. https:\/\/doi.org\/10.1016\/j.media.2019.101557 (2020).","journal-title":"Med. Image Anal."},{"key":"43018_CR46","unstructured":"Laves, M.\u00a0H., Ihler, S. & Ortmaier, T. Uncertainty quantification in computer-aided diagnosis: Make your model say \u201cI don\u2019t know\u201d for ambiguous cases. arXiv 1\u20134 (2019)."},{"key":"43018_CR47","unstructured":"Graves, A. Practical variational inference for neural networks. Proc. Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems (NIPS), 2348\u20132356 (2011)."},{"key":"43018_CR48","first-page":"465","volume":"121","author":"J Linmans","year":"2020","unstructured":"Linmans, J., Van Der Laak, J. & Litjens, G. Efficient out-of-distribution detection in digital pathology using multi-head convolutional neural networks. Proc. Mach. Learn. Res. 121, 465\u2013478 (2020).","journal-title":"Proc. Mach. Learn. Res."},{"key":"43018_CR49","unstructured":"Venkatakrishnan, A.\u00a0R., Kim, S.\u00a0T., Eisawy, R., Pfister, F. & Navab, N. Self-Supervised Out-of-Distribution Detection in Brain CT Scans. In NIPS, 1\u20135 (Vancouver, 2020)."},{"key":"43018_CR50","doi-asserted-by":"crossref","unstructured":"Tan, J., Hou, B., Batten, J., Qiu, H. & Kainz, B. Detecting outliers with foreign patch interpolation. 1\u201327 (2022).","DOI":"10.59275\/j.melba.2022-e651"},{"key":"43018_CR51","unstructured":"Hendrycks, D. & Gimpel, K. A baseline for detecting misclassified and out-of-distribution examples in neural networks. Proc. 5th International Conference on Learning Representations, ICLR 2017 1\u201312 (2017)."},{"key":"43018_CR52","unstructured":"Shafaei, A., Schmidt, M. & Little, J.\u00a0J. A less biased evaluation of out-of-distribution sample detectors. Proc. 30th British Machine Vision Conference 2019, BMVC 2019 1\u201313 (2019). arXiv:1809.04729."},{"key":"43018_CR53","unstructured":"Tan, M. & Le, Q.\u00a0V. EfficientNetV2: Smaller models and faster training. arXiv (2021)."},{"key":"43018_CR54","doi-asserted-by":"publisher","unstructured":"Carreira, J. & Zisserman, A. Quo Vadis, action recognition? A new model and the kinetics dataset. Proc. 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017 4724\u20134733, https:\/\/doi.org\/10.1109\/CVPR.2017.502 (2017).","DOI":"10.1109\/CVPR.2017.502"},{"key":"43018_CR55","unstructured":"Sensoy, M., Kaplan, L. & Kandemir, M. Evidential deep learning to quantify classification uncertainty. Proc. 32nd Conference on Neural Information Processing Systems (NeurIPS 2018) (Montr\u00e9al, 2018)."},{"key":"43018_CR56","unstructured":"Ayhan, M.\u00a0S. & Berens, P. Test-time data augmentation for estimation of heteroscedastic aleatoric uncertainty in deep neural networks. Proc. Medical Imaging with Deep Learning (MIDL), 1\u20139 (2018)."},{"key":"43018_CR57","unstructured":"Hendrycks, D., Mazeika, M. & Dietterich, T. Deep anomaly detection with outlier exposure. Proc. 7th International Conference on Learning Representations, ICLR 2019 1\u201318 (2019)."},{"key":"43018_CR58","doi-asserted-by":"crossref","unstructured":"Thulasidasan, S., Thapa, S., Dhaubhadel, S., Chennupati, G., Bhattacharya, T., & Bilmes, J. A Simple and effective baseline for out-of-distribution detection using abstention, (2021).","DOI":"10.1109\/ICMLA52953.2021.00050"},{"key":"43018_CR59","doi-asserted-by":"publisher","DOI":"10.1117\/1.jbo.19.4.046006","volume":"19","author":"U Sevik","year":"2014","unstructured":"Sevik, U., K\u00f6se, C., Berber, T. & Erd\u00f6l, H. Identification of suitable fundus images using automated quality assessment methods. J. Biomed. Opt. 19, 046006. https:\/\/doi.org\/10.1117\/1.jbo.19.4.046006 (2014).","journal-title":"J. Biomed. Opt."},{"key":"43018_CR60","doi-asserted-by":"publisher","unstructured":"Nguyen, A., Yosinski, J. & Clune, J. Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition07-12-June, 427\u2013436, https:\/\/doi.org\/10.1109\/CVPR.2015.7298640 (2015).","DOI":"10.1109\/CVPR.2015.7298640"},{"key":"43018_CR61","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/978-3-540-44792-4_4","volume-title":"Classic Works of the Dempster-Shafer Theory of Belief Functions","author":"APA Dempster","year":"2008","unstructured":"Dempster, A. P. A. Generalization of Bayesian Inference. In Classic Works of the Dempster-Shafer Theory of Belief Functions 73\u2013104 (Springer, 2008)."},{"key":"43018_CR62","doi-asserted-by":"publisher","unstructured":"Selvaraju, R.\u00a0R. et\u00a0al. Grad-CAM: Visual explanations from deep networks via gradient-based localization. Proc. 2017 IEEE International Conference on Computer Vision (ICCV), 618\u2013626, https:\/\/doi.org\/10.1109\/ICCV.2017.74 (IEEE, Venice, 2017).","DOI":"10.1109\/ICCV.2017.74"},{"key":"43018_CR63","unstructured":"McInnes, L., Healy, J. & Melville, J. Uniform manifold approximation and projection for dimension reduction. Preprint at arXiv, (UMAP, 2020)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-43018-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-43018-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-43018-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T16:14:22Z","timestamp":1700410462000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-43018-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,27]]},"references-count":63,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["43018"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-43018-9","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,27]]},"assertion":[{"value":"2 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"H.B.: Contract Research to the Medical University of Vienna: Heidelberg Engineering, Apellis. U.S-E: Scientific Consultant: Genentech, Heidelberg, Kodiak, Novartis, RetInSight, Roche, Contract Research to the Medical University of Vienna: Apellis, Genentech, Kodiak. T.A., and G.A.: No financial and non-financial disclosures.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"16231"}}