{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T19:37:55Z","timestamp":1776281875332,"version":"3.50.1"},"reference-count":375,"publisher":"Springer Science and Business Media LLC","issue":"S1","license":[{"start":{"date-parts":[[2023,7,29]],"date-time":"2023-07-29T00:00:00Z","timestamp":1690588800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,29]],"date-time":"2023-07-29T00:00:00Z","timestamp":1690588800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01DD20001"],"award-info":[{"award-number":["01DD20001"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005713","name":"Technische Universit\u00e4t M\u00fcnchen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005713","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Over the last decade, neural networks have reached almost every field of science and become a crucial part of various real world applications. Due to the increasing spread, confidence in neural network predictions has become more and more important. However, basic neural networks do not deliver certainty estimates or suffer from over- or under-confidence, i.e. are badly calibrated. To overcome this, many researchers have been working on understanding and quantifying uncertainty in a neural network\u2019s prediction. As a result, different types and sources of uncertainty have been identified and various approaches to measure and quantify uncertainty in neural networks have been proposed. This work gives a comprehensive overview of uncertainty estimation in neural networks, reviews recent advances in the field, highlights current challenges, and identifies potential research opportunities. It is intended to give anyone interested in uncertainty estimation in neural networks a broad overview and introduction, without presupposing prior knowledge in this field. For that, a comprehensive introduction to the most crucial sources of uncertainty is given and their separation into reducible model uncertainty and irreducible data uncertainty is presented. The modeling of these uncertainties based on deterministic neural networks, Bayesian neural networks (BNNs), ensemble of neural networks, and test-time data augmentation approaches is introduced and different branches of these fields as well as the latest developments are discussed. For a practical application, we discuss different measures of uncertainty, approaches for calibrating neural networks, and give an overview of existing baselines and available implementations. Different examples from the wide spectrum of challenges in the fields of medical image analysis, robotics, and earth observation give an idea of the needs and challenges regarding uncertainties in the practical applications of neural networks. Additionally, the practical limitations of uncertainty quantification methods in neural networks for mission- and safety-critical real world applications are discussed and an outlook on the next steps towards a broader usage of such methods is given.<\/jats:p>","DOI":"10.1007\/s10462-023-10562-9","type":"journal-article","created":{"date-parts":[[2023,7,29]],"date-time":"2023-07-29T10:01:56Z","timestamp":1690624916000},"page":"1513-1589","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1012,"title":["A survey of uncertainty in deep neural networks"],"prefix":"10.1007","volume":"56","author":[{"given":"Jakob","family":"Gawlikowski","sequence":"first","affiliation":[]},{"given":"Cedrique Rovile Njieutcheu","family":"Tassi","sequence":"additional","affiliation":[]},{"given":"Mohsin","family":"Ali","sequence":"additional","affiliation":[]},{"given":"Jongseok","family":"Lee","sequence":"additional","affiliation":[]},{"given":"Matthias","family":"Humt","sequence":"additional","affiliation":[]},{"given":"Jianxiang","family":"Feng","sequence":"additional","affiliation":[]},{"given":"Anna","family":"Kruspe","sequence":"additional","affiliation":[]},{"given":"Rudolph","family":"Triebel","sequence":"additional","affiliation":[]},{"given":"Peter","family":"Jung","sequence":"additional","affiliation":[]},{"given":"Ribana","family":"Roscher","sequence":"additional","affiliation":[]},{"given":"Muhammad","family":"Shahzad","sequence":"additional","affiliation":[]},{"given":"Wen","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Richard","family":"Bamler","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5530-3613","authenticated-orcid":false,"given":"Xiao Xiang","family":"Zhu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,7,29]]},"reference":[{"key":"10562_CR1","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.inffus.2021.05.008","volume":"76","author":"M Abdar","year":"2021","unstructured":"Abdar M, Pourpanah F, Hussain S, Rezazadegan D, Liu L, Ghavamzadeh M, Fieguth P, Cao X, Khosravi A, Acharya UR et al (2021) A review of uncertainty quantification in deep learning: techniques, applications and challenges. Inf Fusion 76:243\u2013297","journal-title":"Inf Fusion"},{"key":"10562_CR2","doi-asserted-by":"crossref","first-page":"36538","DOI":"10.1109\/ACCESS.2022.3163384","volume":"10","author":"AA Abdullah","year":"2022","unstructured":"Abdullah AA, Hassan MM, Mustafa YT (2022) A review on Bayesian deep learning in healthcare: applications and challenges. IEEE Access 10:36538\u201336562","journal-title":"IEEE Access"},{"key":"10562_CR3","unstructured":"Achrack O, Kellerman R, Barzilay O (2020) Multi-loss sub-ensembles for accurate classification with uncertainty estimation. arXiv preprint arXiv:2010.01917"},{"key":"10562_CR4","unstructured":"Achterhold J, Koehler JM, Schmeink A, Genewein T (2018) Variational network quantization. In: International conference on learning representations"},{"key":"10562_CR5","unstructured":"Ahn S, Balan AK, Welling M (2012) Bayesian posterior sampling via stochastic gradient fisher scoring. In: International conference on machine learning"},{"key":"10562_CR6","unstructured":"Ahn S, Shahbaba B, Welling M (2014) Distributed stochastic gradient MCMC. In: International conference on machine learning, PMLR, pp 1044\u20131052"},{"key":"10562_CR7","unstructured":"Amini A, Soleimany A, Karaman S, Rus D (2018) Spatial uncertainty sampling for end-to-end control. arXiv preprint arXiv:1805.04829"},{"key":"10562_CR8","unstructured":"Amini A, Schwarting W, Soleimany A, Rus D (2020) Deep evidential regression. In: Advances in neural information processing systems 33"},{"key":"10562_CR9","unstructured":"Antor\u00e1n J, Bhatt U, Adel T, Weller A, Hern\u00e1ndez-Lobato JM (2020) Getting a clue: a method for explaining uncertainty estimates. In: International conference on learning representations"},{"key":"10562_CR10","unstructured":"Ashukha A, Lyzhov A, Molchanov D, Vetrov D (2019) Pitfalls of in-domain uncertainty estimation and ensembling in deep learning. In: International conference on learning representations"},{"key":"10562_CR11","doi-asserted-by":"crossref","unstructured":"Atanov A, Ashukha A, Molchanov D, Neklyudov K, Vetrov D (2019) Uncertainty estimation via stochastic batch normalization. In: International symposium on neural networks, Springer, pp 261\u2013269","DOI":"10.1007\/978-3-030-22796-8_28"},{"key":"10562_CR12","unstructured":"Ayhan MS, Berens P (2018) Test-time data augmentation for estimation of heteroscedastic aleatoric uncertainty in deep neural networks. In: First international conference on medical imaging with deep learning"},{"issue":"101","key":"10562_CR13","first-page":"724","volume":"64","author":"MS Ayhan","year":"2020","unstructured":"Ayhan MS, K\u00fchlewein L, Aliyeva G, Inhoffen W, Ziemssen F, Berens P (2020) Expert-validated estimation of diagnostic uncertainty for deep neural networks in diabetic retinopathy detection. Med Image Anal 64(101):724","journal-title":"Med Image Anal"},{"key":"10562_CR14","unstructured":"Ba J, Grosse R, Martens J (2016) Distributed second-order optimization using Kronecker-factored approximations. In: International conference on learning representations"},{"key":"10562_CR15","unstructured":"Bae J, Zhang G, Grosse R (2018) Eigenvalue corrected noisy natural gradient. arXiv preprint arXiv:1811.12565"},{"issue":"3","key":"10562_CR16","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1109\/MRA.2006.1678144","volume":"13","author":"T Bailey","year":"2006","unstructured":"Bailey T, Durrant-Whyte H (2006) Simultaneous localization and mapping (slam): Part ii. IEEE Robot Autom Mag 13(3):108\u2013117","journal-title":"IEEE Robot Autom Mag"},{"issue":"8","key":"10562_CR17","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1109\/5.5968","volume":"76","author":"R Bajcsy","year":"1988","unstructured":"Bajcsy R (1988) Active perception. Proc IEEE 76(8):966\u20131005","journal-title":"Proc IEEE"},{"key":"10562_CR18","unstructured":"Balan AK, Rathod V, Murphy KP, Welling M (2015) Bayesian dark knowledge. In: Advances in neural information processing systems 28"},{"key":"10562_CR19","first-page":"215","volume":"168","author":"D Barber","year":"1998","unstructured":"Barber D, Bishop CM (1998) Ensemble learning in Bayesian neural networks. Nato ASI Ser F Comput Syst Sci 168:215\u2013238","journal-title":"Nato ASI Ser F Comput Syst Sci"},{"key":"10562_CR20","unstructured":"Battaglia PW, Hamrick JB, Bapst V, Sanchez-Gonzalez A, Zambaldi V, Malinowski M, Tacchetti A, Raposo D, Santoro A, Faulkner R, et al. (2018) Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261"},{"key":"10562_CR21","unstructured":"Becker S, LeCun Y (1989) Improving the convergence of back-propagation learning with second order methods. In: Proceedings of the 1988 connectionist models summer school, Morgan Kaufmann, pp 29\u201337"},{"issue":"1","key":"10562_CR22","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1038\/s42256-018-0004-1","volume":"1","author":"E Begoli","year":"2019","unstructured":"Begoli E, Bhattacharya T, Kusnezov D (2019) The need for uncertainty quantification in machine-assisted medical decision making. Nat Mach Intell 1(1):20\u201323","journal-title":"Nat Mach Intell"},{"key":"10562_CR23","doi-asserted-by":"crossref","unstructured":"Beluch WH, Genewein T, N\u00fcrnberger A, K\u00f6hler JM (2018) The power of ensembles for active learning in image classification. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 9368\u20139377","DOI":"10.1109\/CVPR.2018.00976"},{"key":"10562_CR24","doi-asserted-by":"crossref","unstructured":"Berkenkamp F, Schoellig AP, Krause A (2016) Safe controller optimization for quadrotors with gaussian processes. In: 2016 IEEE international conference on robotics and automation (ICRA), IEEE, pp 491\u2013496","DOI":"10.1109\/ICRA.2016.7487170"},{"key":"10562_CR25","unstructured":"Berkenkamp F, Turchetta M, Schoellig A, Krause A (2017) Safe model-based reinforcement learning with stability guarantees. In: Advances in neural information processing systems 30"},{"issue":"1","key":"10562_CR26","first-page":"973","volume":"20","author":"E Bingham","year":"2019","unstructured":"Bingham E, Chen JP, Jankowiak M, Obermeyer F, Pradhan N, Karaletsos T, Singh R, Szerlip P, Horsfall P, Goodman ND (2019) Pyro: deep universal probabilistic programming. J Mach Learn Res 20(1):973\u2013978","journal-title":"J Mach Learn Res"},{"key":"10562_CR27","volume-title":"Pattern recognition and machine learning","author":"CM Bishop","year":"2006","unstructured":"Bishop CM, Nasrabadi NM (2006) Pattern recognition and machine learning, vol 4. Springer, New York"},{"key":"10562_CR28","unstructured":"Blundell C, Cornebise J, Kavukcuoglu K, Wierstra D (2015) Weight uncertainty in neural network. In: International conference on machine learning, PMLR, pp 1613\u20131622"},{"key":"10562_CR29","doi-asserted-by":"crossref","unstructured":"Boerdijk W, Sundermeyer M, Durner M, Triebel R (2021) \"What\u2019s this?\"\u2013Learning to segment unknown objects from manipulation sequences. In: International conference on robotics and automation","DOI":"10.1109\/ICRA48506.2021.9560806"},{"key":"10562_CR30","unstructured":"Botev A, Ritter H, Barber D (2017) Practical Gauss-Newton optimisation for deep learning. In: International conference on machine learning, PMLR, pp 557\u2013565"},{"key":"10562_CR31","doi-asserted-by":"crossref","unstructured":"Bucilu\u01ce C, Caruana R, Niculescu-Mizil A (2006) Model compression. In: Proceedings of the 12th ACM SIGKDD international conference on knowledge discovery and data mining, pp 535\u2013541","DOI":"10.1145\/1150402.1150464"},{"issue":"6","key":"10562_CR32","first-page":"603","volume":"5","author":"WL Buntine","year":"1991","unstructured":"Buntine WL, Weigend AS (1991) Bayesian back-propagation. Complex Syst 5(6):603\u2013643","journal-title":"Complex Syst"},{"key":"10562_CR33","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.knosys.2018.12.030","volume":"168","author":"R Caba\u00f1as","year":"2019","unstructured":"Caba\u00f1as R, Salmer\u00f3n A, Masegosa AR (2019) Inferpy: probabilistic modeling with tensorflow made easy. Knowl-Based Syst 168:25\u201327","journal-title":"Knowl-Based Syst"},{"issue":"9","key":"10562_CR34","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1038\/s42256-020-0217-y","volume":"2","author":"Y Cao","year":"2020","unstructured":"Cao Y, Geddes TA, Yang JYH, Yang P (2020) Ensemble deep learning in bioinformatics. Nat Mach Intell 2(9):500\u2013508","journal-title":"Nat Mach Intell"},{"key":"10562_CR35","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.patrec.2016.01.029","volume":"74","author":"GD Cavalcanti","year":"2016","unstructured":"Cavalcanti GD, Oliveira LS, Moura TJ, Carvalho GV (2016) Combining diversity measures for ensemble pruning. Pattern Recognit Lett 74:38\u201345","journal-title":"Pattern Recognit Lett"},{"key":"10562_CR36","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.neucom.2019.05.082","volume":"359","author":"R Chandra","year":"2019","unstructured":"Chandra R, Jain K, Deo RV, Cripps S (2019) Langevin-gradient parallel tempering for Bayesian neural learning. Neurocomputing 359:315\u2013326","journal-title":"Neurocomputing"},{"key":"10562_CR37","unstructured":"Charpentier B, Z\u00fcgner D, G\u00fcnnemann S (2020) Posterior network: uncertainty estimation without OOD samples via density-based pseudo-counts. In: Advances in neural information processing systems 33"},{"key":"10562_CR38","unstructured":"Chen C, Ding N, Carin L (2015) On the convergence of stochastic gradient MCMC algorithms with high-order integrators. In: Advances in neural information processing systems 28"},{"key":"10562_CR40","unstructured":"Chen SW, Chou CN, Chang E (2018) BDA-PCH: block-diagonal approximation of positive-curvature hessian for training neural networks. CoRR, arxiv:1802.06502"},{"key":"10562_CR39","first-page":"217","volume":"2021","author":"C Chen","year":"2021","unstructured":"Chen C, Liang J, Ma F, Glass L, Sun J, Xiao C (2021) Unite: uncertainty-based health risk prediction leveraging multi-sourced data. Proc Web Conf 2021:217\u2013226","journal-title":"Proc Web Conf"},{"key":"10562_CR41","unstructured":"Chitta K, Alvarez JM, Lesnikowski A (2018) Large-scale visual active learning with deep probabilistic ensembles. arXiv preprint arXiv:1811.03575"},{"key":"10562_CR42","doi-asserted-by":"crossref","unstructured":"Choi J, Chun D, Kim H, Lee HJ (2019) Gaussian YOLOv3: an accurate and fast object detector using localization uncertainty for autonomous driving. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 502\u2013511","DOI":"10.1109\/ICCV.2019.00059"},{"key":"10562_CR43","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1613\/jair.295","volume":"4","author":"DA Cohn","year":"1996","unstructured":"Cohn DA, Ghahramani Z, Jordan MI (1996) Active learning with statistical models. J Artif Intell Res 4:129\u2013145","journal-title":"J Artif Intell Res"},{"key":"10562_CR44","doi-asserted-by":"crossref","unstructured":"Comaniciu D, Ramesh V, Meer P (2000) Real-time tracking of non-rigid objects using mean shift. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, IEEE, pp 142\u2013149","DOI":"10.1109\/CVPR.2000.854761"},{"key":"10562_CR45","first-page":"27","volume-title":"Artificial intelligence and statistics","author":"A Corduneanu","year":"2001","unstructured":"Corduneanu A, Bishop CM (2001) Variational Bayesian model selection for mixture distributions. Artificial intelligence and statistics. Morgan Kaufmann Waltham, Waltham, pp 27\u201334"},{"key":"10562_CR46","doi-asserted-by":"crossref","unstructured":"Daftry S, Zeng S, Bagnell JA, Hebert M (2016) Introspective perception: learning to predict failures in vision systems. In: 2016 IEEE\/RSJ international conference on intelligent robots and systems (IROS), IEEE, pp 1743\u20131750","DOI":"10.1109\/IROS.2016.7759279"},{"issue":"6","key":"10562_CR47","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1109\/LGRS.2018.2886534","volume":"16","author":"X Dai","year":"2019","unstructured":"Dai X, Wu X, Wang B, Zhang L (2019) Semisupervised scene classification for remote sensing images: a method based on convolutional neural networks and ensemble learning. IEEE Geosci Remote Sens Lett 16(6):869\u2013873","journal-title":"IEEE Geosci Remote Sens Lett"},{"key":"10562_CR48","doi-asserted-by":"crossref","unstructured":"Davis J, Goadrich M (2006) The relationship between Precision-Recall and ROC curves. In: International conference on machine learning, pp 233\u2013240","DOI":"10.1145\/1143844.1143874"},{"key":"10562_CR49","unstructured":"Daxberger E, Nalisnick E, Allingham JU, Antoran J, Hern\u00e1ndez-Lobato JM (2020) Expressive yet tractable Bayesian deep learning via subnetwork inference. In: Third symposium on advances in approximate Bayesian inference"},{"key":"10562_CR50","volume":"12","author":"E De B\u00e9zenac","year":"2019","unstructured":"De B\u00e9zenac E, Pajot A, Gallinari P (2019) Deep learning for physical processes: incorporating prior scientific knowledge. J Stat Mech: Theory Exp 12:124009","journal-title":"J Stat Mech: Theory Exp"},{"issue":"1\u20132","key":"10562_CR51","first-page":"12","volume":"32","author":"MH DeGroot","year":"1983","unstructured":"DeGroot MH, Fienberg SE (1983) The comparison and evaluation of forecasters. J R Stat Soc D 32(1\u20132):12\u201322","journal-title":"J R Stat Soc D"},{"issue":"1\u20132","key":"10562_CR52","first-page":"1","volume":"6","author":"F Dellaert","year":"2017","unstructured":"Dellaert F, Kaess M et al (2017) Factor graphs for robot perception. Found Trends Robot 6(1\u20132):1\u2013139","journal-title":"Found Trends Robot"},{"issue":"2","key":"10562_CR53","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1111\/j.2517-6161.1968.tb00722.x","volume":"30","author":"AP Dempster","year":"1968","unstructured":"Dempster AP (1968) A generalization of Bayesian inference. J R Stat Soc B 30(2):205\u2013232","journal-title":"J R Stat Soc B"},{"issue":"6","key":"10562_CR55","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","volume":"29","author":"L Deng","year":"2012","unstructured":"Deng L (2012) The mnist database of handwritten digit images for machine learning research [best of the web]. IEEE Signal Process Mag 29(6):141\u2013142","journal-title":"IEEE Signal Process Mag"},{"key":"10562_CR54","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, IEEE, pp 248\u2013255","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"10562_CR57","unstructured":"Denker JS, LeCun Y (1991) Transforming neural-net output levels to probability distributions. In: Advances in neural information processing systems 4"},{"issue":"5","key":"10562_CR56","first-page":"877","volume":"1","author":"J Denker","year":"1987","unstructured":"Denker J, Schwartz D, Wittner B, Solla S, Howard R, Jackel L, Hopfield J (1987) Large automatic learning, rule extraction, and generalization. Complex Syst 1(5):877\u2013922","journal-title":"Complex Syst"},{"key":"10562_CR58","unstructured":"Depeweg S, Hern\u00e1ndez-Lobato JM, Udluft S, Runkler T (2017) Sensitivity analysis for predictive uncertainty in Bayesian neural networks. arXiv preprint arXiv:1712.03605"},{"key":"10562_CR59","unstructured":"Depeweg S, Hernandez-Lobato JM, Doshi-Velez F, Udluft S (2018) Decomposition of uncertainty in Bayesian deep learning for efficient and risk-sensitive learning. In: International conference on machine learning, PMLR, pp 1184\u20131193"},{"key":"10562_CR60","unstructured":"DeVries T, Taylor GW (2017) Improved regularization of convolutional neural networks with cutout. arXiv preprint arXiv:1708.04552"},{"key":"10562_CR61","unstructured":"Ding N, Fang Y, Babbush R, Chen C, Skeel RD, Neven H (2014) Bayesian sampling using stochastic gradient thermostats. In: Advances in neural information processing systems 27"},{"key":"10562_CR62","unstructured":"Dua D, Graff C (2017) UCI machine learning repository. Retrieved June 19, 2021, from http:\/\/archive.ics.uci.edu\/ml"},{"issue":"2","key":"10562_CR63","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/0370-2693(87)91197-X","volume":"195","author":"S Duane","year":"1987","unstructured":"Duane S, Kennedy AD, Pendleton BJ, Roweth D (1987) Hybrid Monte Carlo. Phys Lett B 195(2):216\u2013222","journal-title":"Phys Lett B"},{"key":"10562_CR64","unstructured":"Dubey KA, Reddi J, S, Williamson SA, Poczos B, Smola AJ, Xing EP, (2016) Variance reduction in stochastic gradient Langevin dynamics. In: Advances in neural information processing systems 29"},{"issue":"4A","key":"10562_CR65","doi-asserted-by":"crossref","first-page":"2854","DOI":"10.3150\/18-BEJ1073","volume":"25","author":"A Durmus","year":"2019","unstructured":"Durmus A, Moulines E (2019) High-dimensional Bayesian inference via the unadjusted Langevin algorithm. Bernoulli 25(4A):2854\u20132882","journal-title":"Bernoulli"},{"key":"10562_CR66","unstructured":"Durmus A, Simsekli U, Moulines E, Badeau R, Richard G (2016) Stochastic gradient Richardson-Romberg Markov chain Monte Carlo. In: Advances in neural information processing systems 29"},{"issue":"2","key":"10562_CR67","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1109\/MRA.2006.1638022","volume":"13","author":"H Durrant-Whyte","year":"2006","unstructured":"Durrant-Whyte H, Bailey T (2006) Simultaneous localization and mapping: part I. IEEE Robot Autom Mag 13(2):99\u2013110","journal-title":"IEEE Robot Autom Mag"},{"key":"10562_CR68","doi-asserted-by":"crossref","unstructured":"Dusenberry MW, Tran D, Choi E, Kemp J, Nixon J, Jerfel G, Heller K, Dai AM (2020) Analyzing the role of model uncertainty for electronic health records. In: Proceedings of the ACM conference on health, inference, and learning, pp 204\u2013213","DOI":"10.1145\/3368555.3384457"},{"key":"10562_CR69","doi-asserted-by":"crossref","unstructured":"Eaton-Rosen Z, Bragman F, Bisdas S, Ourselin S, Cardoso MJ (2018) Towards safe deep learning: accurately quantifying biomarker uncertainty in neural network predictions. In: International conference on medical image computing and computer-assisted intervention, Springer, pp 691\u2013699","DOI":"10.1007\/978-3-030-00928-1_78"},{"key":"10562_CR70","unstructured":"Ebrahimi S, Elhoseiny M, Darrell T, Rohrbach M (2020) Uncertainty-guided continual learning with Bayesian neural networks. In: International conference on learning representations"},{"key":"10562_CR71","unstructured":"Eggenreich S, Payer C, Urschler M, \u0160tern D (2020) Variational inference and Bayesian CNNs for uncertainty estimation in multi-factorial bone age prediction. arXiv preprint arXiv:2002.10819"},{"key":"10562_CR72","unstructured":"Englesson E, Azizpour H (2019) Efficient evaluation-time uncertainty estimation by improved distillation. In: International conference on machine learning\u2014workshop on uncertainty and robustness in deep learning"},{"key":"10562_CR73","unstructured":"Farquhar S, Gal Y (2019) A unifying Bayesian view of continual learning. arXiv preprint arXiv:1902.06494"},{"key":"10562_CR74","unstructured":"Farquhar S, Smith L, Gal Y (2020) Try depth instead of weight correlations: mean-field is a less restrictive assumption for deeper networks. arXiv preprint arXiv:2002.03704"},{"key":"10562_CR75","unstructured":"Federici M, Ullrich K, Welling M (2017) Improved Bayesian compression. arXiv preprint arXiv:1711.06494"},{"key":"10562_CR76","doi-asserted-by":"crossref","unstructured":"Feldman Y, Indelman V (2018) Bayesian viewpoint-dependent robust classification under model and localization uncertainty. In: 2018 IEEE international conference on robotics and automation (ICRA), IEEE, pp 3221\u20133228","DOI":"10.1109\/ICRA.2018.8461127"},{"key":"10562_CR77","doi-asserted-by":"crossref","unstructured":"Feng D, Rosenbaum L, Dietmayer K (2018) Towards safe autonomous driving: capture uncertainty in the deep neural network for lidar 3d vehicle detection. In: International conference on intelligent transportation systems (ITSC), IEEE, pp 3266\u20133273","DOI":"10.1109\/ITSC.2018.8569814"},{"key":"10562_CR78","doi-asserted-by":"crossref","unstructured":"Feng J, Durner M, M\u00e1rton ZC, B\u00e1lint-Bencz\u00e9di F, Triebel R (2019) Introspective robot perception using smoothed predictions from Bayesian neural networks. In: The international symposium of robotics research, Springer, pp 660\u2013675","DOI":"10.1007\/978-3-030-95459-8_40"},{"key":"10562_CR79","unstructured":"Feng J, Lee J, Durner M, Triebel R (2021) Bridging the last mile in sim-to-real robot perception via Bayesian active learning. arXiv preprint arXiv:2109.11547"},{"key":"10562_CR80","unstructured":"Filos A, Farquhar S, Gomez AN, Rudner TG, Kenton Z, Smith L, Alizadeh M, De Kroon A, Gal Y (2019) A systematic comparison of Bayesian deep learning robustness in diabetic retinopathy tasks. arXiv preprint arXiv:1912.10481"},{"key":"10562_CR81","unstructured":"Foong AY, Li Y, Hern\u00e1ndez-Lobato JM, Turner RE (2019) \u2019In-between\u2019uncertainty in Bayesian neural networks. arXiv preprint arXiv:1906.11537"},{"key":"10562_CR82","unstructured":"Fort S, Hu H, Lakshminarayanan B (2019) Deep ensembles: a loss landscape perspective. arXiv preprint arXiv:1912.02757"},{"key":"10562_CR83","unstructured":"Fox D (1998) Markov localization-a probabilistic framework for mobile robot localization and navigation. PhD Thesis, Universit\u00e4t Bonn"},{"issue":"3","key":"10562_CR84","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1023\/A:1008937911390","volume":"8","author":"D Fox","year":"2000","unstructured":"Fox D, Burgard W, Kruppa H, Thrun S (2000) A probabilistic approach to collaborative multi-robot localization. Auton Robots 8(3):325\u2013344","journal-title":"Auton Robots"},{"key":"10562_CR85","unstructured":"Fu T, Luo L, Zhang Z (2016) Quasi-newton Hamiltonian Monte Carlo. In: Conference on uncertainty in artificial intelligence"},{"key":"10562_CR86","unstructured":"Gal Y (1998) Uncertainty in deep learning. PhD Thesis, University of Cambridge"},{"key":"10562_CR87","unstructured":"Gal Y, Ghahramani Z (2015) Bayesian convolutional neural networks with Bernoulli approximate variational inference. arXiv preprint arXiv:1506.02158"},{"key":"10562_CR88","unstructured":"Gal Y, Ghahramani Z (2016) Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In: International conference on machine learning, PMLR, pp 1050\u20131059"},{"key":"10562_CR89","unstructured":"Gal Y, Hron J, Kendall A (2017a) Concrete dropout. In: Advances in neural information processing systems 30"},{"key":"10562_CR90","unstructured":"Gal Y, Islam R, Ghahramani Z (2017b) Deep Bayesian active learning with image data. In: International conference on machine learning, PMLR, pp 1183\u20131192"},{"key":"10562_CR91","doi-asserted-by":"crossref","unstructured":"Gast J, Roth S (2018) Lightweight probabilistic deep networks. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 3369\u20133378","DOI":"10.1109\/CVPR.2018.00355"},{"key":"10562_CR92","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3140324","volume":"60","author":"J Gawlikowski","year":"2022","unstructured":"Gawlikowski J, Saha S, Kruspe A, Zhu XX (2022) An advanced Dirichlet prior network for out-of-distribution detection in remote sensing. IEEE Trans Geosci Remote Sens 60:1\u201319","journal-title":"IEEE Trans Geosci Remote Sens"},{"key":"10562_CR93","unstructured":"George T, Laurent C, Bouthillier X, Ballas N, Vincent P (2018) Fast approximate natural gradient descent in a Kronecker factored eigenbasis. In: Advances in neural information processing systems 31"},{"key":"10562_CR94","doi-asserted-by":"crossref","unstructured":"Ghandeharioun A, Eoff B, Jou B, Picard R (2019) Characterizing sources of uncertainty to proxy calibration and disambiguate annotator and data bias. In: 2019 IEEE\/CVF international conference on computer vision workshop (ICCVW), IEEE, pp 4202\u20134206","DOI":"10.1109\/ICCVW.2019.00517"},{"key":"10562_CR95","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-12385-1","volume-title":"Handbook of uncertainty quantification","author":"R Ghanem","year":"2017","unstructured":"Ghanem R, Higdon D, Owhadi H et al (2017) Handbook of uncertainty quantification, vol 6. Springer, Cham"},{"issue":"5\u20136","key":"10562_CR96","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1561\/2200000049","volume":"8","author":"M Ghavamzadeh","year":"2015","unstructured":"Ghavamzadeh M, Mannor S, Pineau J, Tamar A (2015) Bayesian reinforcement learning: a survey. Found Trends Mach Learn 8(5\u20136):359\u2013483","journal-title":"Found Trends Mach Learn"},{"key":"10562_CR97","doi-asserted-by":"crossref","unstructured":"Ghesu FC, Georgescu B, Gibson E, Guendel S, Kalra MK, Singh R, Digumarthy SR, Grbic S, Comaniciu D (2019) Quantifying and leveraging classification uncertainty for chest radiograph assessment. In: International conference on medical image computing and computer-assisted intervention, Springer, pp 676\u2013684","DOI":"10.1007\/978-3-030-32226-7_75"},{"issue":"182","key":"10562_CR98","first-page":"1","volume":"20","author":"S Ghosh","year":"2019","unstructured":"Ghosh S, Yao J, Doshi-Velez F (2019) Model selection in Bayesian neural networks via horseshoe priors. J Mach Learn Res 20(182):1\u201346","journal-title":"J Mach Learn Res"},{"key":"10562_CR99","doi-asserted-by":"crossref","unstructured":"Ghoshal B, Ghoshal B, Swift S, Tucker A (2021) Uncertainty estimation in sars-cov-2 b-cell epitope prediction for vaccine development. In: Artificial intelligence in medicine: 19th international conference on artificial intelligence in medicine, AIME 2021, Virtual Event, June 15\u201318, 2021, proceedings, Springer, pp 361\u2013366","DOI":"10.1007\/978-3-030-77211-6_41"},{"issue":"11","key":"10562_CR100","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1001\/jamainternmed.2018.3763","volume":"178","author":"MA Gianfrancesco","year":"2018","unstructured":"Gianfrancesco MA, Tamang S, Yazdany J, Schmajuk G (2018) Potential biases in machine learning algorithms using electronic health record data. JAMA Intern Med 178(11):1544\u20131547","journal-title":"JAMA Intern Med"},{"issue":"14","key":"10562_CR101","doi-asserted-by":"crossref","first-page":"3885","DOI":"10.1007\/s11269-010-9639-3","volume":"24","author":"C Giardino","year":"2010","unstructured":"Giardino C, Bresciani M, Villa P, Martinelli A (2010) Application of remote sensing in water resource management: the case study of lake Trasimeno, Italy. Water Resour Manage 24(14):3885\u20133899","journal-title":"Water Resour Manage"},{"key":"10562_CR102","volume-title":"Deep learning","author":"I Goodfellow","year":"2016","unstructured":"Goodfellow I, Bengio Y, Courville A, Bengio Y (2016) Deep learning, vol 1. MIT Press, Cambridge"},{"key":"10562_CR103","unstructured":"Graves A (2011) Practical variational inference for neural networks. In: Advances in neural information processing systems 24"},{"issue":"7","key":"10562_CR104","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1177\/0278364915587924","volume":"35","author":"H Grimmett","year":"2016","unstructured":"Grimmett H, Triebel R, Paul R, Posner I (2016) Introspective classification for robot perception. Int J Robot Res 35(7):743\u2013762","journal-title":"Int J Robot Res"},{"key":"10562_CR105","unstructured":"Grosse R, Martens J (2016) A kronecker-factored approximate fisher matrix for convolution layers. In: International conference on machine learning, PMLR, pp 573\u2013582"},{"key":"10562_CR108","unstructured":"Guo J, Gould S (2015) Deep CNN ensemble with data augmentation for object detection. arXiv preprint arXiv:1506.07224"},{"key":"10562_CR106","unstructured":"Guo C, Pleiss G, Sun Y, Weinberger KQ (2017) On calibration of modern neural networks. In: International conference on machine learning, PMLR, pp 1321\u20131330"},{"key":"10562_CR107","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.neucom.2017.06.052","volume":"275","author":"H Guo","year":"2018","unstructured":"Guo H, Liu H, Li R, Wu C, Guo Y, Xu M (2018) Margin & diversity based ordering ensemble pruning. Neurocomputing 275:237\u2013246","journal-title":"Neurocomputing"},{"key":"10562_CR109","doi-asserted-by":"crossref","unstructured":"Gur\u0103u C, Tong CH, Posner I (2016) Fit for purpose? Predicting perception performance based on past experience. In: International symposium on experimental robotics, Springer, pp 454\u2013464","DOI":"10.1007\/978-3-319-50115-4_40"},{"key":"10562_CR110","doi-asserted-by":"crossref","unstructured":"Gustafsson FK, Danelljan M, Schon TB (2020) Evaluating scalable Bayesian deep learning methods for robust computer vision. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition workshops, pp 318\u2013319","DOI":"10.1109\/CVPRW50498.2020.00167"},{"issue":"108","key":"10562_CR111","first-page":"648","volume":"226","author":"T Han","year":"2022","unstructured":"Han T, Li YF (2022) Out-of-distribution detection-assisted trustworthy machinery fault diagnosis approach with uncertainty-aware deep ensembles. Reliab Eng Syst Saf 226(108):648","journal-title":"Reliab Eng Syst Saf"},{"issue":"10","key":"10562_CR112","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/34.58871","volume":"12","author":"LK Hansen","year":"1990","unstructured":"Hansen LK, Salamon P (1990) Neural network ensembles. IEEE Trans Pattern Anal Mach Intell 12(10):993\u20131001","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10562_CR113","doi-asserted-by":"crossref","unstructured":"Hein M, Andriushchenko M, Bitterwolf J (2019) Why relu networks yield high-confidence predictions far away from the training data and how to mitigate the problem. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 41\u201350","DOI":"10.1109\/CVPR.2019.00013"},{"key":"10562_CR114","unstructured":"Hendrycks D, Gimpel K (2017) A baseline for detecting misclassified and out-of-distribution examples in neural networks. In: International conference on learning representations"},{"key":"10562_CR115","unstructured":"Hendrycks D, Mazeika M, Dietterich T (2019) Deep anomaly detection with outlier exposure. In: International conference on learning representations"},{"key":"10562_CR116","unstructured":"Hennig P (2013) Fast probabilistic optimization from noisy gradients. In: International conference on machine learning, PMLR, pp 62\u201370"},{"key":"10562_CR117","unstructured":"Heo J, Lee HB, Kim S, Lee J, Kim KJ, Yang E, Hwang SJ (2018) Uncertainty-aware attention for reliable interpretation and prediction. In: Advances in neural information processing systems 31"},{"issue":"106","key":"10562_CR118","first-page":"597","volume":"96","author":"S Hern\u00e1ndez","year":"2020","unstructured":"Hern\u00e1ndez S, L\u00f3pez JL (2020) Uncertainty quantification for plant disease detection using Bayesian deep learning. Appl Soft Comput 96(106):597","journal-title":"Appl Soft Comput"},{"key":"10562_CR119","unstructured":"Hern\u00e1ndez-Lobato JM, Adams R (2015) Probabilistic backpropagation for scalable learning of Bayesian neural networks. In: International conference on machine learning, PMLR, pp 1861\u20131869"},{"key":"10562_CR120","unstructured":"Hern\u00e1ndez-Lobato JM, Li Y, Rowland M, Bui T, Hern\u00e1ndez-Lobato D, Turner R (2016) Black-box alpha divergence minimization. In: International conference on machine learning, PMLR, pp 1511\u20131520"},{"key":"10562_CR121","unstructured":"Herrmann F (2020) A deep-learning based Bayesian approach to seismic imaging and uncertainty quantification. In: EAGE 2020 annual conference & exhibition online, EAGE Publications BV, pp 1\u20135"},{"key":"10562_CR122","doi-asserted-by":"crossref","unstructured":"Herron EJ, Young SR, Potok TE (2020) Ensembles of networks produced from neural architecture search. In: International conference on high performance computing, Springer, pp 223\u2013234","DOI":"10.1007\/978-3-030-59851-8_14"},{"key":"10562_CR123","doi-asserted-by":"crossref","unstructured":"Hinton GE, Van\u00a0Camp D (1993) Keeping the neural networks simple by minimizing the description length of the weights. In: Proceedings of the sixth annual conference on computational learning theory, pp 5\u201313","DOI":"10.1145\/168304.168306"},{"key":"10562_CR124","unstructured":"Hinton GE, Vinyals O, Dean J (2015) Distilling the knowledge in a neural network. arXiv:abs\/1503.02531"},{"key":"10562_CR125","unstructured":"Hobbhahn M, Kristiadi A, Hennig P (2022) Fast predictive uncertainty for classification with Bayesian deep networks. In: Conference on uncertainty in artificial intelligence, PMLR, pp 822\u2013832"},{"key":"10562_CR126","doi-asserted-by":"crossref","unstructured":"Hsu YC, Shen Y, Jin H, Kira Z (2020) Generalized odin: detecting out-of-distribution image without learning from out-of-distribution data. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 10951\u201310960","DOI":"10.1109\/CVPR42600.2020.01096"},{"key":"10562_CR127","doi-asserted-by":"crossref","unstructured":"Hu S, Worrall D, Knegt S, Veeling B, Huisman H, Welling M (2019) Supervised uncertainty quantification for segmentation with multiple annotations. In: International conference on medical image computing and computer-assisted intervention, Springer, pp 137\u2013145","DOI":"10.1007\/978-3-030-32245-8_16"},{"key":"10562_CR128","unstructured":"Huang G, Li Y, Pleiss G, Liu Z, Hopcroft JE, Weinberger KQ (2017) Snapshot ensembles: train 1, get m for free. In: International conference on learning representations"},{"key":"10562_CR129","doi-asserted-by":"crossref","unstructured":"Huang W, Zhang J, Huang K (2019a) Bootstrap estimated uncertainty of the environment model for model-based reinforcement learning. In: Proceedings of 28th the AAAI conference on artificial intelligence, pp 3870\u20133877","DOI":"10.1609\/aaai.v33i01.33013870"},{"key":"10562_CR130","unstructured":"Huang X, Yang J, Li L, Deng H, Ni B, Xu Y (2019b) Evaluating and boosting uncertainty quantification in classification. arXiv preprint arXiv:1909.06030"},{"issue":"3","key":"10562_CR131","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1007\/s10994-021-05946-3","volume":"110","author":"E H\u00fcllermeier","year":"2021","unstructured":"H\u00fcllermeier E, Waegeman W (2021) Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods. Mach Learn 110(3):457\u2013506","journal-title":"Mach Learn"},{"key":"10562_CR132","unstructured":"Humt M, Lee J, Triebel R (2020) Bayesian optimization meets laplace approximation for robotic introspection. arXiv preprint arXiv:2010.16141"},{"key":"10562_CR133","unstructured":"Immer A, Korzepa M, Bauer M (2021) Improving predictions of Bayesian neural nets via local linearization. In: Proceedings of The 24th international conference on artificial intelligence and statistics, PMLR, pp 703\u2013711"},{"key":"10562_CR134","doi-asserted-by":"crossref","unstructured":"Ito Y, Srinivasan C, Izumi H (2005) Bayesian learning of neural networks adapted to changes of prior probabilities. In: International conference on artificial neural networks, Springer, pp 253\u2013259","DOI":"10.1007\/11550907_40"},{"key":"10562_CR135","unstructured":"Iuzzolino ML, Umada T, Ahmed NR, Szafir DA (2020) In automation we trust: investigating the role of uncertainty in active learning systems. arXiv preprint arXiv:2004.00762"},{"key":"10562_CR136","unstructured":"Izmailov P, Maddox WJ, Kirichenko P, Garipov T, Vetrov D, Wilson AG (2020) Subspace inference for Bayesian deep learning. In: Conference on uncertainty in artificial intelligence, PMLR, pp 1169\u20131179"},{"key":"10562_CR137","doi-asserted-by":"crossref","unstructured":"Kaess M, Ila V, Roberts R, Dellaert F (2010) The Bayes tree: an algorithmic foundation for probabilistic robot mapping. In: Algorithmic foundations of robotics IX. Springer, Berlin, pp 157\u2013173","DOI":"10.1007\/978-3-642-17452-0_10"},{"key":"10562_CR138","unstructured":"Kahn G, Villaflor A, Pong V, Abbeel P, Levine S (2017) Uncertainty-aware reinforcement learning for collision avoidance. arXiv preprint arXiv:1702.01182"},{"key":"10562_CR139","doi-asserted-by":"crossref","unstructured":"Kahn G, Villaflor A, Ding B, Abbeel P, Levine S (2018) Self-supervised deep reinforcement learning with generalized computation graphs for robot navigation. In: 2018 IEEE international conference on robotics and automation (ICRA), IEEE, pp 5129\u20135136","DOI":"10.1109\/ICRA.2018.8460655"},{"key":"10562_CR140","doi-asserted-by":"crossref","unstructured":"Kawashima T, Yu Q, Asai A, Ikami D, Aizawa K (2021) The aleatoric uncertainty estimation using a separate formulation with virtual residuals. In: 2020 25th international conference on pattern recognition (ICPR), IEEE, pp 1438\u20131445","DOI":"10.1109\/ICPR48806.2021.9412324"},{"key":"10562_CR141","unstructured":"Kendall A, Gal Y (2017) What uncertainties do we need in Bayesian deep learning for computer vision? In: Advances in neural information processing systems 30"},{"key":"10562_CR142","unstructured":"Kendall AG (2019) Geometry and uncertainty in deep learning for computer vision. PhD Thesis, University of Cambridge, UK"},{"key":"10562_CR144","unstructured":"Khan ME, Liu Z, Tangkaratt V, Gal Y (2017) Vprop: variational inference using rmsprop. arXiv preprint arXiv:1712.01038"},{"key":"10562_CR143","unstructured":"Khan M, Nielsen D, Tangkaratt V, Lin W, Gal Y, Srivastava A (2018) Fast and scalable Bayesian deep learning by weight-perturbation in Adam. In: International conference on machine learning, PMLR, pp 2611\u20132620"},{"key":"10562_CR145","unstructured":"Khan MEE, Immer A, Abedi E, Korzepa M (2019) Approximate inference turns deep networks into Gaussian processes. In: Advances in neural information processing systems 32"},{"key":"10562_CR148","doi-asserted-by":"crossref","unstructured":"Kim W, Goyal B, Chawla K, Lee J, Kwon K (2018) Attention-based ensemble for deep metric learning. In: Proceedings of the European conference on computer vision (ECCV), pp 736\u2013751","DOI":"10.1007\/978-3-030-01246-5_45"},{"key":"10562_CR146","unstructured":"Kim I, Kim Y, Kim S (2020) Learning loss for test-time augmentation. In: Advances in neural information processing systems 33"},{"issue":"20","key":"10562_CR147","doi-asserted-by":"crossref","first-page":"3428","DOI":"10.1093\/bioinformatics\/btab346","volume":"37","author":"Q Kim","year":"2021","unstructured":"Kim Q, Ko JH, Kim S, Park N, Jhe W (2021) Bayesian neural network with pretrained protein embedding enhances prediction accuracy of drug-protein interaction. Bioinformatics 37(20):3428\u20133435","journal-title":"Bioinformatics"},{"key":"10562_CR149","unstructured":"Kingma DP, Salimans T, Welling M (2015) Variational dropout and the local reparameterization trick. In: Advances in neural information processing systems 28"},{"issue":"13","key":"10562_CR150","doi-asserted-by":"crossref","first-page":"3521","DOI":"10.1073\/pnas.1611835114","volume":"114","author":"J Kirkpatrick","year":"2017","unstructured":"Kirkpatrick J, Pascanu R, Rabinowitz N, Veness J, Desjardins G, Rusu AA, Milan K, Quan J, Ramalho T, Grabska-Barwinska A et al (2017) Overcoming catastrophic forgetting in neural networks. Proc Natl Acad Sci 114(13):3521\u20133526","journal-title":"Proc Natl Acad Sci"},{"key":"10562_CR151","unstructured":"Kirsch A, Van\u00a0Amersfoort J, Gal Y (2019) Batchbald: efficient and diverse batch acquisition for deep Bayesian active learning. In: Advances in neural information processing systems 32"},{"issue":"9","key":"10562_CR152","doi-asserted-by":"crossref","first-page":"2064","DOI":"10.3390\/s19092064","volume":"19","author":"J Koci\u0107","year":"2019","unstructured":"Koci\u0107 J, Jovi\u010di\u0107 N, Drndarevi\u0107 V (2019) An end-to-end deep neural network for autonomous driving designed for embedded automotive platforms. Sensors 19(9):2064","journal-title":"Sensors"},{"key":"10562_CR153","unstructured":"Koh PW, Sagawa S, Marklund H, Xie SM, Zhang M, Balsubramani A, Hu W, Yasunaga M, Phillips RL, Gao I, et al. (2021) Wilds: a benchmark of in-the-wild distribution shifts. In: International conference on machine learning, PMLR, pp 5637\u20135664"},{"key":"10562_CR154","unstructured":"Kristiadi A, Hein M, Hennig P (2020) Being Bayesian, even just a bit, fixes overconfidence in relu networks. In: International conference on machine learning, PMLR, pp 5436\u20135446"},{"key":"10562_CR155","unstructured":"Kristiadi A, Hein M, Hennig P (2021) Learnable uncertainty under laplace approximations. In: Conference on uncertainty in artificial intelligence, PMLR, pp 344\u2013353"},{"key":"10562_CR156","unstructured":"Krizhevsky A (2009) Learning multiple layers of features from tiny images. University of Toronto, Tech. rep"},{"key":"10562_CR157","unstructured":"Krueger D, Huang CW, Islam R, Turner R, Lacoste A, Courville A (2017) Bayesian hypernetworks. arXiv preprint arXiv:1710.04759"},{"key":"10562_CR158","unstructured":"Kuleshov V, Fenner N, Ermon S (2018) Accurate uncertainties for deep learning using calibrated regression. In: International conference on machine learning, PMLR, pp 2796\u20132804"},{"key":"10562_CR159","doi-asserted-by":"crossref","unstructured":"Kull M, Flach PA (2014) Reliability maps: a tool to enhance probability estimates and improve classification accuracy. In: Joint European conference on machine learning and knowledge discovery in databases, Springer, pp 18\u201333","DOI":"10.1007\/978-3-662-44851-9_2"},{"key":"10562_CR160","unstructured":"Kull M, Perello\u00a0Nieto M, K\u00e4ngsepp M, Silva\u00a0Filho T, Song H, Flach P (2019) Beyond temperature scaling: obtaining well-calibrated multi-class probabilities with Dirichlet calibration. In: Advances in neural information processing systems 32"},{"key":"10562_CR161","unstructured":"Kurutach T, Clavera I, Duan Y, Tamar A, Abbeel P (2018) Model-ensemble trust-region policy optimization. In: International conference on learning representations"},{"key":"10562_CR162","volume-title":"Stochastic approximation and recursive algorithms and applications","author":"H Kushner","year":"2003","unstructured":"Kushner H, Yin GG (2003) Stochastic approximation and recursive algorithms and applications, vol 35. Springer, New York"},{"key":"10562_CR163","doi-asserted-by":"crossref","unstructured":"LaBonte T, Martinez C, Roberts SA (2019) We know where we don\u2019t know: 3d Bayesian CNNs for credible geometric uncertainty. arXiv preprint arXiv:1910.10793","DOI":"10.2172\/1605518"},{"key":"10562_CR164","unstructured":"Lakshminarayanan B, Pritzel A, Blundell C (2017) Simple and scalable predictive uncertainty estimation using deep ensembles. In: Advances in neural information processing systems 30"},{"key":"10562_CR165","unstructured":"Laves MH, Ihler S, Kortmann KP, Ortmaier T (2019) Well-calibrated model uncertainty with temperature scaling for dropout variational inference. arXiv preprint arXiv:1909.13550"},{"key":"10562_CR166","unstructured":"Le\u00a0Roux N, Fitzgibbon AW (2010) A fast natural newton method. In: International conference on machine learning"},{"key":"10562_CR167","unstructured":"LeCun Y, Denker J, Solla S (1989) Optimal brain damage. In: Advances in neural information processing systems 2"},{"issue":"11","key":"10562_CR168","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278\u20132324","journal-title":"Proc IEEE"},{"key":"10562_CR169","doi-asserted-by":"crossref","unstructured":"Lee J, AlRegib G (2020) Gradients as a measure of uncertainty in neural networks. In: 2020 IEEE international conference on image processing (ICIP), IEEE, pp 2416\u20132420","DOI":"10.1109\/ICIP40778.2020.9190679"},{"key":"10562_CR174","unstructured":"Lee S, Purushwalkam S, Cogswell M, Crandall D, Batra D (2015) Why m heads are better than one: training a diverse ensemble of deep networks. arXiv preprint arXiv:1511.06314"},{"key":"10562_CR172","unstructured":"Lee K, Lee H, Lee K, Shin J (2018a) Training confidence-calibrated classifiers for detecting out-of-distribution samples. In: International conference on learning representations"},{"key":"10562_CR173","unstructured":"Lee K, Lee K, Lee H, Shin J (2018b) A simple unified framework for detecting out-of-distribution samples and adversarial attacks. In: Advances in neural information processing systems 31"},{"key":"10562_CR170","unstructured":"Lee J, Humt M, Feng J, Triebel R (2020) Estimating model uncertainty of neural networks in sparse information form. In: International conference on machine learning, PMLR, pp 5702\u20135713"},{"key":"10562_CR171","unstructured":"Lee J, Feng J, Humt M, M\u00fcller MG, Triebel R (2022) Trust your robots! Predictive uncertainty estimation of neural networks with sparse gaussian processes. In: Conference on robot learning, PMLR, pp 1168\u20131179"},{"key":"10562_CR175","volume-title":"Simulating Hamiltonian dynamics","author":"B Leimkuhler","year":"2004","unstructured":"Leimkuhler B, Reich S (2004) Simulating Hamiltonian dynamics, vol 14. Cambridge University Press, Cambridge"},{"issue":"2","key":"10562_CR176","doi-asserted-by":"crossref","first-page":"A712","DOI":"10.1137\/15M102318X","volume":"38","author":"B Leimkuhler","year":"2016","unstructured":"Leimkuhler B, Shang X (2016) Adaptive thermostats for noisy gradient systems. SIAM J Sci Comput 38(2):A712\u2013A736","journal-title":"SIAM J Sci Comput"},{"issue":"7","key":"10562_CR177","doi-asserted-by":"crossref","first-page":"3515","DOI":"10.1016\/j.jcp.2007.02.014","volume":"227","author":"M Leutbecher","year":"2008","unstructured":"Leutbecher M, Palmer TN (2008) Ensemble forecasting. J Comput Phys 227(7):3515\u20133539","journal-title":"J Comput Phys"},{"issue":"15","key":"10562_CR178","doi-asserted-by":"crossref","first-page":"5540","DOI":"10.3390\/s22155540","volume":"22","author":"D Levi","year":"2022","unstructured":"Levi D, Gispan L, Giladi N, Fetaya E (2022) Evaluating and calibrating uncertainty prediction in regression tasks. Sensors 22(15):5540","journal-title":"Sensors"},{"key":"10562_CR182","unstructured":"Li Y, Gal Y (2017) Dropout inference in Bayesian neural networks with $$\\alpha$$-divergences. In: International conference on machine learning, PMLR, pp 2052\u20132061"},{"key":"10562_CR183","doi-asserted-by":"crossref","unstructured":"Li Z, Hoiem D (2020) Improving confidence estimates for unfamiliar examples. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 2686\u20132695","DOI":"10.1109\/CVPR42600.2020.00276"},{"key":"10562_CR179","doi-asserted-by":"crossref","unstructured":"Li C, Chen C, Carlson D, Carin L (2016a) Preconditioned stochastic gradient Langevin dynamics for deep neural networks. In: Proceedings of the 30th AAAI conference on artificial intelligence","DOI":"10.1609\/aaai.v30i1.10200"},{"key":"10562_CR180","doi-asserted-by":"crossref","unstructured":"Li C, Stevens A, Chen C, Pu Y, Gan Z, Carin L (2016b) Learning weight uncertainty with stochastic gradient MCMC for shape classification. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 5666\u20135675","DOI":"10.1109\/CVPR.2016.611"},{"issue":"9","key":"10562_CR181","doi-asserted-by":"crossref","first-page":"4243","DOI":"10.1109\/TNNLS.2020.3017292","volume":"32","author":"H Li","year":"2020","unstructured":"Li H, Barnaghi P, Enshaeifar S, Ganz F (2020) Continual learning using Bayesian neural networks. IEEE Trans Neural Netw Learn Syst 32(9):4243\u20134252","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"523","key":"10562_CR184","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1080\/01621459.2017.1409122","volume":"113","author":"F Liang","year":"2018","unstructured":"Liang F, Li Q, Zhou L (2018a) Bayesian neural networks for selection of drug sensitive genes. J Am Stat Assoc 113(523):955\u2013972","journal-title":"J Am Stat Assoc"},{"key":"10562_CR185","unstructured":"Liang S, Li Y, Srikant R (2018b) Enhancing the reliability of out-of-distribution image detection in neural networks. In: International conference on learning representations"},{"key":"10562_CR186","doi-asserted-by":"crossref","unstructured":"Lindqvist J, Olmin A, Lindsten F, Svensson L (2020) A general framework for ensemble distribution distillation. In: 2020 IEEE 30th international workshop on machine learning for signal processing (MLSP), IEEE, pp 1\u20136","DOI":"10.1109\/MLSP49062.2020.9231703"},{"issue":"1","key":"10562_CR187","first-page":"503","volume":"45","author":"DC Liu","year":"1989","unstructured":"Liu DC, Nocedal J (1989) On the limited memory BFGS method for large scale optimization. Math Program 45(1):503\u2013528","journal-title":"Math Program"},{"issue":"1","key":"10562_CR188","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s12530-019-09324-2","volume":"12","author":"IE Livieris","year":"2021","unstructured":"Livieris IE, Iliadis L, Pintelas P (2021) On ensemble techniques of weight-constrained neural networks. Evol Syst 12(1):155\u2013167","journal-title":"Evol Syst"},{"issue":"1","key":"10562_CR189","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MSP.2004.1267047","volume":"21","author":"HA Loeliger","year":"2004","unstructured":"Loeliger HA (2004) An introduction to factor graphs. IEEE Signal Process Mag 21(1):28\u201341","journal-title":"IEEE Signal Process Mag"},{"issue":"8","key":"10562_CR190","doi-asserted-by":"crossref","first-page":"e0000,085","DOI":"10.1371\/journal.pdig.0000085","volume":"1","author":"TJ Loftus","year":"2022","unstructured":"Loftus TJ, Shickel B, Ruppert MM, Balch JA, Ozrazgat-Baslanti T, Tighe PJ, Efron PA, Hogan WR, Rashidi P, Upchurch GR Jr et al (2022) Uncertainty-aware deep learning in healthcare: a scoping review. PLoS Digit Health 1(8):e0000,085","journal-title":"PLoS Digit Health"},{"issue":"2","key":"10562_CR191","doi-asserted-by":"crossref","first-page":"3153","DOI":"10.1109\/LRA.2020.2974682","volume":"5","author":"A Loquercio","year":"2020","unstructured":"Loquercio A, Segu M, Scaramuzza D (2020) A general framework for uncertainty estimation in deep learning. IEEE Robot Autom Lett 5(2):3153\u20133160","journal-title":"IEEE Robot Autom Lett"},{"key":"10562_CR192","unstructured":"Louizos C, Welling M (2016) Structured and efficient variational deep learning with matrix gaussian posteriors. In: International conference on machine learning, PMLR, pp 1708\u20131716"},{"key":"10562_CR193","unstructured":"Louizos C, Welling M (2017) Multiplicative normalizing flows for variational Bayesian neural networks. In: International conference on machine learning, PMLR, pp 2218\u20132227"},{"key":"10562_CR194","unstructured":"Louizos C, Ullrich K, Welling M (2017) Bayesian compression for deep learning. In: Advances in neural information processing systems 30"},{"key":"10562_CR195","unstructured":"Lukasik M, Bhojanapalli S, Menon A, Kumar S (2020) Does label smoothing mitigate label noise? In: International conference on machine learning, PMLR, pp 6448\u20136458"},{"key":"10562_CR196","doi-asserted-by":"crossref","unstructured":"L\u00fctjens B, Everett M, How JP (2019) Safe reinforcement learning with model uncertainty estimates. In: 2019 international conference on robotics and automation (ICRA), IEEE, pp 8662\u20138668","DOI":"10.1109\/ICRA.2019.8793611"},{"key":"10562_CR197","doi-asserted-by":"crossref","first-page":"9021","DOI":"10.1109\/ACCESS.2017.2706363","volume":"5","author":"F Lv","year":"2017","unstructured":"Lv F, Han M, Qiu T (2017) Remote sensing image classification based on ensemble extreme learning machine with stacked autoencoder. IEEE Access 5:9021\u20139031","journal-title":"IEEE Access"},{"key":"10562_CR198","unstructured":"Lyzhov A, Molchanova Y, Ashukha A, Molchanov D, Vetrov D (2020) Greedy policy search: a simple baseline for learnable test-time augmentation. In: Conference on uncertainty in artificial intelligence, PMLR, pp 1308\u20131317"},{"key":"10562_CR199","unstructured":"Ma YA, Chen T, Fox E (2015) A complete recipe for stochastic gradient MCMC. In: Advances in neural information processing systems 28"},{"key":"10562_CR200","unstructured":"MacKay D (1992a) Bayesian model comparison and backprop nets. In: Advances in neural information processing systems 4"},{"issue":"4","key":"10562_CR201","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1162\/neco.1992.4.4.590","volume":"4","author":"DJ MacKay","year":"1992","unstructured":"MacKay DJ (1992b) Information-based objective functions for active data selection. Neural Comput 4(4):590\u2013604","journal-title":"Neural Comput"},{"issue":"3","key":"10562_CR202","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1162\/neco.1992.4.3.448","volume":"4","author":"DJ MacKay","year":"1992","unstructured":"MacKay DJ (1992c) A practical Bayesian framework for backpropagation networks. Neural Comput 4(3):448\u2013472","journal-title":"Neural Comput"},{"key":"10562_CR203","unstructured":"Maddox WJ, Izmailov P, Garipov T, Vetrov DP, Wilson AG (2019) A simple baseline for Bayesian uncertainty in deep learning. In: Advances in neural information processing systems 32"},{"key":"10562_CR204","unstructured":"Malinin A (2019) Uncertainty estimation in deep learning with application to spoken language assessment. PhD Thesis, University of Cambridge"},{"key":"10562_CR205","unstructured":"Malinin A, Gales M (2018) Predictive uncertainty estimation via prior networks. In: Advances in neural information processing systems 31"},{"key":"10562_CR206","unstructured":"Malinin A, Gales M (2019) Reverse kl-divergence training of prior networks: improved uncertainty and adversarial robustness. In: Advances in neural information processing systems 32"},{"key":"10562_CR207","unstructured":"Malinin A, Mlodozeniec B, Gales M (2020) Ensemble distribution distillation. In: International conference on learning representations"},{"key":"10562_CR208","doi-asserted-by":"crossref","unstructured":"Marceau-Caron G, Ollivier Y (2017) Natural Langevin dynamics for neural networks. In: International conference on geometric science of information, Springer, pp 451\u2013459","DOI":"10.1007\/978-3-319-68445-1_53"},{"key":"10562_CR209","unstructured":"Maro\u00f1as J, Ramos-Castro D, Palacios RP (2020) Improving calibration in mixup-trained deep neural networks through confidence-based loss functions. arXiv:abs\/2003.09946"},{"key":"10562_CR210","unstructured":"Martens J, Grosse R (2015) Optimizing neural networks with Kronecker-factored approximate curvature. In: International conference on machine learning, PMLR, pp 2408\u20132417"},{"key":"10562_CR211","doi-asserted-by":"crossref","first-page":"48,931","DOI":"10.1109\/ACCESS.2021.3062867","volume":"9","author":"WG Martinez","year":"2021","unstructured":"Martinez WG (2021) Ensemble pruning via quadratic margin maximization. IEEE Access 9:48931-48951","journal-title":"IEEE Access"},{"issue":"2","key":"10562_CR212","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1109\/TPAMI.2008.78","volume":"31","author":"G Mart\u00ednez-Mu\u00f1oz","year":"2008","unstructured":"Mart\u00ednez-Mu\u00f1oz G, Hern\u00e1ndez-Lobato D, Su\u00e1rez A (2008) An analysis of ensemble pruning techniques based on ordered aggregation. IEEE Trans Pattern Anal Mach Intell 31(2):245\u2013259","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"2","key":"10562_CR213","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1134\/S1054661820020108","volume":"30","author":"E Marushko","year":"2020","unstructured":"Marushko E, Doudkin A (2020) Methods of using ensembles of heterogeneous models to identify remote sensing objects. Pattern Recognit Image Anal 30(2):211\u2013216","journal-title":"Pattern Recognit Image Anal"},{"key":"10562_CR214","unstructured":"McClure P, Kriegeskorte N (2016) Robustly representing uncertainty through sampling in deep neural networks. arXiv preprint arXiv:1611.01639"},{"key":"10562_CR215","doi-asserted-by":"crossref","first-page":"67","DOI":"10.3389\/fninf.2019.00067","volume":"13","author":"P McClure","year":"2019","unstructured":"McClure P, Rho N, Lee JA, Kaczmarzyk JR, Zheng CY, Ghosh SS, Nielson DM, Thomas AG, Bandettini P, Pereira F (2019) Knowing what you know in brain segmentation using Bayesian deep neural networks. Front Neuroinform 13:67","journal-title":"Front Neuroinform"},{"issue":"12","key":"10562_CR216","doi-asserted-by":"crossref","first-page":"3868","DOI":"10.1109\/TMI.2020.3006437","volume":"39","author":"A Mehrtash","year":"2020","unstructured":"Mehrtash A, Wells WM, Tempany CM, Abolmaesumi P, Kapur T (2020) Confidence calibration and predictive uncertainty estimation for deep medical image segmentation. IEEE Trans Med Imaging 39(12):3868\u20133878","journal-title":"IEEE Trans Med Imaging"},{"key":"10562_CR218","unstructured":"Minka TP (2001) Expectation propagation for approximate Bayesian inference. In: Conference on uncertainty in artificial intelligence, pp 362\u2013369"},{"key":"10562_CR217","unstructured":"Minka T et al (2005) Divergence measures and message passing. Tech. rep, Microsoft Research"},{"key":"10562_CR219","unstructured":"Mishkin A, Kunstner F, Nielsen D, Schmidt M, Khan ME (2018) Slang: fast structured covariance approximations for Bayesian deep learning with natural gradient. In: Advances in neural information processing systems 31"},{"key":"10562_CR220","unstructured":"Mitros J, Mac\u00a0Namee B (2019) On the validity of Bayesian neural networks for uncertainty estimation. arXiv preprint arXiv:1912.01530"},{"issue":"1","key":"10562_CR221","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-021-84854-x","volume":"11","author":"A Mobiny","year":"2021","unstructured":"Mobiny A, Yuan P, Moulik SK, Garg N, Wu CC, Van Nguyen H (2021) Dropconnect is effective in modeling uncertainty of Bayesian deep networks. Sci Rep 11(1):1\u201314","journal-title":"Sci Rep"},{"key":"10562_CR222","first-page":"12756","volume":"33","author":"M Monteiro","year":"2020","unstructured":"Monteiro M, Le Folgoc L, Coelho de Castro D, Pawlowski N, Marques B, Kamnitsas K, van der Wilk M, Glocker B (2020) Stochastic segmentation networks: modelling spatially correlated aleatoric uncertainty. Adv Neural Inf Process Syst 33:12756\u201312767","journal-title":"Adv Neural Inf Process Syst"},{"key":"10562_CR223","unstructured":"Montemerlo M, Thrun S, Koller D, Wegbreit B, et al. (2002) Fastslam: a factored solution to the simultaneous localization and mapping problem. In: AAAI conference on innovative applications of artificial intelligence"},{"issue":"1","key":"10562_CR224","doi-asserted-by":"crossref","first-page":"5068","DOI":"10.1038\/s41598-020-61808-3","volume":"10","author":"N Moshkov","year":"2020","unstructured":"Moshkov N, Mathe B, Kertesz-Farkas A, Hollandi R, Horvath P (2020) Test-time augmentation for deep learning-based cell segmentation on microscopy images. Sci Rep 10(1):5068","journal-title":"Sci Rep"},{"key":"10562_CR225","unstructured":"Mo\u017cejko M, Susik M, Karczewski R (2018) Inhibited softmax for uncertainty estimation in neural networks. arXiv preprint arXiv:1810.01861"},{"key":"10562_CR226","unstructured":"Mukhoti J, Gal Y (2018) Evaluating Bayesian deep learning methods for semantic segmentation. arXiv preprint arXiv:1811.12709"},{"key":"10562_CR227","unstructured":"Mukhoti J, Stenetorp P, Gal Y (2018) On the importance of strong baselines in Bayesian deep learning. arXiv preprint arXiv:1811.09385"},{"key":"10562_CR228","unstructured":"M\u00fcller R, Kornblith S, Hinton GE (2019) When does label smoothing help? In: Advances in neural information processing systems 32"},{"key":"10562_CR229","doi-asserted-by":"crossref","unstructured":"Mundt M, Pliushch I, Majumder S, Ramesh V (2019) Open set recognition through deep neural network uncertainty: does out-of-distribution detection require generative classifiers? In: Proceedings of the IEEE\/CVF international conference on computer vision workshops","DOI":"10.1109\/ICCVW.2019.00098"},{"key":"10562_CR230","unstructured":"Nado Z, Snoek J, Grosse RB, Duvenaud D, Xu B, Martens J (2018) Stochastic gradient Langevin dynamics that exploit neural network structure. In: International conference on learning representations (workshop)"},{"key":"10562_CR231","unstructured":"Nado Z, Band N, Collier M, Djolonga J, Dusenberry MW, Farquhar S, Feng Q, Filos A, Havasi M, Jenatton R, et al. (2021) Uncertainty baselines: benchmarks for uncertainty & robustness in deep learning. arXiv preprint arXiv:2106.04015"},{"key":"10562_CR232","unstructured":"Naeini MP, Cooper G, Hauskrecht M (2015) Obtaining well calibrated probabilities using Bayesian binning. In: Proceedings of the 26th AAAI conference on artificial intelligence"},{"issue":"101","key":"10562_CR233","first-page":"557","volume":"59","author":"T Nair","year":"2020","unstructured":"Nair T, Precup D, Arnold DL, Arbel T (2020) Exploring uncertainty measures in deep networks for multiple sclerosis lesion detection and segmentation. Med Image Anal 59(101):557","journal-title":"Med Image Anal"},{"issue":"2","key":"10562_CR234","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1109\/LGRS.2019.2921011","volume":"17","author":"J Nalepa","year":"2019","unstructured":"Nalepa J, Myller M, Kawulok M (2019) Training-and test-time data augmentation for hyperspectral image segmentation. IEEE Geosci Remote Sens Lett 17(2):292\u2013296","journal-title":"IEEE Geosci Remote Sens Lett"},{"key":"10562_CR235","unstructured":"Nandy J, Hsu W, Lee ML (2020) Towards maximizing the representation gap between in-domain & out-of-distribution examples. In: Advances in neural information processing systems 33"},{"key":"10562_CR236","doi-asserted-by":"crossref","unstructured":"Nanni L, Brahnam S, Maguolo G (2019) Data augmentation for building an ensemble of convolutional neural networks. In: Innovation in medicine and healthcare systems, and multimedia. Springer, pp 61\u201369","DOI":"10.1007\/978-981-13-8566-7_6"},{"key":"10562_CR237","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.aci.2018.06.002","volume":"17","author":"L Nanni","year":"2020","unstructured":"Nanni L, Ghidoni S, Brahnam S (2020) Ensemble of convolutional neural networks for bioimage classification. Appl Comput Inform 17:19\u201335","journal-title":"Appl Comput Inform"},{"key":"10562_CR238","doi-asserted-by":"crossref","unstructured":"Narr A, Triebel R, Cremers D (2016) Stream-based active learning for efficient and adaptive classification of 3d objects. In: 2016 IEEE international conference on robotics and automation (ICRA), IEEE, pp 227\u2013233","DOI":"10.1109\/ICRA.2016.7487138"},{"key":"10562_CR239","unstructured":"Neal RM (1992) Bayesian training of backpropagation networks by the hybrid Monte Carlo method. University of Toronto, Tech. rep"},{"issue":"1","key":"10562_CR240","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1006\/jcph.1994.1054","volume":"111","author":"RM Neal","year":"1994","unstructured":"Neal RM (1994) An improved acceptance procedure for the hybrid Monte Carlo algorithm. J Comput Phys 111(1):194\u2013203","journal-title":"J Comput Phys"},{"key":"10562_CR241","doi-asserted-by":"crossref","unstructured":"Neal RM (1995) Bayesian learning for neural networks. PhD Thesis, University of Toronto","DOI":"10.1007\/978-1-4612-0745-0"},{"issue":"11","key":"10562_CR242","first-page":"2","volume":"2","author":"RM Neal","year":"2011","unstructured":"Neal RM et al (2011) MCMC using Hamiltonian dynamics. Handb Markov chain Monte Carlo 2(11):2","journal-title":"Handb Markov chain Monte Carlo"},{"issue":"533","key":"10562_CR243","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1080\/01621459.2020.1847120","volume":"116","author":"C Nemeth","year":"2021","unstructured":"Nemeth C, Fearnhead P (2021) Stochastic gradient Markov chain Monte Carlo. J Am Stat Assoc 116(533):433\u2013450","journal-title":"J Am Stat Assoc"},{"key":"10562_CR244","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-540-68009-3","volume-title":"Applied remote sensing for urban planning, governance and sustainability","author":"M Netzband","year":"2007","unstructured":"Netzband M, Stefanov WL, Redman C (2007) Applied remote sensing for urban planning, governance and sustainability. Springer, Berlin"},{"key":"10562_CR245","unstructured":"Netzer Y, Wang T, Coates A, Bissacco A, Wu B, Ng AY (2011) Reading digits in natural images with unsupervised feature learning. In: Advances in neural information processing systems (workshops)"},{"key":"10562_CR246","doi-asserted-by":"crossref","unstructured":"Nguyen A, Yosinski J, Clune J (2015) Deep neural networks are easily fooled: high confidence predictions for unrecognizable images. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 427\u2013436","DOI":"10.1109\/CVPR.2015.7298640"},{"key":"10562_CR247","unstructured":"Nguyen CV, Li Y, Bui TD, Turner RE (2018) Variational continual learning. In: International conference on learning representations"},{"key":"10562_CR248","doi-asserted-by":"crossref","unstructured":"Nguyen VL, Destercke S, H\u00fcllermeier E (2019) Epistemic uncertainty sampling. In: International conference on discovery science, Springer, pp 72\u201386","DOI":"10.1007\/978-3-030-33778-0_7"},{"issue":"8","key":"10562_CR249","doi-asserted-by":"crossref","first-page":"2265","DOI":"10.1007\/s00477-021-02168-w","volume":"36","author":"P Niraula","year":"2022","unstructured":"Niraula P, Mateu J, Chaudhuri S (2022) A Bayesian machine learning approach for spatio-temporal prediction of covid-19 cases. Stoch Environ Res Risk Assess 36(8):2265\u20132283","journal-title":"Stoch Environ Res Risk Assess"},{"key":"10562_CR250","unstructured":"Nixon J, Dusenberry MW, Zhang L, Jerfel G, Tran D (2019) Measuring calibration in deep learning. In: Conference on computer vision and pattern recognition (workshops)"},{"key":"10562_CR251","unstructured":"Oala L, Hei\u00df C, Macdonald J, M\u00e4rz M, Samek W, Kutyniok G (2020) Interval neural networks: uncertainty scores. arXiv preprint arXiv:2003.11566"},{"key":"10562_CR252","doi-asserted-by":"crossref","unstructured":"Oberdiek P, Rottmann M, Gottschalk H (2018) Classification uncertainty of deep neural networks based on gradient information. In: IAPR workshop on artificial neural networks in pattern recognition, Springer, pp 113\u2013125","DOI":"10.1007\/978-3-319-99978-4_9"},{"key":"10562_CR253","unstructured":"Osawa K, Swaroop S, Khan MEE, Jain A, Eschenhagen R, Turner RE, Yokota R (2019) Practical deep learning with Bayesian principles. In: Advances in neural information processing systems 32"},{"key":"10562_CR254","unstructured":"Ovadia Y, Fertig E, Ren J, Nado Z, Sculley D, Nowozin S, Dillon J, Lakshminarayanan B, Snoek J (2019) Can you trust your model\u2019s uncertainty? Evaluating predictive uncertainty under dataset shift. In: Advances in neural information processing systems 32"},{"issue":"3","key":"10562_CR255","first-page":"213","volume":"4","author":"WS Parker","year":"2013","unstructured":"Parker WS (2013) Ensemble modeling, uncertainty and robust predictions. Wiley Interdiscip Rev: Climate Change 4(3):213\u2013223","journal-title":"Wiley Interdiscip Rev: Climate Change"},{"key":"10562_CR256","doi-asserted-by":"crossref","unstructured":"Patel K, Beluch W, Zhang D, Pfeiffer M, Yang B (2021) On-manifold adversarial data augmentation improves uncertainty calibration. In: 2020 25th international conference on pattern recognition (ICPR), IEEE, pp 8029\u20138036","DOI":"10.1109\/ICPR48806.2021.9413010"},{"key":"10562_CR257","unstructured":"Patterson S, Teh YW (2013) Stochastic gradient Riemannian Langevin dynamics on the probability simplex. In: Advances in neural information processing systems 26"},{"key":"10562_CR258","unstructured":"Pearce T, Brintrup A, Zaki M, Neely A (2018) High-quality prediction intervals for deep learning: a distribution-free, ensembled approach. In: International conference on machine learning, PMLR, pp 4075\u20134084"},{"key":"10562_CR259","doi-asserted-by":"crossref","unstructured":"Peretroukhin V, Giamou M, Rosen DM, Greene WN, Roy N, Kelly J (2020) A smooth representation of belief over so (3) for deep rotation learning with uncertainty. arXiv preprint arXiv:2006.01031","DOI":"10.15607\/RSS.2020.XVI.007"},{"key":"10562_CR260","unstructured":"Pereyra G, Tucker G, Chorowski J, Kaiser \u0141, Hinton G (2017) Regularizing neural networks by penalizing confident output distributions. arXiv preprint arXiv:1701.06548"},{"key":"10562_CR261","doi-asserted-by":"crossref","unstructured":"Peterson JC, Battleday RM, Griffiths TL, Russakovsky O (2019) Human uncertainty makes classification more robust. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 9617\u20139626","DOI":"10.1109\/ICCV.2019.00971"},{"key":"10562_CR262","unstructured":"Pop R, Fulop P (2018) Deep ensemble Bayesian active learning: addressing the mode collapse issue in Monte Carlo dropout via ensembles. arXiv preprint arXiv:1811.03897"},{"key":"10562_CR263","doi-asserted-by":"crossref","unstructured":"Postels J, Ferroni F, Coskun H, Navab N, Tombari F (2019) Sampling-free epistemic uncertainty estimation using approximated variance propagation. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 2931\u20132940","DOI":"10.1109\/ICCV.2019.00302"},{"key":"10562_CR264","doi-asserted-by":"crossref","unstructured":"Pulgar FJ, Rivera AJ, Charte F, Jesus MJd (2017) On the impact of imbalanced data in convolutional neural networks performance. In: International conference on hybrid artificial intelligence systems, Springer, pp 220\u2013232","DOI":"10.1007\/978-3-319-59650-1_19"},{"key":"10562_CR265","unstructured":"Qiu R, Jia Y, Hadzikadic M, Dulin M, Niu X, Wang X (2019) Modeling the uncertainty in electronic health records: a Bayesian deep learning approach. arXiv preprint arXiv:1907.06162"},{"key":"10562_CR266","unstructured":"Raghu M, Blumer K, Sayres R, Obermeyer Z, Kleinberg B, Mullainathan S, Kleinberg J (2019) Direct uncertainty prediction for medical second opinions. In: International conference on machine learning, PMLR, pp 5281\u20135290"},{"key":"10562_CR267","unstructured":"Rahaman R et al (2021) Uncertainty quantification and deep ensembles. In: Advances in neural information processing systems 34"},{"key":"10562_CR268","unstructured":"Rajeswaran A, Ghotra S, Ravindran B, Levine S (2017) EPOpt: learning robust neural network policies using model ensembles. In: International conference on learning representations"},{"key":"10562_CR269","doi-asserted-by":"crossref","unstructured":"Ramalho T, Miranda M (2020) Density estimation in representation space to predict model uncertainty. In: International workshop on engineering dependable and secure machine learning systems, Springer, pp 84\u201396","DOI":"10.1007\/978-3-030-62144-5_7"},{"key":"10562_CR270","unstructured":"Rawat M, Wistuba M, Nicolae MI (2017) Harnessing model uncertainty for detecting adversarial examples. In: Advances in neural information processing systems\u2014workshop on Bayesian deep learning"},{"key":"10562_CR271","doi-asserted-by":"crossref","unstructured":"Reich S, Mueller D, Andrews N (2020) Ensemble distillation for structured prediction: calibrated, accurate, fast-choose three. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp 5583\u20135595","DOI":"10.18653\/v1\/2020.emnlp-main.450"},{"issue":"7743","key":"10562_CR272","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1038\/s41586-019-0912-1","volume":"566","author":"M Reichstein","year":"2019","unstructured":"Reichstein M, Camps-Valls G, Stevens B, Jung M, Denzler J, Carvalhais N et al (2019) Deep learning and process understanding for data-driven earth system science. Nature 566(7743):195\u2013204","journal-title":"Nature"},{"key":"10562_CR273","doi-asserted-by":"crossref","unstructured":"Reinhold JC, He Y, Han S, Chen Y, Gao D, Lee J, Prince JL, Carass A (2020) Validating uncertainty in medical image translation. In: 2020 IEEE 17th international symposium on biomedical imaging (ISBI), IEEE, pp 95\u201398","DOI":"10.1109\/ISBI45749.2020.9098543"},{"key":"10562_CR274","unstructured":"Ren J, Liu PJ, Fertig E, Snoek J, Poplin R, Depristo M, Dillon J, Lakshminarayanan B (2019) Likelihood ratios for out-of-distribution detection. In: Advances in neural information processing systems 32"},{"key":"10562_CR275","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.eswa.2019.06.025","volume":"136","author":"A Renda","year":"2019","unstructured":"Renda A, Barsacchi M, Bechini A, Marcelloni F (2019) Comparing ensemble strategies for deep learning: an application to facial expression recognition. Expert Syst Appl 136:1\u201311","journal-title":"Expert Syst Appl"},{"key":"10562_CR276","doi-asserted-by":"crossref","unstructured":"Rewicki F (2021) Estimating uncertainty of deep learning multi-label classifications using Laplace approximation. PhD Thesis, Friedrich-Schiller-Universit\u00e4t Jena","DOI":"10.1109\/IGARSS46834.2022.9884167"},{"key":"10562_CR277","unstructured":"Rezende D, Mohamed S (2015) Variational inference with normalizing flows. In: International conference on machine learning, PMLR, pp 1530\u20131538"},{"key":"10562_CR278","unstructured":"Richards SM, Berkenkamp F, Krause A (2018) The Lyapunov neural network: adaptive stability certification for safe learning of dynamical systems. In: Conference on robot learning, PMLR, pp 466\u2013476"},{"key":"10562_CR279","doi-asserted-by":"crossref","unstructured":"Richter C, Roy N (2017) Safe visual navigation via deep learning and novelty detection. Robotics: Science and Systems Foundation","DOI":"10.15607\/RSS.2017.XIII.064"},{"key":"10562_CR280","unstructured":"Ritter H, Botev A, Barber D (2018) A scalable laplace approximation for neural networks. In: International conference on learning representations"},{"issue":"4","key":"10562_CR281","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1023\/A:1023562417138","volume":"4","author":"GO Roberts","year":"2002","unstructured":"Roberts GO, Stramer O (2002) Langevin diffusions and metropolis-hastings algorithms. Methodol Comput Appl Probab 4(4):337\u2013357","journal-title":"Methodol Comput Appl Probab"},{"key":"10562_CR282","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, Springer, pp 234\u2013241","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"10562_CR283","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1613\/jair.2567","volume":"32","author":"S Ross","year":"2008","unstructured":"Ross S, Pineau J, Paquet S, Chaib-Draa B (2008) Online planning algorithms for POMDPs. J Artif Intell Res 32:663\u2013704","journal-title":"J Artif Intell Res"},{"issue":"10","key":"10562_CR284","doi-asserted-by":"crossref","first-page":"4628","DOI":"10.1063\/1.436415","volume":"69","author":"PJ Rossky","year":"1978","unstructured":"Rossky PJ, Doll JD, Friedman HL (1978) Brownian dynamics as smart Monte Carlo simulation. J Chem Phys 69(10):4628\u20134633","journal-title":"J Chem Phys"},{"key":"10562_CR285","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.neuroimage.2019.03.042","volume":"195","author":"AG Roy","year":"2019","unstructured":"Roy AG, Conjeti S, Navab N, Wachinger C, Initiative ADN et al (2019) Bayesian quicknat: model uncertainty in deep whole-brain segmentation for structure-wise quality control. NeuroImage 195:11\u201322","journal-title":"NeuroImage"},{"key":"10562_CR286","doi-asserted-by":"crossref","unstructured":"Ru\u00dfwurm M, Ali M, Zhu XX, Gal Y, K\u00f6rner M (2020) Model and data uncertainty for satellite time series forecasting with deep recurrent models. In: IEEE international geoscience and remote sensing symposium, IEEE, pp 7025\u20137028","DOI":"10.1109\/IGARSS39084.2020.9323890"},{"key":"10562_CR287","unstructured":"Ruzicka V, D\u2019Aronco S, Wegner JD, Schindler K (2020) Deep active learning in remote sensing for data efficient change detection. In: Proceedings of MACLEAN: MAChine Learning for EArth ObservatioN workshop co-located with the European conference on machine learning and principles and practice of knowledge discovery in databases (ECML\/PKDD 2020), RWTH Aachen University"},{"issue":"4","key":"10562_CR288","volume":"8","author":"O Sagi","year":"2018","unstructured":"Sagi O, Rokach L (2018) Ensemble learning: a survey. Wiley Interdiscip Rev: Data Min Knowl Discov 8(4):e1249","journal-title":"Wiley Interdiscip Rev: Data Min Knowl Discov"},{"key":"10562_CR289","unstructured":"Salimans T, Kingma DP (2016) Weight normalization: a simple reparameterization to accelerate training of deep neural networks. In: Advances in neural information processing systems 29"},{"issue":"7","key":"10562_CR291","doi-asserted-by":"crossref","first-page":"1649","DOI":"10.1162\/089976601750265045","volume":"13","author":"MA Sato","year":"2001","unstructured":"Sato MA (2001) Online model selection based on the variational Bayes. Neural Comput 13(7):1649\u20131681","journal-title":"Neural Comput"},{"key":"10562_CR290","unstructured":"Sato I, Nakagawa H (2014) Approximation analysis of stochastic gradient Langevin dynamics by using Fokker-Planck equation and ito process. In: International conference on machine learning, PMLR, pp 982\u2013990"},{"issue":"6","key":"10562_CR292","doi-asserted-by":"crossref","first-page":"2697","DOI":"10.1021\/acs.jcim.9b00975","volume":"60","author":"G Scalia","year":"2020","unstructured":"Scalia G, Grambow CA, Pernici B, Li YP, Green WH (2020) Evaluating scalable uncertainty estimation methods for deep learning-based molecular property prediction. J Chem Inf Model 60(6):2697\u20132717","journal-title":"J Chem Inf Model"},{"issue":"4","key":"10562_CR293","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2016.2561021","volume":"4","author":"M Schmitt","year":"2016","unstructured":"Schmitt M, Zhu XX (2016) Data fusion and remote sensing: an ever-growing relationship. IEEE Geosci Remote Sens Mag 4(4):6\u201323","journal-title":"IEEE Geosci Remote Sens Mag"},{"key":"10562_CR294","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/TMI.2019.2919951","volume":"39","author":"P Seebock","year":"2020","unstructured":"Seebock P, Orlando JI, Schlegl T, Waldstein SM, Bogunovic H, Klimscha S, Langs G, Schmidt-Erfurth U (2020) Exploiting epistemic uncertainty of anatomy segmentation for anomaly detection in retinal OCT. IEEE Trans Med Imaging 39:87\u201398","journal-title":"IEEE Trans Med Imaging"},{"issue":"100","key":"10562_CR295","first-page":"133","volume":"16","author":"E Semenova","year":"2020","unstructured":"Semenova E, Williams DP, Afzal AM, Lazic SE (2020) A Bayesian neural network for toxicity prediction. Comput Toxicol 16(100):133","journal-title":"Comput Toxicol"},{"key":"10562_CR296","unstructured":"Sensoy M, Kaplan L, Kandemir M (2018) Evidential deep learning to quantify classification uncertainty. In: Advances in neural information processing systems 31"},{"key":"10562_CR297","doi-asserted-by":"crossref","unstructured":"Seo S, Seo PH, Han B (2019) Learning for single-shot confidence calibration in deep neural networks through stochastic inferences. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 9030\u20139038","DOI":"10.1109\/CVPR.2019.00924"},{"key":"10562_CR298","unstructured":"Serban AC, Poll E, Visser J (2018) Adversarial examples-a complete characterisation of the phenomenon. arXiv preprint arXiv:1810.01185"},{"key":"10562_CR299","unstructured":"Settles B (2009) Active learning literature survey. University of Wisconsin-Madison Department of Computer Sciences, Tech. rep"},{"key":"10562_CR300","unstructured":"Shafaei A, Schmidt M, Little JJ (2019) A less biased evaluation of out-of-distribution sample detectors. In: British machine learning conference"},{"key":"10562_CR301","unstructured":"Shang X, Zhu Z, Leimkuhler B, Storkey AJ (2015) Covariance-controlled adaptive langevin thermostat for large-scale Bayesian sampling. In: Advances in neural information processing systems 28"},{"key":"10562_CR302","unstructured":"Shanmugam D, Blalock D, Balakrishnan G, Guttag J (2020) When and why test-time augmentation works. arXiv preprint arXiv:2011.11156"},{"key":"10562_CR303","unstructured":"Shinde K, Lee J, Humt M, Sezgin A, Triebel R (2020) Learning multiplicative interactions with Bayesian neural networks for visual-inertial odometry. In: Workshop on AI for autonomous driving at the 37th international conference on machine learning"},{"issue":"1","key":"10562_CR304","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","volume":"6","author":"C Shorten","year":"2019","unstructured":"Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6(1):1\u201348","journal-title":"J Big Data"},{"key":"10562_CR305","unstructured":"Silver D, Veness J (2010) Monte-Carlo planning in large POMDPs. In: Advances in neural information processing systems 23"},{"key":"10562_CR306","unstructured":"Simsekli U, Badeau R, Cemgil T, Richard G (2016) Stochastic Quasi-Newton Langevin Monte Carlo. In: International conference on machine learning, PMLR, pp 642\u2013651"},{"key":"10562_CR307","unstructured":"Smith L, Gal Y (2018) Understanding measures of uncertainty for adversarial example detection. In: Conference on uncertainty in artificial intelligence, pp 560\u2013569"},{"key":"10562_CR308","unstructured":"Soberanis-Mukul RD, Navab N, Albarqouni S (2020) Uncertainty-based graph convolutional networks for organ segmentation refinement. In: Medical imaging with deep learning, PMLR, pp 755\u2013769"},{"key":"10562_CR309","unstructured":"Soleimany AP, Suresh H, Ortiz JJG, Shanmugam D, Gural N, Guttag J, Bhatia SN (2019) Image segmentation of liver stage malaria infection with spatial uncertainty sampling. arXiv preprint arXiv:1912.00262"},{"issue":"8","key":"10562_CR310","doi-asserted-by":"crossref","first-page":"1356","DOI":"10.1021\/acscentsci.1c00546","volume":"7","author":"AP Soleimany","year":"2021","unstructured":"Soleimany AP, Amini A, Goldman S, Rus D, Bhatia SN, Coley CW (2021) Evidential deep learning for guided molecular property prediction and discovery. ACS Central Sci 7(8):1356\u20131367","journal-title":"ACS Central Sci"},{"key":"10562_CR311","doi-asserted-by":"crossref","unstructured":"St\u00e5hl N, Falkman G, Karlsson A, Mathiason G (2020) Evaluation of uncertainty quantification in deep learning. In: International conference on information processing and management of uncertainty in knowledge-based systems, Springer, pp 556\u2013568","DOI":"10.1007\/978-3-030-50146-4_41"},{"key":"10562_CR312","doi-asserted-by":"crossref","unstructured":"Stulp F, Theodorou E, Buchli J, Schaal S (2011) Learning to grasp under uncertainty. In: 2011 IEEE international conference on robotics and automation, IEEE, pp 5703\u20135708","DOI":"10.1109\/ICRA.2011.5979644"},{"key":"10562_CR313","unstructured":"Su D, Ting YY, Ansel J (2018) Tight prediction intervals using expanded interval minimization. arXiv preprint arXiv:1806.11222"},{"key":"10562_CR314","unstructured":"Sun S, Chen C, Carin L (2017) Learning structured weight uncertainty in Bayesian neural networks. In: Artificial intelligence and statistics, PMLR, pp 1283\u20131292"},{"key":"10562_CR315","unstructured":"Sun S, Zhang G, Shi J, Grosse R (2018) Functional variational Bayesian neural networks. In: International conference on learning representations"},{"issue":"4\u20135","key":"10562_CR316","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1177\/0278364918770733","volume":"37","author":"N S\u00fcnderhauf","year":"2018","unstructured":"S\u00fcnderhauf N, Brock O, Scheirer W, Hadsell R, Fox D, Leitner J, Upcroft B, Abbeel P, Burgard W, Milford M et al (2018) The limits and potentials of deep learning for robotics. Int J Robot Res 37(4\u20135):405\u2013420","journal-title":"Int J Robot Res"},{"key":"10562_CR317","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 2818\u20132826","DOI":"10.1109\/CVPR.2016.308"},{"key":"10562_CR318","unstructured":"Tagasovska N, Lopez-Paz D (2019) Single-model uncertainties for deep learning. In: Advances in neural information processing systems 32"},{"key":"10562_CR319","doi-asserted-by":"crossref","unstructured":"Tassi N, Rovile C (2019) Bayesian convolutional neural network: Robustly quantify uncertainty for misclassifications detection. In: Mediterranean conference on pattern recognition and artificial intelligence, Springer, pp 118\u2013132","DOI":"10.1007\/978-3-030-37548-5_10"},{"issue":"4","key":"10562_CR320","doi-asserted-by":"crossref","first-page":"4329","DOI":"10.1109\/LRA.2018.2852844","volume":"3","author":"V Tchuiev","year":"2018","unstructured":"Tchuiev V, Indelman V (2018) Inference over distribution of posterior class probabilities for reliable Bayesian classification and object-level perception. IEEE Robot Autom Lett 3(4):4329\u20134336","journal-title":"IEEE Robot Autom Lett"},{"key":"10562_CR321","first-page":"1","volume":"17","author":"YW Teh","year":"2016","unstructured":"Teh YW, Thiery AH, Vollmer SJ (2016) Consistency and fluctuations for stochastic gradient Langevin dynamics. J Mach Learn Res 17:1\u201333","journal-title":"J Mach Learn Res"},{"issue":"3","key":"10562_CR322","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1145\/504729.504754","volume":"45","author":"S Thrun","year":"2002","unstructured":"Thrun S (2002) Probabilistic robotics. Commun ACM 45(3):52\u201357","journal-title":"Commun ACM"},{"issue":"1\u20132","key":"10562_CR323","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/S0004-3702(01)00069-8","volume":"128","author":"S Thrun","year":"2001","unstructured":"Thrun S, Fox D, Burgard W, Dellaert F (2001) Robust Monte Carlo localization for mobile robots. Artif Intell 128(1\u20132):99\u2013141","journal-title":"Artif Intell"},{"key":"10562_CR324","doi-asserted-by":"crossref","unstructured":"Thulasidasan S, Chennupati G, Bilmes JA, Bhattacharya T, Michalak S (2019) On mixup training: improved calibration and predictive uncertainty for deep neural networks. In: Advances in neural information processing systems 32","DOI":"10.2172\/1525811"},{"key":"10562_CR325","doi-asserted-by":"crossref","unstructured":"Tishby N, Levin E, Solla SA (1989) Consistent inference of probabilities in layered networks: predictions and generalization. In: International joint conference on neural networks, IEEE, pp 403\u2013409","DOI":"10.1109\/IJCNN.1989.118274"},{"key":"10562_CR326","unstructured":"Tran D, Kucukelbir A, Dieng AB, Rudolph M, Liang D, Blei DM (2016) Edward: a library for probabilistic modeling, inference, and criticism. arXiv preprint arXiv:1610.09787"},{"key":"10562_CR327","unstructured":"Tran D, Hoffman MD, Saurous RA, Brevdo E, Murphy K, Blei DM (2017) Deep probabilistic programming. In: International conference on learning representations"},{"key":"10562_CR328","doi-asserted-by":"crossref","unstructured":"Triebel R, Grimmett H, Paul R, Posner I (2016) Driven learning for driving: how introspection improves semantic mapping. In: Robotics research. Springer, pp 449\u2013465","DOI":"10.1007\/978-3-319-28872-7_26"},{"key":"10562_CR329","doi-asserted-by":"crossref","unstructured":"Tsiligkaridis T (2021) Failure prediction by confidence estimation of uncertainty-aware Dirichlet networks. In: ICASSP 2021\u20132021 IEEE international conference on acoustics. Speech and signal processing (ICASSP), IEEE, pp 3525\u20133529","DOI":"10.1109\/ICASSP39728.2021.9414153"},{"key":"10562_CR330","unstructured":"Tsiligkaridis T (2021b) Information robust Dirichlet networks for predictive uncertainty estimation. US Patent App. 17\/064,046"},{"key":"10562_CR331","unstructured":"Vaicenavicius J, Widmann D, Andersson C, Lindsten F, Roll J, Sch\u00f6n T (2019) Evaluating model calibration in classification. In: Proceedings of the 22nd international conference on artificial intelligence and statistics, PMLR, pp 3459\u20133467"},{"key":"10562_CR332","unstructured":"Valdenegro-Toro, M. (2019). Deep sub-ensembles for fast uncertainty estimation in image classification. arXiv preprint arXiv:1910.08168. https:\/\/github.com\/mvaldenegro\/papersubensemblesimage-classification"},{"key":"10562_CR333","unstructured":"Van\u00a0Amersfoort J, Smith L, Teh YW, Gal Y (2020) Uncertainty estimation using a single deep deterministic neural network. In: International conference on machine learning, PMLR, pp 9690\u20139700"},{"issue":"B7\/4; PART 7","key":"10562_CR334","first-page":"1609","volume":"33","author":"C Van Westen","year":"2000","unstructured":"Van Westen C (2000) Remote sensing for natural disaster management. Int Arch Photogram Remote Sens 33(B7\/4; PART 7):1609\u20131617","journal-title":"Int Arch Photogram Remote Sens"},{"key":"10562_CR335","doi-asserted-by":"crossref","unstructured":"Vasudevan VT, Sethy A, Ghias AR (2019) Towards better confidence estimation for neural models. In: ICASSP 2019\u20132019 IEEE international conference on acoustics. Speech and signal processing (ICASSP), IEEE, pp 7335\u20137339","DOI":"10.1109\/ICASSP.2019.8683359"},{"key":"10562_CR336","unstructured":"Venkatesh B, Thiagarajan JJ (2019) Heteroscedastic calibration of uncertainty estimators in deep learning. arXiv preprint arXiv:1910.14179"},{"key":"10562_CR337","doi-asserted-by":"crossref","unstructured":"Vyas A, Jammalamadaka N, Zhu X, Das D, Kaul B, Willke TL (2018) Out-of-distribution detection using an ensemble of self supervised leave-out classifiers. In: Proceedings of the European conference on computer vision (ECCV), pp 550\u2013564","DOI":"10.1007\/978-3-030-01237-3_34"},{"issue":"12","key":"10562_CR340","doi-asserted-by":"crossref","first-page":"3395","DOI":"10.1109\/TKDE.2016.2606428","volume":"28","author":"H Wang","year":"2016","unstructured":"Wang H, Yeung DY (2016) Towards Bayesian deep learning: a framework and some existing methods. IEEE Trans Knowl Data Eng 28(12):3395\u20133408","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"5","key":"10562_CR341","first-page":"1","volume":"53","author":"H Wang","year":"2020","unstructured":"Wang H, Yeung DY (2020) A survey on Bayesian deep learning. ACM Comput Surv (CSUR) 53(5):1\u201337","journal-title":"ACM Comput Surv (CSUR)"},{"key":"10562_CR343","doi-asserted-by":"crossref","unstructured":"Wang S, Clark R, Wen H, Trigoni N (2017) DeepVO: towards end-to-end visual odometry with deep recurrent convolutional neural networks. In: 2017 IEEE international conference on robotics and automation (ICRA), IEEE, pp 2043\u20132050","DOI":"10.1109\/ICRA.2017.7989236"},{"key":"10562_CR338","doi-asserted-by":"crossref","unstructured":"Wang G, Li W, Ourselin S, Vercauteren T (2018a) Automatic brain tumor segmentation using convolutional neural networks with test-time augmentation. In: International MICCAI brainlesion workshop, Springer, pp 61\u201372","DOI":"10.1007\/978-3-030-11726-9_6"},{"key":"10562_CR342","unstructured":"Wang KC, Vicol P, Lucas J, Gu L, Grosse R, Zemel R (2018b) Adversarial distillation of Bayesian neural network posteriors. In: International conference on machine learning, PMLR, pp 5190\u20135199"},{"key":"10562_CR339","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.neucom.2019.01.103","volume":"338","author":"G Wang","year":"2019","unstructured":"Wang G, Li W, Aertsen M, Deprest J, Ourselin S, Vercauteren T (2019) Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks. Neurocomputing 338:34\u201345","journal-title":"Neurocomputing"},{"key":"10562_CR344","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.artmed.2017.02.005","volume":"83","author":"L Wei","year":"2017","unstructured":"Wei L, Wan S, Guo J, Wong KK (2017) A novel hierarchical selective ensemble classifier with bioinformatics application. Artif Intell Med 83:82\u201390","journal-title":"Artif Intell Med"},{"key":"10562_CR345","unstructured":"Welling M, Teh YW (2011) Bayesian learning via stochastic gradient Langevin dynamics. In: International conference on machine learning, PMLR, pp 681\u2013688"},{"key":"10562_CR347","unstructured":"Wen Y, Tran D, Ba J (2019) BatchEnsemble: an alternative approach to efficient ensemble and lifelong learning. In: International conference on learning representations"},{"key":"10562_CR346","doi-asserted-by":"crossref","unstructured":"Wen Q, Sun L, Yang F, Song X, Gao J, Wang X, Xu H (2021a) Time series data augmentation for deep learning: a survey. In: Proceedings of the thirtieth international joint conference on artificial intelligence. Survey track, pp 4653\u20134660","DOI":"10.24963\/ijcai.2021\/631"},{"key":"10562_CR348","unstructured":"Wen Y, Jerfel G, Muller R, Dusenberry MW, Snoek J, Lakshminarayanan B, Tran D (2021b) Combining ensembles and data augmentation can harm your calibration. In: International conference on learning representations"},{"key":"10562_CR349","unstructured":"Wenger J, Kjellstr\u00f6m H, Triebel R (2020) Non-parametric calibration for classification. In: Proceedings of the 23rd international conference on artificial intelligence and statistics, PMLR, pp 178\u2013190"},{"key":"10562_CR350","unstructured":"Wenzel F, Roth K, Veeling B, Swiatkowski J, Tran L, Mandt S, Snoek J, Salimans T, Jenatton R, Nowozin S (2020) How good is the Bayes posterior in deep neural networks really? In: International conference on machine learning, PMLR, pp 10248\u201310259"},{"key":"10562_CR351","unstructured":"Willard J, Jia X, Xu S, Steinbach M, Kumar V (2020) Integrating physics-based modeling with machine learning: a survey. arXiv preprint arXiv:2003.04919"},{"key":"10562_CR352","unstructured":"Wilson AG, Izmailov P (2020) Bayesian deep learning and a probabilistic perspective of generalization. In: Advances in neural information processing systems 33"},{"key":"10562_CR353","unstructured":"Wong K, Wang S, Ren M, Liang M, Urtasun R (2020) Identifying unknown instances for autonomous driving. In: Conference on robot learning, PMLR, pp 384\u2013393"},{"key":"10562_CR354","unstructured":"Wu A, Nowozin S, Meeds E, Turner RE, Hern\u00e1ndez-Lobato JM, Gaunt AL (2018) Deterministic variational inference for robust Bayesian neural networks. In: International conference on learning representations"},{"key":"10562_CR355","unstructured":"Wu Q, Li H, Li L, Yu Z (2019) Quantifying intrinsic uncertainty in classification via deep Dirichlet mixture networks. arXiv preprint arXiv:1906.04450"},{"key":"10562_CR356","unstructured":"Xiao H, Rasul K, Vollgraf R (2017) Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747"},{"key":"10562_CR359","doi-asserted-by":"crossref","unstructured":"Yang S, Fevens T (2021) Uncertainty quantification and estimation in medical image classification. In: Artificial neural networks and machine learning\u2013ICANN 2021: 30th international conference on artificial neural networks, Bratislava, Slovakia, September 14\u201317, 2021, proceedings, Part III 30, Springer, pp 671\u2013683","DOI":"10.1007\/978-3-030-86365-4_54"},{"key":"10562_CR357","doi-asserted-by":"crossref","first-page":"217,499","DOI":"10.1109\/ACCESS.2020.3041525","volume":"8","author":"J Yang","year":"2020","unstructured":"Yang J, Wang F (2020) Auto-ensemble: an adaptive learning rate scheduling based deep learning model ensembling. IEEE Access 8:217,499-217,509","journal-title":"IEEE Access"},{"key":"10562_CR358","doi-asserted-by":"crossref","unstructured":"Yang N, Stumberg Lv, Wang R, Cremers D (2020) D3vo: deep depth, deep pose and deep uncertainty for monocular visual odometry. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 1281\u20131292","DOI":"10.1109\/CVPR42600.2020.00136"},{"key":"10562_CR360","unstructured":"Yao J, Pan W, Ghosh S, Doshi-Velez F (2019) Quality of uncertainty quantification for Bayesian neural network inference. arXiv preprint arXiv:1906.09686"},{"key":"10562_CR361","doi-asserted-by":"crossref","unstructured":"Ye N, Zhu Z (2018) Stochastic fractional Hamiltonian Monte Carlo. In: Proceedings of the 27th international joint conference on artificial intelligence, pp 3019\u20133025","DOI":"10.24963\/ijcai.2018\/419"},{"key":"10562_CR362","unstructured":"Ye N, Zhu Z, Mantiuk R (2017) Langevin dynamics with continuous tempering for training deep neural networks. In: Advances in neural information processing systems 30"},{"key":"10562_CR363","doi-asserted-by":"crossref","unstructured":"Yu Q, Aizawa K (2019) Unsupervised out-of-distribution detection by maximum classifier discrepancy. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 9518\u20139526","DOI":"10.1109\/ICCV.2019.00961"},{"key":"10562_CR364","unstructured":"Yun P, Liu M (2023) Laplace approximation based epistemic uncertainty estimation in 3d object detection. In: Conference on robot learning, PMLR, pp 1125\u20131135"},{"key":"10562_CR365","unstructured":"Zadrozny B, Elkan C (2001) Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers. In: International conference on machine learning, PMLR, pp 609\u2013616"},{"key":"10562_CR366","unstructured":"Zeng J, Lesnikowski A, Alvarez JM (2018) The relevance of Bayesian layer positioning to model uncertainty in deep Bayesian active learning. arXiv preprint arXiv:1811.12535"},{"key":"10562_CR370","unstructured":"Zhang Y, Sutton C (2011) Quasi-Newton methods for Markov chain Monte Carlo. In: Advances in neural information processing systems 24"},{"key":"10562_CR367","unstructured":"Zhang G, Sun S, Duvenaud D, Grosse R (2018a) Noisy natural gradient as variational inference. In: International conference on machine learning, PMLR, pp 5852\u20135861"},{"key":"10562_CR368","doi-asserted-by":"crossref","unstructured":"Zhang H, Cisse M, Dauphin YN, Lopez-Paz D (2018b) Mixup: beyond empirical risk minimization. In: International conference on learning representations","DOI":"10.1007\/978-1-4899-7687-1_79"},{"key":"10562_CR371","unstructured":"Zhang Z, Dalca AV, Sabuncu MR (2019) Confidence calibration for convolutional neural networks using structured dropout. arXiv preprint arXiv:1906.09551"},{"key":"10562_CR369","unstructured":"Zhang J, Kailkhura B, Han TYJ (2020) Mix-n-match: ensemble and compositional methods for uncertainty calibration in deep learning. In: International conference on machine learning, PMLR, pp 11,117\u201311,128"},{"key":"10562_CR373","unstructured":"Zhao X, Ou Y, Kaplan L, Chen F, Cho JH (2019) Quantifying classification uncertainty using regularized evidential neural networks. arXiv preprint arXiv:1910.06864"},{"key":"10562_CR372","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1016\/j.neucom.2020.06.060","volume":"412","author":"J Zhao","year":"2020","unstructured":"Zhao J, Liu X, He S, Sun S (2020) Probabilistic inference of Bayesian neural networks with generalized expectation propagation. Neurocomputing 412:392\u2013398","journal-title":"Neurocomputing"},{"issue":"4","key":"10562_CR374","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MGRS.2017.2762307","volume":"5","author":"XX Zhu","year":"2017","unstructured":"Zhu XX, Tuia D, Mou L, Xia GS, Zhang L, Xu F, Fraundorfer F (2017) Deep learning in remote sensing: a comprehensive review and list of resources. IEEE Geosci Remote Sens Mag 5(4):8\u201336","journal-title":"IEEE Geosci Remote Sens Mag"},{"key":"10562_CR375","unstructured":"Zou D, Xu P, Gu Q (2018) Stochastic variance-reduced Hamilton Monte Carlo methods. In: International conference on machine learning, PMLR, pp 6028\u20136037"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-023-10562-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-023-10562-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-023-10562-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T08:42:43Z","timestamp":1729845763000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-023-10562-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,29]]},"references-count":375,"journal-issue":{"issue":"S1","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["10562"],"URL":"https:\/\/doi.org\/10.1007\/s10462-023-10562-9","relation":{},"ISSN":["0269-2821","1573-7462"],"issn-type":[{"value":"0269-2821","type":"print"},{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,29]]},"assertion":[{"value":"29 July 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}