{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T16:14:15Z","timestamp":1776442455140,"version":"3.51.2"},"reference-count":77,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T00:00:00Z","timestamp":1638230400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation program, project AI4EU","award":["825619"],"award-info":[{"award-number":["825619"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. However, despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to trust the forecasts. Recently, several practical tools to estimate uncertainty have been developed in probabilistic deep learning. However, there have not been empirical applications and extensive comparisons of these tools in the domain of air quality forecasts. Therefore, this work applies state-of-the-art techniques of uncertainty quantification in a real-world setting of air quality forecasts. Through extensive experiments, we describe training probabilistic models and evaluate their predictive uncertainties based on empirical performance, reliability of confidence estimate, and practical applicability. We also propose improving these models using \u201cfree\u201d adversarial training and exploiting temporal and spatial correlation inherent in air quality data. Our experiments demonstrate that the proposed models perform better than previous works in quantifying uncertainty in data-driven air quality forecasts. Overall, Bayesian neural networks provide a more reliable uncertainty estimate but can be challenging to implement and scale. Other scalable methods, such as deep ensemble, Monte Carlo (MC) dropout, and stochastic weight averaging-Gaussian (SWAG), can perform well if applied correctly but with different tradeoffs and slight variations in performance metrics. Finally, our results show the practical impact of uncertainty estimation and demonstrate that, indeed, probabilistic models are more suitable for making informed decisions.<\/jats:p>","DOI":"10.3390\/s21238009","type":"journal-article","created":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T01:45:02Z","timestamp":1638323102000},"page":"8009","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Probabilistic Deep Learning to Quantify Uncertainty in Air Quality Forecasting"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0774-0741","authenticated-orcid":false,"given":"Abdulmajid","family":"Murad","sequence":"first","affiliation":[{"name":"Department of Information Security and Communication Technology, Norwegian University of Science and Technology, 7491 Trondheim, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8657-5379","authenticated-orcid":false,"given":"Frank Alexander","family":"Kraemer","sequence":"additional","affiliation":[{"name":"Department of Information Security and Communication Technology, Norwegian University of Science and Technology, 7491 Trondheim, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6167-3079","authenticated-orcid":false,"given":"Kerstin","family":"Bach","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Norwegian University of Science and Technology, 7491 Trondheim, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3455-9430","authenticated-orcid":false,"given":"Gavin","family":"Taylor","sequence":"additional","affiliation":[{"name":"Department of Computer Science, United States Naval Academy, Annapolis, MD 21402, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1038\/nature14541","article-title":"Probabilistic machine learning and artificial intelligence","volume":"521","author":"Ghahramani","year":"2015","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1162\/neco.1992.4.3.448","article-title":"A practical bayesian framework for backpropagation networks","volume":"4","author":"MacKay","year":"1992","journal-title":"Neural Comput."},{"key":"ref_3","unstructured":"Blundell, C., Cornebise, J., Kavukcuoglu, K., and Wierstra, D. (2015, January 7\u20139). Weight uncertainty in neural network. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_4","unstructured":"Gal, Y., and Ghahramani, Z. (2016, January 19\u201324). Dropout as a bayesian approximation: Representing model uncertainty in deep learning. Proceedings of the International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_5","unstructured":"Lakshminarayanan, B., Pritzel, A., and Blundell, C. (2017, January 4\u20139). Simple and scalable predictive uncertainty estimation using deep ensembles. Proceedings of the International Conference on Neural Information Processing Systems, California, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhu, L., and Laptev, N. (2017, January 18\u201321). Deep and Confident Prediction for Time Series at Uber. Proceedings of 2017 IEEE International Conference on Data Mining Workshops (ICDMW), New Orleans, LA, USA.","DOI":"10.1109\/ICDMW.2017.19"},{"key":"ref_7","unstructured":"Maddox, W.J., Izmailov, P., Garipov, T., Vetrov, D.P., and Wilson, A.G. (2019, January 8\u201314). A simple baseline for bayesian uncertainty in deep learning. Proceedings of the International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_8","unstructured":"Kendall, A., Gal, Y., and Cipolla, R. (2018, January 18\u201323). Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. Proceeding of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Utah, UT, USA."},{"key":"ref_9","unstructured":"Kendall, A., and Gal, Y. (2017, January 4\u20139). What uncertainties do we need in Bayesian deep learning for computer vision?. Proceedings of the International Conference on Neural Information Processing Systems, California, CA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1109\/TNNLS.2015.2499302","article-title":"Bayesian recurrent neural network for language modeling","volume":"27","author":"Chien","year":"2016","journal-title":"IEEE Trans. Neural Networks Learn. Syst."},{"key":"ref_11","unstructured":"Xiao, Y., and Wang, W.Y. (February, January 27). Quantifying uncertainties in natural language processing tasks. Proceedings of the AAAI Conference on Artificial Intelligence, Hawaii, HI, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ott, M., Auli, M., Grangier, D., and Ranzato, M. (2018, January 10\u201315). Analyzing uncertainty in neural machine translation. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden.","DOI":"10.18653\/v1\/W18-6301"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Meyer, G.P., and Thakurdesai, N. (2020, January 25\u201329). Learning an uncertainty-aware object detector for autonomous driving. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341623"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2777","DOI":"10.5194\/gmd-8-2777-2015","article-title":"A regional air quality forecasting system over Europe: The MACC-II daily ensemble production","volume":"8","author":"Peuch","year":"2015","journal-title":"Geosci. Model Dev."},{"key":"ref_15","unstructured":"Walker, S.E., Hermansen, G.H., and Hjort, N.L. (2015, January 26\u201331). Model selection and verification for ensemble based probabilistic forecasting of air pollution in Oslo, Norway. Proceedings of the 60th ISI World Statistics Congress (WSC), Rio de Janeiro, Brazil."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Garaud, D., and Mallet, V. (2011). Automatic calibration of an ensemble for uncertainty estimation and probabilistic forecast: Application to air quality. J. Geophys. Res. Atmos., 116.","DOI":"10.1029\/2011JD015780"},{"key":"ref_17","unstructured":"(2021, November 27). Air Quality Forecasting Service in Norway. Available online: https:\/\/luftkvalitet.miljodirektoratet.no\/kart\/59\/10\/5\/aqi."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"6303","DOI":"10.5194\/gmd-13-6303-2020","article-title":"Description of the uEMEP_v5 downscaling approach for the EMEP MSC-W chemistry transport model","volume":"13","author":"Denby","year":"2020","journal-title":"Geosci. Model Dev."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mu, Q., Denby, B.R., W\u00e6rsted, E.G., and Fagerli, H. (2021). Downscaling of air pollutants in Europe using uEMEP_v6. Geosci. Model Dev. Discuss., 1\u201324.","DOI":"10.5194\/gmd-2021-198"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.atmosenv.2016.03.035","article-title":"Modelling road dust emission abatement measures using the NORTRIP model: Vehicle speed and studded tyre reduction","volume":"134","author":"Norman","year":"2016","journal-title":"Atmos. Environ."},{"key":"ref_21","unstructured":"Denby, B.R., Klein, H., Wind, P., Gauss, M., Pommier, M., Fagerli, H., and Valdebenito, A. (2021, November 27). The Norwegian Air Quality Service: Model Forecasting. Available online: https:\/\/wiki.met.no\/_media\/airquip\/workshopno\/denby_17sep2018.pdf."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"7825","DOI":"10.5194\/acp-12-7825-2012","article-title":"The EMEP MSC-W chemical transport model\u2013technical description","volume":"12","author":"Simpson","year":"2012","journal-title":"Atmos. Chem. Phys."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lepper\u00f8d, A., Nguyen, H.T., Akselsen, S., Wienhofen, L., \u00d8zturk, P., and Zhang, W. (2019). Air Quality Monitor and Forecast in Norway Using NB-IoT and Machine Learning. Int. Summit Smart City 360\u00b0., Springer.","DOI":"10.1007\/978-3-030-51005-3_7"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Veiga, T., Munch-Ellingsen, A., Papastergiopoulos, C., Tzovaras, D., Kalamaras, I., Bach, K., Votis, K., and Akselsen, S. (2021). From a Low-Cost Air Quality Sensor Network to Decision Support Services: Steps towards Data Calibration and Service Development. Sensors, 21.","DOI":"10.3390\/s21093190"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.jclepro.2018.10.243","article-title":"Explore a deep learning multi-output neural network for regional multi-step-ahead air quality forecasts","volume":"209","author":"Zhou","year":"2019","journal-title":"J. Clean. Prod."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"14765","DOI":"10.1109\/ACCESS.2021.3052429","article-title":"Uncertainty-Aware Deep Learning Architectures for Highly Dynamic Air Quality Prediction","volume":"9","author":"Mokhtari","year":"2021","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"76690","DOI":"10.1109\/ACCESS.2019.2921578","article-title":"Air pollution forecasting using a deep learning model based on 1D convnets and bidirectional GRU","volume":"7","author":"Tao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1007\/s10115-018-1177-y","article-title":"A Bayesian approach to forecasting daily air-pollutant levels","volume":"57","author":"Pucer","year":"2018","journal-title":"Knowl. Inf. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.envpol.2017.05.079","article-title":"Probabilistic forecasting for extreme NO2 pollution episodes","volume":"229","author":"Aznarte","year":"2017","journal-title":"Environ. Pollut."},{"key":"ref_30","unstructured":"Graves, A. (2011, January 12\u201315). Practical variational inference for neural networks. Proceedings of the International Conference on Neural Information Processing Systems, Granada, Spain."},{"key":"ref_31","unstructured":"Louizos, C., and Welling, M. (2017, January 6\u201311). Multiplicative normalizing flows for variational bayesian neural networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_32","unstructured":"Neal, R.M. (2012). Bayesian learning for Neural Networks, Springer Science & Business Media."},{"key":"ref_33","unstructured":"Welling, M., and Teh, Y.W. (July, January 28). Bayesian learning via stochastic gradient Langevin dynamics. Proceedings of the International Conference on Machine Learning, Washington, WA, USA."},{"key":"ref_34","unstructured":"Chen, T., Fox, E., and Guestrin, C. (2014, January 21\u201326). Stochastic gradient hamiltonian monte carlo. Proceedings of the International Conference on Machine Learning, Beijing, China."},{"key":"ref_35","unstructured":"Ritter, H., Botev, A., and Barber, D. (May, January 30). A scalable laplace approximation for neural networks. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_36","unstructured":"Elshout, S.v.d., and L\u00e9ger, K. (2021, November 27). CAQI Air quality index\u2014Comparing Urban Air Quality across Borders-2012. Technical Report, EUROPEAN UNION European Regional Development Fund Regional Initiative Project. Available online: https:\/\/www.airqualitynow.eu\/download\/CITEAIR-Comparing_Urban_Air_Quality_across_Borders.pdf."},{"key":"ref_37","unstructured":"(2021, November 27). Open Database of Air Quality Measurements by the Norwegian Institute for Air Research (NILU). Available online: https:\/\/www.nilu.com\/open-data\/."},{"key":"ref_38","unstructured":"(2021, November 27). The Meteorological Data by the Norwegian Meteorological Institute. Available online: https:\/\/frost.met.no."},{"key":"ref_39","unstructured":"(2021, November 27). Traffic Data by the Norwegian Public Roads Administration. Available online: https:\/\/www.vegvesen.no\/trafikkdata\/start\/om-api."},{"key":"ref_40","first-page":"128","article-title":"Practical confidence and prediction intervals for prediction tasks","volume":"8","author":"Heskes","year":"1997","journal-title":"Prog. Neural Process."},{"key":"ref_41","unstructured":"Dar, Y., Muthukumar, V., and Baraniuk, R.G. (2021). A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A scalable tree boosting system. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, California, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1198\/016214506000001437","article-title":"Strictly proper scoring rules, prediction, and estimation","volume":"102","author":"Gneiting","year":"2007","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2","article-title":"Verification of forecasts expressed in terms of probability","volume":"78","author":"Brier","year":"1950","journal-title":"Mon. Weather. Rev."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.ipm.2009.03.002","article-title":"A systematic analysis of performance measures for classification tasks","volume":"45","author":"Sokolova","year":"2009","journal-title":"Inf. Process. Manag."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1257\/jep.15.4.143","article-title":"Quantile regression","volume":"15","author":"Koenker","year":"2001","journal-title":"J. Econ. Perspect."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: A gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann. Stat."},{"key":"ref_48","unstructured":"Nix, D.A., and Weigend, A.S. (July, January 28). Estimating the mean and variance of the target probability distribution. Proceedings of the IEEE International Conference on Neural Networks, Florida, FL, USA."},{"key":"ref_49","first-page":"1303","article-title":"Stochastic variational inference","volume":"14","author":"Hoffman","year":"2013","journal-title":"J. Mach. Learn. Res."},{"key":"ref_50","unstructured":"Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv."},{"key":"ref_51","unstructured":"Kingma, D.P., Salimans, T., and Welling, M. (2015, January 7\u201312). Variational dropout and the local reparameterization trick. Proceedings of the International Conference on Neural Information Processing Systems, Montreal, Canada."},{"key":"ref_52","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Dietterich, T.G. (2000, January 21\u201323). Ensemble methods in machine learning. Proceedings of the International Workshop on Multiple Classifier Systems, Cagliari, Italy.","DOI":"10.1007\/3-540-45014-9_1"},{"key":"ref_54","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2014, January 8\u201313). Distilling the knowledge in a neural network. Proceedings of The International Conference on Neural Information Processing Systems (Deep Learning and Representation Learning Workshop), Montreal. Canada."},{"key":"ref_55","unstructured":"Jozefowicz, R., Vinyals, O., Schuster, M., Shazeer, N., and Wu, Y. (2016). Exploring the limits of language modeling. arXiv."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1007\/s10707-019-00355-0","article-title":"A hybrid CNN-LSTM model for typhoon formation forecasting","volume":"23","author":"Chen","year":"2019","journal-title":"Geoinformatica"},{"key":"ref_57","unstructured":"Li, Y., Yu, R., Shahabi, C., and Liu, Y. (May, January 30). Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Murad, A., and Pyun, J.Y. (2017). Deep recurrent neural networks for human activity recognition. Sensors, 17.","DOI":"10.3390\/s17112556"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"109864","DOI":"10.1016\/j.chaos.2020.109864","article-title":"Time series forecasting of COVID-19 transmission in Canada using LSTM networks","volume":"135","author":"Chimmula","year":"2020","journal-title":"Chaos Solitons Fractals"},{"key":"ref_60","unstructured":"Sak, H., Senior, A.W., and Beaufays, F. (2021, November 27). Long Short-Term Memory Recurrent Neural Network Architectures for Large Scale Acoustic Modeling: Research.Google. Available online: https:\/\/storage.googleapis.com\/pub-tools-public-publication-data\/pdf\/43905.pdf."},{"key":"ref_61","unstructured":"Gal, Y., and Ghahramani, Z. (2016, January 5\u201310). A theoretically grounded application of dropout in recurrent neural networks. Proceedings of the International Conference on Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_62","unstructured":"Cao, D., Wang, Y., Duan, J., Zhang, C., Zhu, X., Huang, C., Tong, Y., Xu, B., Bai, J., and Tong, J. (2020, January 6\u201312). Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting. Proceedings of the International Conference on Neural Information Processing Systems, British Columbia, Canada."},{"key":"ref_63","unstructured":"Dauphin, Y.N., Fan, A., Auli, M., and Grangier, D. (2017, January 6\u201311). Language modeling with gated convolutional networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_64","unstructured":"Kipf, T.N., and Welling, M. (2017, January 6\u201311). Semi-supervised classification with graph convolutional networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_65","unstructured":"Hasanzadeh, A., Hajiramezanali, E., Boluki, S., Zhou, M., Duffield, N., Narayanan, K., and Qian, X. (2020, January 12\u201318). Bayesian graph neural networks with adaptive connection sampling. Proceedings of International Conference on Machine Learning, Virtual, Vienna, Austria."},{"key":"ref_66","unstructured":"Izmailov, P., Podoprikhin, D., Garipov, T., Vetrov, D., and Wilson, A.G. (2018, January 6\u201310). Averaging weights leads to wider optima and better generalization. Proceedings of the Conference on Uncertainty in Artificial Intelligence, California, CA, USA."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_68","unstructured":"Muller, R., Kornblith, S., and Hinton, G.E. (2019, January 8\u201314). When does label smoothing help?. Proceedings of the International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1979","DOI":"10.1109\/TPAMI.2018.2858821","article-title":"Virtual adversarial training: A regularization method for supervised and semi-supervised learning","volume":"41","author":"Miyato","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_70","unstructured":"Goodfellow, I.J., Shlens, J., and Szegedy, C. (2015, January 7\u20139). Explaining and harnessing adversarial examples. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_71","unstructured":"Qin, Y., Wang, X., Beutel, A., and Chi, E.H. (2020). Improving uncertainty estimates through the relationship with adversarial robustness. arXiv, Available online:https:\/\/arxiv.org\/abs\/2006.16375."},{"key":"ref_72","unstructured":"Shafahi, A., Najibi, M., Ghiasi, A., Xu, Z., Dickerson, J., Studer, C., Davis, L.S., Taylor, G., and Goldstein, T. (2019, January 8\u201314). Adversarial training for free!. Proceedings of the International Conference on Neural Information Processing Systems, Vancouver, Canada."},{"key":"ref_73","unstructured":"Zhang, H., Yu, Y., Jiao, J., Xing, E., El Ghaoui, L., and Jordan, M. (2019, January 9\u201315). Theoretically principled trade-off between robustness and accuracy. Proceedings of the International Conference on Machine Learning, California, CA, USA."},{"key":"ref_74","unstructured":"Williams, C.K. (1996, January 3\u20135). Computing with infinite networks. Proceedings of the International Conference on Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Gustafsson, F.K., Danelljan, M., and Schon, T.B. (2020, January 14\u201319). Evaluating scalable bayesian deep learning methods for robust computer vision. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00167"},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"2697","DOI":"10.1021\/acs.jcim.9b00975","article-title":"Evaluating scalable uncertainty estimation methods for deep learning-based molecular property prediction","volume":"60","author":"Scalia","year":"2020","journal-title":"J. Chem. Inf. Model."},{"key":"ref_77","unstructured":"Gardner, J.R., Pleiss, G., Bindel, D., Weinberger, K.Q., and Wilson, A.G. (2018, January 2\u20138). Gpytorch: Blackbox matrix-matrix Gaussian process inference with GPU acceleration. Proceedings of the International Conference on Neural Information Processing Systems, Montreal, Canada."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/8009\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:38:04Z","timestamp":1760168284000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/8009"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,30]]},"references-count":77,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21238009"],"URL":"https:\/\/doi.org\/10.3390\/s21238009","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,30]]}}}