{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T17:40:41Z","timestamp":1792604441948,"version":"4.5.0"},"reference-count":53,"publisher":"IOP Publishing","issue":"3","license":[{"start":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T00:00:00Z","timestamp":1626134400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T00:00:00Z","timestamp":1626134400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2021,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Uncertainty quantification by ensemble learning is explored in terms of an application known from the field of computational optical form measurements. The application requires solving a large-scale, nonlinear inverse problem. Ensemble learning is used to extend the scope of a recently developed deep learning approach for this problem in order to provide an uncertainty quantification of the solution to the inverse problem predicted by the deep learning method. By systematically inserting out-of-distribution errors as well as noisy data, the reliability of the developed uncertainty quantification is explored. Results are encouraging and the proposed application exemplifies the ability of ensemble methods to make trustworthy predictions on the basis of high-dimensional data in a real-world context.<\/jats:p>","DOI":"10.1088\/2632-2153\/ac0495","type":"journal-article","created":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T18:45:18Z","timestamp":1621881918000},"page":"035030","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["Uncertainty quantification by ensemble learning for computational optical form measurements"],"prefix":"10.1088","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6211-413X","authenticated-orcid":false,"given":"Lara","family":"Hoffmann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ines","family":"Fortmeier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Clemens","family":"Elster","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2021,7,13]]},"reference":[{"key":"mlstac0495bib1","doi-asserted-by":"publisher","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","article-title":"Peeking inside the black-box: a survey on explainable artificial intelligence (XAI)","volume":"6","author":"Adadi","year":"2018","journal-title":"IEEE Access"},{"key":"mlstac0495bib2","doi-asserted-by":"publisher","first-page":"14410","DOI":"10.1109\/ACCESS.2018.2807385","article-title":"Threat of adversarial attacks on deep learning in computer vision: a survey","volume":"6","author":"Akhtar","year":"2018","journal-title":"IEEE Access"},{"key":"mlstac0495bib3","article-title":"Pitfalls of in-domain uncertainty estimation and ensembling in deep learning","author":"Ashukha","year":"2020"},{"key":"mlstac0495bib4","doi-asserted-by":"publisher","first-page":"31200","DOI":"10.1364\/OE.22.031200","article-title":"Calibration of a non-null test interferometer for the measurement of aspheres and free-form surfaces","volume":"22","author":"Baer","year":"2014","journal-title":"Opt. Express"},{"key":"mlstac0495bib5","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1080\/15599612.2014.942925","article-title":"Fast and flexible non-null testing of aspheres and free-form surfaces with the tilted-wave-interferometer","volume":"8","author":"Baer","year":"2014","journal-title":"Int. J. Optomechatronics"},{"key":"mlstac0495bib6","volume":"vol 86","author":"Baer","year":"2017"},{"key":"mlstac0495bib7","first-page":"pp 2814","article-title":"Understanding dropout","volume":"vol 26","author":"Baldi","year":"2013"},{"key":"mlstac0495bib8","doi-asserted-by":"publisher","first-page":"921","DOI":"10.1364\/OPTICA.6.000921","article-title":"On the use of deep learning for computational imaging","volume":"6","author":"Barbastathis","year":"2019","journal-title":"Optica"},{"key":"mlstac0495bib9","volume":"vol 173","author":"Braunecker","year":"2008"},{"key":"mlstac0495bib10","doi-asserted-by":"crossref","DOI":"10.2172\/1623354","article-title":"Deeply uncertain: comparing methods of uncertainty quantification in deep learning algorithms","author":"Caldeira","year":"2020"},{"key":"mlstac0495bib11","doi-asserted-by":"publisher","first-page":"34835","DOI":"10.1364\/OE.412009","article-title":"Calibration-free quantitative phase imaging using data-driven aberration modeling","volume":"28","author":"Chang","year":"2020","journal-title":"Opt. Express"},{"key":"mlstac0495bib12","first-page":"pp 1","article-title":"Ensemble methods in machine learning","author":"Dietterich","year":"2000"},{"key":"mlstac0495bib13","first-page":"pp 8857","article-title":"A variational u-net for conditional appearance and shape generation","author":"Esser","year":"2018"},{"key":"mlstac0495bib14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41476-019-0124-1","article-title":"Round robin comparison study on the form measurement of optical freeform surfaces","volume":"16","author":"Fortmeier","year":"2020","journal-title":"J. Eur. Opt. Soc."},{"key":"mlstac0495bib15","first-page":"pp 790","article-title":"Steps towards traceability for an asphere interferometer","volume":"vol 10329","author":"Fortmeier","year":"2017"},{"key":"mlstac0495bib16","article-title":"Sensitivity analysis of tilted-wave interferometer asphere measurements using virtual experiments","volume":"vol 8789","author":"Fortmeier","year":"2013"},{"key":"mlstac0495bib17","doi-asserted-by":"publisher","first-page":"21313","DOI":"10.1364\/OE.22.021313","article-title":"Analytical Jacobian and its application to tilted-wave interferometry","volume":"22","author":"Fortmeier","year":"2014","journal-title":"Opt. Express"},{"key":"mlstac0495bib18","first-page":"pp 3581","article-title":"Concrete dropout","volume":"vol 30","author":"Gal","year":"2017"},{"key":"mlstac0495bib19","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1029\/RS023i004p00713","article-title":"Satellite radar interferometry: two-dimensional phase unwrapping","volume":"23","author":"Goldstein","year":"1988","journal-title":"Radio Sci."},{"key":"mlstac0495bib20","first-page":"pp 318","article-title":"Evaluating scalable Bayesian deep learning methods for robust computer vision","author":"Gustafsson","year":"2020"},{"key":"mlstac0495bib21","doi-asserted-by":"publisher","first-page":"993","DOI":"10.1109\/34.58871","article-title":"Neural network ensembles","volume":"12","author":"Hansen","year":"1990","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"mlstac0495bib22","doi-asserted-by":"publisher","first-page":"301","DOI":"10.5194\/jsss-9-301-2020","article-title":"Deep neural networks for computational optical form measurements","volume":"9","author":"Hoffmann","year":"2020","journal-title":"J. Sens. Sens. Syst."},{"key":"mlstac0495bib23","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s10994-021-05946-3","article-title":"Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods","volume":"110","author":"H\u00fcllermeier","year":"2021","journal-title":"Mach. Learn."},{"key":"mlstac0495bib24","doi-asserted-by":"publisher","first-page":"5422","DOI":"10.1364\/AO.58.005422","article-title":"Deep iterative reconstruction for phase retrieval","volume":"58","author":"I\u015f\u0131l","year":"2019","journal-title":"Appl. Opt."},{"key":"mlstac0495bib25","first-page":"pp 5574","article-title":"What uncertainties do we need in Bayesian deep learning for computer vision?","volume":"vol 30","author":"Kendall","year":"2017"},{"key":"mlstac0495bib26","article-title":"Adam: a method for stochastic optimization","author":"Kingma","year":"2014"},{"key":"mlstac0495bib27","first-page":"pp 2575","article-title":"Variational dropout and the local reparameterization trick","volume":"vol 28","author":"Kingma","year":"2015"},{"key":"mlstac0495bib28","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1115\/1.3242449","article-title":"The purposes of uncertainty analysis","volume":"107","author":"Kline","year":"1985","journal-title":"J. Fluids Eng."},{"key":"mlstac0495bib29","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1007\/BF00200801","article-title":"Bayesian neural networks","volume":"61","author":"Kononenko","year":"1989","journal-title":"Biol. Cybern."},{"key":"mlstac0495bib30","first-page":"pp 6402","article-title":"Simple and scalable predictive uncertainty estimation using deep ensembles","volume":"vol 30","author":"Lakshminarayanan","year":"2017"},{"key":"mlstac0495bib31","doi-asserted-by":"publisher","first-page":"1096","DOI":"10.1038\/s41467-019-08987-4","article-title":"Unmasking clever Hans predictors and assessing what machines really learn","volume":"10","author":"Lapuschkin","year":"2019","journal-title":"Nat. Commun."},{"key":"mlstac0495bib32","volume":"vol 3361","author":"LeCun","year":"1995"},{"key":"mlstac0495bib33","article-title":"Why M heads are better than one: training a diverse ensemble of deep networks","author":"Lee","year":"2015"},{"key":"mlstac0495bib34","article-title":"Fourier neural operator for parametric partial differential equations","author":"Li","year":"2020"},{"key":"mlstac0495bib35","first-page":"pp 1","author":"Martin","year":"2020"},{"key":"mlstac0495bib36","article-title":"Rectified linear units improve restricted Boltzmann machines","author":"Nair","year":"2010"},{"key":"mlstac0495bib37","article-title":"Highway investigation","author":"","year":"2019"},{"key":"mlstac0495bib38","first-page":"pp 13991","article-title":"Can you trust your model\u2019s uncertainty? Evaluating predictive uncertainty under dataset shift","volume":"vol 32","author":"Ovadia","year":"2019"},{"key":"mlstac0495bib39","first-page":"pp 25","author":"Qin","year":"2020"},{"key":"mlstac0495bib40","first-page":"pp 234","article-title":"U-net: convolutional networks for biomedical image segmentation","author":"Ronneberger","year":"2015"},{"key":"mlstac0495bib41","doi-asserted-by":"publisher","first-page":"2697","DOI":"10.1021\/acs.jcim.9b00975","article-title":"Evaluating scalable uncertainty estimation methods for deep learning-based molecular property prediction","volume":"60","author":"Scalia","year":"2020","journal-title":"J. Chem. Inf. Model."},{"key":"mlstac0495bib42","doi-asserted-by":"publisher","first-page":"105","DOI":"10.5194\/jsss-8-105-2019","article-title":"SimOptDevice: a library for virtual optical experiments","volume":"8","author":"Schachtschneider","year":"2019","journal-title":"J. Sens. Sens. Syst."},{"key":"mlstac0495bib43","volume":"vol 105","author":"Schindler","year":"2020"},{"key":"mlstac0495bib44","doi-asserted-by":"publisher","DOI":"10.1117\/1.OE.58.7.074105","article-title":"Simultaneous removal of nonrotationally symmetric errors in tilted wave interferometry","volume":"58","author":"Schindler","year":"2019","journal-title":"Opt. Eng., Bellingham"},{"key":"mlstac0495bib45","first-page":"pp 618","article-title":"Grad-CAM: visual explanations from deep networks via gradient-based localization","author":"Selvaraju","year":"2017"},{"key":"mlstac0495bib46","first-page":"pp 109","article-title":"Concolic testing for deep neural networks","author":"Sun","year":"2018"},{"key":"mlstac0495bib47","first-page":"pp 303","article-title":"DeepTest: automated testing of deep-neural-network-driven autonomous cars","author":"Tian","year":"2018"},{"key":"mlstac0495bib48","doi-asserted-by":"publisher","first-page":"1510","DOI":"10.1364\/AO.19.001510","article-title":"Wave-front interpretation with Zernike polynomials","volume":"19","author":"Wang","year":"1980","journal-title":"Appl. Opt."},{"key":"mlstac0495bib49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TKDE.2020.3025580","article-title":"Deep learning for spatio-temporal data mining: a survey","author":"Wang","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"mlstac0495bib50","article-title":"How neural networks extrapolate: from feedforward to graph neural networks","author":"Xu","year":"2020"},{"key":"mlstac0495bib51","article-title":"Quality of uncertainty quantification for Bayesian neural network inference","author":"Yao","year":"2019"},{"key":"mlstac0495bib52","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1109\/MCI.2018.2840738","article-title":"Recent trends in deep learning based natural language processing","volume":"13","author":"Young","year":"2018","journal-title":"IEEE Comput. Intell. Mag."},{"key":"mlstac0495bib53","doi-asserted-by":"publisher","first-page":"33709","DOI":"10.1364\/OE.27.033709","article-title":"Deep neural network based calibration for freeform surface misalignments in general interferometer","volume":"27","author":"Zhang","year":"2019","journal-title":"Opt. Express"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T08:48:29Z","timestamp":1639385309000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac0495"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,13]]},"references-count":53,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,7,13]]},"published-print":{"date-parts":[[2021,9,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/ac0495","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,13]]},"assertion":[{"value":"Uncertainty quantification by ensemble learning for computational optical form measurements","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2021 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2021-02-05","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2021-05-24","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2021-07-13","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}