{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T04:09:58Z","timestamp":1777003798907,"version":"3.51.4"},"reference-count":50,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T00:00:00Z","timestamp":1630627200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003407","name":"Ministero dell\u2019Istruzione, dell\u2019Universit\u00e0 e della Ricerca","doi-asserted-by":"publisher","award":["\u201cDepartments of Excellence\u201d (Law 232\/2016)"],"award-info":[{"award-number":["\u201cDepartments of Excellence\u201d (Law 232\/2016)"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>In oil and gas production, it is essential to monitor some performance indicators that are related to the composition of the extracted mixture, such as the liquid and gas content of the flow. These indicators cannot be directly measured and must be inferred with other measurements by using soft sensor approaches that model the target quantity. For the purpose of production monitoring, point estimation alone is not enough, and a confidence interval is required in order to assess the uncertainty in the provided measure. Decisions based on these estimations can have a large impact on production costs; therefore, providing a quantification of uncertainty can help operators make the most correct choices. This paper focuses on the estimation of the performance indicator called the water-in-liquid ratio by using data-driven tools: firstly, anomaly detection techniques are employed to find data that can alter the performance of the subsequent model; then, different machine learning models, such as Gaussian processes, random forests, linear local forests, and neural networks, are tested and employed to perform uncertainty-aware predictions on data coming from an industrial tool, the multiphase flow meter, which collects multiple signals from the flow mixture. The reported results show the differences between the discussed approaches and the advantages of the uncertainty estimation; in particular, they show that methods such as the Gaussian process and linear local forest are capable of reaching competitive performance in terms of both RMSE (1.9\u20132.1) and estimated uncertainty (1.6\u20132.6).<\/jats:p>","DOI":"10.3390\/informatics8030058","type":"journal-article","created":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T23:55:22Z","timestamp":1630972522000},"page":"58","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Uncertainty Estimation for Machine Learning Models in Multiphase Flow Applications"],"prefix":"10.3390","volume":"8","author":[{"given":"Luca","family":"Frau","sequence":"first","affiliation":[{"name":"Department of Information Engineering, University of Padova, 35131 Padova, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5739-9639","authenticated-orcid":false,"given":"Gian Antonio","family":"Susto","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Padova, 35131 Padova, Italy"},{"name":"Human Inspired Technology Research Centre, University of Padova, 35131 Padova, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8945-9058","authenticated-orcid":false,"given":"Tommaso","family":"Barbariol","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Padova, 35131 Padova, Italy"}]},{"given":"Enrico","family":"Feltresi","sequence":"additional","affiliation":[{"name":"Pietro Fiorentini S.p.A., 36057 Arcugnano, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,3]]},"reference":[{"key":"ref_1","unstructured":"(2021, September 01). Market Report: Oil 2021. Available online: https:\/\/www.iea.org\/reports\/oil-2021."},{"key":"ref_2","first-page":"1","article-title":"Quantification of tolerance limits of engineering system using uncertainty modeling for sustainable energy","volume":"1","author":"Datta","year":"2020","journal-title":"Int. J. Intell. Netw."},{"key":"ref_3","first-page":"49","article-title":"Confidence Interval for Solutions of the Black-Scholes Model","volume":"4","author":"Paziresh","year":"2019","journal-title":"Adv. Math. Financ. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1177\/0962280209358135","article-title":"Asymptotic confidence interval construction for proportion difference in medical studies with bilateral data","volume":"20","author":"Tang","year":"2011","journal-title":"Stat. Methods Med. Res."},{"key":"ref_5","unstructured":"Council, N.R. (2012). Assessing the Reliability of Complex Models: Mathematical and Statistical Foundations of Verification, Validation, and Uncertainty Quantification, The National Academies Press."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hansen, L.S., Pedersen, S., and Durdevic, P. (2019). Multi-phase flow metering in offshore oil and gas transportation pipelines: Trends and perspectives. Sensors, 19.","DOI":"10.3390\/s19092184"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"012003","DOI":"10.1088\/0957-0233\/24\/1\/012003","article-title":"Three-phase flow measurement in the petroleum industry","volume":"24","author":"Thorn","year":"2012","journal-title":"Meas. Sci. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"106487","DOI":"10.1016\/j.petrol.2019.106487","article-title":"First principles and machine learning virtual flow metering: A literature review","volume":"184","author":"Bikmukhametov","year":"2020","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sircar, A., Yadav, K., Rayavarapu, K., Bist, N., and Oza, H. (2021). Application of machine learning and artificial intelligence in oil and gas industry. Pet. Res.","DOI":"10.1016\/j.ptlrs.2021.05.009"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zambonin, G., Altinier, F., Beghi, A., Coelho, L.d.S., Fiorella, N., Girotto, T., Rampazzo, M., Reynoso-Meza, G., and Susto, G.A. (2019). Machine learning-based soft sensors for the estimation of laundry moisture content in household dryer appliances. Energies, 12.","DOI":"10.3390\/en12203843"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1021\/acs.jctc.8b00959","article-title":"Fast and accurate uncertainty estimation in chemical machine learning","volume":"15","author":"Musil","year":"2019","journal-title":"J. Chem. Theory Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"074102","DOI":"10.1063\/5.0036522","article-title":"Uncertainty estimation for molecular dynamics and sampling","volume":"154","author":"Imbalzano","year":"2021","journal-title":"J. Chem. Phys."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"014103","DOI":"10.1063\/5.0012405","article-title":"Role of uncertainty estimation in accelerating materials development via active learning","volume":"128","author":"Tian","year":"2020","journal-title":"J. Appl. Phys."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, Y., Gao, Z., He, Z., Zhuang, Y., Radi, A., Chen, R., and El-Sheimy, N. (2019). Wireless fingerprinting uncertainty prediction based on machine learning. Sensors, 19.","DOI":"10.3390\/s19020324"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ani, M., Oluyemi, G., Petrovski, A., and Rezaei-Gomari, S. (2016, January 6\u20138). Reservoir uncertainty analysis: The trends from probability to algorithms and machine learning. Proceedings of the SPE Intelligent Energy International Conference and Exhibition, OnePetro, Aberdeen, Scotland, UK.","DOI":"10.2118\/181049-MS"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Alizadehsani, R., Roshanzamir, M., Hussain, S., Khosravi, A., Koohestani, A., Zangooei, M.H., Abdar, M., Beykikhoshk, A., Shoeibi, A., and Zare, A. (2021). Handling of uncertainty in medical data using machine learning and probability theory techniques: A review of 30 years (1991\u20132020). Ann. Oper. Res., 1\u201342.","DOI":"10.1007\/s10479-021-04006-2"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.flowmeasinst.2018.02.017","article-title":"Application of soft computing techniques to multiphase flow measurement: A review","volume":"60","author":"Yan","year":"2018","journal-title":"Flow Meas. Instrum."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.powtec.2013.01.045","article-title":"Applying uncertainty quantification to multiphase flow computational fluid dynamics","volume":"242","author":"Gel","year":"2013","journal-title":"Powder Technol."},{"key":"ref_19","unstructured":"Hu, X. (2014). Uncertainty Quantification Tools for Multiphase Gas-Solid Flow Simulations Using MFIX. [Ph.D. Thesis, Iowa State University]."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"104530","DOI":"10.1016\/j.compfluid.2020.104530","article-title":"Evaluation of ensemble methods for quantifying uncertainties in steady-state CFD applications with small ensemble sizes","volume":"203","author":"Zhang","year":"2020","journal-title":"Comput. Fluids"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"107297","DOI":"10.1016\/j.petrol.2020.107297","article-title":"Uncertainty quantification and sensitivity analysis for relative permeability models of two-phase flow in porous media","volume":"192","author":"Valdez","year":"2020","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.flowmeasinst.2016.10.001","article-title":"Intelligent recognition of gas-oil-water three-phase flow regime and determination of volume fraction using radial basis function","volume":"54","author":"Roshani","year":"2017","journal-title":"Flow Meas. Instrum."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"AL-Qutami, T.A., Ibrahim, R., Ismail, I., and Ishak, M.A. (2017, January 24\u201326). Radial basis function network to predict gas flow rate in multiphase flow. Proceedings of the 9th International Conference on Machine Learning and Computing, Singapore.","DOI":"10.1145\/3055635.3056638"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/j.measurement.2019.03.054","article-title":"Measurement of water-to-liquid ratio of oil-water-gas three-phase flow using microwave time series method","volume":"140","author":"Zhao","year":"2019","journal-title":"Measurement"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.flowmeasinst.2019.01.018","article-title":"Estimation of flow rates of individual phases in an oil-gas-water multiphase flow system using neural network approach and pressure signal analysis","volume":"66","author":"Bahrami","year":"2019","journal-title":"Flow Meas. Instrum."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4017","DOI":"10.1007\/s11053-020-09675-7","article-title":"Application of artificial intelligence to estimate oil flow rate in gas-lift wells","volume":"29","author":"Khan","year":"2020","journal-title":"Nat. Resour. Res."},{"key":"ref_27","unstructured":"Dave, A.J., and Manera, A. (2020). Inference of Gas-liquid Flowrate using Neural Networks. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, H., Yang, Y., Yang, M., Min, L., Li, Y., and Zheng, X. (2020, January 15\u201317). A Novel CNN Modeling Algorithm for the Instantaneous Flow Rate Measurement of Gas-liquid Multiphase Flow. Proceedings of the 2020 12th International Conference on Machine Learning and Computing, Shenzhen, China.","DOI":"10.1145\/3383972.3384001"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1109\/TNNLS.2019.2905082","article-title":"Flow Adversarial Networks: Flowrate Prediction for Gas\u2013Liquid Multiphase Flows Across Different Domains","volume":"31","author":"Hu","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1109\/TIM.2013.2280485","article-title":"Two-phase air\u2013water slug flow measurement in horizontal pipe using conductance probes and neural network","volume":"63","author":"Fan","year":"2013","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.flowmeasinst.2005.02.017","article-title":"Tomography for multi-phase flow measurement in the oil industry","volume":"16","author":"Ismail","year":"2005","journal-title":"Flow Meas. Instrum."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.flowmeasinst.2015.12.004","article-title":"Measurement and analysis of water\/oil multiphase flow using Electrical Capacitance Tomography sensor","volume":"47","author":"Mohamad","year":"2016","journal-title":"Flow Meas. Instrum."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Aravantinos, V., and Schlicht, P. (2020, January 9\u201313). Making the relationship between uncertainty estimation and safety less uncertain. Proceedings of the IEEE 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE), Grenoble, France.","DOI":"10.23919\/DATE48585.2020.9116541"},{"key":"ref_34","unstructured":"Liu, J.Z., Paisley, J., Kioumourtzoglou, M.A., and Coull, B. (2019). Accurate uncertainty estimation and decomposition in ensemble learning. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.neunet.2006.01.012","article-title":"Machine learning approaches for estimation of prediction interval for the model output","volume":"19","author":"Shrestha","year":"2006","journal-title":"Neural Netw."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.inffus.2021.05.008","article-title":"A review of uncertainty quantification in deep learning: Techniques, applications and challenges","volume":"76","author":"Abdar","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.geoderma.2016.12.017","article-title":"Using quantile regression forest to estimate uncertainty of digital soil mapping products","volume":"291","author":"Vaysse","year":"2017","journal-title":"Geoderma"},{"key":"ref_38","unstructured":"Gal, Y., and Ghahramani, Z. (2016, January 19\u201324). Dropout as a bayesian approximation: Representing model uncertainty in deep learning. Proceedings of the International Conference on Machine Learning, PMLR, New York City, NY, USA."},{"key":"ref_39","unstructured":"Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y. (2016). Deep Learning, MIT Press."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Rasmussen, C.E. (2003). Gaussian processes in machine learning. In Summer School on Machine Learning, Springer.","DOI":"10.1007\/978-3-540-28650-9_4"},{"key":"ref_41","unstructured":"Duvenaud, D. (2014). Automatic Model Construction with Gaussian Processes. [Ph.D. Thesis, Computational and Biological Learning Laboratory, University of Cambridge]."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1080\/10618600.2020.1831930","article-title":"Local linear forests","volume":"30","author":"Friedberg","year":"2020","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_43","first-page":"1625","article-title":"Confidence intervals for random forests: The jackknife and the infinitesimal jackknife","volume":"15","author":"Wager","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2001). The Elements of Statistical Learning, Springer New York Inc.","DOI":"10.1007\/978-0-387-21606-5"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Barbariol, T., Feltresi, E., and Susto, G.A. (2020). Self-Diagnosis of Multiphase Flow Meters through Machine Learning-Based Anomaly Detection. Energies, 13.","DOI":"10.3390\/en13123136"},{"key":"ref_47","unstructured":"Corneliussen, S., Couput, J.P., Dahl, E., Dykesteen, E., Fr\u00f8ysa, K.E., Malde, E., Moestue, H., Moksnes, P.O., Scheers, L., and Tunheim, H. (2005). Handbook of Multiphase Flow Metering, Norwegian Society for Oil and Gas Measurement."},{"key":"ref_48","unstructured":"Barbosa, C.M., Salgado, C.M., and Brand\u00e3o, L.E.B. (2015). Study of Photon Attenuation Coefficient in Brine Using MCNP Code, Available online: https:\/\/core.ac.uk\/download\/pdf\/159274404.pdf."},{"key":"ref_49","unstructured":"(2021, September 01). ProLabNL. Available online: http:\/\/www.prolabnl.com."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Liu, F.T., Ting, K.M., and Zhou, Z.H. (2008, January 15\u201319). Isolation forest. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Pisa, Italy.","DOI":"10.1109\/ICDM.2008.17"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/8\/3\/58\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:56:11Z","timestamp":1760165771000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/8\/3\/58"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,3]]},"references-count":50,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["informatics8030058"],"URL":"https:\/\/doi.org\/10.3390\/informatics8030058","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,3]]}}}