{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,17]],"date-time":"2026-10-17T19:38:38Z","timestamp":1792265918622,"version":"4.4.0"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T00:00:00Z","timestamp":1716940800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2024,5,29]]},"abstract":"<jats:p>We study the problem of missing data imputation, which is a fundamental task in the area of data quality that aims to impute the missing data to achieve the completeness of datasets. Though the recent distribution-modeling-based techniques (e.g., distribution generation and distribution matching) can achieve state-of-the-art performance in terms of imputation accuracy, we notice that (1) they deploy a sophisticated deep learning model that tends to be overfitting for missing data imputation; (2) they directly rely on a global data distribution while overlooking the local information.<\/jats:p>\n                  <jats:p>Driven by the inherent variability in both missing data and missing mechanisms, in this paper, we explore the uncertain nature of this task and aim to address the limitations of existing works by proposing an u&lt;u&gt;N&lt;\/u&gt;certainty-driven netw&lt;u&gt;O&lt;\/u&gt;rk for &lt;u&gt;M&lt;\/u&gt;issing data &lt;u&gt;I&lt;\/u&gt;mputation, termed NOMI. NOMI has three key components, i.e., the retrieval module, the neural network gaussian process imputator (NNGPI) and the uncertainty-based calibration module. NOMI~ runs these components sequentially and in an iterative manner to achieve a better imputation performance. Specifically, in the retrieval module, NOMI~ retrieves local neighbors of the incomplete data samples based on the pre-defined similarity metric. Subsequently, we design NNGPI~ that merges the advantages of both the Gaussian Process and the universal approximation capacity of neural networks. NNGPI~ models the uncertainty by learning the posterior distribution over the data to impute missing values while alleviating the overfitting issue. Moreover, we further propose an uncertainty-based calibration module that utilizes the uncertainty of the imputator on its prediction to help the retrieval module obtain more reliable local information, thereby further enhancing the imputation performance. We also demonstrate that our NOMI~ can be reformulated as an instance of the well-known Expectation Maximization (EM) algorithm, highlighting the strong theoretical foundation of our proposed methods. Extensive experiments are conducted over 12 real-world datasets. The results demonstrate the excellent performance of NOMI in terms of both accuracy and efficiency.<\/jats:p>","DOI":"10.1145\/3654920","type":"journal-article","created":{"date-parts":[[2024,5,30]],"date-time":"2024-05-30T09:44:53Z","timestamp":1717062293000},"page":"1-25","source":"Crossref","is-referenced-by-count":16,"title":["Missing Data Imputation with Uncertainty-Driven Network"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-7887-4179","authenticated-orcid":false,"given":"Jianwei","family":"Wang","sequence":"first","affiliation":[{"name":"University of New South Wales, Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2674-1638","authenticated-orcid":false,"given":"Ying","family":"Zhang","sequence":"additional","affiliation":[{"name":"Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3123-2184","authenticated-orcid":false,"given":"Kai","family":"Wang","sequence":"additional","affiliation":[{"name":"Antai College of Economics and Management, Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2396-7225","authenticated-orcid":false,"given":"Xuemin","family":"Lin","sequence":"additional","affiliation":[{"name":"Antai College of Economics and Management, Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6572-2600","authenticated-orcid":false,"given":"Wenjie","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of New South Wales, Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,30]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.1992.10475879"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3844\/jcssp.2021.610.623"},{"key":"e_1_2_1_3_1","volume-title":"Data-driven science and engineering: Machine learning, dynamical systems, and control","author":"Brunton Steven L","unstructured":"Steven L Brunton and J Nathan Kutz. 2022. Data-driven science and engineering: Machine learning, dynamical systems, and control. Cambridge University Press."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/J.PATCOG.2011.10.012"},{"key":"e_1_2_1_6_1","unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2007.902631"},{"key":"e_1_2_1_8_1","unstructured":"Yarin Gal et al. 2016. Uncertainty in deep learning."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-009-0295-6"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Charles J Geyer. 1992. Practical markov chain monte carlo. Statist. Sci. (1992) 473--483.","DOI":"10.1214\/ss\/1177011137"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93040-4_21"},{"key":"e_1_2_1_12_1","volume-title":"Support vector machines","author":"Hearst Marti A.","year":"1998","unstructured":"Marti A. Hearst, Susan T Dumais, Edgar Osuna, John Platt, and Bernhard Scholkopf. 1998. Support vector machines. IEEE Intelligent Systems and their Applications, Vol. 13, 4 (1998), 18--28."},{"key":"e_1_2_1_13_1","volume-title":"Science","volume":"313","author":"Hinton Geoffrey E","year":"2006","unstructured":"Geoffrey E Hinton and Ruslan R Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science, Vol. 313, 5786 (2006), 504--507."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 19th International Workshop on Mining and Learning with Graphs (MLG).","author":"Hongliang Chi Suhang Wang","year":"2023","unstructured":"Suhang Wang Hongliang Chi, Cong Qi and Yao Ma. 2023. Active Learning for Graphs with Noisy Structures. In Proceedings of the 19th International Workshop on Mining and Learning with Graphs (MLG)."},{"key":"e_1_2_1_15_1","volume-title":"Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3--6, 2012","author":"Jenatton Rodolphe","year":"2012","unstructured":"Rodolphe Jenatton, Nicolas Le Roux, Antoine Bordes, and Guillaume Obozinski. 2012. A latent factor model for highly multi-relational data. In Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3--6, 2012, Lake Tahoe, Nevada, United States, Peter L. Bartlett, Fernando C. N. Pereira, Christopher J. C. Burges, L\u00e9 on Bottou, and Kilian Q. Weinberger (Eds.). 3176--3184. https:\/\/proceedings.neurips.cc\/paper\/2012\/hash\/0a1bf96b7165e962e90cb14648c9462d-Abstract.html"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2010.05.002"},{"key":"e_1_2_1_17_1","volume-title":"International Conference on Machine Learning. PMLR, 4917--4926","author":"Jia Bin-Bin","year":"2021","unstructured":"Bin-Bin Jia and Min-Ling Zhang. 2021. Multi-dimensional classification via sparse label encoding. In International Conference on Machine Learning. PMLR, 4917--4926."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Oliver Johnson. 2004. Information theory and the central limit theorem. World Scientific.","DOI":"10.1142\/9781860945373"},{"key":"e_1_2_1_19_1","first-page":"1865","article-title":"Regularization techniques for learning with matrices","volume":"13","author":"Kakade Sham M","year":"2012","unstructured":"Sham M Kakade, Shai Shalev-Shwartz, and Ambuj Tewari. 2012. Regularization techniques for learning with matrices. The Journal of Machine Learning Research, Vol. 13, 1 (2012), 1865--1890.","journal-title":"The Journal of Machine Learning Research"},{"key":"e_1_2_1_20_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3--6, 2012, Lake Tahoe, Nevada, United States, Peter L. Bartlett, Fernando C. N. Pereira, Christopher J. C. Burges, L\u00e9 on Bottou, and Kilian Q. Weinberger (Eds.). 1106--1114. https:\/\/proceedings.neurips.cc\/paper\/2012\/hash\/c399862d3b9d6b76c8436e924a68c45b-Abstract.html"},{"key":"e_1_2_1_21_1","first-page":"23806","article-title":"Miracle: Causally-aware imputation via learning missing data mechanisms","volume":"34","author":"Kyono Trent","year":"2021","unstructured":"Trent Kyono, Yao Zhang, Alexis Bellot, and Mihaela van der Schaar. 2021. Miracle: Causally-aware imputation via learning missing data mechanisms. Advances in Neural Information Processing Systems, Vol. 34 (2021), 23806--23817.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_22_1","volume-title":"Advances in Neural Information Processing Systems","volume":"13","author":"Lee Daniel","year":"2000","unstructured":"Daniel Lee and H Sebastian Seung. 2000. Algorithms for non-negative matrix factorization. Advances in Neural Information Processing Systems, Vol. 13 (2000)."},{"key":"e_1_2_1_23_1","volume-title":"International Conference on Learning Representations.","author":"Lee Jaehoon","year":"2018","unstructured":"Jaehoon Lee, Yasaman Bahri, Roman Novak, Samuel S Schoenholz, Jeffrey Pennington, and Jascha Sohl-Dickstein. 2018. Deep Neural Networks as Gaussian Processes. In International Conference on Learning Representations."},{"key":"e_1_2_1_24_1","volume-title":"ABC of order dependencies. The VLDB Journal","author":"Li Pei","year":"2021","unstructured":"Pei Li, Jaroslaw Szlichta, Michael B\u00f6hlen, and Divesh Srivastava. 2021. ABC of order dependencies. The VLDB Journal (2021), 1--25."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-019-09709-4"},{"key":"e_1_2_1_26_1","volume-title":"Statistical analysis with missing data","author":"Little Roderick JA","unstructured":"Roderick JA Little and Donald B Rubin. 2019. Statistical analysis with missing data. Vol. 793. John Wiley & Sons."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00119"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2889473"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9--15","volume":"4423","author":"Mattei Pierre-Alexandre","year":"2019","unstructured":"Pierre-Alexandre Mattei and Jes Frellsen. 2019. MIWAE: Deep Generative Modelling and Imputation of Incomplete Data Sets. In Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9--15 June 2019, Long Beach, California, USA (Proceedings of Machine Learning Research, Vol. 97), Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). PMLR, 4413--4423. http:\/\/proceedings.mlr.press\/v97\/mattei19a.html"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/1756006.1859931"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2018.09.406"},{"key":"e_1_2_1_32_1","unstructured":"Edward James McShane. 1937. Jensen's inequality. (1937)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.14778\/3494124.3494143"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2022.3186498"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/79.543975"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2006.01.009"},{"key":"e_1_2_1_37_1","volume-title":"International Conference on Machine Learning. PMLR, 7130--7140","author":"Muzellec Boris","year":"2020","unstructured":"Boris Muzellec, Julie Josse, Claire Boyer, and Marco Cuturi. 2020. Missing data imputation using optimal transport. In International Conference on Machine Learning. PMLR, 7130--7140."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/3104322.3104425"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.203"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1.12312"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v045.i04"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/63.3.581"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1038\/323533a0"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2020.06.005"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btr597"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISESE.2005.1541819"},{"key":"e_1_2_1_48_1","volume-title":"A survey on Bayesian deep learning. ACM Computing Surveys (csur)","author":"Wang Hao","year":"2020","unstructured":"Hao Wang and Dit-Yan Yeung. 2020. A survey on Bayesian deep learning. ACM Computing Surveys (csur), Vol. 53, 5 (2020), 1--37."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP43922.2022.9746136"},{"key":"e_1_2_1_50_1","first-page":"4697","article-title":"Bayesian deep learning and a probabilistic perspective of generalization","volume":"33","author":"Wilson Andrew G","year":"2020","unstructured":"Andrew G Wilson and Pavel Izmailov. 2020. Bayesian deep learning and a probabilistic perspective of generalization. Advances in Neural Information Processing Systems, Vol. 33 (2020), 4697--4708.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_51_1","volume-title":"An Interactive Data Imputation System. In International Conference on Database Systems for Advanced Applications. Springer, 495--499","author":"Wu Yangyang","year":"2022","unstructured":"Yangyang Wu, Xiaoye Miao, Yuchen Peng, Lu Chen, Yunjun Gao, and Jianwei Yin. 2022. An Interactive Data Imputation System. In International Conference on Database Systems for Advanced Applications. Springer, 495--499."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2023.3293129"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41019-019-0095-7"},{"key":"e_1_2_1_54_1","volume-title":"International Conference on Machine Learning. PMLR, 5689--5698","author":"Yoon Jinsung","year":"2018","unstructured":"Jinsung Yoon, James Jordon, and Mihaela Schaar. 2018. Gain: Missing data imputation using generative adversarial nets. In International Conference on Machine Learning. PMLR, 5689--5698."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00023"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2012.05.073"},{"key":"e_1_2_1_57_1","volume-title":"Transformed Distribution Matching for Missing Value Imputation. In International Conference on Machine Learning. PMLR, 42159--42186","author":"Zhao He","year":"2023","unstructured":"He Zhao, Ke Sun, Amir Dezfouli, and Edwin V Bonilla. 2023. Transformed Distribution Matching for Missing Value Imputation. In International Conference on Machine Learning. PMLR, 42159--42186."},{"key":"e_1_2_1_58_1","volume-title":"Energy-based Generative Adversarial Networks. In International Conference on Learning Representations.","author":"Zhao Junbo","year":"2016","unstructured":"Junbo Zhao, Michael Mathieu, and Yann LeCun. 2016. Energy-based Generative Adversarial Networks. In International Conference on Learning Representations."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526156"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1609\/AAAI.V35I12.17317"},{"key":"e_1_2_1_61_1","volume-title":"International Conference on Machine Learning. PMLR, 4180--4188","author":"Zhu Rongda","year":"2017","unstructured":"Rongda Zhu, Lingxiao Wang, Chengxiang Zhai, and Quanquan Gu. 2017. High-dimensional variance-reduced stochastic gradient expectation-maximization algorithm. In International Conference on Machine Learning. PMLR, 4180--4188."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.24963\/IJCAI.2022\/338"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3654920","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3654920","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T14:42:41Z","timestamp":1755787361000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3654920"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,29]]},"references-count":62,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,5,29]]}},"alternative-id":["10.1145\/3654920"],"URL":"https:\/\/doi.org\/10.1145\/3654920","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,29]]}}}