{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,11]],"date-time":"2025-07-11T10:20:37Z","timestamp":1752229237657,"version":"3.41.0"},"reference-count":75,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T00:00:00Z","timestamp":1705017600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"CITI, Academia Sinica"},{"DOI":"10.13039\/100020595","name":"National Science and Technology Council of Taiwan","doi-asserted-by":"crossref","award":["106-2221-E-002-009, 108-2221-E-001-015, 109-2119-M-001-010-A, 109-2221-E-001-010-MY"],"award-info":[{"award-number":["106-2221-E-002-009, 108-2221-E-001-015, 109-2119-M-001-010-A, 109-2221-E-001-010-MY"]}],"id":[{"id":"10.13039\/100020595","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2024,4,30]]},"abstract":"<jats:p>Sparse grid imputation (SGI) is a challenging problem, as its goal is to infer the values of the entire grid from a limited number of cells with values. Traditionally, the problem is solved using regression methods such as KNN and kriging, whereas in the real world, there is often extra information\u2014usually imprecise\u2014that can aid inference and yield better performance. In the SGI problem, in addition to the limited number of fixed grid cells with precise target domain values, there are contextual data and imprecise observations over the whole grid. To solve this problem, we propose a distribution estimation theory for the whole grid and realize the theory via the composition architecture of the Target-Embedding and the Contextual CycleGAN trained with contextual information and imprecise observations. Contextual CycleGAN is structured as two generator\u2013discriminator pairs and uses different types of contextual loss to guide the training. We consider the real-world problem of fine-grained PM2.5 inference with realistic settings: a few (less than 1%) grid cells with precise PM2.5 data and all grid cells with contextual information concerning weather and imprecise observations from satellites and microsensors. The task is to infer reasonable values for all grid cells. As there is no ground truth for empty cells, out-of-sample mean squared error and Jensen\u2013Shannon divergence measurements are used in the empirical study. The results show that Contextual CycleGAN supports the proposed theory and outperforms the methods used for comparison.<\/jats:p>","DOI":"10.1145\/3634751","type":"journal-article","created":{"date-parts":[[2023,11,27]],"date-time":"2023-11-27T15:50:43Z","timestamp":1701100243000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Sparse Grid Imputation Using Unpaired Imprecise Auxiliary Data: Theory and Application to PM2.5 Estimation"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9799-2330","authenticated-orcid":false,"given":"Ming-Chuan","family":"Yang","sequence":"first","affiliation":[{"name":"Research Center for Information Technology Innovation, Academia Sinica, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1748-7818","authenticated-orcid":false,"given":"Guo-Wei","family":"Wong","sequence":"additional","affiliation":[{"name":"Research Center for Information Technology Innovation, Academia Sinica, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6815-2436","authenticated-orcid":false,"given":"Meng Chang","family":"Chen","sequence":"additional","affiliation":[{"name":"Research Center for Information Technology Innovation, Academia Sinica, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,1,12]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/0165-1684(94)90182-1"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.atmosenv.2018.07.058"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.04.010"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-16-7657-4_71"},{"key":"e_1_3_2_6_2","article-title":"Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters","volume":"2","author":"Bridle John","year":"1989","unstructured":"John Bridle. 1989. Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters. Advances in Neural Information Processing Systems 2 (1989).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1137\/151005099"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2009.2035722"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10208-009-9045-5"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2723919"},{"key":"e_1_3_2_11_2","first-page":"2172","volume-title":"Advances in Neural Information Processing Systems","author":"Chen Xi","year":"2016","unstructured":"Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, and Pieter Abbeel. 2016. Infogan: Interpretable representation learning by information maximizing generative adversarial nets. In Advances in Neural Information Processing Systems. 2172\u20132180."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00916"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00821"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683787"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.2307\/1403797"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT.2004.1365067"},{"key":"e_1_3_2_17_2","article-title":"SI-AGAN: Spatial interpolation with attentional generative adversarial networks for environment monitoring","author":"Gao Yujia","year":"2020","unstructured":"Yujia Gao, Liang Liu, Chi Zhang, Xiao Wang, and Huadong Ma. 2020. SI-AGAN: Spatial interpolation with attentional generative adversarial networks for environment monitoring. In Proceedings of the 24th European Conference on Artificial Intelligence (ECAI) (2020).","journal-title":"Proceedings of the 24th European Conference on Artificial Intelligence (ECAI)"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-017-9314-z"},{"key":"e_1_3_2_19_2","first-page":"2672","volume-title":"Advances in Neural Information Processing Systems","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in Neural Information Processing Systems. 2672\u20132680."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2019.2916751"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1127647"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.envpol.2020.114810"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783344"},{"issue":"1","key":"e_1_3_2_25_2","first-page":"1","article-title":"Facial attribute-controlled sketch-to-image translation with generative adversarial networks","volume":"2020","author":"Hu Mingming","year":"2020","unstructured":"Mingming Hu and Jingtao Guo. 2020. Facial attribute-controlled sketch-to-image translation with generative adversarial networks. EURASIP J. Image Vid. Process. 2020, 1 (2020), 1\u201313.","journal-title":"EURASIP J. Image Vid. Process."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/2488608.2488693"},{"key":"e_1_3_2_27_2","article-title":"Target-embedding autoencoders for supervised representation learning","author":"Jarrett Daniel","year":"2020","unstructured":"Daniel Jarrett and Mihaela van der Schaar. 2020. Target-embedding autoencoders for supervised representation learning. In Proceedings of the International Conference on Learning Representations (ICLR\u201920).","journal-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201920)"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5863"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.9967"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2010.2046205"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.envpol.2022.119348"},{"issue":"6","key":"e_1_3_2_32_2","first-page":"119","article-title":"A statistical approach to some basic mine valuation problems on the witwatersrand","volume":"52","author":"Krige Daniel G.","year":"1951","unstructured":"Daniel G. Krige. 1951. A statistical approach to some basic mine valuation problems on the witwatersrand. J. South. Afr. Inst. Min. Metallurg. 52, 6 (1951), 119\u2013139.","journal-title":"J. South. Afr. Inst. Min. Metallurg."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729694"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1989.1.4.541"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2022.108720"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.atmosenv.2020.117293"},{"key":"e_1_3_2_37_2","article-title":"Misgan: Learning from incomplete data with generative adversarial networks","author":"Li Steven Cheng-Xian","year":"2019","unstructured":"Steven Cheng-Xian Li, Bo Jiang, and Benjamin Marlin. 2019. Misgan: Learning from incomplete data with generative adversarial networks. In Proceedings of the International Conference on Learning Representations (ICLR\u201919).","journal-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201919)"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.atmosenv.2022.119304"},{"key":"e_1_3_2_39_2","article-title":"Coupled generative adversarial networks","volume":"29","author":"Liu Ming-Yu","year":"2016","unstructured":"Ming-Yu Liu and Oncel Tuzel. 2016. Coupled generative adversarial networks. Adv. Neural Inf. Process. Syst. 29 (2016).","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3341162.3345606"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01258-8_18"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.109750"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclepro.2019.117729"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2018.8622381"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i10.17086"},{"key":"e_1_3_2_46_2","article-title":"Conditional generative adversarial nets","author":"Mirza Mehdi","year":"2014","unstructured":"Mehdi Mirza and Simon Osindero. 2014. Conditional generative adversarial nets. arXiv:1411.1784. Retrieved from https:\/\/arxiv.org\/abs\/1411.1784","journal-title":"arXiv:1411.1784"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.5555\/3360093"},{"key":"e_1_3_2_48_2","volume-title":"Introduction to Linear Regression Analysis","author":"Montgomery Douglas C.","year":"2021","unstructured":"Douglas C. Montgomery, Elizabeth A. Peck, and G. Geoffrey Vining. 2021. Introduction to Linear Regression Analysis. John Wiley & Sons."},{"key":"e_1_3_2_49_2","first-page":"H51K\u20130753","volume-title":"AGU Fall Meeting Abstracts","author":"Murphy Benjamin S.","year":"2014","unstructured":"Benjamin S. Murphy. 2014. PyKrige: Development of a kriging toolkit for python. In AGU Fall Meeting Abstracts. H51K\u20130753."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00418"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData50022.2020.9378240"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecoinf.2022.101775"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.3390\/app121910006"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.21236\/ADA164453"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.uclim.2021.100872"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2017.8257992"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-020-09963-5"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1137\/10080991X"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1088\/1748-9326\/ac52c9"},{"issue":"12","key":"e_1_3_2_60_2","article-title":"Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion.","volume":"11","author":"Vincent Pascal","year":"2010","unstructured":"Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, Pierre-Antoine Manzagol, and L\u00e9on Bottou. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11, 12 (2010).","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0249694"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.envpol.2019.01.086"},{"key":"e_1_3_2_63_2","first-page":"1","article-title":"GAGIN: Generative adversarial guider imputation network for missing data","author":"Wang Wei","year":"2022","unstructured":"Wei Wang, Yimeng Chai, and Yue Li. 2022. GAGIN: Generative adversarial guider imputation network for missing data. Neural Comput. Appl. (2022), 1\u201314.","journal-title":"Neural Comput. Appl."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.envpol.2021.116846"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2021.3099135"},{"key":"e_1_3_2_66_2","first-page":"5689","volume-title":"International Conference on Machine Learning","author":"Yoon Jinsung","year":"2018","unstructured":"Jinsung Yoon, James Jordon, and Mihaela Schaar. 2018. Gain: Missing data imputation using generative adversarial nets. In International Conference on Machine Learning. PMLR, 5689\u20135698. https:\/\/github.com\/jsyoon0823\/GAIN"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00848"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.3390\/rs13193834"},{"issue":"3","key":"e_1_3_2_69_2","first-page":"2711","article-title":"KNN classification with one-step computation","volume":"35","author":"Zhang Shichao","year":"2023","unstructured":"Shichao Zhang and Jiaye Li. 2023. KNN classification with one-step computation. IEEE Trans. Knowl. Data Eng. 35, 3 (2023), 2711\u20132723.","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2022.3185149"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2022.06.082"},{"issue":"3","key":"e_1_3_2_72_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2990508","article-title":"Learning k for knn classification","volume":"8","author":"Zhang Shichao","year":"2017","unstructured":"Shichao Zhang, Xuelong Li, Ming Zong, Xiaofeng Zhu, and Debo Cheng. 2017. Learning k for knn classification. ACM Trans. Intell. Syst. Technol. 8, 3 (2017), 1\u201319.","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2673241"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788573"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"},{"key":"e_1_3_2_76_2","first-page":"465","volume-title":"Advances in Neural Information Processing Systems","author":"Zhu Jun-Yan","year":"2017","unstructured":"Jun-Yan Zhu, Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A. Efros, Oliver Wang, and Eli Shechtman. 2017. Toward multimodal image-to-image translation. In Advances in Neural Information Processing Systems. 465\u2013476."}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3634751","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3634751","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T23:44:08Z","timestamp":1750290248000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3634751"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,12]]},"references-count":75,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,4,30]]}},"alternative-id":["10.1145\/3634751"],"URL":"https:\/\/doi.org\/10.1145\/3634751","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"type":"print","value":"1556-4681"},{"type":"electronic","value":"1556-472X"}],"subject":[],"published":{"date-parts":[[2024,1,12]]},"assertion":[{"value":"2022-11-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}