{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T19:10:59Z","timestamp":1789672259076,"version":"4.0.1"},"reference-count":82,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2025,6,17]]},"abstract":"<jats:p>Data cleaning is a long-standing challenge in data management. While powerful logic and statistical algorithms have been developed to detect and repair data errors in tables, existing algorithms predominantly rely on domain-experts to first manually specify data-quality constraints specific to a given table, before data cleaning algorithms can be applied.<\/jats:p>\n                  <jats:p>\n                    In this work, we observe that there is an important class of data-quality constraints that we call\n                    <jats:italic toggle=\"yes\">Semantic-Domain Constraints,<\/jats:italic>\n                    which can be reliably inferred and automatically applied to\n                    <jats:italic toggle=\"yes\">any tables,<\/jats:italic>\n                    without requiring domain-experts to manually specify on a per-table basis. We develop a principled framework to systematically learn such constraints from table corpora using large-scale statistical tests, which can further be distilled into a core set of constraints using our optimization framework, with provable quality guarantees. Extensive evaluations show that this new class of constraints can be used to both (1) directly detect errors on real tables in the wild, and (2) augment existing expert-driven data-cleaning techniques as a new class of complementary constraints.\n                  <\/jats:p>\n                  <jats:p>Our code and data are available at https:\/\/github.com\/qixuchen\/AutoTest for future research.<\/jats:p>","DOI":"10.1145\/3725396","type":"journal-article","created":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:23:29Z","timestamp":1750281809000},"page":"1-27","source":"Crossref","is-referenced-by-count":5,"title":["Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3172-4039","authenticated-orcid":false,"given":"Qixu","family":"Chen","sequence":"first","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2824-5299","authenticated-orcid":false,"given":"Yeye","family":"He","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7045-6503","authenticated-orcid":false,"given":"Raymond Chi-Wing","family":"Wong","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0870-7628","authenticated-orcid":false,"given":"Weiwei","family":"Cui","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8040-6513","authenticated-orcid":false,"given":"Song","family":"Ge","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7530-9553","authenticated-orcid":false,"given":"Haidong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9230-2799","authenticated-orcid":false,"given":"Dongmei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8252-5270","authenticated-orcid":false,"given":"Surajit","family":"Chaudhuri","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,18]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"[n. d.]. Benchmark data and code used in the paper. https:\/\/tinyurl.com\/AutoTestSIGMOD25 or https:\/\/github.com\/qixuchen\/AutoTest."},{"key":"e_1_2_2_2_1","unstructured":"[n. d.]. Dataprep.clean: Curated validation functions for common semantic types. https:\/\/docs.dataprep.ai\/user_guide\/clean\/introduction.html#userguide-clean."},{"key":"e_1_2_2_3_1","unstructured":"[n. d.]. Example UPC validation function (Python). https:\/\/en.wikipedia.org\/wiki\/Luhn_algorithm."},{"key":"e_1_2_2_4_1","unstructured":"[n. d.]. Excel clean data: example demo. https:\/\/tinyurl.com\/Excel-Clean-Data-demo or https:\/\/drive.google.com\/file\/d\/1kIVLVOZQfZn2Dqd2M-fblo7EwpP_O4tw\/view?usp=drive_link."},{"key":"e_1_2_2_5_1","unstructured":"[n. d.]. Excel: clean data with copilot. https:\/\/support.microsoft.com\/en-us\/office\/clean-data-in-excel-7fe20d89--3f57--46d3-b659-e8f3ee853bda?ns=XLWAENDUSER&version=16."},{"key":"e_1_2_2_6_1","unstructured":"[n. d.]. Full technical report of Auto-Test. https:\/\/arxiv.org\/abs\/2504.10762."},{"key":"e_1_2_2_7_1","unstructured":"[n. d.]. Google Sheet: Smart Cleanup feature. https:\/\/workspace.google.com\/blog\/product-announcements\/connectedsheets-is-generally-available."},{"key":"e_1_2_2_8_1","unstructured":"[n. d.]. Google sheets. https:\/\/workspace.google.com\/products\/sheets\/."},{"key":"e_1_2_2_9_1","unstructured":"[n. d.]. Microsoft Excel. https:\/\/www.microsoft.com\/en-us\/microsoft-365\/excel."},{"key":"e_1_2_2_10_1","unstructured":"[n. d.]. TabLib: 627M tables and 867B tokens of context for training Large Data Models. https:\/\/www.approximatelabs.com\/blog\/tablib."},{"key":"e_1_2_2_11_1","unstructured":"2024. validators - Python Data Validation for Humans. https:\/\/github.com\/python-validators\/validators\/."},{"key":"e_1_2_2_12_1","unstructured":"Ricardo Baeza-Yates Berthier Ribeiro-Neto et al. 1999. Modern information retrieval. Vol. 463. ACM press New York."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/3204028.3204032"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2013.6544854"},{"key":"e_1_2_2_15_1","volume-title":"Pattern recognition and machine learning","author":"Bishop Christopher M","unstructured":"Christopher M Bishop and Nasser M Nasrabadi. 2006. Pattern recognition and machine learning. Vol. 4. Springer."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335388"},{"key":"e_1_2_2_17_1","volume-title":"Language models are few-shot learners. arXiv preprint arXiv:2005.14165","author":"Brown Tom B","year":"2020","unstructured":"Tom B Brown. 2020. Language models are few-shot learners. arXiv preprint arXiv:2005.14165 (2020)."},{"key":"e_1_2_2_18_1","first-page":"15","article-title":"Data services leveraging Bing's data assets","volume":"39","author":"Chakrabarti Kaushik","year":"2016","unstructured":"Kaushik Chakrabarti, Surajit Chaudhuri, Zhimin Chen, Kris Ganjam, Yeye He, and W Redmond. 2016. Data services leveraging Bing's data assets. IEEE Data Eng. Bull. 39, 3 (2016), 15--28.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1541880.1541882"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2013.6544847"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816746"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2749431"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203771587"},{"key":"e_1_2_2_24_1","unstructured":"Jacob Cohen. 2016. A power primer. (2016)."},{"key":"e_1_2_2_25_1","volume-title":"A comparative evaluation of outlier detection algorithms: Experiments and analyses. Pattern recognition 74","author":"Domingues R\u00e9mi","year":"2018","unstructured":"R\u00e9mi Domingues, Maurizio Filippone, Pietro Michiardi, and Jihane Zouaoui. 2018. A comparative evaluation of outlier detection algorithms: Experiments and analyses. Pattern recognition 74 (2018), 406--421."},{"key":"e_1_2_2_26_1","volume-title":"A survey of data quality measurement and monitoring tools. Frontiers in big data 5","author":"Ehrlinger Lisa","year":"2022","unstructured":"Lisa Ehrlinger and Wolfram W\u00f6\u00df. 2022. A survey of data quality measurement and monitoring tools. Frontiers in big data 5 (2022), 850611."},{"key":"e_1_2_2_27_1","volume-title":"The analysis of contingency tables","author":"Everitt Brian S","unstructured":"Brian S Everitt. 1992. The analysis of contingency tables. CRC Press."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2010.154"},{"key":"e_1_2_2_29_1","volume-title":"ArcheType: A Novel Framework for Open-Source Column Type Annotation using Large Language Models. arXiv preprint arXiv:2310.18208","author":"Feuer Benjamin","year":"2023","unstructured":"Benjamin Feuer, Yurong Liu, Chinmay Hegde, and Juliana Freire. 2023. ArcheType: A Novel Framework for Open-Source Column Type Annotation using Large Language Models. arXiv preprint arXiv:2310.18208 (2023)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2020.3012472"},{"key":"e_1_2_2_31_1","volume-title":"Auto-Tag: Tagging-Data-By-Example in Data Lakes. arXiv preprint arXiv:2112.06049","author":"He Yeye","year":"2021","unstructured":"Yeye He, Jie Song, Yue Wang, Surajit Chaudhuri, Vishal Anil, Blake Lassiter, Yaron Goland, and Gaurav Malhotra. 2021. Auto-Tag: Tagging-Data-By-Example in Data Lakes. arXiv preprint arXiv:2112.06049 (2021)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3319888"},{"key":"e_1_2_2_33_1","unstructured":"Joseph M Hellerstein. 2013. Quantitative data cleaning for large databases. (2013)."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3196889"},{"key":"e_1_2_2_35_1","volume-title":"TANE: An efficient algorithm for discovering functional and approximate dependencies. The computer journal 42, 2","author":"Huhtala Yka","year":"1999","unstructured":"Yka Huhtala, Juha K\u00e4rkk\u00e4inen, Pasi Porkka, and Hannu Toivonen. 1999. TANE: An efficient algorithm for discovering functional and approximate dependencies. The computer journal 42, 2 (1999), 100--111."},{"key":"e_1_2_2_36_1","volume-title":"AdaTyper: Adaptive Semantic Column Type Detection. arXiv preprint arXiv:2311.13806","author":"Hulsebos Madelon","year":"2023","unstructured":"Madelon Hulsebos, Paul Groth, and \u00c7agatay Demiralp. 2023. AdaTyper: Adaptive Semantic Column Type Detection. arXiv preprint arXiv:2311.13806 (2023)."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330993"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2018.00014"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-8176-4811-4"},{"key":"e_1_2_2_40_1","volume-title":"On effect size. Psychological methods 17, 2","author":"Kelley Ken","year":"2012","unstructured":"Ken Kelley and Kristopher J Preacher. 2012. On effect size. Psychological methods 17, 2 (2012), 137."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2747646"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2503323"},{"key":"e_1_2_2_43_1","volume-title":"Proceedings of the international conference on very large data bases. Citeseer, 392--403","author":"Knox Edwin M","year":"1998","unstructured":"Edwin M Knox and Raymond T Ng. 1998. Algorithms for mining distancebased outliers in large datasets. In Proceedings of the international conference on very large data bases. Citeseer, 392--403."},{"key":"e_1_2_2_44_1","volume-title":"Dongmei Zhang, and Surajit Chaudhuri.","author":"Li Peng","year":"2023","unstructured":"Peng Li, Yeye He, Dror Yashar, Weiwei Cui, Song Ge, Haidong Zhang, Danielle Rifinski Fainman, Dongmei Zhang, and Surajit Chaudhuri. 2023. Table-gpt: Table-tuned gpt for diverse table tasks. arXiv preprint arXiv:2310.09263 (2023)."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1921005"},{"key":"e_1_2_2_46_1","volume-title":"Auto-bi: Automatically build bi-models leveraging local join prediction and global schema graph. arXiv preprint arXiv:2306.12515","author":"Lin Yiming","year":"2023","unstructured":"Yiming Lin, Yeye He, and Surajit Chaudhuri. 2023. Auto-bi: Automatically build bi-models leveraging local join prediction and global schema graph. arXiv preprint arXiv:2306.12515 (2023)."},{"key":"e_1_2_2_47_1","volume-title":"Kai Ming Ting, and Zhi-Hua Zhou","author":"Liu Fei Tony","year":"2008","unstructured":"Fei Tony Liu, Kai Ming Ting, and Zhi-Hua Zhou. 2008. Isolation forest. In 2008 eighth ieee international conference on data mining. IEEE, 413--422."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.14778\/3407790.3407801"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3324956"},{"key":"e_1_2_2_50_1","volume-title":"Novelty detection: a review-part 1: statistical approaches. Signal processing 83, 12","author":"Markou Markos","year":"2003","unstructured":"Markos Markou and Sameer Singh. 2003. Novelty detection: a review-part 1: statistical approaches. Signal processing 83, 12 (2003), 2481--2497."},{"key":"e_1_2_2_51_1","volume-title":"Novelty detection: a review-part 2:: neural network based approaches. Signal processing 83, 12","author":"Markou Markos","year":"2003","unstructured":"Markos Markou and Sameer Singh. 2003. Novelty detection: a review-part 2:: neural network based approaches. Signal processing 83, 12 (2003), 2499--2521."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626766"},{"key":"e_1_2_2_53_1","volume-title":"Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.5555\/1690219.1690287"},{"key":"e_1_2_2_55_1","volume-title":"Can foundation models wrangle your data? arXiv preprint arXiv:2205.09911","author":"Narayan Avanika","year":"2022","unstructured":"Avanika Narayan, Ines Chami, Laurel Orr, Simran Arora, and Christopher R\u00e9. 2022. Can foundation models wrangle your data? arXiv preprint arXiv:2205.09911 (2022)."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2590989.2590995"},{"key":"e_1_2_2_57_1","volume-title":"Automatic data repair: Are we ready to deploy? arXiv preprint arXiv:2310.00711","author":"Ni Wei","year":"2023","unstructured":"Wei Ni, Xiaoye Miao, Xiangyu Zhao, Yangyang Wu, and Jianwei Yin. 2023. Automatic data repair: Are we ready to deploy? arXiv preprint arXiv:2310.00711 (2023)."},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3457330"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.2307\/1402731"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02579324"},{"key":"e_1_2_2_62_1","volume-title":"Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084","author":"Reimers Nils","year":"2019","unstructured":"Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084 (2019)."},{"key":"e_1_2_2_63_1","volume-title":"Holoclean: Holistic data repairs with probabilistic inference. arXiv preprint arXiv:1702.00820","author":"Rekatsinas Theodoros","year":"2017","unstructured":"Theodoros Rekatsinas, Xu Chu, Ihab F Ilyas, and Christopher R\u00e9. 2017. Holoclean: Holistic data repairs with probabilistic inference. arXiv preprint arXiv:1702.00820 (2017)."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3320210"},{"key":"e_1_2_2_65_1","unstructured":"SciPy. 2024. SciPy optimize. https:\/\/docs.scipy.org\/doc\/scipy\/reference\/optimize.html."},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3457250"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3517906"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.14778\/3583140.3583149"},{"key":"e_1_2_2_69_1","unstructured":"Mihai Surdeanu David McClosky Julie Tibshirani John Bauer Angel X Chang Valentin I Spitkovsky and Christopher D Manning. 2010. A Simple Distant Supervision Approach for the TAC-KBP Slot Filling Task. In TAC."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00140"},{"key":"e_1_2_2_71_1","volume-title":"Support vector data description. Machine learning 54","author":"Tax David MJ","year":"2004","unstructured":"David MJ Tax and Robert PW Duin. 2004. Support vector data description. Machine learning 54 (2004), 45--66."},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00196"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580305.3599776"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3319855"},{"key":"e_1_2_2_75_1","volume-title":"Denny Zhou, et al.","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems 35 (2022), 24824--24837."},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1927.10502953"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44801-2_11"},{"key":"e_1_2_2_78_1","volume-title":"Table- LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuning. arXiv preprint arXiv:2410.12164","author":"Xing Junjie","year":"2024","unstructured":"Junjie Xing, Yeye He, Mengyu Zhou, Haoyu Dong, Shi Han, Dongmei Zhang, and Surajit Chaudhuri. 2024. Table- LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuning. arXiv preprint arXiv:2410.12164 (2024)."},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2463706"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3196888"},{"key":"e_1_2_2_81_1","volume-title":"Sato: Contextual semantic type detection in tables. arXiv preprint arXiv:1911.06311","author":"Zhang Dan","year":"2019","unstructured":"Dan Zhang, Yoshihiko Suhara, Jinfeng Li, Madelon Hulsebos, \u00c7agatay Demiralp, and Wang-Chiew Tan. 2019. Sato: Contextual semantic type detection in tables. arXiv preprint arXiv:1911.06311 (2019)."},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313578"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3725396","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T18:54:34Z","timestamp":1774983274000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3725396"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,17]]},"references-count":82,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6,17]]}},"alternative-id":["10.1145\/3725396"],"URL":"https:\/\/doi.org\/10.1145\/3725396","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,17]]}}}