{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,18]],"date-time":"2025-04-18T04:13:09Z","timestamp":1744949589009,"version":"3.40.4"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T00:00:00Z","timestamp":1731283200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,4,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Cardinality estimation is a crucial component in query optimizers. After decades of research, employing autoregressive models for cardinality estimation has demonstrated remarkable accuracy. However, when queries involve attributes with large domain sizes, autoregressive model-based estimators struggle to accurately capture the data distribution, leading to poor performance. Furthermore, these models often exhibit significant errors when handling queries with low-selectivity predicates. To address these challenges, we propose a self-adaptive cardinality estimator named AdaCard. Initially, we employ a self-adaptive smoothing factor selection strategy to variably adjust the original data, thereby mitigating the impact of large domain sizes. Secondly, to correct errors stemming from Monte Carlo sampling, we utilize resampling to refine the handling of low-selectivity predicates, thereby improving accuracy. Through evaluation using four real-world benchmarks, we compared AdaCard with mainstream baselines. The final results show that our estimator has the lowest tail estimation error and improves accuracy by nearly 10$\\times $ over the second-best method, with similar latency and model size.<\/jats:p>","DOI":"10.1093\/comjnl\/bxae117","type":"journal-article","created":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T06:56:32Z","timestamp":1731308192000},"page":"360-371","source":"Crossref","is-referenced-by-count":0,"title":["Self-adaptive smoothing model for cardinality estimation"],"prefix":"10.1093","volume":"68","author":[{"given":"Yuming","family":"Lin","sequence":"first","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology , No. 1 Jinji Road, Qixing District, Guilin City, Guangxi 541004 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yinghao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology , No. 1 Jinji Road, Qixing District, Guilin City, Guangxi 541004 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Yang","sequence":"additional","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology , No. 1 Jinji Road, Qixing District, Guilin City, Guangxi 541004 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"You","family":"Li","sequence":"additional","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology , No. 1 Jinji Road, Qixing District, Guilin City, Guangxi 541004 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingwei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology , No. 1 Jinji Road, Qixing District, Guilin City, Guangxi 541004 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,11,11]]},"reference":[{"key":"2025041706110721800_ref1","first-page":"561","article-title":"Learned query optimizer: what is new and what is next","volume-title":"Proceedings of the 2024 International Conference on Management of Data, Santiago AA, Chile, 9-15 June","author":"Zhu","year":"2024"},{"key":"2025041706110721800_ref2","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1007\/s41019-019-00115-y","article-title":"Deep learning for user interest and response prediction in online display advertising","volume":"5","author":"Gharibshah","year":"2020","journal-title":"Data Sci Eng"},{"key":"2025041706110721800_ref3","article-title":"Learned cardinalities: estimating correlated joins with deep learning","volume-title":"Proceedings of the 9th Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, 13-16 January, Online Proceedings","author":"Kipf","year":"2019"},{"key":"2025041706110721800_ref4","first-page":"2859","article-title":"AI meets database: AI4DB and DB4AI","volume-title":"Proceedings of the SIGMOD '21: International Conference on Management of Data, Virtual Event, China, June 20-25","author":"Li","year":"2021"},{"key":"2025041706110721800_ref5","first-page":"1","article-title":"Machine learning for databases","volume-title":".Proceedings of the First International Conference on AI-ML Systems, Bangalore, India, 21-23 October","author":"Li","year":"2021"},{"key":"2025041706110721800_ref6","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1109\/TKDE.2020.2994641","article-title":"Database meets artificial intelligence: a survey","volume":"34","author":"Zhou","year":"2022","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"2025041706110721800_ref7","doi-asserted-by":"publisher","first-page":"3028","DOI":"10.14778\/3476311.3476380","article-title":"OpenGauss: an autonomous database system","volume":"14","author":"Li","year":"2021","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref8","doi-asserted-by":"crossref","first-page":"68","DOI":"10.26599\/BDMA.2019.9020019","article-title":"Mining conditional functional dependency rules on big data","volume":"3","author":"Li","year":"2019","journal-title":"Big Data Min Anal"},{"key":"2025041706110721800_ref9","first-page":"1","article-title":"FactorJoin: a new cardinality estimation framework for join queries","volume":"1","author":"Wu","year":"2023","journal-title":"Proc ACM Manage Data"},{"key":"2025041706110721800_ref10","first-page":"pp. 2483","article-title":"HTAP databases: what is new and what is next","volume-title":".Proceedings of the 2022 International Conference on Management of Data, Philadelphia, PA, USA, 12-17 June","author":"Li","year":"2022"},{"key":"2025041706110721800_ref11","doi-asserted-by":"publisher","first-page":"307","DOI":"10.14778\/3368289.3368296","article-title":"An end-to-end learning-based cost estimator","volume":"13","author":"Sun","year":"2019","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref12","doi-asserted-by":"publisher","first-page":"1520","DOI":"10.14778\/3583140.3583164","article-title":"Robust query driven cardinality estimation under changing workloads","volume":"16","author":"Negi","year":"2023","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3588954","article-title":"Neurosketch: fast and approximate evaluation of range aggregate queries with neural networks","volume":"1","author":"Zeighami","year":"2023","journal-title":"Proc ACM Manage Data"},{"key":"2025041706110721800_ref14","doi-asserted-by":"publisher","first-page":"2085","DOI":"10.14778\/3151106.3151112","article-title":"Estimating join selectivities using bandwidth-optimized kernel density models","volume":"10","author":"Kiefer","year":"2017","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref15","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1145\/376284.375685","article-title":"Independence is good: dependency-based histogram synopses for high-dimensional data","volume":"30","author":"Deshpande","year":"2001","journal-title":"ACM SIGMOD Rec"},{"key":"2025041706110721800_ref16","doi-asserted-by":"crossref","first-page":"992","DOI":"10.14778\/3384345.3384349","article-title":"DeepDB: learn from data, not from queries!","volume":"13","author":"Hilprecht","year":"2020","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref17","doi-asserted-by":"publisher","first-page":"61","DOI":"10.14778\/3421424.3421432","article-title":"NeuroCard: one cardinality estimator for all tables","volume":"14","author":"Yang","year":"2020","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref18","first-page":"2","article-title":"Unsupervised selectivity estimation by integrating Gaussian mixture models and an autoregressive model","volume-title":".Proceedings of EDBT, Edinburgh, UK, 29 March-1 April","author":"Meng","year":"2022"},{"key":"2025041706110721800_ref19","doi-asserted-by":"publisher","first-page":"279","DOI":"10.14778\/3368289.3368294","article-title":"Deep unsupervised cardinality estimation","volume":"13","author":"Yang","year":"2019","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref20","first-page":"460","article-title":"ASM in action: Fast and practical learned cardinality estimation","volume-title":"Proceedings of the 2024 International Conference on Management of Data, Santiago, AA, Chile, 14-16 June","author":"Lee","year":"2024"},{"key":"2025041706110721800_ref21","doi-asserted-by":"publisher","first-page":"133190","DOI":"10.1109\/ACCESS.2019.2940729","article-title":"Smartphone and smartwatch-based biometrics using activities of daily living","volume":"7","author":"Weiss","year":"2019","journal-title":"IEEE Access"},{"volume-title":"Vehicle, Snowmobile, and Boat Registrations","year":"2023","author":"State of New York","key":"2025041706110721800_ref22"},{"key":"2025041706110721800_ref23","doi-asserted-by":"publisher","first-page":"204","DOI":"10.14778\/2850583.2850594","article-title":"How good are query optimizers, really?","volume":"9","author":"Leis","year":"2015","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref24","doi-asserted-by":"crossref","first-page":"72","DOI":"10.14778\/3485450.3485458","article-title":"FACE: a normalizing flow based cardinality estimator","volume":"15","author":"Wang","year":"2021","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11280-023-01195-7","article-title":"Cardinality estimation with smoothing autoregressive models","volume":"26","author":"Lin","year":"2023","journal-title":"World Wide Web"},{"key":"2025041706110721800_ref26","first-page":"1477","article-title":"Self-tuning, GPU-accelerated kernel density models for multidimensional selectivity estimation","volume-title":"Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, Melbourne, Victoria, Australia, 31 May-4 June","author":"Heimel","year":"2015"},{"key":"2025041706110721800_ref27","first-page":"1017","article-title":"Quicksel: quick selectivity learning with mixture models","volume-title":"Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, Portland, OR, 14-19 June","author":"Park","year":"2020"},{"key":"2025041706110721800_ref28","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1145\/335191.335448","article-title":"Approximating multi-dimensional aggregate range queries over real attributes","volume":"29","author":"Gunopulos","year":"2000","journal-title":"ACM SIGMOD Rec"},{"key":"2025041706110721800_ref29","doi-asserted-by":"publisher","first-page":"414","DOI":"10.14778\/3494124.3494127","article-title":"Pre-training summarization models of structured datasets for cardinality estimation","volume":"15","author":"Lu","year":"2021","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref30","doi-asserted-by":"crossref","DOI":"10.14778\/3712221.3712231","article-title":"PRICE: a pretrained model for cross-database cardinality estimation","author":"Zeng","year":"2024"},{"key":"2025041706110721800_ref31","first-page":"689","article-title":"Sum-product networks: a new deep architecture","volume-title":"2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 6-13 November","author":"Poon"},{"article-title":"FSPN: a new class of probabilistic graphical model","year":"2020","author":"Wu","key":"2025041706110721800_ref32"},{"key":"2025041706110721800_ref33","doi-asserted-by":"publisher","first-page":"1489","DOI":"10.14778\/3461535.3461539","article-title":"FLAT: fast, lightweight and accurate method for cardinality estimation","volume":"14","author":"Zhu","year":"2021","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref34","doi-asserted-by":"publisher","first-page":"1044","DOI":"10.14778\/3329772.3329780","article-title":"Selectivity estimation for range predicates using lightweight models","volume":"12","author":"Dutt","year":"2019","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref35","first-page":"973","article-title":"Lightweight and accurate cardinality estimation by neural network Gaussian process","volume-title":"Proceedings of the 2022 ACM SIGMOD International Conference on Management of Data, Philadelphia, PA, USA, 12-17 June","author":"Zhao","year":"2022"},{"key":"2025041706110721800_ref36","first-page":"28","article-title":"Equi-depth multidimensional histograms","volume-title":"Proceedings of the 1988 ACM SIGMOD International Conference on Management of Data, Chicago, IL, 1-3 June","author":"Muralikrishna","year":"1988"},{"key":"2025041706110721800_ref37","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1007\/978-3-540-70504-8_12","article-title":"Smooth interpolating histograms with error guarantees","volume-title":"Proceedings of the 25th British National Conference on Databases: Sharing Data, Information and Knowledge, Cardiff, UK, 7-10 July","author":"Neumann","year":"2008"},{"key":"2025041706110721800_ref38","first-page":"14","article-title":"On the relative cost of sampling for join selectivity estimation","volume-title":"Proceedings of the Thirteenth ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, Minneapolis, Minnesota, USA, 24-27 May","author":"Haas","year":"1994"},{"key":"2025041706110721800_ref39","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1145\/376284.375727","article-title":"Selectivity estimation using probabilistic models","volume-title":"Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data, Santa Barbara, CA, 21-24 May","author":"Getoor","year":"2001"},{"key":"2025041706110721800_ref40","doi-asserted-by":"publisher","first-page":"852","DOI":"10.14778\/3402707.3402724","article-title":"Lightweight graphical models for selectivity estimation without independence assumptions","volume":"4","author":"Tzoumas","year":"2011","journal-title":"Proc VLDB Endow"},{"key":"2025041706110721800_ref41","first-page":"1786","article-title":"Sample complexity of testing the manifold hypothesis","volume-title":"Proceedings of the 23rd International Conference on Neural Information Processing Systems, Vancouver, BC, Canada, 6-9 December","author":"Narayanan","year":"2010"},{"key":"2025041706110721800_ref42","first-page":"1310","article-title":"Certified adversarial robustness via randomized smoothing","volume-title":"Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA, 9-15 May","author":"Cohen","year":"2019"},{"key":"2025041706110721800_ref43","first-page":"881","article-title":"MADE: masked autoencoder for distribution estimation","volume-title":"Proceedings of the 32nd International Conference on Machine Learning, Lille, France, 6-11 July","author":"Germain","year":"2015"},{"key":"2025041706110721800_ref44","first-page":"4797","article-title":"Conditional image generation with PixelCNN decoders","volume-title":"Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, Spain, 5-10 December","author":"Oord","year":"2016"},{"key":"2025041706110721800_ref45","first-page":"5998","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv Neural Inf Process Syst"},{"key":"2025041706110721800_ref46","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21606-5","volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer Series in Statistics","author":"Hastie","year":"2001"},{"volume-title":"Row Estimation in PostgreSQL","year":"2018","author":"PostgreSQL","key":"2025041706110721800_ref47"},{"key":"2025041706110721800_ref48","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1109\/TIT.1968.1054142","article-title":"Approximating discrete probability distributions with dependence trees","volume":"14","author":"Chow","year":"1968","journal-title":"IEEE Trans on Inf Theory"},{"key":"2025041706110721800_ref49","first-page":"2009","article-title":"A unified deep model of learning from both data and queries for cardinality estimation","volume-title":"Proceedings of the 2021 International Conference on Management of Data, Virtual Event, China, 20-25 June","author":"Wu","year":"2021"},{"key":"2025041706110721800_ref50","first-page":"1035","article-title":"Deep learning models for selectivity estimation of multi-attribute queries","volume-title":"Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, Portland, OR, 14-19 June","author":"Hasan","year":"2020"},{"key":"2025041706110721800_ref51","doi-asserted-by":"publisher","first-page":"752","DOI":"10.14778\/3503585.3503586","article-title":"Cardinality estimation in DBMS: a comprehensive benchmark evaluation","volume":"15","author":"Han","year":"2021","journal-title":"Proc VLDB Endow"}],"container-title":["The Computer Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/comjnl\/advance-article-pdf\/doi\/10.1093\/comjnl\/bxae117\/60584531\/bxae117.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/comjnl\/advance-article-pdf\/doi\/10.1093\/comjnl\/bxae117\/60584531\/bxae117.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,17]],"date-time":"2025-04-17T10:11:50Z","timestamp":1744884710000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/comjnl\/article\/68\/4\/360\/7889121"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,11]]},"references-count":51,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,11,11]]},"published-print":{"date-parts":[[2025,4,12]]}},"URL":"https:\/\/doi.org\/10.1093\/comjnl\/bxae117","relation":{},"ISSN":["0010-4620","1460-2067"],"issn-type":[{"type":"print","value":"0010-4620"},{"type":"electronic","value":"1460-2067"}],"subject":[],"published-other":{"date-parts":[[2025,4]]},"published":{"date-parts":[[2024,11,11]]}}}