{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T02:23:37Z","timestamp":1779330217099,"version":"3.51.4"},"reference-count":100,"publisher":"Association for Computing Machinery (ACM)","issue":"9","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2021,5]]},"abstract":"<jats:p>\n            Cardinality estimation is a fundamental but long unresolved problem in query optimization. Recently, multiple papers from different research groups consistently report that learned models have the potential to replace existing cardinality estimators. In this paper, we ask a forward-thinking question:\n            <jats:italic>Are we ready to deploy these learned cardinality models in production?<\/jats:italic>\n            Our study consists of three main parts. Firstly, we focus on the static environment (i.e., no data updates) and compare five new learned methods with nine traditional methods on four real-world datasets under a unified workload setting. The results show that learned models are indeed more accurate than traditional methods, but they often suffer from high training and inference costs. Secondly, we explore whether these learned models are ready for dynamic environments (i.e., frequent data updates). We find that they cannot catch up with fast data updates and return large errors for different reasons. For less frequent updates, they can perform better but there is no clear winner among themselves. Thirdly, we take a deeper look into learned models and explore when they may go wrong. Our results show that the performance of learned methods can be greatly affected by the changes in correlation, skewness, or domain size. More importantly, their behaviors are much harder to interpret and often unpredictable. Based on these findings, we identify two promising research directions (control the cost of learned models and make learned models trustworthy) and suggest a number of research opportunities. We hope that our study can guide researchers and practitioners to work together to eventually push learned cardinality estimators into real database systems.\n          <\/jats:p>","DOI":"10.14778\/3461535.3461552","type":"journal-article","created":{"date-parts":[[2021,10,22]],"date-time":"2021-10-22T22:22:49Z","timestamp":1634941369000},"page":"1640-1654","source":"Crossref","is-referenced-by-count":95,"title":["Are we ready for learned cardinality estimation?"],"prefix":"10.14778","volume":"14","author":[{"given":"Xiaoying","family":"Wang","sequence":"first","affiliation":[{"name":"Simon Fraser University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Changbo","family":"Qu","sequence":"additional","affiliation":[{"name":"Simon Fraser University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiyuan","family":"Wu","sequence":"additional","affiliation":[{"name":"Simon Fraser University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiannan","family":"Wang","sequence":"additional","affiliation":[{"name":"Simon Fraser University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingqing","family":"Zhou","sequence":"additional","affiliation":[{"name":"Tencent Inc"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/304182.304198"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465351.2465355"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2015.7363736"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3190662"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2188395"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/376284.375686"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3319894"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/3008751.3008807"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/191843.191874"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_11_1","volume-title":"A survey of model compression and acceleration for deep neural networks. CoRR, abs\/1710.09282","author":"Cheng Y.","year":"2017"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2014.2310059"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1968.1054142"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/376284.375685"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/3091622.3091646"},{"key":"e_1_2_1_16_1","volume-title":"UCI machine learning repository","author":"Dua D."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.14778\/3407790.3407820"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/3329772.3329780"},{"issue":"2","key":"e_1_2_1_19_1","first-page":"105","article-title":"Log-transformation and its implications for data analysis","volume":"26","author":"C. FENG, H. WANG, N. LU, T. CHEN, H. HE, Y.","year":"2014","journal-title":"Shanghai Archives of Psychiatry"},{"key":"e_1_2_1_20_1","volume-title":"Non-negative networks against adversarial attacks. CoRR, abs\/1806.06108","author":"Fleshman W.","year":"2018"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/153850.153872"},{"key":"e_1_2_1_22_1","volume-title":"Dresden University of Technology","author":"Gemulla R.","year":"2008"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/3045118.3045213"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/376284.375727"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335448"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-003-0090-4"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3186728.3164145"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389741"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2749438"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.14778\/3384345.3384349"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/376284.375687"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3190656"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.14778\/3151106.3151112"},{"key":"e_1_2_1_34_1","volume-title":"CIDR 2019, 9th Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 13--16, 2019, Online Proceedings. www.cidrdb.org","author":"Kipf A.","year":"2019"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305381.3305576"},{"key":"e_1_2_1_36_1","volume-title":"CEAS'09: sixth conference on email and anti-spam","author":"Ko\u0142cz A.","year":"2009"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3196909"},{"key":"e_1_2_1_38_1","volume-title":"Learning to optimize join queries with deep reinforcement learning. CoRR, abs\/1808.03196","author":"Krishnan S.","year":"2018"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389752"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939874"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/645924.671200"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.14778\/2850583.2850594"},{"key":"e_1_2_1_43_1","volume-title":"CIDR 2017, 8th Biennial Conference on Innovative Data Systems Research, Chaminade, CA, USA, January 8--11, 2017, Online Proceedings. www.cidrdb.org","author":"Leis V.","year":"2017"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9991(78)90004-9"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2915235"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3242042"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/1315451.1315484"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/93605.93611"},{"key":"e_1_2_1_49_1","first-page":"53","volume-title":"Proceedings of 25th Annual International Conference on Computer Science and Software Engineering, CASCON 2015","author":"Liu H.","year":"2015"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/2999611.2999612"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014333932021"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295230"},{"key":"e_1_2_1_53_1","volume-title":"11th Conference on Innovative Data Systems Research, CIDR 2021, Virtual Event, January 11--15, 2021, Online Proceedings. www.cidrdb.org","author":"Ma Q.","year":"2021"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3324958"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3211954.3211957"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.14778\/3342263.3342644"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/1083592.1083638"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/276305.276344"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687738"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.14778\/3213880.3213882"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/971701.50205"},{"key":"e_1_2_1_62_1","volume-title":"of New York. Vehicle, snowmobile, and boat registrations. catalog.data.gov\/dataset\/vehicle-snowmobile-and-boat-registration","author":"S.","year":"2019"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209889.3209890"},{"key":"e_1_2_1_64_1","volume-title":"An empirical analysis of deep learning for cardinality estimation. CoRR, abs\/1905.06425","author":"Ortiz J.","year":"2019"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3196905"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389727"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455008"},{"key":"e_1_2_1_68_1","volume-title":"HAIS 2018, Oviedo, Spain, June 20--22, 2018, Proceedings","volume":"10870","author":"Pedrozo W. G.","year":"2018"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3183747"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00191"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/971697.602294"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.5555\/3020548.3020588"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.5555\/645923.673638"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/235968.233342"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_76_1","first-page":"1527","volume-title":"Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18)","author":"Ribeiro M. T.","year":"2018"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.5555\/2034117.2034160"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2494218"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305890.3306006"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595637"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2006.84"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.14778\/3368289.3368296"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305890.3306024"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.14778\/3339490.3339503"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00117"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505756"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3300088"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402707.3402724"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_1_90_1","volume-title":"Fundamental Algorithms for Scientific Computing in Python. Nature Methods, 17:261--272","author":"Virtanen P.","year":"2020"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3329859.3329875"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882914"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/376284.375724"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.14778\/3421424.3421432"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.14778\/3368289.3368294"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00116"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137765.3137785"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3300085"},{"key":"e_1_2_1_99_1","unstructured":"Q. Zhou. An experimental relational optimizer and executor. https:\/\/github.com\/zhouqingqing\/qpmodel. Accessed: 2020-11-30.  Q. Zhou. An experimental relational optimizer and executor. https:\/\/github.com\/zhouqingqing\/qpmodel. Accessed: 2020-11-30."},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2020.2994641"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3461535.3461552","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T09:50:37Z","timestamp":1672221037000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3461535.3461552"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5]]},"references-count":100,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2021,5]]}},"alternative-id":["10.14778\/3461535.3461552"],"URL":"https:\/\/doi.org\/10.14778\/3461535.3461552","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2021,5]]}}}