{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T00:02:26Z","timestamp":1779062546597,"version":"3.51.4"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2020,3,16]],"date-time":"2020-03-16T00:00:00Z","timestamp":1584316800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,3,16]],"date-time":"2020-03-16T00:00:00Z","timestamp":1584316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Distrib Parallel Databases"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Challenges for self-driving database systems, which tune their physical design and configuration autonomously, are manifold: Such systems have to anticipate future workloads, find robust configurations efficiently, and incorporate knowledge gained by previous actions into later decisions. We present a component-based framework for self-driving database systems that enables database integration and development of self-managing functionality with low overhead by relying on separation of concerns. By keeping the components of the framework reusable and exchangeable, experiments are simplified, which promotes further research in that area. Moreover, to optimize multiple mutually dependent features, e.g., index selection and compression configurations, we propose a linear programming (LP) based algorithm to derive an efficient tuning order automatically. Afterwards, we demonstrate the applicability and scalability of our approach with reproducible examples.<\/jats:p>","DOI":"10.1007\/s10619-020-07288-w","type":"journal-article","created":{"date-parts":[[2020,3,16]],"date-time":"2020-03-16T09:04:23Z","timestamp":1584349463000},"page":"795-817","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Self-driving database systems: a conceptual approach"],"prefix":"10.1007","volume":"38","author":[{"given":"Jan","family":"Kossmann","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rainer","family":"Schlosser","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,3,16]]},"reference":[{"key":"7288_CR1","doi-asserted-by":"crossref","unstructured":"Akdere, M., \u00c7etintemel, U., Riondato, M., Upfal, E., Zdonik, S.B.: Learning-based query performance modeling and prediction. In: Proceedings of the International Conference on Data Engineering (ICDE), pp. 390\u2013401 (2012)","DOI":"10.1109\/ICDE.2012.64"},{"key":"7288_CR2","volume-title":"Robust Optimization. Vol. 28. Princeton Series in Applied Mathematics","author":"A Ben-Tal","year":"2009","unstructured":"Ben-Tal, A., El Ghaoui, L., Arkadi, N.: Robust Optimization. Vol. 28. Princeton Series in Applied Mathematics. Princeton University Press, Princeton (2009)"},{"key":"7288_CR3","unstructured":"Boissier, M., Jendruk, M.: Workload-driven and robust selection of compression schemes for column stores. In: Proceedings of the International Conference on Extending Database Technology (EDBT), pp. 674\u2013677 (2019)"},{"key":"7288_CR4","unstructured":"Chaudhuri, S., Narasayya, V.R.: An efficient cost-driven index selection tool for Microsoft SQL server. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 146\u2013155 (1997)"},{"key":"7288_CR5","doi-asserted-by":"crossref","unstructured":"Chaudhuri, S., Weikum, G.: Self-management technology in databases. In: Encyclopedia of Database Systems, pp. 2550\u20132555 (2009)","DOI":"10.1007\/978-0-387-39940-9_334"},{"key":"7288_CR6","doi-asserted-by":"crossref","unstructured":"Chaudhuri, S., Kumar G., Ashish, N., Vivek R.: Compressing SQL workloads. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 488\u2013499 (2002)","DOI":"10.1145\/564691.564747"},{"key":"7288_CR7","doi-asserted-by":"crossref","unstructured":"Chaudhuri, S., Ganesan, P., Narasayya, V.R.: Primitives for workload summarization and implications for SQL. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 730\u2013741 (2003)","DOI":"10.1016\/B978-012722442-8\/50070-7"},{"key":"7288_CR8","unstructured":"Chaudhuri, S., Narasayya, V.R.: Self-tuning database systems: a decade of progress. In: Proceedings of the International Conference on Very Large Data Bases (VLDB), pp. 3\u201314 (2007)"},{"key":"7288_CR9","doi-asserted-by":"crossref","unstructured":"Curino, C., Zhang, Y., Jones, E.P.C., Madden, S.: Schism: aWorkload-driven approach to database replication and partitioning. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 48\u201357 (2010)","DOI":"10.14778\/1920841.1920853"},{"key":"7288_CR10","doi-asserted-by":"crossref","unstructured":"Das, S., et al.: Automatically indexing millions of databases in Microsoft Azure SQL database. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 666\u2013679 (2019)","DOI":"10.1145\/3299869.3314035"},{"key":"7288_CR11","doi-asserted-by":"crossref","unstructured":"Dash, D., Polyzotis, N., Ailamaki, A.: CoPhy: a scalable, portable, and interactive index advisor for large workloads. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 362\u2013372 (2011)","DOI":"10.14778\/1978665.1978668"},{"key":"7288_CR12","doi-asserted-by":"crossref","unstructured":"Ding, B., et al.: AI Meets AI: leveraging query executions to improve index recommendations. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 1241\u20131258 (2019)","DOI":"10.1145\/3299869.3324957"},{"key":"7288_CR13","unstructured":"Dreseler, M., et al.: Hyrise Re-engineered: an extensible database system for research in relational in-memory data management. In: Proceedings of the International Conference on Extending Database Technology (EDBT), pp. 313\u2013324 (2019)"},{"key":"7288_CR14","doi-asserted-by":"crossref","unstructured":"Elnaffar, S., Patrick M., Horman, R.: Automatically classifying database workloads. In: Proceedings of the International Conference on Information and Knowledge Management (CIKM), pp. 622\u2013624 (2002)","DOI":"10.1145\/584792.584898"},{"key":"7288_CR15","doi-asserted-by":"crossref","unstructured":"Halfpap, S., Schlosser, R.: Workload-driven fragment allocation for partially replicated databases using linear programming. In: Proceedings of the International Conference on Data Engineering (ICDE), pp. 1746\u20131749 (2019)","DOI":"10.1109\/ICDE.2019.00188"},{"issue":"1","key":"7288_CR16","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1109\/MC.2003.1160055","volume":"36","author":"JO Kephart","year":"2003","unstructured":"Kephart, J.O., Chess, D.M.: The vision of autonomic computing. IEEE Comput. 36(1), 41\u201350 (2003)","journal-title":"IEEE Comput."},{"key":"7288_CR17","unstructured":"Kipf, A., et al.: Learned cardinalities: estimating correlated joins with deep learning. In: Online Proceedings of the Biennial Conference on Innovative Data Systems Research (CIDR) (2019)"},{"key":"7288_CR18","doi-asserted-by":"crossref","unstructured":"Kossmann, J., Schlosser, R.: A framework for self-managing database systems. In: Proceedings of the International Conference on Data Engineering ICDE Workshops, pp. 100\u2013106 (2019)","DOI":"10.1109\/ICDEW.2019.00-27"},{"key":"7288_CR19","unstructured":"Kraska, T., et al.: SageDB: a learned database system. In: Online Proceedings of the Biennial Conference on Innovative Data Systems Research (CIDR) (2019)"},{"key":"7288_CR20","doi-asserted-by":"crossref","unstructured":"Kratica, J., Ljubic, I., Tosic, D.: A genetic algorithm for the index selection problem. In: Proceedings of the Applications of Evolutionary Computing, EvoWorkshop, pp. 280\u2013290 (2003)","DOI":"10.1007\/3-540-36605-9_26"},{"key":"7288_CR21","doi-asserted-by":"crossref","unstructured":"Li, J., Christian K\u00f6nig, A., Narasayya, V.R., Chaudhuri, S.: Robust estimation of resource consumption for sql queries using statistical techniques. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 1555\u20131566 (2012)","DOI":"10.14778\/2350229.2350269"},{"key":"7288_CR22","doi-asserted-by":"crossref","unstructured":"Lightstone, S., Bhattacharjee, B.: Automated design of multidimensional clustering tables for relational databases. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 1170\u20131181 (2004)","DOI":"10.1016\/B978-012088469-8.50102-9"},{"key":"7288_CR23","doi-asserted-by":"crossref","unstructured":"Ma, L., et al.: Query-based workload forecasting for self-driving database management systems. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 631\u2013645 (2018)","DOI":"10.1145\/3183713.3196908"},{"issue":"11","key":"7288_CR24","first-page":"1733","volume":"12","author":"RC Marcus","year":"2019","unstructured":"Marcus, R.C., Papaemmanouil, O.: Plan-structured deep neural network models for query performance prediction. Proc. Int. Conf. Very Large Databases (VLDB) 12(11), 1733\u20131746 (2019)","journal-title":"Proc. Int. Conf. Very Large Databases (VLDB)"},{"key":"7288_CR25","doi-asserted-by":"crossref","unstructured":"Marcus, R., Papaemmanouil, O., Semenova, S., Garber, S.: NashDB: an end-to-end economic method for elastic database fragmentation, replication, and provisioning. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 1253\u20131267 (2018)","DOI":"10.1145\/3183713.3196935"},{"key":"7288_CR26","unstructured":"Martin, P., Elnaffar, S., Wasserman, T.J.: Workload models for autonomic database management systems. In: Proceedings of the International Conference on Autonomic and Autonomous Systems (ICAS) (2006)"},{"key":"7288_CR27","unstructured":"Microsoft.: Query processing architecture guide\u2014execution plan caching and reuse. https:\/\/docs.microsoft.com\/en-US\/sql\/relational-databases\/query-processing-architecture-guide?view=sql-server-ver15#execution-plan-caching-and-reuse (2019)"},{"key":"7288_CR28","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/3927.001.0001","volume-title":"An Introduction to Genetic Algorithms","author":"M Mitchell","year":"1998","unstructured":"Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)"},{"key":"7288_CR29","doi-asserted-by":"crossref","unstructured":"Mozafari, B., Goh, E.Z.Y., Yoon, D.Y.: Cliff-guard: a principled framework for finding robust database designs. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 1167\u20131182 (2015)","DOI":"10.1145\/2723372.2749454"},{"key":"7288_CR30","unstructured":"Oracle: World\u2019s First \u201cSelf-Driving\u201d Database, 2018. https:\/\/www.oracle.com\/database\/autonomous-database\/feature.html (2019)"},{"key":"7288_CR31","unstructured":"Pavlo, A., et al.: Self-driving database management systems. In: Online Proceedings of the Biennial Conference on Innovative Data Systems Research (CIDR) (2017)"},{"issue":"2","key":"7288_CR32","first-page":"31","volume":"42","author":"A Pavlo","year":"2019","unstructured":"Pavlo, A., et al.: External vs. internal: an essay on machine learning agents for autonomous database management systems. IEEE Data Eng. Bull. 42(2), 31\u201345 (2019)","journal-title":"IEEE Data Eng. Bull."},{"key":"7288_CR33","unstructured":"SAP: Analyzing SQL execution with the SQL plan cache. 2019. https:\/\/help.sap.com\/viewer\/bed8c14f9f024763b0777aa72b5436f6\/2.0.04\/en-US\/bed20ba0bb57101483ffa333cf3e55c8.html (2019)"},{"key":"7288_CR34","doi-asserted-by":"crossref","unstructured":"Schlosser, R., Kossmann, J., Boissier, M.: Efficient scalable multi-attribute index selection using recursive strategies. In: Proceedings of the International Conference on Data Engineering (ICDE), pp. 1238\u20131249 (2019)","DOI":"10.1109\/ICDE.2019.00113"},{"key":"7288_CR35","doi-asserted-by":"crossref","unstructured":"Sun, J., Li, G.: An end-to-end learning-based cost estimator. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 307\u2013319 (2019)","DOI":"10.14778\/3368289.3368296"},{"key":"7288_CR36","doi-asserted-by":"crossref","unstructured":"Tan, Z., Babu, S.: Tempo: robust and self-tuning resource management in multi-tenant parallel databases. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 720\u2013731 (2016)","DOI":"10.14778\/2977797.2977799"},{"key":"7288_CR37","doi-asserted-by":"crossref","unstructured":"Tran, Q.T., Morfonios, K., Polyzotis, N.: Oracle workload intelligence. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 1669\u20131681 (2015)","DOI":"10.1145\/2723372.2742791"},{"key":"7288_CR38","unstructured":"Valentin, G., Zuliani, M., Zilio, D.C., Lohman, G.M., Skelley, A.: DB2 advisor: an optimizer smart enough to recommend its own indexes. In: Proceedings of the International Conference on Data Engineering (ICDE), pp. 101\u2013110 (2000)"},{"key":"7288_CR39","doi-asserted-by":"crossref","unstructured":"Van Aken, D., Pavlo, A., Gordon, G.J., Zhang, B.: Automatic database management system tuning through large-scale machine learning. In: Proceedings of the International Conference on Management of Data (SIGMOD), pp. 1009\u20131024 (2017)","DOI":"10.1145\/3035918.3064029"},{"key":"7288_CR40","unstructured":"Vogelsgesang, A., et al.: Get real: how benchmarks fail to represent the real world. In: Proceedings of the International Workshop on Testing Database Systems, pp. 1:1\u20131:6 . DBTest@SIGMOD 2018, Houston, TX, USA, June 15, 2018 (2018)"},{"key":"7288_CR41","doi-asserted-by":"crossref","unstructured":"Weikum, G., M\u00f6nkeberg, A., Hasse, C., Zabback, P.: Self-tuning database technology and information services: from wishful thinking to viable engineering. In: Proceedings of the International Conference on Very Large Databases (VLDB), pp. 20\u201331 (2002)","DOI":"10.1016\/B978-155860869-6\/50011-1"},{"key":"7288_CR42","doi-asserted-by":"crossref","unstructured":"Zilio, D.C., et al.: DB2 design advisor: integrated automatic physical database design. In: Proceedings of the International Conference on Very Large Data Bases (VLDB), pp. 1087\u20131097 (2004)","DOI":"10.1016\/B978-012088469-8.50095-4"}],"container-title":["Distributed and Parallel Databases"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10619-020-07288-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10619-020-07288-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10619-020-07288-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,16]],"date-time":"2021-03-16T00:20:45Z","timestamp":1615854045000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10619-020-07288-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,16]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["7288"],"URL":"https:\/\/doi.org\/10.1007\/s10619-020-07288-w","relation":{},"ISSN":["0926-8782","1573-7578"],"issn-type":[{"value":"0926-8782","type":"print"},{"value":"1573-7578","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,16]]},"assertion":[{"value":"16 March 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}