{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:05Z","timestamp":1750220345852,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":47,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,7,7]],"date-time":"2021-07-07T00:00:00Z","timestamp":1625616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001942","name":"CHIST-ERA","doi-asserted-by":"publisher","award":["CHIST-ERA-17-BDSI-001 ABIDI"],"award-info":[{"award-number":["CHIST-ERA-17-BDSI-001 ABIDI"]}],"id":[{"id":"10.13039\/501100001942","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,7]]},"DOI":"10.1145\/3449726.3463180","type":"proceedings-article","created":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T14:51:34Z","timestamp":1625755894000},"page":"1614-1621","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Determining a consistent experimental setup for benchmarking and optimizing databases"],"prefix":"10.1145","author":[{"given":"Mois\u00e9s","family":"Silva-Mu\u00f1oz","sequence":"first","affiliation":[{"name":"Universit\u00e9 Libre de Bruxelles (ULB), Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gonzalo","family":"Calderon","sequence":"additional","affiliation":[{"name":"Universidad Politecnica de Madrid (UPM), Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alberto","family":"Franzin","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Libre de Bruxelles (ULB), Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hugues","family":"Bersini","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Libre de Bruxelles (ULB), Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,7,8]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_3_2_1_1_1","DOI":"10.1007\/978-3-319-10085-2_18"},{"key":"e_1_3_2_1_2_1","first-page":"23","article-title":"Performance evaluation of NoSQL systems using YCSB in a resource austere environment","volume":"7","author":"Abubakar Yusuf","year":"2014","unstructured":"Yusuf Abubakar , Thankgod Sani Adeyi , and Ibrahim Gambo Auta . 2014 . Performance evaluation of NoSQL systems using YCSB in a resource austere environment . Performance Evaluation 7 , 8 (2014), 23 -- 27 . Yusuf Abubakar, Thankgod Sani Adeyi, and Ibrahim Gambo Auta. 2014. Performance evaluation of NoSQL systems using YCSB in a resource austere environment. Performance Evaluation 7, 8 (2014), 23--27.","journal-title":"Performance Evaluation"},{"key":"e_1_3_2_1_3_1","volume-title":"Available online at https:\/\/cassandra.apache.org\/doc\/latest\/tools\/cassandra_stress.html 1","author":"Apache Cassandra","year":"2021","unstructured":"Cassandra Apache . 2021. Cassandra Stress . Website. Available online at https:\/\/cassandra.apache.org\/doc\/latest\/tools\/cassandra_stress.html 1 ( 2021 ). Cassandra Apache. 2021. Cassandra Stress. Website. Available online at https:\/\/cassandra.apache.org\/doc\/latest\/tools\/cassandra_stress.html 1 (2021)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_4_1","DOI":"10.1016\/j.comcom.2019.10.002"},{"key":"e_1_3_2_1_5_1","volume-title":"Technology Conference on Performance Evaluation and Benchmarking. Springer, 197--208","author":"Baru Chaitanya","year":"2012","unstructured":"Chaitanya Baru , Milind Bhandarkar , Raghunath Nambiar , Meikel Poess , and Tilmann Rabl . 2012 . Setting the direction for big data benchmark standards . In Technology Conference on Performance Evaluation and Benchmarking. Springer, 197--208 . Chaitanya Baru, Milind Bhandarkar, Raghunath Nambiar, Meikel Poess, and Tilmann Rabl. 2012. Setting the direction for big data benchmark standards. In Technology Conference on Performance Evaluation and Benchmarking. Springer, 197--208."},{"key":"e_1_3_2_1_6_1","volume-title":"SIGIR workshop on open source information retrieval. 17","author":"Bia\u0142ecki Andrzej","year":"2012","unstructured":"Andrzej Bia\u0142ecki , Robert Muir , Grant Ingersoll , and Lucid Imagination . 2012 . Apache lucene 4 . In SIGIR workshop on open source information retrieval. 17 . Andrzej Bia\u0142ecki, Robert Muir, Grant Ingersoll, and Lucid Imagination. 2012. Apache lucene 4. In SIGIR workshop on open source information retrieval. 17."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_7_1","DOI":"10.1016\/j.future.2018.05.080"},{"key":"e_1_3_2_1_8_1","volume-title":"2018 USENIX Annual Technical Conference (USENIX ATC 18)","author":"Cao Zhen","year":"2018","unstructured":"Zhen Cao , Vasily Tarasov , Sachin Tiwari , and Erez Zadok . 2018 . Towards better understanding of black-box auto-tuning: A comparative analysis for storage systems . In 2018 USENIX Annual Technical Conference (USENIX ATC 18) . 893--907. Zhen Cao, Vasily Tarasov, Sachin Tiwari, and Erez Zadok. 2018. Towards better understanding of black-box auto-tuning: A comparative analysis for storage systems. In 2018 USENIX Annual Technical Conference (USENIX ATC 18). 893--907."},{"key":"e_1_3_2_1_9_1","volume-title":"Apache cassandra. Website. Available online at https:\/\/www.datastax.com\/cassandra 13","author":"Cassandra Apache","year":"2014","unstructured":"Apache Cassandra . 2014. Apache cassandra. Website. Available online at https:\/\/www.datastax.com\/cassandra 13 ( 2014 ). Apache Cassandra. 2014. Apache cassandra. Website. Available online at https:\/\/www.datastax.com\/cassandra 13 (2014)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_10_1","DOI":"10.1007\/s11192-010-0289-2"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_11_1","DOI":"10.1145\/1807128.1807152"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_12_1","DOI":"10.1016\/j.is.2016.07.009"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_13_1","DOI":"10.1109\/CloudCom.2012.6427516"},{"key":"e_1_3_2_1_14_1","volume-title":"Hdconfigor: Automatically Tuning High Dimensional Configuration Parameters for Log Search Engines","author":"Dou Hui","year":"2020","unstructured":"Hui Dou , Pengfei Chen , and Zibin Zheng . 2020 . Hdconfigor: Automatically Tuning High Dimensional Configuration Parameters for Log Search Engines . IEEE Access 8 (apr 2020), 80638--80653. Hui Dou, Pengfei Chen, and Zibin Zheng. 2020. Hdconfigor: Automatically Tuning High Dimensional Configuration Parameters for Log Search Engines. IEEE Access 8 (apr 2020), 80638--80653."},{"key":"e_1_3_2_1_15_1","volume-title":"Available online at https:\/\/esrally.readthedocs.io\/en\/stable\/index.html 1","author":"Website Rally","year":"2021","unstructured":"Elasticsearch. 2021. Rally 2.1.0. Website . Available online at https:\/\/esrally.readthedocs.io\/en\/stable\/index.html 1 ( 2021 ). Elasticsearch. 2021. Rally 2.1.0. Website. Available online at https:\/\/esrally.readthedocs.io\/en\/stable\/index.html 1 (2021)."},{"key":"e_1_3_2_1_16_1","volume-title":"SEPT-search engine and processing tool (Query DSL). (Sep","author":"Filip Adrian","year":"2019","unstructured":"Adrian Filip , Vadim Doga , Tatiana Poleacov , and Nina Cavcaliuc . 2019. SEPT-search engine and processing tool (Query DSL). (Sep . 2019 ). Adrian Filip, Vadim Doga, Tatiana Poleacov, and Nina Cavcaliuc. 2019. SEPT-search engine and processing tool (Query DSL). (Sep. 2019)."},{"key":"e_1_3_2_1_17_1","volume-title":"Proceedings of the 32nd Benelux Conference on Artificial Intelligence. 56--70","author":"Franzin Alberto","year":"2020","unstructured":"Alberto Franzin , Raph\u00e4el Gyory , Jean-Charles Nad\u00e9 , Guillaume Aubert , Georges Klenkle , and Hugues Bersini . 2020 . Phil\u00e9as: Anomaly Detection for IoT Monitoring .. In Proceedings of the 32nd Benelux Conference on Artificial Intelligence. 56--70 . Alberto Franzin, Raph\u00e4el Gyory, Jean-Charles Nad\u00e9, Guillaume Aubert, Georges Klenkle, and Hugues Bersini. 2020. Phil\u00e9as: Anomaly Detection for IoT Monitoring.. In Proceedings of the 32nd Benelux Conference on Artificial Intelligence. 56--70."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_18_1","DOI":"10.1023\/B:JIMS.0000010073.54241.e7"},{"volume-title":"Elasticsearch: the definitive guide: a distributed real-time search and analytics engine","author":"Gormley Clinton","unstructured":"Clinton Gormley and Zachary Tong . 2015. Elasticsearch: the definitive guide: a distributed real-time search and analytics engine . O'Reilly Media, Inc. Clinton Gormley and Zachary Tong. 2015. Elasticsearch: the definitive guide: a distributed real-time search and analytics engine. O'Reilly Media, Inc.","key":"e_1_3_2_1_19_1"},{"doi-asserted-by":"crossref","unstructured":"Gerard Haughian Rasha Osman and W. Knottenbelt. 2016. Benchmarking Replication in Cassandra and MongoDB NoSQL Datastores. In DEXA.  Gerard Haughian Rasha Osman and W. Knottenbelt. 2016. Benchmarking Replication in Cassandra and MongoDB NoSQL Datastores. In DEXA.","key":"e_1_3_2_1_20_1","DOI":"10.1007\/978-3-319-44406-2_12"},{"key":"e_1_3_2_1_21_1","volume-title":"Proc. ANA Sr. Marketer's Summit","author":"Humby Clive","year":"2006","unstructured":"Clive Humby . 2006 . Data is the new oil . Proc. ANA Sr. Marketer's Summit . Evanston, IL, USA (2006). Clive Humby. 2006. Data is the new oil. Proc. ANA Sr. Marketer's Summit. Evanston, IL, USA (2006)."},{"volume-title":"Towards User-Centric Transport in Europe","author":"Javornik Marko","unstructured":"Marko Javornik , Nives Nadoh , and Dustin Lange . 2019. Data is the new oil . In Towards User-Centric Transport in Europe . Springer , 295--308. Marko Javornik, Nives Nadoh, and Dustin Lange. 2019. Data is the new oil. In Towards User-Centric Transport in Europe. Springer, 295--308.","key":"e_1_3_2_1_22_1"},{"key":"e_1_3_2_1_23_1","volume-title":"Syed Arshad Ali, and Mansaf Alam","author":"Khan Samiya","year":"2019","unstructured":"Samiya Khan , Xiufeng Liu , Syed Arshad Ali, and Mansaf Alam . 2019 . Storage solutions for big data systems: A qualitative study and comparison. arXiv preprint arXiv:1904.11498 (2019). Samiya Khan, Xiufeng Liu, Syed Arshad Ali, and Mansaf Alam. 2019. Storage solutions for big data systems: A qualitative study and comparison. arXiv preprint arXiv:1904.11498 (2019)."},{"key":"e_1_3_2_1_24_1","volume-title":"Learning to optimize join queries with deep reinforcement learning. arXiv preprint arXiv:1808.03196","author":"Krishnan Sanjay","year":"2018","unstructured":"Sanjay Krishnan , Zongheng Yang , Ken Goldberg , Joseph Hellerstein , and Ion Stoica . 2018. Learning to optimize join queries with deep reinforcement learning. arXiv preprint arXiv:1808.03196 ( 2018 ), 1--19. Sanjay Krishnan, Zongheng Yang, Ken Goldberg, Joseph Hellerstein, and Ion Stoica. 2018. Learning to optimize join queries with deep reinforcement learning. arXiv preprint arXiv:1808.03196 (2018), 1--19."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_25_1","DOI":"10.14778\/2732977.2732995"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_26_1","DOI":"10.1377\/hlthaff.2017.1595"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_27_1","DOI":"10.1109\/ACCESS.2020.2979812"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_28_1","DOI":"10.1016\/j.orp.2016.09.002"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_29_1","DOI":"10.14778\/3352063.3352112"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_30_1","DOI":"10.1016\/j.suscom.2019.01.017"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_31_1","DOI":"10.1109\/COMSNETS.2017.7945437"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_32_1","DOI":"10.1145\/3135974.3135991"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_33_1","DOI":"10.1145\/2038916.2038925"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_34_1","DOI":"10.1145\/3209950.3209955"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_35_1","DOI":"10.1145\/3053600.3053622"},{"doi-asserted-by":"crossref","unstructured":"Mois\u00e9s Silva-Mu\u00f1oz Alberto Franzin and Hugues Bersini. 2021. Automatic configuration of the Cassandra database using irace. (2021). Under review.  Mois\u00e9s Silva-Mu\u00f1oz Alberto Franzin and Hugues Bersini. 2021. Automatic configuration of the Cassandra database using irace. (2021). Under review.","key":"e_1_3_2_1_36_1","DOI":"10.7717\/peerj-cs.634"},{"unstructured":"Mois\u00e9s Silva-Mu\u00f1oz Alberto Franzin and Hugues Bersini. 2020. Supplementary Material for: Automatic configuration of the Cassandra database using irace. http:\/\/iridia.ulb.ac.be\/supp\/IridiaSupp2020-014.  Mois\u00e9s Silva-Mu\u00f1oz Alberto Franzin and Hugues Bersini. 2020. Supplementary Material for: Automatic configuration of the Cassandra database using irace. http:\/\/iridia.ulb.ac.be\/supp\/IridiaSupp2020-014.","key":"e_1_3_2_1_37_1"},{"unstructured":"Mohamad Sobhie. 2019. Tuning of Elasticsearch Configuration-Parameter Optimization Through Simultaneous Perturbation Stochastic Approximation Algorithm. Master's thesis.  Mohamad Sobhie. 2019. Tuning of Elasticsearch Configuration-Parameter Optimization Through Simultaneous Perturbation Stochastic Approximation Algorithm. Master's thesis.","key":"e_1_3_2_1_38_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_39_1","DOI":"10.1109\/BigDataCongress.2016.49"},{"unstructured":"Transaction Processing Performance Council TPC. 2010. TPC BENCHMARK\u2122E. (2010).  Transaction Processing Performance Council TPC. 2010. TPC BENCHMARK \u2122 E. (2010).","key":"e_1_3_2_1_40_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_41_1","DOI":"10.1145\/3035918.3064029"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_42_1","DOI":"10.1109\/CSSS.2012.336"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_43_1","DOI":"10.1007\/978-3-319-13021-7_6"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_44_1","DOI":"10.1145\/3299869.3300085"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_45_1","DOI":"10.1007\/978-3-319-09333-8_1"},{"key":"e_1_3_2_1_46_1","volume-title":"Database Meets Artificial Intelligence: A Survey","author":"Zhou Xuanhe","year":"2020","unstructured":"Xuanhe Zhou , Chengliang Chai , Guoliang Li , and Ji Sun . 2020. Database Meets Artificial Intelligence: A Survey . IEEE Transactions on Knowledge and Data Engineering ( 2020 ). Xuanhe Zhou, Chengliang Chai, Guoliang Li, and Ji Sun. 2020. Database Meets Artificial Intelligence: A Survey. IEEE Transactions on Knowledge and Data Engineering (2020)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_47_1","DOI":"10.1145\/3127479.3128605"}],"event":{"sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"],"acronym":"GECCO '21","name":"GECCO '21: Genetic and Evolutionary Computation Conference","location":"Lille France"},"container-title":["Proceedings of the Genetic and Evolutionary Computation Conference Companion"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449726.3463180","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449726.3463180","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:02Z","timestamp":1750191422000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449726.3463180"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,7]]},"references-count":47,"alternative-id":["10.1145\/3449726.3463180","10.1145\/3449726"],"URL":"https:\/\/doi.org\/10.1145\/3449726.3463180","relation":{},"subject":[],"published":{"date-parts":[[2021,7,7]]},"assertion":[{"value":"2021-07-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}