{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:17:28Z","timestamp":1750306648320,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":18,"publisher":"ACM","license":[{"start":{"date-parts":[[2014,7,12]],"date-time":"2014-07-12T00:00:00Z","timestamp":1405123200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2014,7,12]]},"DOI":"10.1145\/2598394.2609850","type":"proceedings-article","created":{"date-parts":[[2014,7,11]],"date-time":"2014-07-11T12:10:42Z","timestamp":1405080642000},"page":"1427-1430","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["The executable experimental template pattern for the systematic comparison of metaheuristics"],"prefix":"10.1145","author":[{"given":"Geoffrey","family":"Neumann","sequence":"first","affiliation":[{"name":"University of Stirling, Stirling, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jerry","family":"Swan","sequence":"additional","affiliation":[{"name":"University of Stirling, Stirling, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Harman","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John A.","family":"Clark","sequence":"additional","affiliation":[{"name":"University of York, York, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,7,12]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985795"},{"key":"e_1_3_2_1_2_1","volume-title":"Verification and Reliability","author":"Arcuri Andrea","year":"2012","unstructured":"Andrea Arcuri and Lionel Briand . A hitchhiker's guide to statistical tests for assessing randomized algorithms in software engineering. Software Testing , Verification and Reliability , 2012 . Andrea Arcuri and Lionel Briand. A hitchhiker's guide to statistical tests for assessing randomized algorithms in software engineering. Software Testing, Verification and Reliability, 2012."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1974.10482955"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1521-4036(200001)42:1<17::AID-BIMJ17>3.0.CO;2-U"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.114.3.494"},{"key":"e_1_3_2_1_6_1","first-page":"449","volume-title":"A Classification of Hyper-heuristic Approaches","author":"Kendall G.","year":"2010","unstructured":"G. Kendall , G. Ochoa , E. \u00d6zcan , E. K. Burke , M. Hyde and J. R. Woodward . A Classification of Hyper-heuristic Approaches , chapter Handbook of Meta-Heuristics, pages 449 -- 468 . Kluwer , 2010 . G. Kendall, G. Ochoa, E. \u00d6zcan, E. K. Burke, M. Hyde and J. R. Woodward. A Classification of Hyper-heuristic Approaches, chapter Handbook of Meta-Heuristics, pages 449--468. Kluwer, 2010."},{"key":"e_1_3_2_1_7_1","volume-title":"Pearson Education","author":"Gamma Erich","year":"1994","unstructured":"Erich Gamma , Richard Helm , Ralph Johnson , and John Vlissides . Design patterns: elements of reusable object-oriented software . Pearson Education , 1994 . Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. Design patterns: elements of reusable object-oriented software. Pearson Education, 1994."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1986.289288"},{"key":"e_1_3_2_1_9_1","first-page":"1","volume-title":"Mark McMinn and Shin Yoo. Search based software engineering: Techniques, taxonomy, tutorial","author":"Souza Phil","year":"2009","unstructured":"Phil Souza , Jerffeson Teixeira de Harman , Mark McMinn and Shin Yoo. Search based software engineering: Techniques, taxonomy, tutorial . In Bertrand Meyer and Martin Nordio, editors, Empirical software engineering and verification: LASER 2009 -2010, pages 1 -- 59 . Springer , 2012. LNCS 7007. Phil Souza, Jerffeson Teixeira de Harman, Mark McMinn and Shin Yoo. Search based software engineering: Techniques, taxonomy, tutorial. In Bertrand Meyer and Martin Nordio, editors, Empirical software engineering and verification: LASER 2009-2010, pages 1--59. Springer, 2012. LNCS 7007."},{"key":"e_1_3_2_1_10_1","volume-title":"February 5","author":"Hathaway W. M.","year":"2013","unstructured":"W. M. Hathaway . Automated hypothesis testing , February 5 2013 . US Patent 8,370,107. W. M. Hathaway. Automated hypothesis testing, February 5 2013. US Patent 8,370,107."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.42.2.201"},{"key":"e_1_3_2_1_12_1","volume-title":"Essentials of Metaheuristics. Lulu","author":"Luke Sean","year":"2013","unstructured":"Sean Luke . Essentials of Metaheuristics. Lulu , second edition, 2013 . Available for free at http:\/\/cs.gmu.edu\/~sean\/book\/metaheuristics\/. Sean Luke. Essentials of Metaheuristics. Lulu, second edition, 2013. Available for free at http:\/\/cs.gmu.edu\/~sean\/book\/metaheuristics\/."},{"key":"e_1_3_2_1_13_1","volume-title":"On a test of whether one of two random variables is stochastically larger than the other. The annals of mathematical statistics, 18(1):50--60","author":"Mann Henry B.","year":"1947","unstructured":"Henry B. Mann and Donald R. Whitney . On a test of whether one of two random variables is stochastically larger than the other. The annals of mathematical statistics, 18(1):50--60 , 1947 . Henry B. Mann and Donald R. Whitney. On a test of whether one of two random variables is stochastically larger than the other. The annals of mathematical statistics, 18(1):50--60, 1947."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.2307\/2331945"},{"key":"e_1_3_2_1_15_1","volume-title":"R: A Language and Environment for Statistical Computing","author":"Team R. Core","year":"2013","unstructured":"R. Core Team . R: A Language and Environment for Statistical Computing . R Foundation for Statistical Computing , Vienna, Austria , 2013 . R. Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2013."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1968.10480932"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1972.10481232"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491411.2491420"}],"event":{"name":"GECCO '14: Genetic and Evolutionary Computation Conference","sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"],"location":"Vancouver BC Canada","acronym":"GECCO '14"},"container-title":["Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2598394.2609850","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2598394.2609850","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:56:07Z","timestamp":1750229767000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2598394.2609850"}},"subtitle":["Extended Abstract"],"short-title":[],"issued":{"date-parts":[[2014,7,12]]},"references-count":18,"alternative-id":["10.1145\/2598394.2609850","10.1145\/2598394"],"URL":"https:\/\/doi.org\/10.1145\/2598394.2609850","relation":{},"subject":[],"published":{"date-parts":[[2014,7,12]]},"assertion":[{"value":"2014-07-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}