{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T01:25:32Z","timestamp":1789521932206,"version":"build-2803163510"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,7,1]],"date-time":"2017-07-01T00:00:00Z","timestamp":1498867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"European Union","award":["692286"],"award-info":[{"award-number":["692286"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,7]]},"DOI":"10.1145\/3071178.3071190","type":"proceedings-article","created":{"date-parts":[[2017,6,30]],"date-time":"2017-06-30T17:59:28Z","timestamp":1498845568000},"page":"905-912","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Simulation-based test functions for optimization algorithms"],"prefix":"10.1145","author":[{"given":"Martin","family":"Zaefferer","sequence":"first","affiliation":[{"name":"TH K\u00f6ln, Gummersbach, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Fischbach","sequence":"additional","affiliation":[{"name":"TH K\u00f6ln, Gummersbach, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Boris","family":"Naujoks","sequence":"additional","affiliation":[{"name":"TH K\u00f6ln, Gummersbach, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Bartz-Beielstein","sequence":"additional","affiliation":[{"name":"TH K\u00f6ln, Gummersbach, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,7]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Coello Coello","author":"Barrera Julio","year":"2011","unstructured":"Julio Barrera and Carlos A . Coello Coello . 2011 . Test Function Generators for Assessing the Performance of PSO Algorithms in Multimodal Optimization. Springer Berlin Heidelberg , Berlin, Heidelberg, 89--117. Julio Barrera and Carlos A. Coello Coello. 2011. Test Function Generators for Assessing the Performance of PSO Algorithms in Multimodal Optimization. Springer Berlin Heidelberg, Berlin, Heidelberg, 89--117."},{"key":"e_1_3_2_1_2_1","volume-title":"How to Create Generalizable Results","author":"Bartz-Beielstein Thomas","unstructured":"Thomas Bartz-Beielstein . 2015. How to Create Generalizable Results . In Springer Handbook of Computational Intelligence, Janusz Kacprzyk and Witold Pedrycz (Eds.). Springer Berlin Heidelberg , Berlin, Heidelberg, 1127--1142. Thomas Bartz-Beielstein. 2015. How to Create Generalizable Results. In Springer Handbook of Computational Intelligence, Janusz Kacprzyk and Witold Pedrycz (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 1127--1142."},{"key":"e_1_3_2_1_3_1","volume-title":"Microarray data: Analysis of the Complete Sequence-Fitness Landscape of a DNA Aptamer. Online, last accessed 31 jan","author":"Bioanalytical Sciences Group - Manchester University. 2011.","year":"2017","unstructured":"Bioanalytical Sciences Group - Manchester University. 2011. Microarray data: Analysis of the Complete Sequence-Fitness Landscape of a DNA Aptamer. Online, last accessed 31 jan 2017 . (2011). http:\/\/dbkgroup.org\/directed-evolution\/ Bioanalytical Sciences Group - Manchester University. 2011. Microarray data: Analysis of the Complete Sequence-Fitness Landscape of a DNA Aptamer. Online, last accessed 31 jan 2017. (2011). http:\/\/dbkgroup.org\/directed-evolution\/"},{"key":"e_1_3_2_1_4_1","volume-title":"Experimental Methods for the Analysis of Optimization Algorithms, Thomas Bartz-Beielstein","author":"Chiarandini Marco","unstructured":"Marco Chiarandini and Yuri Goegebeur . 2010. Mixed Models for the Analysis of Optimization Algorithms . In Experimental Methods for the Analysis of Optimization Algorithms, Thomas Bartz-Beielstein , Marco Chiarandini, Luis Paquete, and Mike Preuss (Eds.). Springer , Germany , 225--264. Marco Chiarandini and Yuri Goegebeur. 2010. Mixed Models for the Analysis of Optimization Algorithms. In Experimental Methods for the Analysis of Optimization Algorithms, Thomas Bartz-Beielstein, Marco Chiarandini, Luis Paquete, and Mike Preuss (Eds.). Springer, Germany, 225--264."},{"key":"e_1_3_2_1_5_1","volume-title":"Statistics for Spatial Data","author":"Cressie Noel A.C.","unstructured":"Noel A.C. Cressie . 1993. Statistics for Spatial Data . JOHN WILEY & SONS INC. Noel A.C. Cressie. 1993. Statistics for Spatial Data. JOHN WILEY & SONS INC."},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings. 26. Workshop Computational Intelligence, Frank Hoffmann, Eyke H\u00fcllermeier, and Ralf Mikut (Eds.). KIT Scientific Publishing, Dortmund, 159--177","author":"Fischbach Andreas","year":"2016","unstructured":"Andreas Fischbach , Martin Zaefferer , J\u00f6rg Stork , Martina Friese , and Thomas Bartz-Beielstein . 2016 . From Real World Data to Test Functions . In Proceedings. 26. Workshop Computational Intelligence, Frank Hoffmann, Eyke H\u00fcllermeier, and Ralf Mikut (Eds.). KIT Scientific Publishing, Dortmund, 159--177 . Andreas Fischbach, Martin Zaefferer, J\u00f6rg Stork, Martina Friese, and Thomas Bartz-Beielstein. 2016. From Real World Data to Test Functions. In Proceedings. 26. Workshop Computational Intelligence, Frank Hoffmann, Eyke H\u00fcllermeier, and Ralf Mikut (Eds.). KIT Scientific Publishing, Dortmund, 159--177."},{"key":"e_1_3_2_1_9_1","volume-title":"Engineering Design via Surrogate Modelling","author":"Forrester Alexander","unstructured":"Alexander Forrester , Andras Sobester , and Andy Keane . 2008. Engineering Design via Surrogate Modelling . Wiley . Alexander Forrester, Andras Sobester, and Andy Keane. 2008. Engineering Design via Surrogate Modelling. Wiley."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2005.863628"},{"key":"e_1_3_2_1_11_1","volume-title":"COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting. ArXiv e-prints arXiv:1603.08785","author":"Hansen Nikolaus","year":"2016","unstructured":"Nikolaus Hansen , Anne Auger , Olaf Mersmann , Tea Tu\u0161ar , and Dimo Brockhoff . 2016 . COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting. ArXiv e-prints arXiv:1603.08785 (2016). Nikolaus Hansen, Anne Auger, Olaf Mersmann, Tea Tu\u0161ar, and Dimo Brockhoff. 2016. COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting. ArXiv e-prints arXiv:1603.08785 (2016)."},{"key":"e_1_3_2_1_13_1","volume-title":"The Elements of Statistical Learning","author":"Hastie Trevor","unstructured":"Trevor Hastie , Robert Tibshirani , and Jerome Friedman . 2001. The Elements of Statistical Learning . Springer , Berlin, Heidelberg , New York. Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2001. The Elements of Statistical Learning. Springer, Berlin, Heidelberg, New York."},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI'98)","author":"Holger","unstructured":"Holger H. Hoos and Thomas St\u00fctzle. 1998. Evaluating Las Vegas Algorithms: Pitfalls and Remedies . In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI'98) . Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 238--245. Holger H. Hoos and Thomas St\u00fctzle. 1998. Evaluating Las Vegas Algorithms: Pitfalls and Remedies. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI'98). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 238--245."},{"key":"e_1_3_2_1_15_1","volume-title":"An Introduction to Statistical Learning with Applications in R","author":"James Gareth","unstructured":"Gareth James , Daniela Witten , Trevor Hastie , and Robert Tibshirani . 2014. An Introduction to Statistical Learning with Applications in R ( 4 th ed.). Springer . Gareth James, Daniela Witten, Trevor Hastie, and Robert Tibshirani. 2014. An Introduction to Statistical Learning with Applications in R (4th ed.). Springer.","edition":"4"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008306431147"},{"key":"e_1_3_2_1_17_1","volume-title":"Huijbregts","author":"Journel Andre G.","year":"1978","unstructured":"Andre G. Journel and Charles J . Huijbregts . 1978 . Mining Geostatistics. Academic Press . Andre G. Journel and Charles J. Huijbregts. 1978. Mining Geostatistics. Academic Press."},{"key":"e_1_3_2_1_18_1","volume-title":"Geostatistical Simulation - Models and Algorithms","author":"Lantu\u00e9joul Christian","unstructured":"Christian Lantu\u00e9joul . 2002. Geostatistical Simulation - Models and Algorithms . Springer-Verlag Berlin Heidelberg . Christian Lantu\u00e9joul. 2002. Geostatistical Simulation - Models and Algorithms. Springer-Verlag Berlin Heidelberg."},{"key":"e_1_3_2_1_19_1","unstructured":"Jonas Mockus Vytautas Tiesis and Antanas Zilinskas. 1978. Towards Global Optimization 2. North-Holland Chapter The application of Bayesian methods for seeking the extremum 117--129.  Jonas Mockus Vytautas Tiesis and Antanas Zilinskas. 1978. Towards Global Optimization 2 . North-Holland Chapter The application of Bayesian methods for seeking the extremum 117--129."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2008339.2008352"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/355934.355936"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1137\/080724083"},{"key":"e_1_3_2_1_23_1","first-page":"44","article-title":"Analysis of a complete DNA-protein affinity landscape","volume":"7","author":"Rowe William","year":"2009","unstructured":"William Rowe , Mark Platt , David C. Wedge , Philip J. Day , Douglas B. Kell , and Joshua Knowles . 2009 . Analysis of a complete DNA-protein affinity landscape . Journal of The Royal Society Interface 7 , 44 (jul 2009), 397--408. William Rowe, Mark Platt, David C. Wedge, Philip J. Day, Douglas B. Kell, and Joshua Knowles. 2009. Analysis of a complete DNA-protein affinity landscape. Journal of The Royal Society Interface 7, 44 (jul 2009), 397--408.","journal-title":"Journal of The Royal Society Interface"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btq353"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/1051482"},{"key":"e_1_3_2_1_27_1","volume-title":"Evolution and Optimum Seeking","author":"Schwefel Hans-Paul","unstructured":"Hans-Paul Schwefel . 1995. Evolution and Optimum Seeking . Wiley , New York NY . Hans-Paul Schwefel. 1995. Evolution and Optimum Seeking. Wiley, New York NY."},{"key":"e_1_3_2_1_28_1","volume-title":"Bayesian and Maximum Likelihood Estimation for Gaussian Processes on an Incomplete Lattice. Journal of Computational and Graphical Statistics","author":"Stroud Jonathan R.","year":"2016","unstructured":"Jonathan R. Stroud , Michael L. Stein , and Shaun Lysen . 2016. Bayesian and Maximum Likelihood Estimation for Gaussian Processes on an Incomplete Lattice. Journal of Computational and Graphical Statistics ( 2016 ). Jonathan R. Stroud, Michael L. Stein, and Shaun Lysen. 2016. Bayesian and Maximum Likelihood Estimation for Gaussian Processes on an Incomplete Lattice. Journal of Computational and Graphical Statistics (2016)."},{"key":"e_1_3_2_1_29_1","volume-title":"The Krigifier: A Procedure for Generating Pseudorandom Nonlinear Objective Functions for Computational Experimentation. Technical Report","author":"Trosset Michael W.","year":"1999","unstructured":"Michael W. Trosset . 1999 . The Krigifier: A Procedure for Generating Pseudorandom Nonlinear Objective Functions for Computational Experimentation. Technical Report . Institute for Computer Applications in Science and Engineering, NASA Langley Research Center , Hampton, VA. Michael W. Trosset. 1999. The Krigifier: A Procedure for Generating Pseudorandom Nonlinear Objective Functions for Computational Experimentation. Technical Report. Institute for Computer Applications in Science and Engineering, NASA Langley Research Center, Hampton, VA."},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of the Sixth International Conference on Genetic Algorithms, Larry J. Eshelman (Ed.). Morgan Kaufmann, San Francisco CA, 239--246","author":"Whitley L. Darrel","year":"1995","unstructured":"L. Darrel Whitley , Keith E. Mathias , Soraya Rana , and John Dzubera . 1995 . Building Better Test Functions . In Proceedings of the Sixth International Conference on Genetic Algorithms, Larry J. Eshelman (Ed.). Morgan Kaufmann, San Francisco CA, 239--246 . L. Darrel Whitley, Keith E. Mathias, Soraya Rana, and John Dzubera. 1995. Building Better Test Functions. In Proceedings of the Sixth International Conference on Genetic Algorithms, Larry J. Eshelman (Ed.). Morgan Kaufmann, San Francisco CA, 239--246."},{"key":"e_1_3_2_1_31_1","volume-title":"Parallel Problem Solving from Nature-PPSN XIII, Thomas Bartz-Beielstein, J\u00fcrgen Branke, Bogdan Filipi\u010d","author":"Zaefferer Martin","unstructured":"Martin Zaefferer , J\u00f6rg Stork , and Thomas Bartz-Beielstein . 2014. Distance Measures for Permutations in Combinatorial Efficient Global Optimization . In Parallel Problem Solving from Nature-PPSN XIII, Thomas Bartz-Beielstein, J\u00fcrgen Branke, Bogdan Filipi\u010d , and Jim Smith (Eds.). Springer, Cham , Switzerland , 373--383. Martin Zaefferer, J\u00f6rg Stork, and Thomas Bartz-Beielstein. 2014. Distance Measures for Permutations in Combinatorial Efficient Global Optimization. In Parallel Problem Solving from Nature-PPSN XIII, Thomas Bartz-Beielstein, J\u00fcrgen Branke, Bogdan Filipi\u010d, and Jim Smith (Eds.). Springer, Cham, Switzerland, 373--383."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2576768.2598282"}],"event":{"name":"GECCO '17: Genetic and Evolutionary Computation Conference","location":"Berlin Germany","acronym":"GECCO '17","sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"]},"container-title":["Proceedings of the Genetic and Evolutionary Computation Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3071178.3071190","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3071178.3071190","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:24:04Z","timestamp":1750220644000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3071178.3071190"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7]]},"references-count":28,"alternative-id":["10.1145\/3071178.3071190","10.1145\/3071178"],"URL":"https:\/\/doi.org\/10.1145\/3071178.3071190","relation":{},"subject":[],"published":{"date-parts":[[2017,7]]},"assertion":[{"value":"2017-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}