{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T06:01:41Z","timestamp":1783749701014,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,7,13]],"date-time":"2019-07-13T00:00:00Z","timestamp":1562976000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,7,13]]},"DOI":"10.1145\/3321707.3321813","type":"proceedings-article","created":{"date-parts":[[2019,7,3]],"date-time":"2019-07-03T13:48:04Z","timestamp":1562161684000},"page":"709-717","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":82,"title":["Deep reinforcement learning based parameter control in differential evolution"],"prefix":"10.1145","author":[{"given":"Mudita","family":"Sharma","sequence":"first","affiliation":[{"name":"University of York, York, U.K."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandros","family":"Komninos","sequence":"additional","affiliation":[{"name":"University of York, York, U.K."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manuel","family":"L\u00f3pez-Ib\u00e1\u00f1ez","sequence":"additional","affiliation":[{"name":"University of Manchester, Manchester, U.K."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dimitar","family":"Kazakov","sequence":"additional","affiliation":[{"name":"University of York, York, U.K."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,7,13]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2996355"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2005.1554903"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2005.1554902"},{"key":"e_1_3_2_1_4_1","volume-title":"Control and Automation, 2005 and International Conference on Intelligent Agents, Web Technologies and Internet Commerce, International Conference on","volume":"1","author":"Chen F.","year":"2005","unstructured":"F. Chen , Y. Gao , Z.-q. Chen , and S.-f. Chen . 2005 . SCGA: Controlling genetic algorithms with Sarsa(0). In Computational Intelligence for Modelling , Control and Automation, 2005 and International Conference on Intelligent Agents, Web Technologies and Internet Commerce, International Conference on , Vol. 1 . IEEE, 1177--1183. F. Chen, Y. Gao, Z.-q. Chen, and S.-f. Chen. 2005. SCGA: Controlling genetic algorithms with Sarsa(0). In Computational Intelligence for Modelling, Control and Automation, 2005 and International Conference on Intelligent Agents, Web Technologies and Internet Commerce, International Conference on, Vol. 1. IEEE, 1177--1183."},{"key":"e_1_3_2_1_5_1","volume-title":"International Workshop on Engineering Self-Organising Applications. Springer, 151--160","author":"Eiben A. E.","unstructured":"A. E. Eiben , M. Horvath , W. Kowalczyk , and M. C. Schut . 2006. Reinforcement learning for online control of evolutionary algorithms . In International Workshop on Engineering Self-Organising Applications. Springer, 151--160 . A. E. Eiben, M. Horvath, W. Kowalczyk, and M. C. Schut. 2006. Reinforcement learning for online control of evolutionary algorithms. In International Workshop on Engineering Self-Organising Applications. Springer, 151--160."},{"key":"e_1_3_2_1_6_1","unstructured":"\u00c1. Fialho. 2010.\n  Adaptive operator selection for optimization\n  . Ph.D. Dissertation. \n  Universit\u00e9 Paris Sud-Paris XI.  \u00c1. Fialho. 2010. Adaptive operator selection for optimization. Ph.D. Dissertation. Universit\u00e9 Paris Sud-Paris XI."},{"key":"e_1_3_2_1_7_1","volume-title":"Lecture Notes in Computer Science","volume":"6238","author":"Ros R.","unstructured":"\u00c1. Fialho, R. Ros , M. Schoenauer , and M. Sebag . 2010. Comparison-based adaptive strategy selection with bandits in differential evolution. In Parallel Problem Solving from Nature, PPSN XI, R. Schaefer et al. (Eds.) . Lecture Notes in Computer Science , Vol. 6238 . Springer, Heidelberg, Germany, 194--203. \u00c1. Fialho, R. Ros, M. Schoenauer, and M. Sebag. 2010. Comparison-based adaptive strategy selection with bandits in differential evolution. In Parallel Problem Solving from Nature, PPSN XI, R. Schaefer et al. (Eds.). Lecture Notes in Computer Science, Vol. 6238. Springer, Heidelberg, Germany, 194--203."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1830483.1830619"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1830483.1830559"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2576768.2598360"},{"key":"e_1_3_2_1_11_1","volume-title":"Lecture Notes in Computer Science","volume":"9028","author":"Karafotias G.","unstructured":"G. Karafotias , M. Hoogendoorn , and A. E. Eiben . 2015. Evaluating reward definitions for parameter control. In Applications of Evolutionary Computation, EvoApplications 2015, A. M. Mora and G. Squillero (Eds.) . Lecture Notes in Computer Science , Vol. 9028 . Springer, Heidelberg, Germany, 667--680. G. Karafotias, M. Hoogendoorn, and A. E. Eiben. 2015. Evaluating reward definitions for parameter control. In Applications of Evolutionary Computation, EvoApplications 2015, A. M. Mora and G. Squillero (Eds.). Lecture Notes in Computer Science, Vol. 9028. Springer, Heidelberg, Germany, 667--680."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2014.2308294"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29178-4_37"},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference, GECCO","author":"Kee E.","year":"2001","unstructured":"E. Kee , S. Airey , and W. Cyre . 2001. An adaptive genetic algorithm . In Proceedings of the Genetic and Evolutionary Computation Conference, GECCO 2001 , E. D. Goodman (Ed.). Morgan Kaufmann Publishers, San Francisco, CA, 391--397. E. Kee, S. Airey, and W. Cyre. 2001. An adaptive genetic algorithm. In Proceedings of the Genetic and Evolutionary Computation Conference, GECCO 2001, E. D. Goodman (Ed.). Morgan Kaufmann Publishers, San Francisco, CA, 391--397."},{"key":"e_1_3_2_1_15_1","volume-title":"Adam: A method for stochastic optimization. Arxiv preprint arXiv:1412.6980 {cs.LG}","author":"Kingma D. P.","year":"2014","unstructured":"D. P. Kingma and J. Ba . 2014 . Adam: A method for stochastic optimization. Arxiv preprint arXiv:1412.6980 {cs.LG} (2014). https:\/\/arxiv.org\/abs\/1412.6980 D. P. Kingma and J. Ba. 2014. Adam: A method for stochastic optimization. Arxiv preprint arXiv:1412.6980 {cs.LG} (2014). https:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jspi.2007.04.032"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143997.1144086"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"crossref","unstructured":"V. Mnih K. Kavukcuoglu D. Silver A. A. Rusu J. Veness M. G. Bellemare A. Graves M. Riedmiller A. K. Fidjeland G. Ostrovski etal 2015. Human-level control through deep reinforcement learning. Nature 518 7540 (2015) 529.  V. Mnih K. Kavukcuoglu D. Silver A. A. Rusu J. Veness M. G. Bellemare A. Graves M. Riedmiller A. K. Fidjeland G. Ostrovski et al. 2015. Human-level control through deep reinforcement learning. Nature 518 7540 (2015) 529.","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the 27th international conference on machine learning (ICML-10)","author":"Nair V.","unstructured":"V. Nair and G. E. Hinton . 2010. Rectified linear units improve restricted boltzmann machines . In Proceedings of the 27th international conference on machine learning (ICML-10) . ACM Press, New York, NY, 807--814. V. Nair and G. E. Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th international conference on machine learning (ICML-10). ACM Press, New York, NY, 807--814."},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference, GECCO","author":"Pettinger J. E.","year":"2002","unstructured":"J. E. Pettinger and R. M. Everson . 2002. Controlling genetic algorithms with reinforcement learning . In Proceedings of the Genetic and Evolutionary Computation Conference, GECCO 2002 , W. B. Langdon et al. (Eds.). Morgan Kaufmann Publishers, San Francisco, CA, 692--692. J. E. Pettinger and R. M. Everson. 2002. Controlling genetic algorithms with reinforcement learning. In Proceedings of the Genetic and Evolutionary Computation Conference, GECCO 2002, W. B. Langdon et al. (Eds.). Morgan Kaufmann Publishers, San Francisco, CA, 692--692."},{"key":"e_1_3_2_1_21_1","volume-title":"Differential Evolution: A Practical Approach to Global Optimization","author":"Price K.","year":"2005","unstructured":"K. Price , R. M. Storn , and J. A. Lampinen . 2005 . Differential Evolution: A Practical Approach to Global Optimization . Springer , New York, NY . K. Price, R. M. Storn, and J. A. Lampinen. 2005. Differential Evolution: A Practical Approach to Global Optimization. Springer, New York, NY."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/SITIS.2010.22"},{"key":"e_1_3_2_1_23_1","volume-title":"Lecture Notes in Computer Science","volume":"11102","author":"Sharma M.","unstructured":"M. Sharma , M. L\u00f3pez-Ib\u00e1\u00f1ez , and D. Kazakov . 2018. Performance Assessment of Recursive Probability Matching for Adaptive Operator Selection in Differential Evolution. In Parallel Problem Solving from Nature - PPSN XV, A. Auger et al. (Eds.) . Lecture Notes in Computer Science , Vol. 11102 . Springer, Cham, 321--333. M. Sharma, M. L\u00f3pez-Ib\u00e1\u00f1ez, and D. Kazakov. 2018. Performance Assessment of Recursive Probability Matching for Adaptive Operator Selection in Differential Evolution. In Parallel Problem Solving from Nature - PPSN XV, A. Auger et al. (Eds.). Lecture Notes in Computer Science, Vol. 11102. Springer, Cham, 321--333."},{"key":"e_1_3_2_1_24_1","volume-title":"Differential Evolution: Supplementary material. https:\/\/github.com\/mudita11\/DE-DDQN.","author":"Sharma M.","year":"2019","unstructured":"M. Sharma , M. L\u00f3pez-Ib\u00e1\u00f1ez , and D. Kazakov . 2019 . Deep Reinforcement Learning Based Parameter Control in Differential Evolution: Supplementary material. https:\/\/github.com\/mudita11\/DE-DDQN. (2019). M. Sharma, M. L\u00f3pez-Ib\u00e1\u00f1ez, and D. Kazakov. 2019. Deep Reinforcement Learning Based Parameter Control in Differential Evolution: Supplementary material. https:\/\/github.com\/mudita11\/DE-DDQN. (2019)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008202821328"},{"key":"e_1_3_2_1_26_1","unstructured":"P. N. Suganthan N. Hansen J. J. Liang K. Deb Y. P. Chen A. Auger and S. Tiwari. 2005. Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. Technical Report. Nanyang Technological University Singapore.  P. N. Suganthan N. Hansen J. J. Liang K. Deb Y. P. Chen A. Auger and S. Tiwari. 2005. Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. Technical Report. Nanyang Technological University Singapore."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/551283"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"H. van Hasselt A. Guez and D. Silver. 2016. Deep Reinforcement Learning with Double Q-Learning. In AAAI D. Schuurmans and M. P. Wellman (Eds.). AAAI Press.   H. van Hasselt A. Guez and D. Silver. 2016. Deep Reinforcement Learning with Double Q-Learning. In AAAI D. Schuurmans and M. P. Wellman (Eds.). AAAI Press.","DOI":"10.1609\/aaai.v30i1.10295"}],"event":{"name":"GECCO '19: Genetic and Evolutionary Computation Conference","location":"Prague Czech Republic","acronym":"GECCO '19","sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"]},"container-title":["Proceedings of the Genetic and Evolutionary Computation Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3321707.3321813","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3321707.3321813","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:28Z","timestamp":1750206328000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3321707.3321813"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,13]]},"references-count":28,"alternative-id":["10.1145\/3321707.3321813","10.1145\/3321707"],"URL":"https:\/\/doi.org\/10.1145\/3321707.3321813","relation":{},"subject":[],"published":{"date-parts":[[2019,7,13]]},"assertion":[{"value":"2019-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}