{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T13:02:30Z","timestamp":1779195750233,"version":"3.51.4"},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T00:00:00Z","timestamp":1717804800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"JSPS KAKENHI","award":["JP20H04240"],"award-info":[{"award-number":["JP20H04240"]}]},{"name":"JST PRESTO","award":["JPMJPR2133"],"award-info":[{"award-number":["JPMJPR2133"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Evol. Learn. Optim."],"published-print":{"date-parts":[[2024,6,30]]},"abstract":"<jats:p>This study targets the mixed-integer black-box optimization (MI-BBO) problem where continuous and integer variables should be optimized simultaneously. The covariance matrix adaptation evolution strategy (CMA-ES), our focus in this study, is a population-based stochastic search method that samples solution candidates from a multivariate Gaussian distribution (MGD), which shows excellent performance in continuous black-box optimization. The parameters of MGD, mean and (co)variance, are updated based on the evaluation value of candidate solutions in the CMA-ES. If the CMA-ES is applied to the MI-BBO with straightforward discretization, however, the variance corresponding to the integer variables becomes much smaller than the granularity of the discretization before reaching the optimal solution, which leads to the stagnation of the optimization. In particular, when binary variables are included in the problem, this stagnation more likely occurs because the granularity of the discretization becomes wider, and the existing integer handling for the CMA-ES does not address this stagnation. To overcome these limitations, we propose a simple integer handling for the CMA-ES based on lower-bounding the marginal probabilities associated with the generation of integer variables in the MGD. The numerical experiments on the MI-BBO benchmark problems demonstrate the efficiency and robustness of the proposed method. Furthermore, to demonstrate the generality of the idea of the proposed method, in addition to the single-objective optimization case, we incorporate it into multi-objective CMA-ES and verify its performance on bi-objective mixed-integer benchmark problems.<\/jats:p>","DOI":"10.1145\/3632962","type":"journal-article","created":{"date-parts":[[2024,1,25]],"date-time":"2024-01-25T12:32:20Z","timestamp":1706185940000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Marginal Probability-Based Integer Handling for CMA-ES Tackling Single- and Multi-Objective Mixed-Integer Black-Box Optimization"],"prefix":"10.1145","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4425-1683","authenticated-orcid":false,"given":"Ryoki","family":"Hamano","sequence":"first","affiliation":[{"name":"Yokohama National University, Yokohama, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9863-6765","authenticated-orcid":false,"given":"Shota","family":"Saito","sequence":"additional","affiliation":[{"name":"Yokohama National University and SKILLUP NeXt Ltd., Yokohama, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4945-5984","authenticated-orcid":false,"given":"Masahiro","family":"Nomura","sequence":"additional","affiliation":[{"name":"CyberAgent, Shibuya, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4659-6108","authenticated-orcid":false,"given":"Shinichi","family":"Shirakawa","sequence":"additional","affiliation":[{"name":"Yokohama National University, Yokohama, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,6,8]]},"reference":[{"key":"e_1_3_2_2_1","first-page":"171","volume-title":"Proceedings of the 36th International Conference on Machine Learning (ICML\u201919)","volume":"97","author":"Akimoto Youhei","year":"2019","unstructured":"Youhei Akimoto, Shinichi Shirakawa, Nozomu Yoshinari, Kento Uchida, Shota Saito, and Kouhei Nishida. 2019. Adaptive stochastic natural gradient method for one-shot neural architecture search. In Proceedings of the 36th International Conference on Machine Learning (ICML\u201919), Vol. 97. 171\u2013180."},{"key":"e_1_3_2_3_1","doi-asserted-by":"crossref","unstructured":"Thomas B\u00e4ck and Martin Sch\u00fctz. 1995. Evolution strategies for mixed-integer optimization of optical multilayer systems. In Evolutionary Programming IV: Proceedings of the Fourth Annual Conference on Evolutionary Programming. MIT Press Cambridge MA 33\u201351.","DOI":"10.7551\/mitpress\/2887.003.0009"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/865123"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449726.3463136"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_3_2_7_1","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1007\/978-3-540-31880-4_5","volume-title":"Evolutionary Multi-Criterion Optimization","author":"Emmerich Michael","year":"2005","unstructured":"Michael Emmerich, Nicola Beume, and Boris Naujoks. 2005. An EMO algorithm using the hypervolume measure as selection criterion. In Evolutionary Multi-Criterion Optimization, Carlos A. Coello Coello, Arturo Hern\u00e1ndez Aguirre, and Eckart Zitzler (Eds.). Springer, Berlin, Germany, 62\u201376."},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2018.01.008"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512290.3528827"},{"key":"e_1_3_2_10_1","volume-title":"A CMA-ES for Mixed-Integer Nonlinear Optimization","author":"Hansen Nikolaus","year":"2011","unstructured":"Nikolaus Hansen. 2011. A CMA-ES for Mixed-Integer Nonlinear Optimization. Research Report. INRIA."},{"key":"e_1_3_2_11_1","article-title":"The CMA evolution strategy: A tutorial","author":"Hansen Nikolaus","year":"2016","unstructured":"Nikolaus Hansen. 2016. The CMA evolution strategy: A tutorial. arXiv preprint arXiv:1604.00772 (2016).","journal-title":"arXiv preprint arXiv:1604.00772"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1162\/106365603321828970"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICEC.1996.542381"},{"key":"e_1_3_2_14_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201918)","author":"Hazan Elad","year":"2018","unstructured":"Elad Hazan, Adam Klivans, and Yang Yuan. 2018. Hyperparameter optimization: A spectral approach. In Proceedings of the International Conference on Learning Representations (ICLR\u201918)."},{"key":"e_1_3_2_15_1","unstructured":"John H. Holland. 1975. Adaptation in Natural and Artificial Systems. University of Michigan Press."},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco.2007.15.1.1"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1039\/D0ME00079E"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00059"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3205651.3205706"},{"key":"e_1_3_2_21_1","volume-title":"Evolutionsstrategie Optimierung technischer Systeme nach Prinzipien der biologischen Evolution","author":"Rechenberg I.","year":"1973","unstructured":"I. Rechenberg. 1973. Evolutionsstrategie Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Friedrich Frommann Verlag, Stuttgart-Bad Cannstatt."},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","unstructured":"Edgar Reehuis and Thomas B\u00e4ck. 2010. Mixed-integer evolution strategy using multiobjective selection applied to warehouse design optimization. In Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation (GECCO\u201910). 1187\u20131194. 10.1145\/1830483.1830700","DOI":"10.1145\/1830483.1830700"},{"key":"e_1_3_2_23_1","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1007\/3-540-58484-6_258","volume-title":"Parallel Problem Solving from Nature\u2014PPSN III","author":"Rudolph G\u00fcnter","year":"1994","unstructured":"G\u00fcnter Rudolph. 1994. An evolutionary algorithm for integer programming. In Parallel Problem Solving from Nature\u2014PPSN III, Yuval Davidor, Hans-Paul Schwefel, and Reinhard M\u00e4nner (Eds.). Springer, Berlin, Germany, 139\u2013148."},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijepes.2014.03.039"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3321707.3321868"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1830483.1830573"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0056936"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-60652-9"},{"key":"e_1_3_2_29_1","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1007\/BFb0056872","volume-title":"Parallel Problem Solving from Nature\u2014PPSN V","author":"Zitzler Eckart","year":"1998","unstructured":"Eckart Zitzler and Lothar Thiele. 1998. Multiobjective optimization using evolutionary algorithms\u2014A comparative case study. In Parallel Problem Solving from Nature\u2014PPSN V, Agoston E. Eiben, Thomas B\u00e4ck, Marc Schoenauer, and Hans-Paul Schwefel (Eds.). Springer, Berlin, Germany, 292\u2013301."}],"container-title":["ACM Transactions on Evolutionary Learning and Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3632962","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3632962","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:35:50Z","timestamp":1750178150000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3632962"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,8]]},"references-count":28,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,6,30]]}},"alternative-id":["10.1145\/3632962"],"URL":"https:\/\/doi.org\/10.1145\/3632962","relation":{},"ISSN":["2688-299X","2688-3007"],"issn-type":[{"value":"2688-299X","type":"print"},{"value":"2688-3007","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,8]]},"assertion":[{"value":"2022-12-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-25","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}