{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T21:58:31Z","timestamp":1769551111247,"version":"3.49.0"},"reference-count":40,"publisher":"World Scientific Pub Co Pte Ltd","issue":"04","funder":[{"name":"National Key Research and Development Program of China","award":["2018AAA0102200"],"award-info":[{"award-number":["2018AAA0102200"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61572507"],"award-info":[{"award-number":["61572507"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61532003"],"award-info":[{"award-number":["61532003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61622212"],"award-info":[{"award-number":["61622212"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100007085","name":"National University of Defense Technology","doi-asserted-by":"crossref","award":["ZK21-41"],"award-info":[{"award-number":["ZK21-41"]}],"id":[{"id":"10.13039\/501100007085","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J CIRCUIT SYST COMP"],"published-print":{"date-parts":[[2023,3,15]]},"abstract":"<jats:p> The hyperparameters of the metaheuristic algorithm are difficult to determine when solving optimization problems. The existing methods mainly adjust hyperparameters through preset rules or traditional RL. The performance of the above methods is unsatisfactory and the generalization is poor. This work proposes a deep Q-learning network (DQN)-based dynamic setting framework for combinatorial hyperparameters, and applies it to a Genetic algorithm (GA) to improve its performance. By defining the four elements of the environment, state, action and reward required for learning strategy in advance, the parametrized strategy can be trained offline and different DQN models can be studied. Our method was compared with other algorithms and achieved the shortest path on 14 of 15 public TSP instances. Meanwhile, the test results on our simulation TSP validation dataset revealed that Category DQN achieved the best performance. This means the proposed method can effectively solve the problem of combinatorial hyperparameters setting, and bring more solving advantages to the GA. <\/jats:p>","DOI":"10.1142\/s0218126623500627","type":"journal-article","created":{"date-parts":[[2022,8,24]],"date-time":"2022-08-24T08:52:09Z","timestamp":1661331129000},"source":"Crossref","is-referenced-by-count":12,"title":["A Hyperparameter Adaptive Genetic Algorithm Based on DQN"],"prefix":"10.1142","volume":"32","author":[{"given":"Detian","family":"Zeng","sequence":"first","affiliation":[{"name":"Information Institute, Hunan University of Humanities, Science and Technology, Loudi, 417700, Hunan, P. R. China"}]},{"given":"Tianwei","family":"Yan","sequence":"additional","affiliation":[{"name":"Information Institute, Hunan University of Humanities, Science and Technology, Loudi, 417700, Hunan, P. R. China"}]},{"given":"Zengri","family":"Zeng","sequence":"additional","affiliation":[{"name":"Information Institute, Hunan University of Humanities, Science and Technology, Loudi, 417700, Hunan, P. R. China"}]},{"given":"Hao","family":"Liu","sequence":"additional","affiliation":[{"name":"Information Institute, Hunan University of Humanities, Science and Technology, Loudi, 417700, Hunan, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1248-487X","authenticated-orcid":false,"given":"Peiyuan","family":"Guan","sequence":"additional","affiliation":[{"name":"Department of Informatics, University of Oslo, P.O. Box 1072 Blindern, 0316 Oslo, Norway"}]}],"member":"219","published-online":{"date-parts":[[2022,9,28]]},"reference":[{"key":"S0218126623500627BIB001","first-page":"1","volume":"0","author":"Zeng D.","year":"2021","journal-title":"Eng. Optimiz."},{"key":"S0218126623500627BIB002","first-page":"170","volume-title":"Int. Conf. Integration of Constraint Programming, Artificial Intelligence, and Operations Research","author":"Deudon M.","year":"2018"},{"key":"S0218126623500627BIB003","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1145\/3406325.3451009","volume-title":"Proc. 53rd Annual ACM SIGACT Symp. Theory of Computing","author":"Karlin A. R.","year":"2021"},{"key":"S0218126623500627BIB004","doi-asserted-by":"publisher","DOI":"10.1007\/s11831-020-09412-6"},{"key":"S0218126623500627BIB005","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2021.107250"},{"key":"S0218126623500627BIB006","doi-asserted-by":"crossref","first-page":"3926","DOI":"10.1007\/s10489-020-01727-y","volume":"50","author":"Qais M. H.","year":"2020","journal-title":"App. Intell."},{"issue":"10","key":"S0218126623500627BIB007","doi-asserted-by":"crossref","first-page":"7517","DOI":"10.1007\/s10489-021-02208-6","volume":"51","author":"Jiang C.","year":"2021","journal-title":"Appl. Intell."},{"key":"S0218126623500627BIB008","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1007\/s10489-020-01833-x","volume":"51","author":"Rezaeipanah A.","year":"2021","journal-title":"Appl. Intell."},{"key":"S0218126623500627BIB009","doi-asserted-by":"crossref","first-page":"104619","DOI":"10.1016\/j.nanoen.2020.104619","volume":"71","author":"Wei H.","year":"2020","journal-title":"Nano Energy"},{"key":"S0218126623500627BIB010","first-page":"1111","volume":"19","author":"Pan J.-S.","year":"2018","journal-title":"J. Internet Technol."},{"key":"S0218126623500627BIB012","doi-asserted-by":"crossref","first-page":"1740","DOI":"10.1109\/ACCESS.2015.2481463","volume":"3","author":"Chang H.-C.","year":"2015","journal-title":"IEEE Access"},{"key":"S0218126623500627BIB013","first-page":"1177","volume-title":"Int. Conf. Computational Intelligence for Modelling, Control and Automation and International Conf. Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC\u201906)","volume":"1","author":"Chen F.","year":"2005"},{"key":"S0218126623500627BIB014","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2020.106778"},{"key":"S0218126623500627BIB015","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.cie.2017.05.026","volume":"110","author":"Shahrabi J.","year":"2017","journal-title":"Comput. Ind. Eng."},{"key":"S0218126623500627BIB016","first-page":"3207","volume-title":"Proc. AAAI Conf. Artificial Intelligence","volume":"32","author":"Henderson P.","year":"2018"},{"key":"S0218126623500627BIB017","doi-asserted-by":"crossref","first-page":"5993","DOI":"10.1109\/TII.2020.3029974","volume":"17","author":"Li Y.","year":"2020","journal-title":"IEEE Trans. Ind. Inf."},{"key":"S0218126623500627BIB018","author":"Li Y.","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"S0218126623500627BIB019","doi-asserted-by":"crossref","first-page":"2301","DOI":"10.1109\/TNSE.2022.3162669","author":"Li Y.","year":"2022","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"S0218126623500627BIB021","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2018.07.021"},{"key":"S0218126623500627BIB022","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.energy.2018.08.112","volume":"163","author":"Zhang W.","year":"2018","journal-title":"Energy"},{"key":"S0218126623500627BIB023","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1201\/9780429081385-222","volume-title":"Int. Conf. Computational Methods in Sciences and Engineering 2004 (ICCMSE 2004)","author":"Parsopoulos K. E.","year":"2019"},{"key":"S0218126623500627BIB024","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-017-0710-8"},{"key":"S0218126623500627BIB025","first-page":"104","volume-title":"UK Workshop Computational Intelligence","author":"Chitty D. M.","year":"2017"},{"key":"S0218126623500627BIB026","doi-asserted-by":"publisher","DOI":"10.1155\/2015\/212794"},{"key":"S0218126623500627BIB027","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1007\/978-981-15-6067-5_60","volume-title":"Innovations in Computational Intelligence and Computer Vision","author":"Bye R. T.","year":"2021"},{"key":"S0218126623500627BIB028","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"S0218126623500627BIB029","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"S0218126623500627BIB030","first-page":"2094","volume-title":"Proc. AAAI Conf. Artificial Intelligence","volume":"30","author":"Van Hasselt H.","year":"2016"},{"key":"S0218126623500627BIB032","first-page":"1995","volume-title":"Int. Conf. Machine Learning, PMLR","author":"Wang Z.","year":"2016"},{"key":"S0218126623500627BIB033","volume-title":"Int. Conf. Machine Learning, PMLR","author":"Bellemare M. G.","year":"2017"},{"key":"S0218126623500627BIB034","first-page":"3215","volume-title":"Thirty-second AAAI Conf. Artificial Intelligence","author":"Hessel M.","year":"2018"},{"key":"S0218126623500627BIB035","doi-asserted-by":"publisher","DOI":"10.1109\/21.286385"},{"key":"S0218126623500627BIB036","first-page":"93","volume":"12","author":"Hangyu K.","year":"2006","journal-title":"Computer Eng. Appl."},{"key":"S0218126623500627BIB037","first-page":"692","volume-title":"Proc. 4th Annual Conf. Genetic and Evolutionary Computation","author":"Pettinger J. E.","year":"2002"},{"key":"S0218126623500627BIB038","volume":"2020","author":"Chen Q.","year":"2020","journal-title":"Math. Probl. Eng."},{"key":"S0218126623500627BIB039","first-page":"47","volume-title":"2018 8th Int. Conf. Electronics Information and Emergency Communication (ICEIEC)","author":"Liu J.","year":"2018"},{"key":"S0218126623500627BIB040","doi-asserted-by":"crossref","first-page":"2237","DOI":"10.1016\/j.asoc.2012.03.025","volume":"12","author":"Lei D.","year":"2012","journal-title":"Appl. Soft Comput."},{"key":"S0218126623500627BIB041","doi-asserted-by":"crossref","first-page":"2483","DOI":"10.1109\/TNNLS.2020.3006080","volume":"32","author":"Xi L.","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"S0218126623500627BIB042","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1007\/s10100-016-0437-8","volume":"25","author":"Pferschy U.","year":"2017","journal-title":"Central Eur. J. Oper. Res."},{"key":"S0218126623500627BIB043","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/S0954-1810(01)00005-X","volume":"15","author":"Tan K. C.","year":"2001","journal-title":"Artif. Intell. Eng."}],"container-title":["Journal of Circuits, Systems and Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218126623500627","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T03:12:02Z","timestamp":1677208322000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218126623500627"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,28]]},"references-count":40,"journal-issue":{"issue":"04","published-print":{"date-parts":[[2023,3,15]]}},"alternative-id":["10.1142\/S0218126623500627"],"URL":"https:\/\/doi.org\/10.1142\/s0218126623500627","relation":{},"ISSN":["0218-1266","1793-6454"],"issn-type":[{"value":"0218-1266","type":"print"},{"value":"1793-6454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,28]]},"article-number":"2350062"}}