{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T07:15:22Z","timestamp":1782544522969,"version":"3.54.5"},"reference-count":32,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2025,6,9]],"date-time":"2025-06-09T00:00:00Z","timestamp":1749427200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Efficient task allocation remains a fundamental challenge in multi-agent systems, particularly under resource constraints and large-scale deployments. Classical methods, including market-based mechanisms, centralized optimization techniques, and game-theoretic strategies, have been widely applied to address the multi-agent task allocation problem. While effective in small-to-medium-sized settings, these approaches often encounter limitations in terms of scalability, adaptability to dynamic environments, and computational efficiency as the problem size increases. To address these limitations, this study introduces a proximal policy optimization system augmented with a genetic algorithm (GAPPO) that integrates evolutionary search with deep reinforcement learning. GAPPO enables agents to develop energy-efficient task allocation strategies by perceiving environmental states and optimizing their actions through iterative policy updates. The genetic component promotes broader policy exploration beyond local optima, while the proximal policy optimization ensures update stability and sample efficiency. To evaluate the proposed GAPPO algorithm, extensive simulations are conducted across four scenarios, with the largest involving 50 tasks and 500 agents. The results demonstrate that GAPPO achieves superior performance compared to baseline methods, particularly in reducing task completion time. These findings highlight the algorithm\u2019s robustness and efficiency in handling large-scale and computationally intensive coordination tasks.<\/jats:p>","DOI":"10.3390\/systems13060453","type":"journal-article","created":{"date-parts":[[2025,6,9]],"date-time":"2025-06-09T08:22:34Z","timestamp":1749457354000},"page":"453","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Hybrid Genetic Algorithm and Proximal Policy Optimization System for Efficient Multi-Agent Task Allocation"],"prefix":"10.3390","volume":"13","author":[{"given":"Zimo","family":"Zhu","sequence":"first","affiliation":[{"name":"Department of Vehicle Engineering, Rocket Force University of Engineering, Xi\u2019an 710025, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-4986-3100","authenticated-orcid":false,"given":"Chuanqiang","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Vehicle Engineering, Rocket Force University of Engineering, Xi\u2019an 710025, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junti","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Vehicle Engineering, Rocket Force University of Engineering, Xi\u2019an 710025, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Li, N., Duan, J., Qin, J., and Zhou, Y. (2024). Resource scheduling optimisation study considering both supply and demand sides of services under cloud manufacturing. Systems, 12.","DOI":"10.3390\/systems12040133"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2586","DOI":"10.1109\/TCE.2023.3319043","article-title":"Online multi-agent task assignment and path finding with kinematic constraint in the federated internet of things","volume":"70","author":"Hou","year":"2024","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"840","DOI":"10.1109\/TETCI.2020.3042244","article-title":"Intelligentcrowd: Mobile crowdsensing via multi-agent reinforcement learning","volume":"5","author":"Chen","year":"2021","journal-title":"IEEE Trans. Emerg. Top. Comput. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1846","DOI":"10.1109\/TMECH.2021.3076080","article-title":"Learning communication for cooperation in dynamic agent-number environment","volume":"26","author":"Liu","year":"2021","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2143","DOI":"10.1109\/TNET.2023.3342020","article-title":"Multi-agent reinforcement learning-based trading decision-making in platooning-assisted vehicular networks","volume":"32","author":"Xiao","year":"2024","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2707","DOI":"10.1109\/TEM.2019.2950694","article-title":"Multiagent optimization approach to supply network configuration problems with varied product-market profiles","volume":"69","author":"Dharmapriya","year":"2022","journal-title":"IEEE Trans. Eng. Manag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"10638","DOI":"10.1109\/TNNLS.2022.3170070","article-title":"Distributed energy trading and scheduling among microgrids via multiagent reinforcement learning","volume":"34","author":"Gao","year":"2023","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ramirez, C.A., Agrawal, P., and Thompson, A.E. (2025). An approach integrating model-based systems engineering, iot, and digital twin for the design of electric unmanned autonomous vehicles. Systems, 13.","DOI":"10.3390\/systems13020073"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rehman, A.U., Usmani, Y.S., Mian, S.H., Abidi, M.H., and Alkhalefah, H. (2023). Simulation and goal programming approach to improve public hospital emergency department resource allocation. Systems, 11.","DOI":"10.3390\/systems11090467"},{"key":"ref_10","first-page":"6843","article-title":"Video content placement at the network edge: Centralized and distributed algorithms","volume":"22","author":"Gao","year":"2023","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1109\/TAC.2022.3170529","article-title":"Distributed synchronous and asynchronous algorithms for semidefinite programming with diagonal constraints","volume":"68","author":"Jiang","year":"2023","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"12888","DOI":"10.1109\/TVT.2021.3121281","article-title":"Game combined multi-agent reinforcement learning approach for uav assisted offloading","volume":"70","author":"Gao","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"12098","DOI":"10.1109\/TPAMI.2023.3283537","article-title":"Mo-mix: Multi-objective multi-agent cooperative decision-making with deep reinforcement learning","volume":"45","author":"Hu","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6636","DOI":"10.1109\/TAC.2024.3375248","article-title":"Distributed multiagent reinforcement learning based on graph-induced local value functions","volume":"69","author":"Jing","year":"2024","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Tian, L., Ji, X., and Zhou, Y. (2025). Maximizing information dissemination in social network via a fast local search. Systems, 13.","DOI":"10.3390\/systems13010059"},{"key":"ref_16","first-page":"1208","article-title":"Optimal distributed leader-following consensus of linear multi-agent systems: A dynamic average consensus-based approach","volume":"69","author":"Ren","year":"2022","journal-title":"IEEE Trans. Circuits Syst. II Express Briefs"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1350","DOI":"10.1109\/TCSI.2022.3226578","article-title":"Privacy-preserved distributed optimization for multi-agent systems with antagonistic interactions","volume":"70","author":"Luo","year":"2023","journal-title":"IEEE Trans. Circuits Syst. I Regul. Pap."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3108","DOI":"10.1109\/TITS.2023.3337334","article-title":"Hierarchical optimization scheduling algorithm for logistics transport vehicles based on multi-agent reinforcement learning","volume":"25","author":"Zhang","year":"2024","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2747","DOI":"10.1109\/TNSE.2022.3169151","article-title":"Solving specified-time distributed optimization problem via sampled-data-based algorithm","volume":"9","author":"Zhou","year":"2022","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Khdoudi, A., Masrour, T., Hassani, I.E., and Mazgualdi, C.E. (2024). A deep-reinforcement-learning-based digital twin for manufacturing process optimization. Systems, 12.","DOI":"10.3390\/systems12020038"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"12747","DOI":"10.1109\/TVT.2024.3391279","article-title":"Cooperative control of maglev levitation system via hamilton\u2013jacobi\u2013bellman multi-agent deep reinforcement learning","volume":"73","author":"Zhu","year":"2024","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.1109\/TKDE.2020.3006084","article-title":"Learning to delay in ride-sourcing systems: A multi-agent deep reinforcement learning framework","volume":"34","author":"Ke","year":"2022","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_23","first-page":"2229","article-title":"Deterministic reinforcement learning consensus control of nonlinear multi-agent systems via autonomous convergence perception","volume":"71","author":"Gao","year":"2024","journal-title":"IEEE Trans. Circuits Syst. II Express Briefs"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2940","DOI":"10.1109\/TNSE.2022.3171600","article-title":"Trajectory design and resource allocation for multi-uav networks: Deep reinforcement learning approaches","volume":"10","author":"Chang","year":"2023","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Guo, J., Yao, H., He, W., Mai, T., Ouyang, T., and Wang, F. (2024, January 27\u201331). Reinforcement learning-based genetic algorithm for differentiated traffic scheduling in industrial TSN-5G networks. Proceedings of the 2024 International Wireless Communications and Mobile Computing (IWCMC), Ayia Napa, Cyprus.","DOI":"10.1109\/IWCMC61514.2024.10592554"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1109\/TAC.2005.846556","article-title":"Consensus seeking in multiagent systems under dynamically changing interaction topologies","volume":"50","author":"Ren","year":"2005","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Low, C.B. (2011, January 19\u201321). A dynamic virtual structure formation control for fixed-wing uavs. Proceedings of the 2011 9th IEEE International Conference on Control and Automation (ICCA), Santiago, Chile.","DOI":"10.1109\/ICCA.2011.6137877"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1109\/70.736776","article-title":"Behavior-based formation control for multirobot teams","volume":"14","author":"Balch","year":"1998","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_29","unstructured":"Konda, V., and Tsitsiklis, J. (December, January 29). Actor-critic algorithms. Proceedings of the Advances in Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1116","DOI":"10.1109\/TITS.2022.3160757","article-title":"Ppo-based pdacb traffic control scheme for massive iov communications","volume":"24","author":"Zhang","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1109\/TCOMM.2022.3221422","article-title":"Ddpg-based joint time and energy management in ambient backscatter-assisted hybrid underlay crns","volume":"71","author":"Zheng","year":"2023","journal-title":"IEEE Trans. Commun."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/13\/6\/453\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:48:55Z","timestamp":1760032135000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/13\/6\/453"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,9]]},"references-count":32,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["systems13060453"],"URL":"https:\/\/doi.org\/10.3390\/systems13060453","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,9]]}}}