{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T06:05:05Z","timestamp":1762495505438,"version":"build-2065373602"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T00:00:00Z","timestamp":1758758400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T00:00:00Z","timestamp":1758758400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["OIA-2242812","DMS-2038080"],"award-info":[{"award-number":["OIA-2242812","DMS-2038080"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100020312","name":"Office of Fossil Energy and Carbon Management","doi-asserted-by":"publisher","award":["DE-SC0025229"],"award-info":[{"award-number":["DE-SC0025229"]}],"id":[{"id":"10.13039\/100020312","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008899","name":"University of South Carolina","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008899","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Sci Comput"],"published-print":{"date-parts":[[2025,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>We formulate the swarming optimization problem as a weakly coupled, dissipative dynamical system governed by a controlled energy dissipation rate and initial velocities that adhere to the nonequilibrium Onsager principle. In this formulation, agents\u2019 inertia, positions, and masses are dynamically coupled. To enable rapid convergence toward equilibrium, we develop a class of efficient, energy-stable numerical algorithms for the dynamical system that preserve or enhance energy dissipation at the discrete level. At the equilibrium, the system reaches one of the lowest local minima explored by the agents, thereby improving the likelihood of identifying the global minimum. Numerical experiments confirm the effectiveness of the proposed approach, demonstrating significant advantages over traditional swarm-based gradient descent methods, especially when operating with a limited number of agents.<\/jats:p>","DOI":"10.1007\/s10915-025-03041-6","type":"journal-article","created":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T09:30:23Z","timestamp":1758792623000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Energy-Stable Swarm-Based Inertial Algorithms for Optimization"],"prefix":"10.1007","volume":"105","author":[{"given":"Xuelong","family":"Gu","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9928-2703","authenticated-orcid":false,"given":"Qi","family":"Wang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,9,25]]},"reference":[{"issue":"1","key":"3041_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1142\/S0219199700000025","volume":"2","author":"H Attouch","year":"2000","unstructured":"Attouch, H., Goudou, X., Redont, P.: The heavy ball with friction method, I: The continuous dynamical system. Commun. Contemp. Math. 2(1), 1\u201334 (2000)","journal-title":"Commun. Contemp. Math."},{"key":"3041_CR2","unstructured":"Borghi, G., Pareschi, L.: Kinetic description and convergence analysis of genetic algorithms for global optimization. (2023). arXiv:2310.08562"},{"issue":"6","key":"3041_CR3","doi-asserted-by":"publisher","first-page":"1037","DOI":"10.1142\/S0218202518500276","volume":"28","author":"JA Carrillo","year":"2018","unstructured":"Carrillo, J.A., Choi, Y.-P., Totzeck, C., Tse, O.: An analytical framework for consensus-based global optimization method. Math. Models Methods Appl. Sci. 28(6), 1037\u20131066 (2018)","journal-title":"Math. Models Methods Appl. Sci."},{"key":"3041_CR4","unstructured":"Chen, Y., Chen, J., Dong, J., Peng, J., Wang, Z.: Accelerating Nonconvex Learning via Replica Exchange Langevin Diffusion. (2020). arXiv:2007.01990"},{"key":"3041_CR5","volume-title":"PTIMIZATION FOR ENGINEERING DESIGN: Algorithms and Examples","author":"K DEB","year":"2012","unstructured":"DEB, K.: PTIMIZATION FOR ENGINEERING DESIGN: Algorithms and Examples, 2nd edn. PHI Learning Private Limited, New Delhi (2012)","edition":"2"},{"issue":"6","key":"3041_CR6","doi-asserted-by":"publisher","first-page":"2745","DOI":"10.1137\/24M1657808","volume":"62","author":"Z Ding","year":"2024","unstructured":"Ding, Z., Guerra, M., Li, Q., Tadmor, E.: Swarm-based Gradient Descent meets Simulated Annealing. SIAM J. Numer. Anal. 62(6), 2745\u20132781 (2024)","journal-title":"SIAM J. Numer. Anal."},{"issue":"1","key":"3041_CR7","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1109\/3477.484436","volume":"26","author":"M Dorigo","year":"1996","unstructured":"Dorigo, M., Maniezzo, V., Colorni, A.: Ant system: optimization by a colony of cooperating agents. IEEE Trans. Syst. Man Cybern. B 26(1), 29\u201341 (1996)","journal-title":"IEEE Trans. Syst. Man Cybern. B"},{"key":"3041_CR8","doi-asserted-by":"publisher","first-page":"875","DOI":"10.1137\/18M118236X","volume":"57","author":"Q Du","year":"2019","unstructured":"Du, Q., Ju, L., Li, X., Qiao, Z.: Maximum principle preserving exponential time differencing schemes for the nonlocal Allen-Cahn equation. SIAM J. Numer. Anal. 57, 875\u2013898 (2019)","journal-title":"SIAM J. Numer. Anal."},{"key":"3041_CR9","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1137\/19M1243750","volume":"63","author":"Q Du","year":"2021","unstructured":"Du, Q., Ju, L., Li, X., Qiao, Z.: Maximum bound principles for a class of semilinear parabolic equations and exponential time-differencing schemes. SIAM Rev. 63, 317\u2013359 (2021)","journal-title":"SIAM Rev."},{"key":"3041_CR10","doi-asserted-by":"crossref","unstructured":"Eyre, D. J.: Unconditionally gradient stable time marching the Cahn-Hilliard equation. In MRS Proceedings, volume 529, page 39. Cambridge University Press, (1998)","DOI":"10.1557\/PROC-529-39"},{"key":"3041_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2021.113746","volume":"381","author":"Y Gong","year":"2021","unstructured":"Gong, Y., Hong, Q., Wang, Q.: Supplementary variable method for thermodynamically consistent partial differential equations. Comput. Methods Appl. Mech. Eng. 381, 113746 (2021)","journal-title":"Comput. Methods Appl. Mech. Eng."},{"issue":"2","key":"3041_CR12","doi-asserted-by":"publisher","first-page":"B528","DOI":"10.1137\/17M1135451","volume":"40","author":"Y Gong","year":"2018","unstructured":"Gong, Y., Zhao, J., Wang, Q.: Second order fully discrete energy stable methods on staggered grids for hydrodynamic phase field models of binary viscous fluids. SIAM J. Sci. Comput. 40(2), B528\u2013B553 (2018)","journal-title":"SIAM J. Sci. Comput."},{"issue":"5","key":"3041_CR13","doi-asserted-by":"publisher","first-page":"1573","DOI":"10.1007\/s10444-018-9597-5","volume":"44","author":"Y Gong","year":"2018","unstructured":"Gong, Y., Zhao, J., Wang, Q.: Linear second order in time energy stable schemes for hydrodynamic models of binary mixtures based on a spatially pseudospectral approximation. Adv. Comput. Math. 44(5), 1573\u20131600 (2018)","journal-title":"Adv. Comput. Math."},{"key":"3041_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2020.109610","volume":"419","author":"Y Gong","year":"2020","unstructured":"Gong, Y., Zhao, J., Wang, Q.: Arbitrarily high-order linear energy stable schemes for gradient flow models. J. Comput. Phys. 419, 109610 (2020)","journal-title":"J. Comput. Phys."},{"key":"3041_CR15","doi-asserted-by":"crossref","unstructured":"Grassi, S., Huang, H., Pareschi, L., Qiu, J.: Mean-field particle swarm optimization. In: Perthame, B., Bao, W., Markowich, P. A., Tadmor, E.: editors, Modeling and Simulation for Collective Dynamics, pages 127\u2013193. World Scientific, (2023)","DOI":"10.1142\/9789811266140_0003"},{"key":"3041_CR16","doi-asserted-by":"crossref","unstructured":"Hong, Q., Wang, Q., Gong, Y.: High-order supplementary variable methods for thermodynamically consistent partial differential equations. Comput. Methods Appl. Mech. Eng., 461, (2023)","DOI":"10.1016\/j.cma.2023.116306"},{"key":"3041_CR17","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1090\/cams\/42","volume":"4","author":"L Jingcheng","year":"2024","unstructured":"Jingcheng, L., Eitan, T., Anil, Z.: Swarm-Based Gradient Descent Method for Non-Convex Optimization. Commun. Amer. Math. Soc. 4, 787\u2013822 (2024)","journal-title":"Commun. Amer. Math. Soc."},{"key":"3041_CR18","doi-asserted-by":"crossref","unstructured":"Kennedy, J., Eberhart, R.: Particle swarm optimization. In Proceedings of ICNN\u201995 - International Conference on Neural Networks, volume 4, pages 1942\u20131948. IEEE, (1995)","DOI":"10.1109\/ICNN.1995.488968"},{"key":"3041_CR19","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-015-7744-1","volume-title":"Simulated Annealing: Theory and Applications","author":"PJM Laarhoven","year":"1987","unstructured":"Laarhoven, P.J.M., Aarts, E.H.L.: Simulated Annealing: Theory and Applications. Springer, Dordrecht (1987)"},{"issue":"3","key":"3041_CR20","first-page":"543","volume":"269","author":"Y Nesterov","year":"1983","unstructured":"Nesterov, Y.: A method for unconstrained convex minimization problem with the rate of convergence $$O(1\/k^2)$$. Dokl. Akad. Nauk SSSR 269(3), 543\u2013547 (1983)","journal-title":"Dokl. Akad. Nauk SSSR"},{"key":"3041_CR21","volume-title":"Numerical Optimization","author":"J Nocedal","year":"2006","unstructured":"Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York, NY (2006)","edition":"2"},{"issue":"1","key":"3041_CR22","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1142\/S0218202517400061","volume":"27","author":"R Pinnau","year":"2017","unstructured":"Pinnau, R., Totzeck, C., Tse, O., Martin, S.: A consensus-based model for global optimization and its mean-field limit. Math. Models Methods Appl. Sci. 27(1), 183\u2013204 (2017)","journal-title":"Math. Models Methods Appl. Sci."},{"issue":"5","key":"3041_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0041-5553(64)90137-5","volume":"4","author":"BT Polyak","year":"1964","unstructured":"Polyak, B.T.: Some methods of speeding up the convergence of iteration methods. USSR Comput. Math. & Math. Phys. 4(5), 1\u201317 (1964)","journal-title":"USSR Comput. Math. & Math. Phys."},{"issue":"3","key":"3041_CR24","doi-asserted-by":"publisher","first-page":"474","DOI":"10.1137\/17M1150153","volume":"61","author":"J Shen","year":"2019","unstructured":"Shen, J., Xu, J., Yang, J.: A new class of efficient and robust energy stable schemes for gradient flows. SIAM Rev. 61(3), 474\u2013506 (2019)","journal-title":"SIAM Rev."},{"volume-title":"Optimization for Machine Learning","year":"2011","key":"3041_CR25","unstructured":"Sra, S., Nowozin, S., Wright, S.J. (eds.): Optimization for Machine Learning. The MIT Press (2011)"},{"key":"3041_CR26","unstructured":"Sutskever, I., Martens, J., Dahl, G., Hinton, G.: On the importance of initialization and momentum in deep learning. In Proceedings of the 30th International Conference on Machine Learning, volume 28, pages 1139\u20131147, (2013)"},{"key":"3041_CR27","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1007\/s10440-024-00639-0","volume":"190","author":"E Tadmor","year":"2024","unstructured":"Tadmor, E., Zenginoglu, A.: Swarm-Based Optimization with Random Descent. Acta Appl. Math. 190, 2 (2024)","journal-title":"Acta Appl. Math."},{"key":"3041_CR28","volume-title":"Energy Landscapes: Applications to Clusters. Biomolecules and Glasses","author":"D Wales","year":"2004","unstructured":"Wales, D.: Energy Landscapes: Applications to Clusters. Biomolecules and Glasses. Cambridge University Press (2004)"},{"key":"3041_CR29","doi-asserted-by":"crossref","unstructured":"Wang, Q.: Generalized onsager principle and its applications. In Xiang you Liu, editor, Frontiers and Progress of Current Soft Matter Research, chapter 3, pages 101\u2013132. Springer Nature, Berlin, (2020)","DOI":"10.1007\/978-981-15-9297-3_3"},{"issue":"47","key":"3041_CR30","doi-asserted-by":"publisher","first-page":"E7351","DOI":"10.1073\/pnas.1614734113","volume":"113","author":"A Wibisono","year":"2016","unstructured":"Wibisono, A., Wilson, A.C., Jordan, M.I.: A variational perspective on accelerated methods in optimization. Proc. Natl. Acad. Sci. U.S.A. 113(47), E7351\u2013E7358 (2016)","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"3041_CR31","volume-title":"Nature-Inspired Metaheuristic Algorithms","author":"X Yang","year":"2010","unstructured":"Yang, X.: Nature-Inspired Metaheuristic Algorithms, 2nd edn. Luniver Press (2010)","edition":"2"},{"issue":"11","key":"3041_CR32","doi-asserted-by":"publisher","first-page":"1993","DOI":"10.1142\/S0218202517500373","volume":"27","author":"X Yang","year":"2017","unstructured":"Yang, X., Zhao, J., Wang, Q., Shen, J.: Numerical approximations for a three components Cahn-Hilliard phase-field model based on the invariant energy quadratization method. Math. Models Methods Appl. Sci. 27(11), 1993\u20132030 (2017)","journal-title":"Math. Models Methods Appl. Sci."},{"key":"3041_CR33","doi-asserted-by":"publisher","first-page":"1241","DOI":"10.1007\/s10915-016-0177-x","volume":"68","author":"J Zhao","year":"2016","unstructured":"Zhao, J., Wang, Q.: Semi-discrete energy-stable schemes for a tensor-based hydrodynamic model of nematic liquid crystal flows. J. Sci. Comput. 68, 1241\u20131266 (2016)","journal-title":"J. Sci. Comput."}],"container-title":["Journal of Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10915-025-03041-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10915-025-03041-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10915-025-03041-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T06:03:23Z","timestamp":1762495403000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10915-025-03041-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,25]]},"references-count":33,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,11]]}},"alternative-id":["3041"],"URL":"https:\/\/doi.org\/10.1007\/s10915-025-03041-6","relation":{},"ISSN":["0885-7474","1573-7691"],"issn-type":[{"type":"print","value":"0885-7474"},{"type":"electronic","value":"1573-7691"}],"subject":[],"published":{"date-parts":[[2025,9,25]]},"assertion":[{"value":"22 April 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 August 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 August 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 September 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"37"}}