{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T16:55:05Z","timestamp":1781369705700,"version":"3.54.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T00:00:00Z","timestamp":1774569600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T00:00:00Z","timestamp":1774569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Genet Program Evolvable Mach"],"published-print":{"date-parts":[[2026,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>We report the solution of a benchmark set of ordinary differential equations (ODEs) with genetic programming (GP) within a collocation framework using numerical tuning of the embedded tree constants. Alongside a conventional soft penalty formulation, we also report results from two GP variants that enforce the initial conditions on the ODEs as hard constraints: the first uses the so-called death penalty while the second employs a novel ranking method that orders infeasible individuals using Pareto dominance according to the degree to which they violate the constraints. We investigate the influence of the numbers of collocation points used to solve the problem, and conclude that a few ODEs require more than 10\u201320 points, otherwise the number of points is not critical. A statistical comparison of the different methods indicates that only a few ODEs display differences, an observation we attribute to the influence of parameter tuning. We obtain highly accurate solutions for all the benchmark ODEs, but identify a problem with certain of the ODEs producing trivial solutions, which we are able to mostly mitigate by introducing an additional constraint on the mean squared amplitude of the evolved solutions. Overall, we infer that the properties of the individual ODEs can impact the solution process.<\/jats:p>","DOI":"10.1007\/s10710-026-09536-x","type":"journal-article","created":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T02:37:56Z","timestamp":1774579076000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Solving ordinary differential equations with genetic programming with hard initial\/boundary value constraints"],"prefix":"10.1007","volume":"27","author":[{"given":"Peter","family":"Rockett","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,3,27]]},"reference":[{"key":"9536_CR1","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780199208241.001.0001","volume-title":"Nonlinear ordinary differential equations: An introduction for scientists and engineers","author":"DW Jordan","year":"2007","unstructured":"D.W. Jordan, P. Smith, Nonlinear ordinary differential equations: An introduction for scientists and engineers, 4th edn. (Oxford University Press, Oxford, UK, 2007)","edition":"4"},{"key":"9536_CR2","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/s10710-006-7009-y","volume":"7","author":"IG Tsoulos","year":"2006","unstructured":"I.G. Tsoulos, I.E. Lagaris, Solving differential equations with genetic programming. Genet. Program. Evol. M. 7, 33\u201354 (2006)","journal-title":"Genet. Program. Evol. M."},{"key":"9536_CR3","unstructured":"T. Seaton, G. Brown, J.\u00a0F. EMiller, A.\u00a0I. sparcia-Alc\u00e1zar, A. Ek\u00e1rt, S. Silva, S. Dignum, A.\u00a0S. Etaner-Uyar, (eds) Analytic solutions to differential equations under graph-based genetic programming. (eds A.\u00a0I. Esparcia-Alc\u00e1zar, A. Ek\u00e1rt, S. Silva, S. Dignum, A.\u00a0S.Etaner-Uyar, ) 13th European Conference on Genetic Programming (EuroGP\u201910), 232\u2013243 (Istanbul, Turkey, 2010)"},{"key":"9536_CR4","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","volume":"378","author":"M Raissi","year":"2019","unstructured":"M. Raissi, P. Perdikaris, G.E. Karniadakis, Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J. Comput. Phys. 378, 686\u2013707 (2019)","journal-title":"J. Comput. Phys."},{"key":"9536_CR5","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1080\/0025570X.1986.11977261","volume":"59","author":"LB Rall","year":"1986","unstructured":"L.B. Rall, The arithmetic of differentiation. Math. Mag. 59, 275\u2013282 (1986)","journal-title":"Math. Mag."},{"key":"9536_CR6","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1007\/s10915-022-01939-z","volume":"92","author":"S Cuomo","year":"2022","unstructured":"S. Cuomo et al., Scientific machine learning through physics-informed neural networks: where we are and what\u2019s next. J. Sci. Comput. 92, 88 (2022)","journal-title":"J. Sci. Comput."},{"key":"9536_CR7","doi-asserted-by":"publisher","unstructured":"J. Ramirez, M. Hashemizadeh, S. Lacoste-Julien, Position: adopt constraints over penalties in deep learning. CoRR arXiv:2505.20628 (2025). https:\/\/doi.org\/10.48550\/arXiv.2505.20628","DOI":"10.48550\/arXiv.2505.20628"},{"key":"9536_CR8","doi-asserted-by":"crossref","unstructured":"W. J.\u00a0A. Lob\u00e3o, D.\u00a0M. Dias, M. A.\u00a0C. Pacheco, D.\u00a0E. Goldberg, C. A.\u00a0C. Coello, X. Zhang, (eds) Genetic programming and automatic differentiation algorithms applied to the solution of ordinary and partial differential equations. (eds D.\u00a0E. Goldberg, C. A.\u00a0C. Coello, X.Zhang, ) IEEE Congress on Evolutionary Computation, 5286\u20135292 (Vancouver, Canada, 2016)","DOI":"10.1109\/CEC.2016.7748362"},{"key":"9536_CR9","unstructured":"H. Oh, et\u00a0al., Genetic programming based symbolic regression for analytical solutions to differential equations (2023). arXiv:2302.03175"},{"key":"9536_CR10","doi-asserted-by":"crossref","unstructured":"P. Rockett, The solution of ordinary differential equations using genetic programming with constant tuning. 24th UK Workshop on Computational Intelligence, Edinburgh (2025)","DOI":"10.1007\/978-3-032-07938-1_9"},{"key":"9536_CR11","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1007\/s10710-021-09410-y","volume":"23","author":"P Rockett","year":"2021","unstructured":"P. Rockett, Constant optimization and feature standardization in multiobjective genetic programming. Genet. Program. Evol. M. 23, 37\u201369 (2021)","journal-title":"Genet. Program. Evol. M."},{"key":"9536_CR12","volume-title":"Numerical optimization","author":"J Nocedal","year":"2006","unstructured":"J. Nocedal, S.J. Wright, Numerical optimization, 2nd edn. (Springer, New York, 2006)","edition":"2"},{"key":"9536_CR13","doi-asserted-by":"publisher","first-page":"B1105","DOI":"10.1137\/21M1397908","volume":"43","author":"L Lu","year":"2021","unstructured":"L. Lu et al., Physics-informed neural networks with hard constraints for inverse design. SIAM J. Sci. Comput. 43, B1105\u2013B1132 (2021)","journal-title":"SIAM J. Sci. Comput."},{"key":"9536_CR14","unstructured":"P. M\u00e1rquez-Neila, M. Salzmann, P. Fua, Imposing hard constraints on deep networks: promises and limitations. CoRR (2017). arXiv:1706.02025"},{"key":"9536_CR15","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1109\/TEVC.2012.2195319","volume":"17","author":"J Ni","year":"2013","unstructured":"J. Ni, R.H. Drieberg, P.I. Rockett, The use of an analytic quotient operator in genetic programming. IEEE Trans. Evol. Comput. 17, 146\u2013152 (2013)","journal-title":"IEEE Trans. Evol. Comput."},{"key":"9536_CR16","first-page":"105","volume-title":"The Levenberg-Marquardt algorithm: Implementation and theory","author":"JJ Mor\u00e9","year":"1978","unstructured":"J.J. Mor\u00e9, The Levenberg-Marquardt algorithm: Implementation and theory (Springer, Berlin, Heidelberg, 1978), pp.105\u2013116"},{"key":"9536_CR17","unstructured":"P. Rockett, Y. Kaszubowski\u00a0Lopes, T. Dou, E.\u00a0A. Hathway, H.\u00a0P. Garc\u00eda, L. S\u00e1nchez-Gonz\u00e1lez, M.\u00a0C. Limas, H. Quinti\u00e1n-Pardo, E. S.\u00a0C. Rodr\u00edguez, (eds) d(Tree)-by-dx: Automatic and exact differentiation of genetic programming trees. (eds H.\u00a0P. Garc\u00eda, L. S\u00e1nchez-Gonz\u00e1lez, M.\u00a0C. H. Limas, Quinti\u00e1n-Pardo, E. S.\u00a0C. Rodr\u00edguez,) 14th International Conference on Hybrid Artificial Intelligent Systems (HAIS2019), 133\u2013144 (Le\u00f3n, Spain, 2019)"},{"key":"9536_CR18","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1305","volume":"9","author":"CC Margossian","year":"2019","unstructured":"C.C. Margossian, A review of automatic differentiation and its efficient implementation. WIREs Data Min. Knowl. Discov. 9, e1305 (2019)","journal-title":"WIREs Data Min. Knowl. Discov."},{"key":"9536_CR19","doi-asserted-by":"publisher","first-page":"2181","DOI":"10.1007\/s11831-022-09859-9","volume":"30","author":"I Rahimi","year":"2023","unstructured":"I. Rahimi, A.H. Gandomi, F. Chen, E. Mezura-Montes, A review on constraint handling techniques for population-based algorithms: From single-objective to multi-objective optimization. Arch. Comput. Method. E. 30, 2181\u20132209 (2023)","journal-title":"Arch. Comput. Method. E."},{"key":"9536_CR20","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1007\/s10710-018-9325-4","volume":"19","author":"T Dou","year":"2018","unstructured":"T. Dou, P. Rockett, Comparison of semantic-based local search methods for multiobjective genetic programming. Genet. Program. Evol. M. 19, 535\u2013563 (2018)","journal-title":"Genet. Program. Evol. M."},{"key":"9536_CR21","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1109\/3468.650319","volume":"28","author":"C Fonseca","year":"1998","unstructured":"C. Fonseca, P.J. Fleming, Multiobjective optimization and multiple constraint handling with evolutionary algorithms - Part I: a unified formulation. IEEE Trans. Syst. Man Cybern. Part A Syst. Humans 28, 26\u201337 (1998)","journal-title":"Syst. Man Cybern. Part A Syst. Humans"},{"key":"9536_CR22","unstructured":"R. Poli, W.\u00a0B. Langdon, N.\u00a0F. McPhee, A Field Guide to Genetic Programming (Published via http:\/\/lulu.com and freely available at http:\/\/www.gp-field-guide.org.uk, 2008)"},{"key":"9536_CR23","unstructured":"W. Rudin, Principles of Mathematical Analysis (McGraw-Hill, 1976)"},{"key":"9536_CR24","doi-asserted-by":"crossref","unstructured":"E. Mezura-Montes, C.\u00a0A. Coello\u00a0Coello, E.\u00a0I. Tun-Morales, R. Monroy, G. Arroyo-Figueroa, L.\u00a0E. Sucar, H. Sossa, (eds) Simple feasibility rules and differential evolution for constrained optimization. (eds R. Monroy, G. Arroyo-Figueroa, L.\u00a0E. H. Sucar, Sossa,) MICAI 2004: Advances in Artificial Intelligence, 707\u2013716 (Mexico City, Mexico, 2004)","DOI":"10.1007\/978-3-540-24694-7_73"},{"key":"9536_CR25","unstructured":"F.\u00a0M. Rohrhofer, S. Posch, C. G\u00f6\u00dfnitzer, B.\u00a0C. Geiger, On the role of fixed points of dynamical systems in training physics-informed neural networks. Trans. Mach. Learn. Res. 2023 (2023)"},{"key":"9536_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2023.112464","volume":"493","author":"M Penwarden","year":"2023","unstructured":"M. Penwarden, A.D. Jagtap, S. Zhe, G.E. Karniadakis, R.M. Kirby, A unified scalable framework for causal sweeping strategies for physics-informed neural networks (PINNs) and their temporal decompositions. J. Comput. Phys. 493, 112464 (2023)","journal-title":"J. Comput. Phys."},{"key":"9536_CR27","doi-asserted-by":"publisher","first-page":"1282","DOI":"10.1038\/s41562-021-01177-7","volume":"5","author":"JK Kruschke","year":"2021","unstructured":"J.K. Kruschke, Bayesian analysis reporting guidelines. Nat. Hum. Behav. 5, 1282\u20131291 (2021)","journal-title":"Nat. Hum. Behav."},{"key":"9536_CR28","unstructured":"A. Benavoli, G. Corani, F. Mangili, M. Zaffalon, F. Ruggeri, E.\u00a0P. Xing, T. Jebara, (eds) A Bayesian Wilcoxon signed-rank test based on the Dirichlet process. (eds E.\u00a0P. Xing, T. Jebara,) 31st International Conference on Machine Learning, Vol.\u00a032, 1026\u20131034 (Bejing, China, 2014)"},{"key":"9536_CR29","first-page":"1","volume":"18","author":"A Benavoli","year":"2017","unstructured":"A. Benavoli, G. Corani, J. Dem\u0161ar, M. Zaffalon, Time for a change: A tutorial for comparing multiple classifiers through Bayesian analysis. J. Mach. Learn. Res. 18, 1\u201336 (2017)","journal-title":"J. Mach. Learn. Res."},{"key":"9536_CR30","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1007\/s10654-016-0149-3","volume":"31","author":"S Greenland","year":"2016","unstructured":"S. Greenland et al., Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur. J. Epidemiol. 31, 337\u2013350 (2016)","journal-title":"Eur. J. Epidemiol."},{"key":"9536_CR31","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1080\/01621459.1995.10476572","volume":"90","author":"RE Kass","year":"1995","unstructured":"R.E. Kass, A.E. Raftery, Bayes factors. J. Amer. Stat. Assoc. 90, 773\u2013795 (1995)","journal-title":"J. Amer. Stat. Assoc."},{"key":"9536_CR32","doi-asserted-by":"publisher","first-page":"178","DOI":"10.3758\/s13423-016-1221-4","volume":"25","author":"JK Kruschke","year":"2018","unstructured":"J.K. Kruschke, T.M. Liddell, The Bayesian new statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective. Psychon B Rev 25, 178\u2013206 (2018)","journal-title":"Psychon B Rev"},{"key":"9536_CR33","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1037\/0003-066X.45.12.1304","volume":"45","author":"J Cohen","year":"1990","unstructured":"J. Cohen, Things I have learned (so far). Am. Psychol. 45, 1304\u20131312 (1990)","journal-title":"Am. Psychol."},{"key":"9536_CR34","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1080\/01621459.1987.10478410","volume":"82","author":"B Efron","year":"1987","unstructured":"B. Efron, Better bootstrap confidence intervals. J. Amer. Stat. Assoc. 82, 171\u2013185 (1987)","journal-title":"J. Amer. Stat. Assoc."},{"key":"9536_CR35","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1007\/s10710-019-09370-4","volume":"21","author":"T Dou","year":"2020","unstructured":"T. Dou, Y. Kaszubowski Lopes, P. Rockett, E.A. Hathway, E. Saber, GPML: an XML-based standard for the interchange of genetic programming trees. Genet. Program. Evol. M. 21, 605\u2013627 (2020)","journal-title":"Genet. Program. Evol. M."},{"key":"9536_CR36","doi-asserted-by":"crossref","unstructured":"J. Kubal\u00edk, E. Derner, R. Babu\u0161ka, C.\u00a0A. Coello\u00a0Coello, (ed.) Symbolic regression driven by training data and prior knowledge. (ed.Coello\u00a0Coello, C.\u00a0A.) Genetic and Evolutionary Computation Conference (GECCO \u201920), 958\u2013966 (Canc\u00fan Mexico, 2020)","DOI":"10.1145\/3377930.3390152"},{"key":"9536_CR37","doi-asserted-by":"crossref","unstructured":"C. Haider, F. Bachinger, F. Holzinger, F.\u00a0O. de\u00a0Fran\u00e7a, A. Quesada-Arencibia, M. Affenzeller, R. Moreno-D\u00edaz, (eds) Comparing constraint evaluation methods for shape-constrained regression. (eds Quesada-Arencibia, A., Affenzeller, M. & Moreno-D\u00edaz, R.) 19th International Conference on Computer Aided Systems Theory (EUROCAST 2024), 68\u201376 (Las Palmas de Gran Canaria, Spain, 2024)","DOI":"10.1007\/978-3-031-82949-9_7"},{"key":"9536_CR38","doi-asserted-by":"crossref","unstructured":"Z. Hao, et\u00a0al. A. Globerson, et\u00a0al. (eds) PINNacle: A comprehensive benchmark of physics-informed neural networks for solving PDEs. (eds Globerson, A. et\u00a0al.) Advances in Neural Information Processing Systems, Vol.\u00a037, 76721\u201376774 (2024)","DOI":"10.52202\/079017-2442"},{"key":"9536_CR39","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0020124","volume":"2","author":"JPA Ioannidis","year":"2005","unstructured":"J.P.A. Ioannidis, Why most published research findings are false. PLoS Med. 2, e124 (2005)","journal-title":"PLoS Med."},{"key":"9536_CR40","doi-asserted-by":"publisher","DOI":"10.1090\/gsm\/019","volume-title":"Partial differential equations","author":"LC Evans","year":"2010","unstructured":"L.C. Evans, Partial differential equations, 2nd edn. (American Mathematical Society, Providence, RI, 2010)","edition":"2"}],"container-title":["Genetic Programming and Evolvable Machines"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10710-026-09536-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10710-026-09536-x","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10710-026-09536-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T16:02:30Z","timestamp":1781366550000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10710-026-09536-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,27]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,6]]}},"alternative-id":["9536"],"URL":"https:\/\/doi.org\/10.1007\/s10710-026-09536-x","relation":{},"ISSN":["1389-2576","1573-7632"],"issn-type":[{"value":"1389-2576","type":"print"},{"value":"1573-7632","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,27]]},"assertion":[{"value":"24 September 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 March 2026","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 March 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 March 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interests"}},{"value":"This work did not require ethics approval.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}],"article-number":"11"}}