{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T02:15:09Z","timestamp":1774923309240,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T00:00:00Z","timestamp":1692576000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["22-21-20004"],"award-info":[{"award-number":["22-21-20004"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>The article presents the development of new physics-informed evolutionary neural network learning algorithms. These algorithms aim to address the challenges of ill-posed problems by constructing a population close to the Pareto front. The study focuses on comparing the algorithm\u2019s capabilities based on three quality criteria of solutions. To evaluate the algorithms\u2019 performance, two benchmark problems have been used. The first involved solving the Laplace equation in square regions with discontinuous boundary conditions. The second problem considered the absence of boundary conditions but with the presence of measurements. Additionally, the study investigates the influence of hyperparameters on the final results. Comparisons have been made between the proposed algorithms and standard algorithms for constructing neural networks based on physics (commonly referred to as vanilla\u2019s algorithms). The results demonstrate the advantage of the proposed algorithms in achieving better performance when solving incorrectly posed problems. Furthermore, the proposed algorithms have the ability to identify specific solutions with the desired smoothness.<\/jats:p>","DOI":"10.3390\/computation11080166","type":"journal-article","created":{"date-parts":[[2023,8,22]],"date-time":"2023-08-22T00:46:22Z","timestamp":1692665182000},"page":"166","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Evolutionary PINN Learning Algorithms Inspired by Approximation to Pareto Front for Solving Ill-Posed Problems"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3324-6213","authenticated-orcid":false,"given":"Tatiana","family":"Lazovskaya","sequence":"first","affiliation":[{"name":"Department of Higher Mathematics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9431-8241","authenticated-orcid":false,"given":"Dmitriy","family":"Tarkhov","sequence":"additional","affiliation":[{"name":"Department of Higher Mathematics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8420-9349","authenticated-orcid":false,"given":"Maria","family":"Chistyakova","sequence":"additional","affiliation":[{"name":"Institute of Physics and Mechanics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-1272-5439","authenticated-orcid":false,"given":"Egor","family":"Razumov","sequence":"additional","affiliation":[{"name":"Institute of Physics and Mechanics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-1490-1882","authenticated-orcid":false,"given":"Anna","family":"Sergeeva","sequence":"additional","affiliation":[{"name":"Institute of Physics and Mechanics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9572-1406","authenticated-orcid":false,"given":"Tatiana","family":"Shemyakina","sequence":"additional","affiliation":[{"name":"Department of Higher Mathematics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,21]]},"reference":[{"key":"ref_1","unstructured":"Haykin, S. (1999). Neural Networks: A Comprehensive Foundation, Prentice Hall."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"12363","DOI":"10.1007\/s00521-020-04832-8","article-title":"Evolutionary algorithms and their applications to engineering problems","volume":"32","author":"Slowik","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.envsoft.2018.11.018","article-title":"Introductory overview: Optimization using evolutionary algorithms and other metaheuristics","volume":"114","author":"Maier","year":"2019","journal-title":"Environ. Model. Softw."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yu, X., and Gen, M. (2010). Introduction to Evolutionary Algorithms, Springer Science & Business Media.","DOI":"10.1007\/978-1-84996-129-5"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2380","DOI":"10.1109\/TEVC.2019.2918140","article-title":"An Evolutionary Algorithm for Large-Scale Sparse Multiobjective Optimization Problems","volume":"24","author":"Tian","year":"2020","journal-title":"IEEE Trans. Evolut. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1016\/j.jcp.2018.08.029","article-title":"DGM: A deep learning algorithm for solving partial differential equations","volume":"375","author":"Sirignano","year":"2018","journal-title":"J. Comput. Phys."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1002\/cnm.1640100303","article-title":"Neural-network-based approximations for solving partial differential equations","volume":"10","author":"Dissanayake","year":"1994","journal-title":"Commun. Numer. Methods Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1109\/72.712178","article-title":"Artificial neural networks for solving ordinary and partial differential equations","volume":"9","author":"Lagaris","year":"1998","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","article-title":"Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations","volume":"378","author":"Raissi","year":"2019","journal-title":"J. Comput. Phys."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Elsken, T., Metzen, J.H., and Hutter, F. (2018). Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution. arXiv.","DOI":"10.1007\/978-3-030-05318-5_3"},{"key":"ref_11","first-page":"327","article-title":"Mathematical models of complex systems on the basis of artificial neural networks","volume":"17","author":"Vasilyev","year":"2014","journal-title":"Nonlinear Phenom. Complex Syst."},{"key":"ref_12","first-page":"1","article-title":"Neural networks as a means of mathematical modeling","volume":"2","author":"Tarkhov","year":"2006","journal-title":"Neurocomput. Dev. Appl."},{"key":"ref_13","unstructured":"Tarkhov, D., and Vasilyev, A.N. (2019). Semi-Empirical Neural Network Modeling and Digital Twins Development, Academic Press."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.advengsoft.2013.12.007","article-title":"Grey Wolf optimizer","volume":"69","author":"Mirjalili","year":"2014","journal-title":"Adv. Eng. Softw."},{"key":"ref_15","unstructured":"Eberhart, R., and Kennedy, J. (December, January 27). Particle swarm optimization. Proceedings of the ICNN\u201995\u2014International Conference on Neural Networks, Perth, WA, Australia."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/s42256-018-0006-z","article-title":"Designing neural networks through neuroevolution","volume":"1","author":"Stanley","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.neunet.2018.07.013","article-title":"Born to learn: The inspiration, progress, and future of evolved plastic artificial neural networks","volume":"108","author":"Soltoggio","year":"2018","journal-title":"Neural Netw."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1016\/j.ins.2022.06.036","article-title":"An ensemble of differential evolution and Adam for training feed-forward neural networks","volume":"608","author":"Xue","year":"2022","journal-title":"Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.istruc.2023.03.178","article-title":"Efficient training of two ANNs using four meta-heuristic algorithms for predicting the FRP strength","volume":"52","author":"Kaveh","year":"2023","journal-title":"Structures"},{"key":"ref_20","unstructured":"Basir, S., and Inanc, S. (2021). Physics and Equality Constrained Artificial Neural Networks: Application to Partial Differential Equations. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"104232","DOI":"10.1016\/j.engappai.2021.104232","article-title":"A Physics-Informed Machine Learning Approach for Solving Heat Transfer Equation in Advanced Manufacturing and Engineering Applications","volume":"101","author":"Zobeiry","year":"2021","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Rao, C., Sun, H., and Liu, Y. (2020). Physics-informed deep learning for incompressible laminar flows. arXiv.","DOI":"10.1016\/j.taml.2020.01.039"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Huang, Y., Zhang, Z., and Zhang, X. (2022). A Direct-Forcing Immersed Boundary Method for Incompressible Flows Based on Physics-Informed Neural Network. Fluids, 7.","DOI":"10.3390\/fluids7020056"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"017116","DOI":"10.1063\/5.0078143","article-title":"Dense velocity reconstruction from particle image velocimetry\/particle tracking velocimetry using a physics-informed neural network","volume":"34","author":"Wang","year":"2022","journal-title":"Phys. Fluids"},{"key":"ref_25","unstructured":"Bischof, R., and Kraus, M. (2021). Multi-objective loss balancing for physics-informed deep learning. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1211","DOI":"10.1007\/s40747-022-00650-8","article-title":"Multi-objective multi-criteria evolutionary algorithm for multi-objective multi-task optimization","volume":"9","author":"Du","year":"2022","journal-title":"Complex Intell. Syst."},{"key":"ref_27","unstructured":"Coello, C.A.C., Lamont, G.B., and Van Veldhuizen, D.A. (2007). Evolutionary Algorithms for Solving Multi-Objective Problems, Springer. [2nd ed.]."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2698","DOI":"10.1109\/TCYB.2020.3020630","article-title":"An Adaptive Reference Vector-Guided Evolutionary Algorithm Using Growing Neural Gas for Many-Objective Optimization of Irregular Problems","volume":"52","author":"Liu","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_29","unstructured":"Lin, X., Zhen, H., Li, Z., Zhang, Q., and Kwong, S.T. (2019). Pareto Multi-Task Learning. arXiv."},{"key":"ref_30","unstructured":"Momma, M., Dong, C., and Liu, J. (2022, January 17\u201323). A Multi-objective \/ Multi-task Learning Framework Induced by Pareto Stationarity. Proceedings of the 39th International Conference on Machine Learning (PMLR), Baltimore, MD, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lu, B., Moya, C., and Lin, G. (2023). NSGA-PINN: A Multi-Objective Optimization Method for Physics-Informed Neural Network Training. Algorithms, 16.","DOI":"10.3390\/a16040194"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.neucom.2022.01.001","article-title":"A self-adaptive gradient descent search algorithm for fully-connected neural networks","volume":"478","author":"Xue","year":"2022","journal-title":"Neurocomputing"},{"key":"ref_33","unstructured":"Daw, A., Bu, J., Wang, S., Perdikaris, P., and Karpatne, A. (2022). Rethinking the importance of sampling in physics-informed neural networks. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Cauteruccio, F., Stamile, C., Terracina, G., Ursino, G., and Sappey-Mariniery, D. (2015, January 12\u201317). An automated string-based approach to White Matter fiber-bundles clustering. Proceedings of the 2015 International Joint Conference on Neural Networks (IJCNN), Killarney, Ireland.","DOI":"10.1109\/IJCNN.2015.7280545"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"103610","DOI":"10.1016\/j.advwatres.2020.103610","article-title":"Physics-informed neural networks for multiphysics data assimilation with application to subsurface transport","volume":"141","author":"He","year":"2020","journal-title":"Adv. Water Resour."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"106617","DOI":"10.1016\/j.aml.2020.106617","article-title":"Simulating the spread of COVID-19 via a spatially-resolved susceptible\u2013exposed\u2013infected\u2013recovered\u2013deceased (SEIRD) model with heterogeneous diffusion","volume":"111","author":"Viguerie","year":"2021","journal-title":"Appl. Math. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1017\/S1471068419000449","article-title":"A logic-based framework leveraging neural networks for studying the evolution of neurological disorders","volume":"21","author":"Calimeri","year":"2021","journal-title":"Theory Pract. Logic Programm."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1090\/qam\/1526","article-title":"Evolution partial differential equations with discontinuous data","volume":"77","author":"Trogdon","year":"2019","journal-title":"Quart. Appl. Math."},{"key":"ref_39","first-page":"125979","article-title":"An accuracy-preserving numerical scheme for parabolic partial differential equations subject to discontinuities in boundary conditions","volume":"400","author":"Mitchell","year":"2021","journal-title":"Appl. Math. Comput."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1016\/j.enganabound.2021.02.001","article-title":"Automatic mesh-free boundary analysis: Multi-objective optimization","volume":"125","author":"Martins","year":"2021","journal-title":"Eng. Anal. Bound. Elem."},{"key":"ref_41","first-page":"192","article-title":"Fresh approaches to the construction of parameterized neural network solutions of a stiff differential equation","volume":"1","author":"Lazovskaya","year":"2015","journal-title":"St. Petersburg Polytech. Univ. J. Phys. Math."},{"key":"ref_42","first-page":"97","article-title":"New neural network technique to the numerical solution of mathematical physics problems. II: Complicated and nonstandard problems","volume":"14","author":"Tarkhov","year":"2005","journal-title":"Opt. Mem. Neural Netw. (Inf. Opt.)"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kryzhanovsky, B., Dunin-Barkowski, W., Redko, V., and Tiumentsev, Y. (2023). Advances in Neural Computation, Machine Learning, and Cognitive Research VI. NEUROINFORMATICS 2022, Springer.","DOI":"10.1007\/978-3-031-19032-2"},{"key":"ref_44","first-page":"48","article-title":"Optimization of HVAC system energy consumption in a building using artificial neural network and multi-objective genetic algorithm","volume":"35","author":"Satrio","year":"2019","journal-title":"Sustain. Energy Technol. Assess."},{"key":"ref_45","unstructured":"Braun, H., and Riedmiller, M. (April, January 28). A direct adaptive method for faster backpropagation learning: The Rprop algorithm. Proceedings of the IEEE International Conference on Neural Networks, San Francisco, CA, USA."}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/11\/8\/166\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:38:55Z","timestamp":1760128735000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/11\/8\/166"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,21]]},"references-count":45,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["computation11080166"],"URL":"https:\/\/doi.org\/10.3390\/computation11080166","relation":{},"ISSN":["2079-3197"],"issn-type":[{"value":"2079-3197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,21]]}}}