{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T16:33:30Z","timestamp":1792946010756,"version":"4.5.0"},"reference-count":157,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2024,5,24]],"date-time":"2024-05-24T00:00:00Z","timestamp":1716508800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,24]],"date-time":"2024-05-24T00:00:00Z","timestamp":1716508800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Mathematics lies at the heart of engineering science and is very important for capturing and modeling of diverse processes. These processes may be naturally-occurring or man-made. One important engineering problem in this regard is the modeling of advanced mathematical problems and their analysis. Partial differential equations (PDEs) are important and useful tools to this end. However, solving complex PDEs for advanced problems requires extensive computational resources and complex techniques. Neural networks provide a way to solve complex PDEs reliably. In this regard, large-data models are new generation of techniques, which have large dependency capturing capabilities. Hence, they can richly model and accurately solve such complex PDEs. Some common large-data models include Convolutional neural networks (CNNs) and their derivatives, transformers, etc. In this literature survey, the mathematical background is introduced. A gentle introduction to the area of solving PDEs using large-data models is given. Various state-of-the-art large-data models for solving PDEs are discussed. Also, the major issues and future scope of the area are identified. Through this literature survey, it is hoped that readers will gain an insight into the area of solving PDEs using large-data models and pursue future\u00a0research in this interesting area.<\/jats:p>","DOI":"10.1007\/s10462-024-10784-5","type":"journal-article","created":{"date-parts":[[2024,5,24]],"date-time":"2024-05-24T22:01:28Z","timestamp":1716588088000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Solving partial differential equations using large-data models: a literature review"],"prefix":"10.1007","volume":"57","author":[{"given":"Abdul Mueed","family":"Hafiz","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irfan","family":"Faiq","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M.","family":"Hassaballah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,5,24]]},"reference":[{"issue":"1","key":"10784_CR1","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1007\/s10851-022-01106-x","volume":"65","author":"T Alt","year":"2023","unstructured":"Alt T, Schrader K, Augustin M, Peter P, Weickert J (2023) Connections between numerical algorithms for PDEs and neural networks. J Math Imaging Vis 65(1):185\u2013208","journal-title":"J Math Imaging Vis"},{"issue":"1","key":"10784_CR2","doi-asserted-by":"crossref","first-page":"9116","DOI":"10.1038\/s41598-023-35531-8","volume":"13","author":"ANM Antony","year":"2023","unstructured":"Antony ANM, Narisetti N, Gladilin E (2023) FDM data driven U-Net as a 2D Laplace PINN solver. Sci Rep 13(1):9116","journal-title":"Sci Rep"},{"key":"10784_CR3","doi-asserted-by":"crossref","first-page":"119509","DOI":"10.1016\/j.eswa.2023.119509","volume":"217","author":"MN Ashtiani","year":"2023","unstructured":"Ashtiani MN, Raahemi B (2023) News-based intelligent prediction of financial markets using text mining and machine learning: a systematic literature review. Expert Syst Appl 217:119509","journal-title":"Expert Syst Appl"},{"issue":"11","key":"10784_CR4","doi-asserted-by":"crossref","first-page":"115003","DOI":"10.1088\/1361-6420\/abb447","volume":"36","author":"G Bao","year":"2020","unstructured":"Bao G, Ye X, Zang Y, Zhou H (2020) Numerical solution of inverse problems by weak adversarial networks. Inverse Probl 36(11):115003","journal-title":"Inverse Probl"},{"key":"10784_CR5","first-page":"1","volume":"18","author":"AG Baydin","year":"2018","unstructured":"Baydin AG, Pearlmutter BA, Radul AA, Siskind JM (2018) Automatic differentiation in machine learning: a survey. J March Learn Res 18:1\u201343","journal-title":"J March Learn Res"},{"issue":"2","key":"10784_CR6","doi-asserted-by":"crossref","first-page":"1913","DOI":"10.1007\/s11277-022-09640-y","volume":"125","author":"KB Bhangale","year":"2022","unstructured":"Bhangale KB, Kothandaraman M (2022) Survey of deep learning paradigms for speech processing. Wirel Pers Commun 125(2):1913\u20131949","journal-title":"Wirel Pers Commun"},{"issue":"6","key":"10784_CR7","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/s42985-023-00244-0","volume":"4","author":"V Boussange","year":"2023","unstructured":"Boussange V, Becker S, Jentzen A, Kuckuck B, Pellissier L (2023) Deep learning approximations for non-local nonlinear PDEs with Neumann boundary conditions. Partial Differ Equ Appl 4(6):51","journal-title":"Partial Differ Equ Appl"},{"key":"10784_CR8","first-page":"31972","volume":"35","author":"O Boussif","year":"2022","unstructured":"Boussif O, Bengio Y, Benabbou L, Assouline D (2022) MAgnet: mesh agnostic neural PDE solver. Adv Neural Inf Process Syst 35:31972\u201331985","journal-title":"Adv Neural Inf Process Syst"},{"key":"10784_CR9","first-page":"24924","volume":"34","author":"S Cao","year":"2021","unstructured":"Cao S (2021) Choose a transformer: Fourier or Galerkin. Adv Neural Inf Process Syst 34:24924\u201324940","journal-title":"Adv Neural Inf Process Syst"},{"issue":"4","key":"10784_CR10","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1109\/72.392252","volume":"6","author":"T Chen","year":"1995","unstructured":"Chen T, Chen H (1995a) Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks. IEEE Trans Neural Netw 6(4):904\u2013910","journal-title":"IEEE Trans Neural Netw"},{"issue":"4","key":"10784_CR11","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1109\/72.392253","volume":"6","author":"T Chen","year":"1995","unstructured":"Chen T, Chen H (1995b) Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems. IEEE Trans Neural Netw 6(4):911\u2013917","journal-title":"IEEE Trans Neural Netw"},{"issue":"4","key":"10784_CR12","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","volume":"40","author":"L-C Chen","year":"2018","unstructured":"Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018) DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell 40(4):834\u2013848","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10784_CR13","doi-asserted-by":"crossref","first-page":"110668","DOI":"10.1016\/j.jcp.2021.110668","volume":"447","author":"Y Chen","year":"2021","unstructured":"Chen Y, Hosseini B, Owhadi H, Stuart AM (2021) Solving and learning nonlinear PDEs with gaussian processes. J Comput Phys 447:110668","journal-title":"J Comput Phys"},{"issue":"7","key":"10784_CR14","doi-asserted-by":"crossref","first-page":"6499","DOI":"10.1007\/s11071-022-08161-4","volume":"111","author":"M Chen","year":"2023","unstructured":"Chen M, Niu R, Zheng W (2023) Adaptive multi-scale neural network with resnet blocks for solving partial differential equations. Nonlinear Dyn 111(7):6499\u20136518","journal-title":"Nonlinear Dyn"},{"key":"10784_CR15","doi-asserted-by":"crossref","first-page":"23433","DOI":"10.1109\/ACCESS.2023.3244681","volume":"11","author":"J Choi","year":"2023","unstructured":"Choi J, Kim N, Hong Y (2023) Unsupervised Legendre-Galerkin neural network for solving partial differential equations. IEEE Access 11:23433\u201323446","journal-title":"IEEE Access"},{"issue":"229","key":"10784_CR16","first-page":"1","volume":"136","author":"A El-Ajou","year":"2021","unstructured":"El-Ajou A (2021) Adapting the Laplace transform to create solitary solutions for the nonlinear time-fractional dispersive PDEs via a new approach. Eur Phys J Plus 136(229):1\u201322","journal-title":"Eur Phys J Plus"},{"key":"10784_CR17","doi-asserted-by":"crossref","first-page":"113528","DOI":"10.1016\/j.chaos.2023.113528","volume":"172","author":"X Fang","year":"2023","unstructured":"Fang X, Qiao L, Zhang F, Sun F (2023) Explore deep network for a class of fractional partial differential equations. Chaos Solitons Fract 172:113528","journal-title":"Chaos Solitons Fract"},{"key":"10784_CR18","volume-title":"An introduction to differential equations and their applications","author":"SJ Farlow","year":"2006","unstructured":"Farlow SJ (2006) An introduction to differential equations and their applications. Dover Publications, Mineola"},{"issue":"7","key":"10784_CR19","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1007\/s10483-023-2992-6","volume":"44","author":"JN Fuhg","year":"2023","unstructured":"Fuhg JN, Karmarkar A, Kadeethum T, Yoon H, Bouklas N (2023) Deep convolutional Ritz method: parametric PDE surrogates without labeled data. Appl Math Mech 44(7):1151\u20131174","journal-title":"Appl Math Mech"},{"key":"10784_CR20","doi-asserted-by":"crossref","first-page":"111270","DOI":"10.1016\/j.jcp.2022.111270","volume":"463","author":"Y Gao","year":"2022","unstructured":"Gao Y, Ng MK (2022) Wasserstein generative adversarial uncertainty quantification in physics-informed neural networks. J Comput Phys 463:111270","journal-title":"J Comput Phys"},{"issue":"1","key":"10784_CR21","doi-asserted-by":"crossref","first-page":"21614","DOI":"10.1038\/s41598-021-00773-x","volume":"11","author":"CR Gin","year":"2021","unstructured":"Gin CR, Shea DE, Brunton SL, Nathan Kutz J (2021) DeepGreen: deep learning of Green\u2019s functions for nonlinear boundary value problems. Sci Rep 11(1):21614","journal-title":"Sci Rep"},{"issue":"4","key":"10784_CR22","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.1016\/j.spa.2016.07.011","volume":"127","author":"E Gobet","year":"2017","unstructured":"Gobet E, Turkedjiev P (2017) Adaptive importance sampling in least-squares Monte Carlo algorithms for backward stochastic differential equations. Stoch Process Appl 127(4):1171\u20131203","journal-title":"Stoch Process Appl"},{"issue":"1","key":"10784_CR23","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1007\/s10444-022-09970-2","volume":"49","author":"P Grohs","year":"2023","unstructured":"Grohs P, Hornung F, Jentzen A, Zimmermann P (2023) Space-time error estimates for deep neural network approximations for differential equations. Adv Comput Math 49(1):4","journal-title":"Adv Comput Math"},{"key":"10784_CR24","doi-asserted-by":"crossref","first-page":"105239","DOI":"10.1016\/j.compfluid.2021.105239","volume":"233","author":"R Gupta","year":"2022","unstructured":"Gupta R, Jaiman R (2022) A hybrid partitioned deep learning methodology for moving interface and fluid-structure interaction. Comput Fluids 233:105239","journal-title":"Comput Fluids"},{"key":"10784_CR25","first-page":"24048","volume":"34","author":"G Gupta","year":"2021","unstructured":"Gupta G, Xiao X, Bogdan P (2021) Multiwavelet-based operator learning for differential equations. Adv Neural Inf Process Syst 34:24048\u201324062","journal-title":"Adv Neural Inf Process Syst"},{"key":"10784_CR26","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1007\/978-981-19-1844-5_30","volume-title":"Intelligent communication technologies and virtual mobile networks","author":"AM Hafiz","year":"2023","unstructured":"Hafiz AM (2023) A survey of deep Q-networks used for reinforcement learning: state of the art. In: Rajakumar G, Ke-Lin D, Vuppalapati C, Beligiannis GN (eds) Intelligent communication technologies and virtual mobile networks. Springer, Singapore, pp 393\u2013402"},{"issue":"3","key":"10784_CR27","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s13735-020-00195-x","volume":"9","author":"AM Hafiz","year":"2020","unstructured":"Hafiz AM, Bhat GM (2020a) A survey on instance segmentation: state of the art. Int J Multimed Inf Retr 9(3):171\u2013189","journal-title":"Int J Multimed Inf Retr"},{"key":"10784_CR28","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/978-981-13-7166-0_16","volume-title":"Information and communication technology for sustainable development, Singapore","author":"AM Hafiz","year":"2020","unstructured":"Hafiz AM, Bhat GM (2020b) A survey of deep learning techniques for medical diagnosis. In: Tuba M, Akashe S, Joshi A (eds) Information and communication technology for sustainable development, Singapore. Springer, Singapore, pp 161\u2013170"},{"key":"10784_CR29","first-page":"445","volume-title":"Information and communication technology for competitive strategies","author":"AM Hafiz","year":"2021","unstructured":"Hafiz AM, Hassaballah M (2021) Digit image recognition using an ensemble of one-versus-all deep network classifiers. In: Shamim Kaiser M, Xie J, Rathore VS (eds) Information and communication technology for competitive strategies. Springer, Singapore, pp 445\u2013455"},{"issue":"2","key":"10784_CR30","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s13735-021-00209-2","volume":"10","author":"AM Hafiz","year":"2021","unstructured":"Hafiz AM, Parah SA, Bhat RA (2021) Reinforcement learning applied to machine vision: state of the art. Int J Multimed Inf Retr 10(2):71\u201382","journal-title":"Int J Multimed Inf Retr"},{"issue":"3","key":"10784_CR31","doi-asserted-by":"crossref","first-page":"2651","DOI":"10.32604\/csse.2023.031720","volume":"46","author":"AM Hafiz","year":"2023","unstructured":"Hafiz AM, Hassaballah M, Alqahtani A, Alsubai S, Hameed MA (2023) Reinforcement learning with an ensemble of binary action deep Q-networks. Comput Syst Sci Eng 46(3):2651\u20132666","journal-title":"Comput Syst Sci Eng"},{"key":"10784_CR32","doi-asserted-by":"crossref","first-page":"1291","DOI":"10.1007\/s10044-023-01155-x","volume":"26","author":"AM Hafiz","year":"2023","unstructured":"Hafiz AM, Bhat RUA, Parah SA, Hassaballah M (2023) SE-MD: a single-encoder multiple-decoder deep network for point cloud reconstruction from 2D images. Pattern Anal Appl 26:1291\u20131302","journal-title":"Pattern Anal Appl"},{"issue":"34","key":"10784_CR33","doi-asserted-by":"crossref","first-page":"8505","DOI":"10.1073\/pnas.1718942115","volume":"115","author":"J Han","year":"2018","unstructured":"Han J, Jentzen A, Weinan E (2018) Solving high-dimensional partial differential equations using deep learning. Proc Natl Acad Sci 115(34):8505\u20138510","journal-title":"Proc Natl Acad Sci"},{"key":"10784_CR34","doi-asserted-by":"crossref","DOI":"10.1201\/9781351003827","volume-title":"Deep learning in computer vision: principles and applications","author":"M Hassaballah","year":"2020","unstructured":"Hassaballah M, Awad AI (2020) Deep learning in computer vision: principles and applications. CRC Press, Boca Raton"},{"key":"10784_CR35","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-03000-1","volume-title":"Recent advances in computer vision: theories and applications","author":"M Hassaballah","year":"2019","unstructured":"Hassaballah M, Hosny KM (2019) Recent advances in computer vision: theories and applications. Springer, Berlin"},{"issue":"2","key":"10784_CR36","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/0893-6080(91)90009-T","volume":"4","author":"K Hornik","year":"1991","unstructured":"Hornik K (1991) Approximation capabilities of multilayer feedforward networks. Neural Netw 4(2):251\u2013257","journal-title":"Neural Netw"},{"issue":"16","key":"10784_CR37","doi-asserted-by":"crossref","first-page":"15233","DOI":"10.1007\/s11071-023-08654-w","volume":"111","author":"J Hou","year":"2023","unstructured":"Hou J, Li Y, Ying S (2023) Enhancing PINNs for solving PDEs via adaptive collocation point movement and adaptive loss weighting. Nonlinear Dyn 111(16):15233\u201315261","journal-title":"Nonlinear Dyn"},{"issue":"1","key":"10784_CR38","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/0021-9991(90)90007-N","volume":"91","author":"L Hyuk","year":"1990","unstructured":"Hyuk L, In SK (1990) Neural algorithm for solving differential equations. J Comput Phys 91(1):110\u2013131","journal-title":"J Comput Phys"},{"key":"10784_CR39","doi-asserted-by":"crossref","first-page":"127731","DOI":"10.1016\/j.amc.2022.127731","volume":"442","author":"M Innerberger","year":"2023","unstructured":"Innerberger M, Praetorius D (2023) MooAFEM: an object oriented Matlab code for higher-order adaptive FEM for (nonlinear) elliptic PDEs. Appl Math Comput 442:127731","journal-title":"Appl Math Comput"},{"key":"10784_CR40","doi-asserted-by":"crossref","first-page":"113028","DOI":"10.1016\/j.cma.2020.113028","volume":"365","author":"AD Jagtap","year":"2020","unstructured":"Jagtap AD, Kharazmi E, Karniadakis GE (2020) Conservative physics-informed neural networks on discrete domains for conservation laws: applications to forward and inverse problems. Comput Methods Appl Mech Eng 365:113028","journal-title":"Comput Methods Appl Mech Eng"},{"key":"10784_CR41","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.neucom.2021.10.036","volume":"468","author":"AD Jagtap","year":"2022","unstructured":"Jagtap AD, Shin Y, Kawaguchi K, Karniadakis GE (2022) Deep Kronecker neural networks: a general framework for neural networks with adaptive activation functions. Neurocomputing 468:165\u2013180","journal-title":"Neurocomputing"},{"issue":"1","key":"10784_CR42","doi-asserted-by":"crossref","first-page":"2095039","DOI":"10.1080\/08839514.2022.2095039","volume":"36","author":"LK Jean","year":"2022","unstructured":"Jean LK, Fendji E, Tala DCM, Yenke BO, Atemkeng M (2022) Automatic speech recognition using limited vocabulary: a survey. Appl Artif Intell 36(1):2095039","journal-title":"Appl Artif Intell"},{"key":"10784_CR43","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/j.ins.2022.07.138","volume":"610","author":"X Jia","year":"2022","unstructured":"Jia X, Meng D, Zhang X, Feng X (2022) PDNet: progressive denoising network via stochastic supervision on reaction-diffusion-advection equation. Inf Sci 610:345\u2013358","journal-title":"Inf Sci"},{"key":"10784_CR44","doi-asserted-by":"crossref","first-page":"110928","DOI":"10.1016\/j.jcp.2021.110928","volume":"453","author":"Q Jiagang","year":"2022","unstructured":"Jiagang Q, Cai W, Zhao Y (2022) Learning time-dependent PDEs with a linear and nonlinear separate convolutional neural network. J Comput Phys 453:110928","journal-title":"J Comput Phys"},{"issue":"1","key":"10784_CR45","doi-asserted-by":"crossref","first-page":"4479","DOI":"10.1038\/s41598-023-31236-0","volume":"13","author":"Z Jiang","year":"2023","unstructured":"Jiang Z, Jiang J, Yao Q, Yang G (2023) A neural network-based PDE solving algorithm with high precision. Sci Rep 13(1):4479","journal-title":"Sci Rep"},{"issue":"6","key":"10784_CR46","doi-asserted-by":"crossref","first-page":"A3490","DOI":"10.1137\/22M1477751","volume":"44","author":"P Jin","year":"2022","unstructured":"Jin P, Meng S, Lu L (2022) MIONet: learning multiple-input operators via tensor product. SIAM J Sci Comput 44(6):A3490\u2013A3514","journal-title":"SIAM J Sci Comput"},{"issue":"11","key":"10784_CR47","doi-asserted-by":"crossref","first-page":"4037","DOI":"10.1109\/TPAMI.2020.2992393","volume":"43","author":"L Jing","year":"2021","unstructured":"Jing L, Tian Y (2021) Self-supervised visual feature learning with deep neural networks: a survey. IEEE Trans Pattern Anal Mach Intell 43(11):4037\u20134058","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"2245","key":"10784_CR48","doi-asserted-by":"crossref","first-page":"20190897","DOI":"10.1098\/rspa.2019.0897","volume":"477","author":"F Jos\u00e9 del \u00c1guila","year":"2021","unstructured":"Jos\u00e9 del \u00c1guila F, Triantafyllou MS, Chryssostomidis C, Karniadakis GE (2021) Learning functionals via LSTM neural networks for predicting vessel dynamics in extreme sea states. Proc R Soc A 477(2245):20190897","journal-title":"Proc R Soc A"},{"issue":"12","key":"10784_CR49","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1038\/s43588-021-00171-3","volume":"1","author":"T Kadeethum","year":"2021","unstructured":"Kadeethum T, O\u2019Malley D, Fuhg JN, Choi Y, Lee J, Viswanathan HS, Bouklas N (2021) A framework for data-driven solution and parameter estimation of PDEs using conditional generative adversarial networks. Nat Comput Sci 1(12):819\u2013829","journal-title":"Nat Comput Sci"},{"issue":"6","key":"10784_CR50","doi-asserted-by":"crossref","first-page":"065303","DOI":"10.1103\/PhysRevE.106.065303","volume":"106","author":"E Kiyani","year":"2022","unstructured":"Kiyani E, Silber S, Kooshkbaghi M, Karttunen M (2022) Machine-learning-based data-driven discovery of nonlinear phase-field dynamics. Phys Rev E 106(6):065303","journal-title":"Phys Rev E"},{"key":"10784_CR51","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1016\/j.apm.2017.01.077","volume":"46","author":"R Kolman","year":"2017","unstructured":"Kolman R, Okrouhl\u00edk M, Berezovski A, Gabriel D, Kopa\u010dka J, Ple\u0161ek J (2017) B-spline based finite element method in one-dimensional discontinuous elastic wave propagation. Appl Math Model 46:382\u2013395","journal-title":"Appl Math Model"},{"issue":"1","key":"10784_CR52","first-page":"13237","volume":"22","author":"N Kovachki","year":"2021","unstructured":"Kovachki N, Lanthaler S, Mishra S (2021a) On universal approximation and error bounds for Fourier neural operators. J Mach Learn Res 22(1):13237\u201313312","journal-title":"J Mach Learn Res"},{"key":"10784_CR53","doi-asserted-by":"crossref","first-page":"106041","DOI":"10.1016\/j.cnsns.2021.106041","volume":"104","author":"A Kovacs","year":"2022","unstructured":"Kovacs A, Exl L, Kornell A, Fischbacher J, Hovorka M, Gusenbauer M, Breth L, Oezelt H, Yano M, Sakuma N et al (2022) Conditional physics informed neural networks. Commun Nonlinear Sci Numer Simul 104:106041","journal-title":"Commun Nonlinear Sci Numer Simul"},{"key":"10784_CR54","volume-title":"Advances in neural information processing systems","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Pereira F, Burges CJ, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems, vol 25. Curran Associates Inc, Montreal"},{"issue":"7","key":"10784_CR55","doi-asserted-by":"crossref","first-page":"1956","DOI":"10.1007\/s11263-020-01316-z","volume":"128","author":"A Kuznetsova","year":"2020","unstructured":"Kuznetsova A et al (2020) The open images dataset v4. Int J Comput Vis 128(7):1956\u20131981","journal-title":"Int J Comput Vis"},{"issue":"5","key":"10784_CR56","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1109\/72.712178","volume":"9","author":"IE Lagaris","year":"1998","unstructured":"Lagaris IE, Likas A, Fotiadis DI (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9(5):987\u20131000","journal-title":"IEEE Trans Neural Netw"},{"issue":"1","key":"10784_CR57","first-page":"tnac001","volume":"6","author":"S Lanthaler","year":"2022","unstructured":"Lanthaler S, Mishra S, Karniadakis GE (2022) Error estimates for deeponets: a deep learning framework in infinite dimensions. Trans Math Appl 6(1):tnac001","journal-title":"Trans Math Appl"},{"issue":"11","key":"10784_CR58","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y Lecun","year":"1998","unstructured":"Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278\u20132324","journal-title":"Proc IEEE"},{"issue":"3","key":"10784_CR59","doi-asserted-by":"crossref","first-page":"2429","DOI":"10.1007\/s11071-021-07043-5","volume":"107","author":"C Li","year":"2022","unstructured":"Li C, Yang Y, Liang H, Boying W (2022) Learning high-order geometric flow based on the level set method. Nonlinear Dyn 107(3):2429\u20132445","journal-title":"Nonlinear Dyn"},{"issue":"4","key":"10784_CR60","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1007\/s11222-023-10262-y","volume":"33","author":"S Li","year":"2023","unstructured":"Li S, Zhang C, Zhang Z, Zhao H (2023) A data-driven and model-based accelerated Hamiltonian Monte Carlo method for Bayesian elliptic inverse problems. Stat Comput 33(4):90","journal-title":"Stat Comput"},{"issue":"1","key":"10784_CR61","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1137\/19M1274067","volume":"63","author":"L Lu","year":"2021","unstructured":"Lu L, Meng X, Mao Z, Karniadakis GE (2021a) DeepXDE: a deep learning library for solving differential equations. SIAM Rev 63(1):208\u2013228","journal-title":"SIAM Rev"},{"issue":"3","key":"10784_CR62","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1038\/s42256-021-00302-5","volume":"3","author":"L Lu","year":"2021","unstructured":"Lu L, Jin P, Pang G, Zhang Z, Karniadakis GE (2021b) Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators. Nat Mach Intell 3(3):218\u2013229","journal-title":"Nat Mach Intell"},{"key":"10784_CR63","doi-asserted-by":"crossref","first-page":"114778","DOI":"10.1016\/j.cma.2022.114778","volume":"393","author":"L Lu","year":"2022","unstructured":"Lu L, Meng X, Cai S, Mao Z, Goswami S, Zhang Z, Karniadakis GE (2022a) A comprehensive and fair comparison of two neural operators (with practical extensions) based on fair data. Comput Methods Appl Mech Eng 393:114778","journal-title":"Comput Methods Appl Mech Eng"},{"issue":"2","key":"10784_CR64","doi-asserted-by":"crossref","first-page":"023210","DOI":"10.1103\/PhysRevResearch.4.023210","volume":"4","author":"L Lu","year":"2022","unstructured":"Lu L, Pestourie R, Johnson SG, Romano G (2022b) Multifidelity deep neural operators for efficient learning of partial differential equations with application to fast inverse design of nanoscale heat transport. Phys Rev Res 4(2):023210","journal-title":"Phys Rev Res"},{"issue":"3","key":"10784_CR65","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1017\/S0956792520000224","volume":"32","author":"KO Lye","year":"2021","unstructured":"Lye KO, Mishra S, Molinaro R (2021) A multi-level procedure for enhancing accuracy of machine learning algorithms. Eur J Appl Math 32(3):436\u2013469","journal-title":"Eur J Appl Math"},{"key":"10784_CR66","doi-asserted-by":"crossref","first-page":"110863","DOI":"10.1016\/j.asoc.2023.110863","volume":"148","author":"SM Mallikarjunaiah","year":"2023","unstructured":"Mallikarjunaiah SM (2023) A deep learning feed-forward neural network framework for the solutions to singularly perturbed delay differential equations. Appl Soft Comput 148:110863","journal-title":"Appl Soft Comput"},{"key":"10784_CR67","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.jcp.2017.11.039","volume":"357","author":"R Maziar","year":"2018","unstructured":"Maziar R, George EK (2018) Hidden physics models: machine learning of nonlinear partial differential equations. J Comput Phys 357:125\u2013141","journal-title":"J Comput Phys"},{"issue":"9","key":"10784_CR68","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/0895-7177(94)00160-X","volume":"20","author":"AJ Meade Jr","year":"1994","unstructured":"Meade Jr AJ, Fernandez AA (1994) Solution of nonlinear ordinary differential equations by feedforward neural networks. Math Comput Model 20(9):19\u201344","journal-title":"Math Comput Model"},{"issue":"12","key":"10784_CR69","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0895-7177(94)90095-7","volume":"19","author":"AJ Meade Jr","year":"1994","unstructured":"Meade Jr AJ, Fernandez AA (1994) The numerical solution of linear ordinary differential equations by feedforward neural networks. Math Comput Model 19(12):1\u201325","journal-title":"Math Comput Model"},{"key":"10784_CR70","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.camwa.2023.04.030","volume":"143","author":"H Melchers","year":"2023","unstructured":"Melchers H, Crommelin D, Koren B, Menkovski V, Sanderse B (2023) Comparison of neural closure models for discretised PDEs. Comput Math Appl 143:94\u2013107","journal-title":"Comput Math Appl"},{"key":"10784_CR71","doi-asserted-by":"crossref","first-page":"111073","DOI":"10.1016\/j.jcp.2022.111073","volume":"457","author":"X Meng","year":"2022","unstructured":"Meng X, Yang L, Mao Z, del \u00c1guila FJ, George EK (2022) Learning functional priors and posteriors from data and physics. J Comput Phys 457:111073","journal-title":"J Comput Phys"},{"key":"10784_CR72","doi-asserted-by":"crossref","first-page":"116172","DOI":"10.1016\/j.cma.2023.116172","volume":"414","author":"Z Meng","year":"2023","unstructured":"Meng Z, Qian Q, Mengqiang X, Bo Yu, Y\u0131ld\u0131z AR, Mirjalili S (2023) PINN-FORM: a new physics-informed neural network for reliability analysis with partial differential equation. Comput Methods Appl Mech Eng 414:116172","journal-title":"Comput Methods Appl Mech Eng"},{"key":"10784_CR73","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.neucom.2020.02.015","volume":"399","author":"C Michoski","year":"2020","unstructured":"Michoski C, Milosavljevi\u0107 M, Oliver T, Hatch DR (2020) Solving differential equations using deep neural networks. Neurocomputing 399:193\u2013212","journal-title":"Neurocomputing"},{"issue":"2","key":"10784_CR74","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1093\/imanum\/drab032","volume":"42","author":"S Mishra","year":"2022","unstructured":"Mishra S, Molinaro R (2022) Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs. IMA J Numer Anal 42(2):981\u20131022","journal-title":"IMA J Numer Anal"},{"key":"10784_CR75","doi-asserted-by":"crossref","first-page":"110651","DOI":"10.1016\/j.jcp.2021.110651","volume":"446","author":"SK Mitusch","year":"2021","unstructured":"Mitusch SK, Funke SW, Kuchta M (2021) Hybrid FEM-NN models: combining artificial neural networks with the finite element method. J Comput Phys 446:110651","journal-title":"J Comput Phys"},{"key":"10784_CR76","doi-asserted-by":"crossref","first-page":"111731","DOI":"10.1016\/j.jcp.2022.111731","volume":"473","author":"S Mowlavi","year":"2023","unstructured":"Mowlavi S, Nabi S (2023) Optimal control of PDEs using physics-informed neural networks. J Comput Phys 473:111731","journal-title":"J Comput Phys"},{"issue":"3","key":"10784_CR77","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/0898-1221(88)90182-4","volume":"16","author":"DH Mugler","year":"1988","unstructured":"Mugler DH, Scott RA (1988) Fast Fourier transform method for partial differential equations, case study: the 2-D diffusion equation. Comput Math Appl 16(3):221\u2013228","journal-title":"Comput Math Appl"},{"key":"10784_CR78","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/j.camwa.2023.10.002","volume":"152","author":"N Namaki","year":"2023","unstructured":"Namaki N, Eslahchi MR, Salehi R (2023) The use of physics-informed neural network approach to image restoration via nonlinear PDE tools. Comput Math Appl 152:355\u2013363","journal-title":"Comput Math Appl"},{"issue":"3","key":"10784_CR79","doi-asserted-by":"crossref","first-page":"1801","DOI":"10.1007\/s11071-021-07118-3","volume":"107","author":"J Nathan Kutz","year":"2022","unstructured":"Nathan Kutz J, Brunton SL (2022) Parsimony as the ultimate regularizer for physics-informed machine learning. Nonlinear Dyn 107(3):1801\u20131817","journal-title":"Nonlinear Dyn"},{"issue":"5","key":"10784_CR80","doi-asserted-by":"crossref","first-page":"A3212","DOI":"10.1137\/20M133957X","volume":"43","author":"NH Nelsen","year":"2021","unstructured":"Nelsen NH, Stuart AM (2021) The random feature model for input-output maps between Banach spaces. SIAM J Sci Comput 43(5):A3212\u2013A3243","journal-title":"SIAM J Sci Comput"},{"key":"10784_CR81","series-title":"Computational Methods in Applied Sciences","volume-title":"Particle-based methods: fundamentals and applications","author":"E O\u00f1ate","year":"2014","unstructured":"O\u00f1ate E, Owen R (2014) Particle-based methods: fundamentals and applications. Computational Methods in Applied Sciences. Springer, Dordrecht"},{"key":"10784_CR82","doi-asserted-by":"crossref","first-page":"110754","DOI":"10.1016\/j.jcp.2021.110754","volume":"449","author":"RG Patel","year":"2022","unstructured":"Patel RG, Manickam I, Trask NA, Wood MA, Lee M, Tomas I, Cyr EC (2022) Thermodynamically consistent physics-informed neural networks for hyperbolic systems. J Comput Phys 449:110754","journal-title":"J Comput Phys"},{"issue":"2","key":"10784_CR83","doi-asserted-by":"crossref","first-page":"025111","DOI":"10.1063\/5.0079302","volume":"34","author":"W Peng","year":"2022","unstructured":"Peng W, Yuan Z, Wang J (2022) Attention-enhanced neural network models for turbulence simulation. Phys Fluids 34(2):025111","journal-title":"Phys Fluids"},{"key":"10784_CR84","doi-asserted-by":"crossref","first-page":"111690","DOI":"10.1016\/j.jcp.2022.111690","volume":"472","author":"Y Peng","year":"2023","unstructured":"Peng Y, Dan H, Zin-Qin John X (2023) A non-gradient method for solving elliptic partial differential equations with deep neural networks. J Comput Phys 472:111690","journal-title":"J Comput Phys"},{"key":"10784_CR85","doi-asserted-by":"crossref","first-page":"111912","DOI":"10.1016\/j.jcp.2023.111912","volume":"477","author":"M Penwarden","year":"2023","unstructured":"Penwarden M, Zhe S, Narayan A, Kirby RM (2023) A metalearning approach for physics-informed neural networks (PINNs): application to parameterized PDEs. J Comput Phys 477:111912","journal-title":"J Comput Phys"},{"key":"10784_CR86","doi-asserted-by":"crossref","first-page":"111902","DOI":"10.1016\/j.jcp.2022.111902","volume":"477","author":"AF Psaros","year":"2023","unstructured":"Psaros AF, Meng X, Zou Z, Guo L, Karniadakis GE (2023) Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons. J Comput Phys 477:111902","journal-title":"J Comput Phys"},{"issue":"1","key":"10784_CR87","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13662-018-1939-6","volume":"2019","author":"D Qin","year":"2019","unstructured":"Qin D, Yanwei D, Liu B, Huang W (2019) A B-spline finite element method for nonlinear differential equations describing crystal surface growth with variable coefficient. Adv Differ Equ 2019(1):1\u201316","journal-title":"Adv Differ Equ"},{"key":"10784_CR88","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1016\/j.matcom.2022.10.018","volume":"205","author":"HD Quan","year":"2023","unstructured":"Quan HD, Huynh HT (2023) Solving partial differential equation based on extreme learning machine. Math Comput Simul 205:697\u2013708","journal-title":"Math Comput Simul"},{"key":"10784_CR89","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","volume":"378","author":"M Raissi","year":"2019","unstructured":"Raissi M, Perdikaris P, Karniadakis GE (2019) Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J Comput Phys 378:686\u2013707","journal-title":"J Comput Phys"},{"issue":"6481","key":"10784_CR90","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1126\/science.aaw4741","volume":"367","author":"M Raissi","year":"2020","unstructured":"Raissi M, Yazdani A, Karniadakis GE (2020) Hidden fluid mechanics: learning velocity and pressure fields from flow visualizations. Science 367(6481):1026\u20131030","journal-title":"Science"},{"issue":"6","key":"10784_CR91","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2017","unstructured":"Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137\u20131149","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10784_CR92","doi-asserted-by":"crossref","first-page":"114399","DOI":"10.1016\/j.cma.2021.114399","volume":"389","author":"P Ren","year":"2022","unstructured":"Ren P, Rao C, Liu Y, Wang J-X, Sun H (2022) PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs. Comput Methods Appl Mech Eng 389:114399","journal-title":"Comput Methods Appl Mech Eng"},{"key":"10784_CR93","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1007\/s10851-019-00903-1","volume":"62","author":"L Ruthotto","year":"2020","unstructured":"Ruthotto L, Haber E (2020) Deep neural networks motivated by partial differential equations. J Math Imaging Vis 62:352\u2013364","journal-title":"J Math Imaging Vis"},{"key":"10784_CR94","doi-asserted-by":"crossref","first-page":"169270","DOI":"10.1109\/ACCESS.2021.3138137","volume":"9","author":"F Sajid","year":"2021","unstructured":"Sajid F, Javed AR, Basharat A, Kryvinska N, Afzal A, Rizwan M (2021) An efficient deep learning framework for distracted driver detection. IEEE Access 9:169270\u2013169280","journal-title":"IEEE Access"},{"key":"10784_CR95","doi-asserted-by":"crossref","first-page":"106691","DOI":"10.1016\/j.engappai.2023.106691","volume":"125","author":"WM Shaban","year":"2023","unstructured":"Shaban WM, Elbaz K, Zhou A, Shen S-L (2023) Physics-informed deep neural network for modeling the chloride diffusion in concrete. Eng Appl Artif Intell 125:106691","journal-title":"Eng Appl Artif Intell"},{"issue":"4","key":"10784_CR96","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","volume":"39","author":"E Shelhamer","year":"2017","unstructured":"Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640\u2013651","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"8","key":"10784_CR97","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1038\/s43017-023-00450-9","volume":"4","author":"C Shen","year":"2023","unstructured":"Shen C, Appling AP, Gentine P, Bandai T, Gupta H, Tartakovsky A, Baity-Jesi M, Fenicia F, Kifer D, Li L et al (2023) Differentiable modelling to unify machine learning and physical models for geosciences. Nat Rev Earth Environ 4(8):552\u2013567","journal-title":"Nat Rev Earth Environ"},{"key":"10784_CR98","doi-asserted-by":"crossref","first-page":"112084","DOI":"10.1016\/j.jcp.2023.112084","volume":"484","author":"JW Siegel","year":"2023","unstructured":"Siegel JW, Hong Q, Jin X, Hao W, Jinchao X (2023) Greedy training algorithms for neural networks and applications to PDEs. J Comput Phys 484:112084","journal-title":"J Comput Phys"},{"key":"10784_CR99","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1016\/j.jcp.2018.08.029","volume":"375","author":"J Sirignano","year":"2018","unstructured":"Sirignano J, Spiliopoulos K (2018) DGM: a deep learning algorithm for solving partial differential equations. J Comput Phys 375:1339\u20131364","journal-title":"J Comput Phys"},{"issue":"1","key":"10784_CR100","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/s10851-022-01114-x","volume":"65","author":"BMN Smets","year":"2023","unstructured":"Smets BMN, Portegies J, Bekkers EJ, Duits R (2023) PDE-based group equivariant convolutional neural networks. J Math Imaging Vis 65(1):209\u2013239","journal-title":"J Math Imaging Vis"},{"key":"10784_CR101","doi-asserted-by":"crossref","first-page":"106682","DOI":"10.1016\/j.petrol.2019.106682","volume":"186","author":"X Song","year":"2020","unstructured":"Song X, Liu Y, Xue L, Wang J, Zhang J, Wang J, Jiang L, Cheng Z (2020) Time-series well performance prediction based on long short-term memory (LSTM) neural network model. J Pet Sci Eng 186:106682","journal-title":"J Pet Sci Eng"},{"issue":"1","key":"10784_CR102","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1109\/MIC.2021.3132591","volume":"26","author":"M Swan","year":"2021","unstructured":"Swan M, Witte F, dos Santos RP (2021) Quantum information science. IEEE Internet Comput 26(1):7\u201314","journal-title":"IEEE Internet Comput"},{"key":"10784_CR103","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.camwa.2022.12.008","volume":"132","author":"S Tang","year":"2023","unstructured":"Tang S, Feng X, Wei W, Hui X (2023a) Physics-informed neural networks combined with polynomial interpolation to solve nonlinear partial differential equations. Comput Math Appl 132:48\u201362","journal-title":"Comput Math Appl"},{"key":"10784_CR104","doi-asserted-by":"crossref","first-page":"111868","DOI":"10.1016\/j.jcp.2022.111868","volume":"476","author":"K Tang","year":"2023","unstructured":"Tang K, Wan X, Yang C (2023b) DAS-PINNs: a deep adaptive sampling method for solving high-dimensional partial differential equations. J Comput Phys 476:111868","journal-title":"J Comput Phys"},{"issue":"10","key":"10784_CR105","doi-asserted-by":"crossref","first-page":"103001","DOI":"10.1088\/1361-6420\/ace9d4","volume":"39","author":"DN Tanyu","year":"2023","unstructured":"Tanyu DN, Ning J, Freudenberg T, Heilenk\u00f6tter N, Rademacher A, Iben U, Maass P (2023) Deep learning methods for partial differential equations and related parameter identification problems. Inverse Probl 39(10):103001","journal-title":"Inverse Probl"},{"key":"10784_CR106","doi-asserted-by":"crossref","first-page":"115850","DOI":"10.1016\/j.cma.2022.115850","volume":"405","author":"JM Taylor","year":"2023","unstructured":"Taylor JM, Pardo D, Muga I (2023) A deep Fourier residual method for solving PDEs using neural networks. Comput Methods Appl Mech Eng 405:115850","journal-title":"Comput Methods Appl Mech Eng"},{"key":"10784_CR107","doi-asserted-by":"crossref","first-page":"115892","DOI":"10.1016\/j.cma.2023.115892","volume":"405","author":"C Uriarte","year":"2023","unstructured":"Uriarte C, Pardo D, Muga I, Mu\u00f1oz-Matute J (2023) A deep double Ritz method (D2RM) for solving partial differential equations using neural networks. Comput Methods Appl Mech Eng 405:115892","journal-title":"Comput Methods Appl Mech Eng"},{"key":"10784_CR108","doi-asserted-by":"crossref","first-page":"115718","DOI":"10.1016\/j.cma.2022.115718","volume":"403","author":"S Venturi","year":"2023","unstructured":"Venturi S, Casey T (2023) SVD perspectives for augmenting DeepONet flexibility and interpretability. Comput Methods Appl Mech Eng 403:115718","journal-title":"Comput Methods Appl Mech Eng"},{"key":"10784_CR109","volume-title":"An introduction to computational fluid dynamics: the finite","author":"HK Versteeg","year":"2011","unstructured":"Versteeg HK, Malalasekera W (2011) An introduction to computational fluid dynamics: the finite, vol Method. Pearson Education, Limited, London"},{"issue":"4","key":"10784_CR110","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1109\/JAS.2017.7510583","volume":"4","author":"K Wang","year":"2017","unstructured":"Wang K, Gou C, Duan Y, Lin Y, Zheng X, Wang F-Y (2017) Generative adversarial networks: introduction and outlook. IEEE\/CAA J Autom Sin 4(4):588\u2013598","journal-title":"IEEE\/CAA J Autom Sin"},{"key":"10784_CR111","doi-asserted-by":"crossref","first-page":"113938","DOI":"10.1016\/j.cma.2021.113938","volume":"384","author":"S Wang","year":"2021","unstructured":"Wang S, Wang H, Perdikaris P (2021) On the eigenvector bias of Fourier feature networks: from regression to solving multi-scale PDEs with physics-informed neural networks. Comput Methods Appl Mech Eng 384:113938","journal-title":"Comput Methods Appl Mech Eng"},{"key":"10784_CR112","doi-asserted-by":"crossref","first-page":"114424","DOI":"10.1016\/j.cma.2021.114424","volume":"389","author":"H Wang","year":"2022","unstructured":"Wang H, Planas R, Chandramowlishwaran A, Bostanabad R (2022) Mosaic flows: a transferable deep learning framework for solving PDEs on unseen domains. Comput Methods Appl Mech Eng 389:114424","journal-title":"Comput Methods Appl Mech Eng"},{"key":"10784_CR113","doi-asserted-by":"crossref","first-page":"104180","DOI":"10.1016\/j.advwatres.2022.104180","volume":"163","author":"G Wen","year":"2022","unstructured":"Wen G, Li Z, Azizzadenesheli K, Anandkumar A, Benson SM (2022) U-FNO: an enhanced Fourier neural operator-based deep-learning model for multiphase flow. Adv Water Resour 163:104180","journal-title":"Adv Water Resour"},{"issue":"4","key":"10784_CR114","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3514228","volume":"55","author":"J Willard","year":"2022","unstructured":"Willard J, Jia X, Shaoming X, Steinbach M, Kumar V (2022) Integrating scientific knowledge with machine learning for engineering and environmental systems. ACM Comput Surv 55(4):1\u201337","journal-title":"ACM Comput Surv"},{"key":"10784_CR115","doi-asserted-by":"crossref","first-page":"109046","DOI":"10.1016\/j.patcog.2022.109046","volume":"134","author":"H Xiang","year":"2023","unstructured":"Xiang H, Zou Q, Nawaz MA, Huang X, Zhang F, Yu H (2023) Deep learning for image inpainting: a survey. Pattern Recogn 134:109046","journal-title":"Pattern Recogn"},{"key":"10784_CR116","doi-asserted-by":"crossref","first-page":"109347","DOI":"10.1016\/j.patcog.2023.109347","volume":"137","author":"M Xu","year":"2023","unstructured":"Xu M, Yoon S, Fuentes A, Park DS (2023) A comprehensive survey of image augmentation techniques for deep learning. Pattern Recogn 137:109347","journal-title":"Pattern Recogn"},{"issue":"8","key":"10784_CR117","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1109\/81.526685","volume":"43","author":"R Yentis","year":"1996","unstructured":"Yentis R, Zaghloul ME (1996) VLSI implementation of locally connected neural network for solving partial differential equations. IEEE Trans Circ Syst I: Fundam Theory Appl 43(8):687\u2013690","journal-title":"IEEE Trans Circ Syst I: Fundam Theory Appl"},{"issue":"4","key":"10784_CR118","first-page":"045303","volume":"104","author":"D Yifan","year":"2021","unstructured":"Yifan D, Zaki TA (2021) Evolutional deep neural network. Phys Rev E 104(4):045303","journal-title":"Phys Rev E"},{"issue":"5","key":"10784_CR119","doi-asserted-by":"crossref","first-page":"A2356","DOI":"10.1137\/22M1488132","volume":"45","author":"G Yiqi","year":"2023","unstructured":"Yiqi G, Ng MK (2023) Deep neural networks for solving large linear systems arising from high-dimensional problems. SIAM J Sci Comput 45(5):A2356\u2013A2381","journal-title":"SIAM J Sci Comput"},{"key":"10784_CR120","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1007\/s00466-020-01928-9","volume":"67","author":"L Zhang","year":"2021","unstructured":"Zhang L, Cheng L, Li H, Gao J, Cheng Y, Domel R, Yang Y, Tang S, Liu WK (2021) Hierarchical deep-learning neural networks: finite elements and beyond. Comput Mech 67:207\u2013230","journal-title":"Comput Mech"},{"key":"10784_CR121","doi-asserted-by":"crossref","first-page":"109921","DOI":"10.1016\/j.asoc.2022.109921","volume":"133","author":"Y Zhao","year":"2023","unstructured":"Zhao Y, Yang G (2023) Deep learning-based integrated framework for stock price movement prediction. Appl Soft Comput 133:109921","journal-title":"Appl Soft Comput"},{"key":"10784_CR122","volume-title":"The finite element method, the basis. The finite element method","author":"OC Zienkiewicz","year":"2000","unstructured":"Zienkiewicz OC, Taylor RL (2000) The finite element method, the basis. The finite element method. Wiley, New York"},{"key":"10784_CR123","doi-asserted-by":"crossref","unstructured":"Amanat A, Rizwan M, Javed AR, Maha A, Alsaqour R, Pandya S, Uddin M (2022) Deep learning for depression detection from textual data. Electronics 11(5)","DOI":"10.3390\/electronics11050676"},{"key":"10784_CR124","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) ImageNet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, pp 248\u2013255","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"10784_CR125","doi-asserted-by":"crossref","unstructured":"Girshick R (2015) Fast R-CNN. In: IEEE international conference on computer vision, pp 1440\u20131448","DOI":"10.1109\/ICCV.2015.169"},{"key":"10784_CR126","doi-asserted-by":"crossref","unstructured":"Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE conference on computer vision and pattern recognition, pp 580\u2013587","DOI":"10.1109\/CVPR.2014.81"},{"key":"10784_CR127","doi-asserted-by":"crossref","unstructured":"Gobovic D, Zaghloul ME (1993) Design of locally connected CMOS neural cells to solve the steady-state heat flow problem. In: 36th midwest symposium on circuits and systems. IEEE, pp 755\u2013757","DOI":"10.1109\/MWSCAS.1993.342937"},{"key":"10784_CR128","unstructured":"Gobovic D, Zaghloul ME (1994) Analog cellular neural network with application to partial differential equations with variable mesh-size. In: IEEE international symposium on circuits and systems. IEEE, vol 6, pp 359\u2013362"},{"key":"10784_CR129","unstructured":"Goodfellow IJ, Pouget-Abadie J, Mirza M, Bing X, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. arxiv preprint arxiv:1406:2661"},{"key":"10784_CR130","doi-asserted-by":"crossref","unstructured":"Gordijn B, ten Have H (2023) ChatGPT: evolution or revolution? Medicine, health care and philosophy, pp 1\u20132","DOI":"10.1007\/s11019-023-10136-0"},{"key":"10784_CR131","unstructured":"Gui J, Sun Z, Wen Y, Tao D, Ye J (2021) A review on generative adversarial networks: algorithms, theory, and applications. IEEE Trans Knowl Data Eng"},{"key":"10784_CR132","unstructured":"Hafiz AM, Bhat GM (2021) Fast training of deep networks with one-class CNNs. In: Modern approaches in machine learning and cognitive science: a walkthrough: latest trends in AI. Springer, Berlin, pp 409\u2013421"},{"key":"10784_CR133","unstructured":"Hafiz AM, Bhat RA, Hassaballah M (2022) Image classification using convolutional neural network tree ensembles. Multimed Tools Appl, pp 1\u201318"},{"key":"10784_CR134","doi-asserted-by":"crossref","unstructured":"Hafiz AM, Hassaballah M, Binbusayyis A (2023) Formula-driven supervised learning in computer vision: a literature survey. Appl Sci 13(2)","DOI":"10.3390\/app13020723"},{"key":"10784_CR135","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"10784_CR136","doi-asserted-by":"crossref","unstructured":"Hook DW, Porter SJ, Herzog C (2018) Dimensions: building context for search and evaluation. Front Res Metr Anal 3:23. https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2018.00023\/pdf","DOI":"10.3389\/frma.2018.00023"},{"key":"10784_CR137","unstructured":"Huang S, Feng W, Tang C, Lv J (2022) Partial differential equations meet deep neural networks: a survey. Preprint arxiv:2211.05567"},{"key":"10784_CR138","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van&nbsp;Der Maaten L, Weinberger KQ (July 2017) Densely connected convolutional networks. In: IEEE conference on computer vision and pattern recognition, Los Alamitos, CA, USA, pp 2261\u20132269","DOI":"10.1109\/CVPR.2017.243"},{"key":"10784_CR139","unstructured":"Jagtap AD, Karniadakis GE (2021) Extended physics-informed neural networks (XPINNs): a generalized space-time domain decomposition based deep learning framework for nonlinear partial differential equations. In: AAAI spring symposium: MLPS, pp 2002\u20132041"},{"key":"10784_CR140","unstructured":"Kollmannsberger S (2019) The finite cell method: towards engineering applications. Technische Universit\u00e4t M\u00fcnchen"},{"key":"10784_CR141","unstructured":"Kovachki N, Li Z, Liu B, Azizzadenesheli K, Bhattacharya K, Stuart A, Anandkumar A (2021b) Neural operator: learning maps between function spaces. arxiv preprint arxiv:2108.08481"},{"key":"10784_CR142","doi-asserted-by":"crossref","unstructured":"Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, Shi W (July 2017) Photo-realistic single image super-resolution using a generative adversarial network. In: IEEE conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR.2017.19"},{"key":"10784_CR143","doi-asserted-by":"crossref","unstructured":"Minaee S, Abdolrashidi A, Su H, Bennamoun M, Zhang D (2023) Biometrics recognition using deep learning: a survey. Artif Intell Rev, pp 1\u201349","DOI":"10.1007\/s10462-022-10237-x"},{"key":"10784_CR144","unstructured":"Patrik SH (2022) Shift-DeepONet: extending deep operator networks for discontinuous output functions. ETH Zurich, Seminar for applied mathematics"},{"key":"10784_CR145","unstructured":"Raissi M (2024) Forward-backward stochastic neural networks: deep learning of high-dimensional partial differential equations. In Peter Carr Gedenkschrift: research advances in mathematical finance. World Scientific, pp 637\u2013655"},{"key":"10784_CR146","doi-asserted-by":"crossref","unstructured":"Rodkina A, Kelly C (2011) Stochastic difference equations and applications","DOI":"10.1007\/978-3-642-04898-2_568"},{"key":"10784_CR147","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition"},{"key":"10784_CR148","doi-asserted-by":"crossref","unstructured":"Soldatenko S, Yusupov R (2017) Predictability in deterministic dynamical systems with application to weather forecasting and climate modelling. In: Dynamical systems-analytical and computational techniques. IntechOpen, p 101","DOI":"10.5772\/66752"},{"key":"10784_CR149","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (Jun 2015) Going deeper with convolutions. In: IEEE conference on computer vision and pattern recognition, Los Alamitos, CA, USA. IEEE Computer Society, pp 1\u20139","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"10784_CR150","doi-asserted-by":"crossref","unstructured":"Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (December 2015) Learning spatiotemporal features with 3D convolutional networks. In: IEEE international conference on computer vision","DOI":"10.1109\/ICCV.2015.510"},{"key":"10784_CR151","doi-asserted-by":"crossref","unstructured":"Vakalopoulou M, Christodoulidis S, Burgos N, Colliot O, Lepetit V (2023) Deep learning: basics and convolutional neural networks (CNNs). Mach Learn Brain Disord, pp 77\u2013115","DOI":"10.1007\/978-1-0716-3195-9_3"},{"key":"10784_CR152","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, vol&nbsp;30"},{"key":"10784_CR153","doi-asserted-by":"crossref","unstructured":"Vinyals O, Toshev A, Bengio S, Erhan D (June 2015) Show and tell: a neural image caption generator. In: IEEE conference on computer vision and pattern recognition, Los Alamitos, CA, USA. IEEE Computer Society, pp 3156\u20133164","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"10784_CR154","unstructured":"Yang L et&nbsp;al (2019) Highly-scalable, physics-informed GANs for learning solutions of stochastic PDEs. In: IEEE\/ACM 3rd workshop on deep learning on supercomputers. IEEE, pp 1\u201311"},{"key":"10784_CR155","doi-asserted-by":"crossref","unstructured":"Yao H, Ren Y, Liu Y (2019) FEA-Net: a deep convolutional neural network with physicsprior for efficient data driven PDE learning. In: AIAA Scitech 2019 forum, p 0680","DOI":"10.2514\/6.2019-0680"},{"key":"10784_CR156","unstructured":"Yentis R, Zaghloul ME (1994) CMOS implementation of locally connected neural cells to solve the steady-state heat flow problem. In: 37th midwest symposium on circuits and systems. IEEE, vol 1, pp 503\u2013506"},{"key":"10784_CR157","doi-asserted-by":"crossref","unstructured":"Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: IEEE conference on computer vision and pattern recognition, pp 6230\u20136239","DOI":"10.1109\/CVPR.2017.660"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10784-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-024-10784-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10784-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T23:54:14Z","timestamp":1732060454000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-024-10784-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,24]]},"references-count":157,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["10784"],"URL":"https:\/\/doi.org\/10.1007\/s10462-024-10784-5","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,24]]},"assertion":[{"value":"4 May 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 May 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"152"}}