{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,22]],"date-time":"2025-02-22T00:36:23Z","timestamp":1740184583333,"version":"3.37.3"},"reference-count":153,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T00:00:00Z","timestamp":1732665600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T00:00:00Z","timestamp":1732665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Hum-Cent Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Universal Numerical Integrators (UNIs) can be defined as the coupling of a universal approximator of functions (e.g., artificial neural network) with some conventional numerical integrator (e.g., Euler or Runge\u2013Kutta). The UNIs are used to model non-linear dynamic systems governed by Ordinary Differential Equations (ODEs). Among the main types of UNIs existing in the literature, we can mention (i) The Euler-Type Universal Numerical Integrator (E-TUNI), (ii) The Runge-Kutta Neural Network (RKNN), and (iii) The Non-linear Auto Regressive Moving Average with Exogenous input or NARMAX model. All of them are equally accurate, regardless of their order. Furthermore, one of the reasons for writing this article is to show the reader that there are many other UNIs besides these. Thus, this article aims to carry out a detailed bibliographic review of this object of study, taking into more significant consideration the qualitative aspects of these UNIs. Computational experiments are also presented in this article to prove the numerical effectiveness of the main types of UNIs in the literature. Therefore, it is expected that this paper will help researchers in the future development of new UNIs.<\/jats:p>","DOI":"10.1007\/s44230-024-00087-x","type":"journal-article","created":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T12:48:24Z","timestamp":1732711704000},"page":"571-598","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Qualitative Approach to Universal Numerical Integrators (UNIs) with Computational Application"],"prefix":"10.1007","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7069-8430","authenticated-orcid":false,"given":"Paulo M.","family":"Tasinaffo","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5958-8011","authenticated-orcid":false,"given":"Luiz A. V.","family":"Dias","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2399-5066","authenticated-orcid":false,"given":"Adilson M.","family":"da Cunha","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,11,27]]},"reference":[{"issue":"1","key":"87_CR1","doi-asserted-by":"publisher","first-page":"383","DOI":"10.24507\/ijicic.15.01.383","volume":"15","author":"PM Tasinaffo","year":"2019","unstructured":"Tasinaffo PM, Goncalves GS, Cunha AM, Dias LAV. An introduction to universal numerical integrators. Int J Innov Comput Inform Control. 2019;15(1):383\u2013406. https:\/\/doi.org\/10.24507\/ijicic.15.01.383.","journal-title":"Int J Innov Comput, Inform Control"},{"issue":"2","key":"87_CR2","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1109\/72.661124","volume":"9","author":"Y-J Wang","year":"1998","unstructured":"Wang Y-J, Lin C-T. Runge-Kutta neural network for identification of dynamical systems in high accuracy. IEEE Trans Neural Netw. 1998;9(2):294\u2013307. https:\/\/doi.org\/10.1109\/72.661124.","journal-title":"IEEE Trans Neural Netw"},{"key":"87_CR3","doi-asserted-by":"crossref","unstructured":"Rios\u00a0Neto A. Dynamic systems numerical integrators in neural control schemes. In: V Congresso Brasileiro de Redes Neurais, Rio de Janeiro-RJ, Brazil, pp. 2001;85\u201388","DOI":"10.21528\/CBRN2001-019"},{"issue":"2","key":"87_CR4","doi-asserted-by":"publisher","first-page":"98","DOI":"10.21528\/LNLM-vol3-no2-art5","volume":"3","author":"PM Tasinaffo","year":"2005","unstructured":"Tasinaffo PM, Rios Neto A. Mean derivatives based neural Euler integrator for nonlinear dynamic systems modeling. Learn Nonlinear Models. 2005;3(2):98\u2013109.","journal-title":"Learn Nonlinear Models"},{"issue":"5","key":"87_CR5","doi-asserted-by":"publisher","first-page":"1703","DOI":"10.24507\/ijicic.12.05.1703","volume":"12","author":"TP Marcelo","year":"2016","unstructured":"Marcelo TP, dos Santos GR, Vieira DL, Strafacci JV, Motta CF. Discrete and exact general solution for nonlinear autonomous ordinary differential equations. Int J Innov Comput, Inform Control. 2016;12(5):1703\u201319. https:\/\/doi.org\/10.24507\/ijicic.12.05.1703.","journal-title":"Int J Innov Comput, Inform Control"},{"issue":"6","key":"87_CR6","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/BF02478259","volume":"5","author":"W McCulloch","year":"1943","unstructured":"McCulloch W, Pitts W. A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys. 1943;5(6):115\u201333. https:\/\/doi.org\/10.1007\/BF02478259.","journal-title":"Bull Math Biophys"},{"key":"87_CR7","volume-title":"Introduction to Artificial Neural Systems","author":"JM Zurada","year":"1992","unstructured":"Zurada JM. Introduction to Artificial Neural Systems. St. Paul, MN, USA: West Pub. Co.; 1992."},{"key":"87_CR8","volume-title":"Neuro-Fuzzy and soft computing: a computational approach to learning and machine intelligence","author":"JS Jang","year":"1997","unstructured":"Jang JS, Sun CT, Mizutani E. Neuro-Fuzzy and soft computing: a computational approach to learning and machine intelligence. New Jersey: Prentice-Hall Inc; 1997."},{"key":"87_CR9","volume-title":"Neural networks: a comprehensive foundation","author":"S Haykin","year":"1999","unstructured":"Haykin S. Neural networks: a comprehensive foundation. New Jersey: Prentice-Hall Inc; 1999."},{"key":"87_CR10","doi-asserted-by":"publisher","DOI":"10.1002\/0471221139","volume-title":"Stable adaptive control and estimation for nonlinear systems neural and fuzzy approximator techniques","author":"JT Spooner","year":"2002","unstructured":"Spooner JT, Maggiore M, Ord\u00f3nez R, Passino KM. Stable adaptive control and estimation for nonlinear systems neural and fuzzy approximator techniques. New York: Wiley-Interscience; 2002."},{"issue":"4","key":"87_CR11","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/BF02551274","volume":"2","author":"G Cybenko","year":"1989","unstructured":"Cybenko G. Approximation by superpositions of a sigmoidal function. Math Control Signals Syst. 1989;2(4):303\u201314. https:\/\/doi.org\/10.1007\/BF02551274.","journal-title":"Math Control Signals Syst"},{"issue":"5","key":"87_CR12","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","volume":"2","author":"K Hornik","year":"1989","unstructured":"Hornik K, Stinchcombe M, White H. Multilayer feedforward networks are universal approximators. Neural Netw. 1989;2(5):359\u201366. https:\/\/doi.org\/10.1016\/0893-6080(89)90020-8.","journal-title":"Neural Netw"},{"issue":"4","key":"87_CR13","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1109\/72.80265","volume":"1","author":"NE Cotter","year":"1990","unstructured":"Cotter NE. The Stone-Weierstrass and its application to neural networks. IEEE Trans Neural Netw. 1990;1(4):290\u20135. https:\/\/doi.org\/10.1109\/72.80265.","journal-title":"IEEE Trans Neural Netw"},{"key":"87_CR14","doi-asserted-by":"publisher","unstructured":"Hanin, B. Universal function approximation by deep neural nets with bounded width and ReLU activations. In: Internal Report, Cornell University, Ithaca\/NY, United States of America (2017); https:\/\/doi.org\/10.48550\/arXiv.1708.02691","DOI":"10.48550\/arXiv.1708.02691"},{"key":"87_CR15","unstructured":"Euler LP. Institutiones Calculi Integralis, St. Petersburg (1768)"},{"key":"87_CR16","doi-asserted-by":"crossref","unstructured":"Boser BE, Guyon IM, Vapnik VN. A training algorithm for optimal margin classifiers. In: Proceedings of The Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, Pennsylvania\/USA, pp. 1992;144\u2013152","DOI":"10.1145\/130385.130401"},{"issue":"3","key":"87_CR17","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1007\/BF00994018","volume":"20","author":"C Cortes","year":"1995","unstructured":"Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273\u201397. https:\/\/doi.org\/10.1007\/BF00994018.","journal-title":"Mach Learn"},{"issue":"2","key":"87_CR18","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1023\/A:1009715923555","volume":"2","author":"CJC Burges","year":"1998","unstructured":"Burges CJC. A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc. 1998;2(2):121\u201367. https:\/\/doi.org\/10.1023\/A:1009715923555.","journal-title":"Data Min Knowl Disc"},{"issue":"1","key":"87_CR19","first-page":"92","volume":"5","author":"S Gazzah","year":"2008","unstructured":"Gazzah S, Amara NB. Neural networks and support vector machines classifiers for writer identification using arabic script. Int Arab J Inforrm Technol. 2008;5(1):92\u2013101.","journal-title":"Int Arab J Inforrm Technol"},{"key":"87_CR20","doi-asserted-by":"publisher","unstructured":"Cristianini N, Shawe-Taylor J. An introduction to support vector machines and other Kernel-based learning methods. Cambridge University Press, 16th edition, New York, USA. 2014;. https:\/\/doi.org\/10.1017\/CBO9780511801389","DOI":"10.1017\/CBO9780511801389"},{"key":"87_CR21","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/4175.001.0001","author":"B Sh\u00f6lkopf","year":"2002","unstructured":"Sh\u00f6lkopf B, Smola AJ. Learning with Kernels support vector machines, regularization, optimization, and beyond. MIT Press Mass Instit Technol. 2002. https:\/\/doi.org\/10.7551\/mitpress\/4175.001.0001.","journal-title":"MIT Press Mass Instit Technol"},{"issue":"6","key":"87_CR22","doi-asserted-by":"publisher","first-page":"989","DOI":"10.1109\/72.329697","volume":"5","author":"MT Hagan","year":"1994","unstructured":"Hagan MT, Menhaj MB. Training feedforward networks with the Marquardt algorithm. IEEE Trans Neural Netw. 1994;5(6):989\u201393. https:\/\/doi.org\/10.1109\/72.329697.","journal-title":"IEEE Trans Neural Netw"},{"key":"87_CR23","doi-asserted-by":"publisher","unstructured":"Chang C-C, Lin C-J. LIBSVM: A Library for Support Vector Machines. National Taiwan University, Taipei, Taiwan (2001). https:\/\/doi.org\/10.1145\/1961189.1961199","DOI":"10.1145\/1961189.1961199"},{"key":"87_CR24","first-page":"1","volume":"19","author":"Z Wen","year":"2018","unstructured":"Wen Z, Shi J, He B, Chen J. Thundersvm: A fast SVM library on GPUs and CPUs. J Mach Learn Res. 2018;19:1\u20135.","journal-title":"J Mach Learn Res"},{"issue":"6","key":"87_CR25","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1109\/72.165591","volume":"3","author":"Q Zhang","year":"1992","unstructured":"Zhang Q, Benveniste A. Wavelet networks. IEEE Trans Neural Netw. 1992;3(6):889\u201398. https:\/\/doi.org\/10.1109\/72.165591.","journal-title":"IEEE Trans Neural Netw"},{"issue":"1","key":"87_CR26","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1109\/72.182697","volume":"4","author":"YC Pati","year":"1993","unstructured":"Pati YC, Krishnaprasad PS. Analysis and synthesis of feedforward neural networks using discrete affine wavelet transforms. IEEE Trans Neural Netw. 1993;4(1):73\u201385. https:\/\/doi.org\/10.1109\/72.182697.","journal-title":"IEEE Trans Neural Netw"},{"key":"87_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2139\/ssrn.1923020","volume":"42","author":"A Alexandridis","year":"2013","unstructured":"Alexandridis A, Zapranis A. Wavelet neural networks: a practical guide. Neural Netw. 2013;42:1\u201327. https:\/\/doi.org\/10.2139\/ssrn.1923020.","journal-title":"Neural Netw"},{"key":"87_CR28","volume-title":"Elements of numerical analysis","author":"P Henrici","year":"1964","unstructured":"Henrici P. Elements of numerical analysis. New York: John Wiley and Sons; 1964."},{"key":"87_CR29","volume-title":"Numerical solution of ordinary differential equations","author":"L Lapidus","year":"1971","unstructured":"Lapidus L, Seinfeld JH. Numerical solution of ordinary differential equations. New York and London: Academic Press; 1971."},{"key":"87_CR30","volume-title":"Computational methods in ordinary differential equations","author":"JD Lambert","year":"1973","unstructured":"Lambert JD. Computational methods in ordinary differential equations. New York: John Wiley and Sons; 1973."},{"key":"87_CR31","volume-title":"Nonlinear aystems analysis","author":"M Vidyasagar","year":"1978","unstructured":"Vidyasagar M. Nonlinear aystems analysis. New Jersey Prentice-Hall: Electrical Engineering Series; 1978."},{"key":"87_CR32","volume-title":"Numerical methods for parcial differential equations","author":"WF Ames","year":"1977","unstructured":"Ames WF. Numerical methods for parcial differential equations. New York: Academic Press; 1977."},{"key":"87_CR33","volume-title":"Introductory computer methods and numerical analysis","author":"RH Pennington","year":"1970","unstructured":"Pennington RH. Introductory computer methods and numerical analysis. London: The Macmillan Company; 1970."},{"key":"87_CR34","volume-title":"Numerical methods in engineering","author":"MG Salvadori","year":"1961","unstructured":"Salvadori MG, Baron ML. Numerical methods in engineering. Englewood Cliffs, NJ: Prentice-Hall; 1961."},{"key":"87_CR35","volume-title":"k An Introduction to Applied Mathematics","author":"M Braun","year":"1983","unstructured":"Braun M. Differential Equations and Their Applications. In: k An Introduction to Applied Mathematics. New York: Springer; 1983."},{"key":"87_CR36","unstructured":"Rama\u00a0Rao K. A review on numerical methods for initial value problems. In: Internal Report, INPE-3011-RPI\/088, S\u00e3o Jos\u00e9 dos Campos\/SP, Brazil. 1984"},{"issue":"3","key":"87_CR37","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1016\/0377-0427(90)90279-9","volume":"30","author":"A Rios Neto","year":"1990","unstructured":"Rios Neto A, Rama Rao K. A stochastic approach to global error estimation in ODE multistep numerical integration. J Comput Appl Math. 1990;30(3):257\u201381. https:\/\/doi.org\/10.1016\/0377-0427(90)90279-9.","journal-title":"J Comput Appl Math"},{"issue":"3","key":"87_CR38","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1023\/A:1012873910884","volume":"16","author":"B Cockburn","year":"2001","unstructured":"Cockburn B, Shu C-W. Runge-Kutta discontinuous Galerkin methods for convection-dominated problems. J Sci Comput. 2001;16(3):173\u2013261. https:\/\/doi.org\/10.1023\/A:1012873910884.","journal-title":"J Sci Comput"},{"issue":"3","key":"87_CR39","doi-asserted-by":"publisher","first-page":"199","DOI":"10.5556\/j.tkjm.39.2008.12","volume":"39","author":"DJL Chen","year":"2008","unstructured":"Chen DJL, Chang JC, Cheng CH. Higher order composition Runge-Kutta methods. Tamkang J Math. 2008;39(3):199\u2013211. https:\/\/doi.org\/10.5556\/j.tkjm.39.2008.12.","journal-title":"Tamkang J Math"},{"issue":"11","key":"87_CR40","doi-asserted-by":"publisher","first-page":"3032","DOI":"10.1016\/j.camwa.2010.10.002","volume":"60","author":"J Peinado","year":"2010","unstructured":"Peinado J, Ib\u00e1\u00f1ez J, Arias E, Hern\u00e1ndez V. Adams-Bashforth and Adams-Moulton methods for solving differential Riccati equations. Comput Math Appl. 2010;60(11):3032\u201345. https:\/\/doi.org\/10.1016\/j.camwa.2010.10.002.","journal-title":"Comput Math Appl"},{"issue":"6","key":"87_CR41","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1007\/s13351-011-0606-6","volume":"25","author":"Z Bin","year":"2011","unstructured":"Bin Z. Comparison of different order Adams-Bashforth methods in an atmospheric general circulation model. Acta Meteorol Sin. 2011;25(6):754\u201364. https:\/\/doi.org\/10.1007\/s13351-011-0606-6.","journal-title":"Acta Meteorol Sin"},{"issue":"4","key":"87_CR42","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1007\/s11075-010-9437-2","volume":"57","author":"E Misirli","year":"2011","unstructured":"Misirli E, Gurefe Y. Multiplicative Adams Bashforth-Moulton methods. Numer Algorithm. 2011;57(4):425\u201339. https:\/\/doi.org\/10.1007\/s11075-010-9437-2.","journal-title":"Numer Algorithm"},{"issue":"1","key":"87_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2012\/867948","volume":"2012","author":"Q Ming","year":"2012","unstructured":"Ming Q, Yang Y, Fang Y. An optimized Runge-Kutta method for the numerical solution of the radial Schr\u00f6dinger equation. Math Probl Eng. 2012;2012(1):1\u201312. https:\/\/doi.org\/10.1155\/2012\/867948.","journal-title":"Math Probl Eng"},{"issue":"103","key":"87_CR44","doi-asserted-by":"publisher","first-page":"5115","DOI":"10.12988\/ams.2013.36314","volume":"7","author":"G Polla","year":"2013","unstructured":"Polla G. Comparing accuracy of differential equation results between Runge-Kutta Fehlberg methods and Adams-Moulton methods. Appl Math Sci. 2013;7(103):5115\u201327. https:\/\/doi.org\/10.12988\/ams.2013.36314.","journal-title":"Appl Math Sci"},{"issue":"3","key":"87_CR45","doi-asserted-by":"publisher","first-page":"1013","DOI":"10.1080\/00207178908559683","volume":"49","author":"S Chen","year":"1989","unstructured":"Chen S, Billings SA. Representations of nonlinear systems: the NARMAX model. Int J Control. 1989;49(3):1013\u201332. https:\/\/doi.org\/10.1080\/00207178908559683.","journal-title":"Int J Control"},{"issue":"6","key":"87_CR46","doi-asserted-by":"publisher","first-page":"1327","DOI":"10.1080\/00207179008953599","volume":"52","author":"S Chen","year":"1990","unstructured":"Chen S, Billings SA, Cowan CFN, Grant PM. Practical identification of NARMAX models using radial basis functions. Int J Control. 1990;52(6):1327\u201350. https:\/\/doi.org\/10.1080\/00207179008953599.","journal-title":"Int J Control"},{"issue":"6","key":"87_CR47","doi-asserted-by":"publisher","first-page":"2157","DOI":"10.1080\/00207178908559767","volume":"49","author":"SA Billings","year":"1989","unstructured":"Billings SA, Chen S, Koreberg MJ. Identification of MIMO non-linear systems using forward-regression orthogonal estimator. Int J Control. 1989;49(6):2157\u201389. https:\/\/doi.org\/10.1080\/00207178908559767.","journal-title":"Int J Control"},{"issue":"2","key":"87_CR48","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1080\/0020718508961129","volume":"41","author":"IJ Leontaritis","year":"1985","unstructured":"Leontaritis IJ, Billings SA. Input-output parametric models for non-linear systems part I: deterministic non-linear systems. Int J Control. 1985;41(2):303\u201344. https:\/\/doi.org\/10.1080\/0020718508961129.","journal-title":"Int J Control"},{"issue":"1","key":"87_CR49","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/72.80202","volume":"1","author":"KS Narendra","year":"1990","unstructured":"Narendra KS, Parthasarathy K. Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw. 1990;1(1):4\u201327. https:\/\/doi.org\/10.1109\/72.80202.","journal-title":"IEEE Trans Neural Netw"},{"issue":"5","key":"87_CR50","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1049\/ip-d.1991.0059","volume":"138","author":"KJ Hunt","year":"1991","unstructured":"Hunt KJ, Sbarbaro D. Neural networks for nonlinear internal model control. IEE Proceed D (Control Theory and Applications). 1991;138(5):431\u20138. https:\/\/doi.org\/10.1049\/ip-d.1991.0059.","journal-title":"IEE Proceed D (Control Theory and Applications)"},{"issue":"6","key":"87_CR51","doi-asserted-by":"publisher","first-page":"1083","DOI":"10.1016\/0005-1098(92)90053-I","volume":"28","author":"KJ Hunt","year":"1992","unstructured":"Hunt KJ, Sbarbaro D, Zbikowski R, Gawthrop PJ. Neural networks for control systems-A survey. Automatica. 1992;28(6):1083\u2013112. https:\/\/doi.org\/10.1016\/0005-1098(92)90053-I.","journal-title":"Automatica"},{"issue":"2","key":"87_CR52","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1080\/00207179208934317","volume":"56","author":"S Chen","year":"1992","unstructured":"Chen S, Billings SA. Neural networks for nonlinear dynamic system modelling and identification. Int J Control. 1992;56(2):319\u201346. https:\/\/doi.org\/10.1080\/00207179208934317.","journal-title":"Int J Control"},{"issue":"1\/2","key":"87_CR53","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/0895-7177(95)00221-9","volume":"23","author":"SN Balakrishnan","year":"1996","unstructured":"Balakrishnan SN, Weil RD. Neurocontrol: a literature survey. Mathl Comput Model. 1996;23(1\/2):101\u201317. https:\/\/doi.org\/10.1016\/0895-7177(95)00221-9.","journal-title":"Mathl Comput Model"},{"key":"87_CR54","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-0453-7","volume-title":"Neural networks for modelling and control of dynamic systems","author":"M Norgaard","year":"2000","unstructured":"Norgaard M, Ravn O, Poulsen NK, Hansen LK. Neural networks for modelling and control of dynamic systems. London: Spring; 2000."},{"key":"87_CR55","unstructured":"Nygren K. Sotck prediction: a neural network approach. In: Master Thesis, Sweden ;2004"},{"issue":"5","key":"87_CR56","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1590\/S0103-17592010000500005","volume":"21","author":"RP Melo","year":"2010","unstructured":"Melo RP, Tasinaffo PM. Uma metodologia de modelagem empirica utilizando o integrador neural de multiplos passos do tipo Adams-Bashforth. Rev Controle e Autom. 2010;21(5):487\u2013509. https:\/\/doi.org\/10.1590\/S0103-17592010000500005.","journal-title":"Rev Controle e Autom"},{"key":"87_CR57","unstructured":"Rios\u00a0Neto A, Tasinaffo PM. Modeling with ODE neural numerical integrators applied to the dynamics of an orbit transfer problem. In: XI Col\u00f3quio Brasileiro de Din\u00e2mica Orbital, Vi\u00e7osa\/MG, Brazil ;2002"},{"key":"87_CR58","unstructured":"Melo RP. Metodologia de modelagem empi\u00adrica utilizando integradores neurais de multiplos-passos aplicado a sistemas din\u00e2micos n\u00e3o-lineares. Master\u2019s thesis, Instituto Tecnol\u00f3gico de Aeronautica (ITA), S\u00e3o Jos\u00e9 dos Campos\/SP, Brazil; 2008."},{"key":"87_CR59","unstructured":"Rios\u00a0Neto A, Tasinaffo PM. Feedforward neural networks combined with a numerical integrator structure for dynamic systems modeling. In: XVII COBEM - International Congress of Mechanical Engineering, S\u00e3o Paulo\/SP, Brazil 2003;. https:\/\/api.semanticscholar.org\/CorpusID:222927851"},{"key":"87_CR60","volume-title":"Calculus with analytic geometry (Volumes I and II)","author":"MA Munem","year":"1978","unstructured":"Munem MA, Foulis DJ. Calculus with analytic geometry (Volumes I and II). New York: Worth Publishers Inc; 1978."},{"key":"87_CR61","volume-title":"Mathematics of physics and modern engineering","author":"IS Sokolnikoff","year":"1966","unstructured":"Sokolnikoff IS, Redheffer RM. Mathematics of physics and modern engineering. Tokyo, Japan: McGraw-Hill Kogakusha, LTD.; 1966."},{"key":"87_CR62","volume-title":"Advanced calculus","author":"E Wilson","year":"1958","unstructured":"Wilson E. Advanced calculus. New York, USA: Dover Publications; 1958."},{"key":"87_CR63","unstructured":"Tasinaffo PM. Estruturas de integrac\u00e3o neural feedforward testadas em problemas de controle preditivo. PhD thesis, INPE-10475-TDI\/945, S\u00e3o Jose dos Campos\/SP, Brazil; 2003."},{"issue":"3","key":"87_CR64","doi-asserted-by":"publisher","first-page":"1","DOI":"10.19080\/RAEJ.2019.04.555636","volume":"4","author":"PM Tasinaffo","year":"2019","unstructured":"Tasinaffo PM, Goncalves GS, Melo GA, Dias LAV. A brief bibliographic review on Euler neural networks. Robot Autom Eng J. 2019;4(3):1\u20135. https:\/\/doi.org\/10.19080\/RAEJ.2019.04.555636.","journal-title":"Robot Autom Eng J"},{"issue":"5","key":"87_CR65","doi-asserted-by":"publisher","first-page":"1721","DOI":"10.24507\/ijicic.12.05.1721","volume":"12","author":"MO Figueiredo","year":"2016","unstructured":"Figueiredo MO, Tasinaffo PM, Dias LAV. Modeling autonomous nonlinear dynamic systems using mean derivatives, fuzzy logic and genetic algorithms. Int J Innov Comput Inform Control. 2016;12(5):1721\u201343. https:\/\/doi.org\/10.24507\/ijicic.12.05.1721.","journal-title":"Int J Innov Comput Inform Control"},{"issue":"6","key":"87_CR66","doi-asserted-by":"publisher","first-page":"1881","DOI":"10.24507\/ijicic.12.06.1881","volume":"12","author":"PM Tasinaffo","year":"2016","unstructured":"Tasinaffo PM, Guimar\u00e3es RS, Dias LAV, Strafacci J\u00fanior V. Mean derivatives methodology by using Euler integrator improved to allow the variation in the size of integration step. Int J Innov Comput, Informat Control. 2016;12(6):1881\u201391. https:\/\/doi.org\/10.24507\/ijicic.12.06.1881.","journal-title":"Int J Innov Comput, Informat Control"},{"issue":"5","key":"87_CR67","doi-asserted-by":"publisher","first-page":"987","DOI":"10.1109\/72.712178","volume":"9","author":"IE Lagaris","year":"1998","unstructured":"Lagaris IE, Likas A, Fotiadis DI. Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw. 1998;9(5):987\u20131000. https:\/\/doi.org\/10.1109\/72.712178.","journal-title":"IEEE Trans Neural Netw"},{"issue":"4","key":"87_CR68","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1109\/MCSE.2006.73","volume":"8","author":"Z Zhe-Zhao","year":"2006","unstructured":"Zhe-Zhao Z, Yao-Nan W, Hui W. Numerical integration based on neural network algorithm. Comput Sci Eng. 2006;8(4):42\u20138. https:\/\/doi.org\/10.1109\/MCSE.2006.73.","journal-title":"Comput Sci Eng"},{"key":"87_CR69","doi-asserted-by":"publisher","unstructured":"Xu Ly, Li Lj. The new numerical integration algorithm based on neural network. In: Third International Conference on Natural Computation (ICNC) and IEEE Computer Society, Haikou, Hainan, China 2007; https:\/\/doi.org\/10.1109\/ICNC.2007.730","DOI":"10.1109\/ICNC.2007.730"},{"issue":"1","key":"87_CR70","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/s10827-008-0131-5","volume":"27","author":"RD Stewart","year":"2009","unstructured":"Stewart RD, Bair W. Spiking neural network simulation: mumerical integration with the Parker-Sochacki method. J Comput Neurosci. 2009;27(1):115\u201333. https:\/\/doi.org\/10.1007\/s10827-008-0131-5.","journal-title":"J Comput Neurosci"},{"key":"87_CR71","doi-asserted-by":"publisher","unstructured":"Zhang Y, Li L, Yang Y, Ruan G. Euler neural network with its weight-direct-determination and structure-automatic-determination algorithms. In: Ninth International Conference on Hybrid Intelligent Systems (IEEE Computer Society), Shenyang, China, pp. 319\u2013324. 2009; https:\/\/doi.org\/10.1109\/HIS.2009.278","DOI":"10.1109\/HIS.2009.278"},{"issue":"47","key":"87_CR72","doi-asserted-by":"publisher","first-page":"6144","DOI":"10.5897\/IJPS12.585","volume":"7","author":"ME-S Wahed","year":"2012","unstructured":"Wahed ME-S, Wahed OHA. An efficient numerical integration algorithm for single-layer raster cellular neural networks simulator. Int J Phys Sci. 2012;7(47):6144\u20138. https:\/\/doi.org\/10.5897\/IJPS12.585.","journal-title":"Int J Phys Sci"},{"issue":"1","key":"87_CR73","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1007\/2Fs00521-013-1476-x","volume":"25","author":"AA Anastassi","year":"2014","unstructured":"Anastassi AA. Constructing Runge-Kutta method with the use of artificial neural networks. Neural Comput Appl. 2014;25(1):229\u201336. https:\/\/doi.org\/10.1007\/2Fs00521-013-1476-x.","journal-title":"Neural Comput Appl"},{"issue":"1","key":"87_CR74","doi-asserted-by":"publisher","first-page":"180","DOI":"10.14419\/jacst.v4i1.4365","volume":"4","author":"M Dehghanpour","year":"2015","unstructured":"Dehghanpour M, Rahati A, Dehghanian E. ANN-based modeling of third order rungekutta method. J Adv Comput Sci Technol. 2015;4(1):180\u20139. https:\/\/doi.org\/10.14419\/jacst.v4i1.4365.","journal-title":"J Adv Comput Sci Technol"},{"issue":"17","key":"87_CR75","doi-asserted-by":"publisher","first-page":"7769","DOI":"10.1007\/s00500-018-3405-5","volume":"23","author":"K U\u00e7ak","year":"2019","unstructured":"U\u00e7ak K. A Runge-Kutta neural network-based control method for nonlinear MIMO systems. Soft Comput. 2019;23(17):7769\u2013803. https:\/\/doi.org\/10.1007\/s00500-018-3405-5.","journal-title":"Soft Comput"},{"key":"87_CR76","doi-asserted-by":"publisher","unstructured":"U\u00e7ak K, G\u00fcnel GO. An adaptive state feedback controller based on SVR for nonlinear systems. In: 6th International Conference on Control Engineering and Information Technology (CEIT), Istanbul, Turkey, pp. 25\u201327. 2018; https:\/\/doi.org\/10.1109\/CEIT.2018.8751888","DOI":"10.1109\/CEIT.2018.8751888"},{"key":"87_CR77","doi-asserted-by":"publisher","unstructured":"U\u00e7ak, K.: A Runge-Kutta MLP neural network based control method for nonlinear MIMO systems. In: 6th International Conference on Electrical and Electronics Engineering (ICEEE), Istanbul, Turkey, 2019; 186\u2013192. https:\/\/doi.org\/10.1109\/ICEEE2019.2019.00043","DOI":"10.1109\/ICEEE2019.2019.00043"},{"key":"87_CR78","doi-asserted-by":"publisher","unstructured":"Chen, R.T.Q., Rubanova, Y., Bettencourt, J., Duveand, D.: Neural ordinary differential equations. In: 32nd Conference on Neural Information Processing Systems (NeurlPS), Montr\u00e9al, Canada, pp. 1\u201319. 2018; https:\/\/doi.org\/10.48550\/arXiv.1806.07366","DOI":"10.48550\/arXiv.1806.07366"},{"issue":"2","key":"87_CR79","doi-asserted-by":"publisher","first-page":"1789","DOI":"10.1007\/s11063-019-10167-w","volume":"51","author":"K U\u00e7ak","year":"2020","unstructured":"U\u00e7ak K. A novel model predictive Runge-Kutta neural network controller for nonlinear MIMO systems. Neural Process Lett. 2020;51(2):1789\u2013833. https:\/\/doi.org\/10.1007\/s11063-019-10167-w.","journal-title":"Neural Process Lett"},{"issue":"1","key":"87_CR80","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1590\/S0103-17592007000100007","volume":"18","author":"PM Tasinaffo","year":"2006","unstructured":"Tasinaffo PM, Rios Neto A. Predictive control with mean derivative based neural euler integrator dynamic model. Rev Control Autom. 2006;18(1):94\u2013105. https:\/\/doi.org\/10.1590\/S0103-17592007000100007.","journal-title":"Rev Control Autom"},{"key":"87_CR81","unstructured":"Rios Neto, A, Tasinaffo PM. Neural numerical integrators in predictive control tested in na orbit transfer problem. In: DINCON-2003 or II Congresso Tem\u00e1tico de Din\u00e2mica, Controle e Aplica\u00e7\u00e3oes, S\u00e3o Jos\u00e9 dos Campos\/SP, Brazil, 2003;692\u2013 702"},{"issue":"2","key":"87_CR82","doi-asserted-by":"publisher","first-page":"445","DOI":"10.24507\/ijicic.15.02.445","volume":"15","author":"PM Tasinaffo","year":"2019","unstructured":"Tasinaffo PM, Rios Neto A. Adams-Bashforth neural networks applied in a predictive control structure with only one horizon. Int J Innov Comput, Inform Control. 2019;15(2):445\u201364. https:\/\/doi.org\/10.24507\/ijicic.15.02.445.","journal-title":"Int J Innov Comput, Inform Control"},{"issue":"6","key":"87_CR83","doi-asserted-by":"publisher","first-page":"112","DOI":"10.11648\/j.mcs.20190406.13","volume":"4","author":"PM Tasinaffo","year":"2019","unstructured":"Tasinaffo PM, Santos AHM, Cavalcante Junior E, Forster CHQ, Shigemura RAL, Jacomel R, Pugliese VU, Iha BKV, Cunha AM, Gon\u00c3\u00e7alves GS, Dias LAV. Determination of forest reserves area using images processed by drones, neural networks and Monte Carlo method. Math Comput Sci. 2019;4(6):112\u201329. https:\/\/doi.org\/10.11648\/j.mcs.20190406.13.","journal-title":"Math Comput Sci"},{"issue":"12","key":"87_CR84","doi-asserted-by":"publisher","first-page":"31","DOI":"10.31873\/IJETR.9.12.42","volume":"9","author":"VPR Arruda","year":"2019","unstructured":"Arruda VPR, Tasinaffo PM, Cunha AM, Dias LAV. River flux prediction via RBF neural networks and NARMAX methodology. Int J Eng Tech Res. 2019;9(12):31\u20136. https:\/\/doi.org\/10.31873\/IJETR.9.12.42.","journal-title":"Int J Eng Tech Res"},{"issue":"12","key":"87_CR85","doi-asserted-by":"publisher","first-page":"1978","DOI":"10.1109\/TLA.2019.9011542","volume":"17","author":"GA Melo","year":"2019","unstructured":"Melo GA, Sugimoto DN, Tasinaffo PM, Santos AHM, Cunha AM, Dias LAV. A new approach to river flow forecasting: LSTM and GRU multivariate models. IEEE Lat Am Trans. 2019;17(12):1978\u201386. https:\/\/doi.org\/10.1109\/TLA.2019.9011542.","journal-title":"IEEE Lat Am Trans"},{"issue":"12","key":"87_CR86","doi-asserted-by":"publisher","first-page":"5","DOI":"10.31873\/IJETR.9.12.35","volume":"9","author":"RF Costa","year":"2019","unstructured":"Costa RF, Yelisetty SMH, Marques JC, Tasinaffo PM. A brief didactic theoretical review on convolutional neural networks, deep belief networks and stacked auto-encoders. Int J Eng Techn Res. 2019;9(12):5\u201312. https:\/\/doi.org\/10.31873\/IJETR.9.12.35.","journal-title":"Int J Eng Techn Res"},{"key":"87_CR87","unstructured":"Sotomayor J. Li\u00e7\u00f5es de Equacoes Diferencias Ordinarias. Projeto Euclides: Instituto de Matematica Pura e Aplicada (IMPA), Rio de Janeiro, Brazil; 1979."},{"key":"87_CR88","unstructured":"Palis Junior J, Melo W. Introducao Aos Sistemas Dinamicos. Projeto Euclides: Instituto de Matematica Pura e Aplicada (IMPA), Second Editon, Rio de Janeiro, Brazil; 2017."},{"key":"87_CR89","unstructured":"Barreira L, Valls C. Teoria Dos Sistemas Din\u00e2micos: Uma Introdu\u00c3\u00a7\u00c3\u00a3o. Editora Livraria da F\u00c3\u00adsica: Editorial Portugal, Lisboa, Portugal; 2012."},{"key":"87_CR90","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-39892-0","volume-title":"Classical dynamical systems","author":"W Thirring","year":"1978","unstructured":"Thirring W. Classical dynamical systems. New York: Springer; 1978."},{"key":"87_CR91","unstructured":"Barreira, L., Valls, C.: Equacoes Diferenciais Ordinarias: Teoria Qualitativa. Editora Livraria da Fisica: Editorial Portugal, Lisboa, Portugal. 2012"},{"key":"87_CR92","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-4575-7","volume-title":"Averaging methods in nonlinear dynamical systems","author":"JA Sanders","year":"1985","unstructured":"Sanders JA, Verhulst F. Averaging methods in nonlinear dynamical systems. New York: Springer; 1985."},{"key":"87_CR93","volume-title":"Qualitative theory of differential equations","author":"VV Nemytskii","year":"1989","unstructured":"Nemytskii VV, Stepanov VV. Qualitative theory of differential equations. New York: Dover Publications; 1989."},{"key":"87_CR94","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1038\/323533a0","volume":"323","author":"DE Rumelhart","year":"1986","unstructured":"Rumelhart DE, Hinton GE, Williams RJ. Learning representations by back-propagating errors. Nature. 1986;323:533\u20136. https:\/\/doi.org\/10.1038\/323533a0.","journal-title":"Nature"},{"issue":"4\u20135","key":"87_CR95","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1007\/BF00332914","volume":"59","author":"TP Vogl","year":"1988","unstructured":"Vogl TP, Mangis JK, Rigler AK, Zink WT, Alkon DL. Accelerating the convergence of the back-propagation metlhod. Biol Cybern. 1988;59(4\u20135):257\u201363. https:\/\/doi.org\/10.1007\/BF00332914.","journal-title":"Biol Cybern"},{"issue":"3","key":"87_CR96","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1049\/ip-g-2.1992.0050","volume":"139","author":"C Charalambous","year":"1992","unstructured":"Charalambous C. Conjugate gradient algorithm for efficient training of artificial neural networks. IEEE Proceed. 1992;139(3):301\u201310. https:\/\/doi.org\/10.1049\/ip-g-2.1992.0050.","journal-title":"IEEE Proceed"},{"issue":"2","key":"87_CR97","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1109\/72.125864","volume":"3","author":"E Barnard","year":"1992","unstructured":"Barnard E. Optimization for training neural nets. IEEE Trans Neural Netw. 1992;3(2):232\u201340. https:\/\/doi.org\/10.1109\/72.125864.","journal-title":"IEEE Trans Neural Netw"},{"key":"87_CR98","volume-title":"Neural network design","author":"MT Hagan","year":"2014","unstructured":"Hagan MT, Demuth HB, Beale MH, Jesus O. Neural network design. 2nd ed. Boston, MA: PWS Publishing; 2014.","edition":"2"},{"issue":"5","key":"87_CR99","doi-asserted-by":"publisher","first-page":"1041","DOI":"10.1109\/72.870037","volume":"11","author":"IE Lagaris","year":"2000","unstructured":"Lagaris IE, Likas A, Fotiadis DI. Neural-network methods for boundary value problems with irregular boundaries. IEEE Trans Neural Netw. 2000;11(5):1041\u20139. https:\/\/doi.org\/10.1109\/72.870037.","journal-title":"IEEE Trans Neural Netw"},{"issue":"19","key":"87_CR100","doi-asserted-by":"publisher","first-page":"2812","DOI":"10.3923\/jas.2007.2812.2817","volume":"7","author":"M Hayati","year":"2007","unstructured":"Hayati M, Karami B. Feedforward neural network for solving partial differential equations. J Appl Sci. 2007;7(19):2812\u20137. https:\/\/doi.org\/10.3923\/jas.2007.2812.2817.","journal-title":"J Appl Sci"},{"key":"87_CR101","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1007\/s40304-017-0117-6","volume":"5","author":"E Weinan","year":"2017","unstructured":"Weinan E, Han J, Jentzen A. Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations. Commun Math Stat. 2017;5:349\u201380. https:\/\/doi.org\/10.1007\/s40304-017-0117-6.","journal-title":"Commun Math Stat"},{"issue":"34","key":"87_CR102","doi-asserted-by":"publisher","first-page":"8505","DOI":"10.1073\/pnas.1718942115","volume":"115","author":"J Han","year":"2018","unstructured":"Han J, Arnulf J, Weinan E. Solving high-dimensional partial differential equations using deep learning. Proceed Nat Acad Sci. 2018;115(34):8505\u201310. https:\/\/doi.org\/10.1073\/pnas.1718942115.","journal-title":"Proceed Nat Acad Sci"},{"key":"87_CR103","doi-asserted-by":"publisher","first-page":"5595","DOI":"10.48550\/arXiv.1502.05767","volume":"18","author":"AG Baydin","year":"2018","unstructured":"Baydin AG, Pearlmutter BA, Radul AA, Siskind JM. Automatic differential in machine learning: a survey. J Mach Learn Res. 2018;18:5595\u2013637. https:\/\/doi.org\/10.48550\/arXiv.1502.05767.","journal-title":"J Mach Learn Res"},{"key":"87_CR104","doi-asserted-by":"publisher","unstructured":"Dockhorn, T.: A discussion on solving partial differential equations using neural networks. ArXiv abs\/1904.07200 2019; https:\/\/doi.org\/10.48550\/arXiv.1904.07200","DOI":"10.48550\/arXiv.1904.07200"},{"key":"87_CR105","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","volume":"378","author":"M Raissi","year":"2019","unstructured":"Raissi M, Perdikaris P, Karniadakis GE. Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J Comput Phys. 2019;378:686\u2013707. https:\/\/doi.org\/10.1016\/j.jcp.2018.10.045.","journal-title":"J Comput Phys"},{"key":"87_CR106","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2020.109672","volume":"419","author":"J Han","year":"2020","unstructured":"Han J, Nica M, Stinchcombe AR. A derivative-free method for solving elliptic partial differential equations with deep neural networks. J Comput Phys. 2020;419: 109672. https:\/\/doi.org\/10.1016\/j.jcp.2020.109672.","journal-title":"J Comput Phys"},{"key":"87_CR107","doi-asserted-by":"publisher","unstructured":"Lu, L., Meng, X., Mao, Z., E., K.G.: Deepxde: a deep learning library for solving differential equations. SIAM Review 63(1), 208\u2013228 (2021) https:\/\/doi.org\/10.1137\/19M1274067","DOI":"10.1137\/19M1274067"},{"issue":"1","key":"87_CR108","doi-asserted-by":"publisher","first-page":"42","DOI":"10.48550\/arXiv.2103.08915","volume":"15","author":"Q Zhu","year":"2022","unstructured":"Zhu Q, Yang J. A local deep learning method for solving high order partial differential equations. Numer Math Theor Meth Appl. 2022;15(1):42\u201367. https:\/\/doi.org\/10.48550\/arXiv.2103.08915.","journal-title":"Numer Math Theor Meth Appl"},{"key":"87_CR109","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1016\/0168-9274(95)00109-3","volume":"20","author":"PJ Houven","year":"1996","unstructured":"Houven PJ. The development of runge-kutta methods for partial differential equations. Appl Numer Math. 1996;20:261\u201372. https:\/\/doi.org\/10.1016\/0168-9274(95)00109-3.","journal-title":"Appl Numer Math"},{"key":"87_CR110","unstructured":"Cellier, F.E., Kofman, E.: Partial differential equations, pp. 191\u2013251. Springer, Boston, MA. 2006"},{"issue":"4","key":"87_CR111","doi-asserted-by":"publisher","first-page":"1842","DOI":"10.1109\/TLA.2016.7483524","volume":"14","author":"JI Da Silva Filho","year":"2016","unstructured":"Da Silva Filho JI, Cruz CM. A method with paraconsistent partial differential equation used in explicit solution on one-dimensional heat conduction. IEEE Lat Am Trans. 2016;14(4):1842\u20138. https:\/\/doi.org\/10.1109\/TLA.2016.7483524.","journal-title":"IEEE Lat Am Trans"},{"key":"87_CR112","doi-asserted-by":"publisher","first-page":"949","DOI":"10.4236\/am.2014.56090","volume":"5","author":"JI Da Silva Filho","year":"2014","unstructured":"Da Silva Filho JI. An introduction to paraconsistent differential calculus: with application examples. Appl Math. 2014;5:949\u201362. https:\/\/doi.org\/10.4236\/am.2014.56090.","journal-title":"Appl Math"},{"key":"87_CR113","unstructured":"Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. The MIT Press, Cambridge, MA (2017). http:\/\/www.deeplearningbook.org"},{"issue":"7","key":"87_CR114","doi-asserted-by":"publisher","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","volume":"18","author":"GE Hinton","year":"2006","unstructured":"Hinton GE, Osindero S, Teh Y-W. A fast learning algorithm for deep belief nets. Neural Comput. 2006;18(7):1527\u201354. https:\/\/doi.org\/10.1162\/neco.2006.18.7.1527.","journal-title":"Neural Comput"},{"issue":"1","key":"87_CR115","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2200000006","volume":"2","author":"Y Bengio","year":"2009","unstructured":"Bengio Y. Learning deep architectures for AI. Fund Trends Mach Learn. 2009;2(1):1\u2013127. https:\/\/doi.org\/10.1561\/2200000006.","journal-title":"Fund Trends Mach Learn"},{"key":"87_CR116","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","volume":"61","author":"J Schmidhuber","year":"2015","unstructured":"Schmidhuber J. Deep learning in neural networks: an overview. Neural Netw. 2015;61:85\u2013117. https:\/\/doi.org\/10.1016\/j.neunet.2014.09.003.","journal-title":"Neural Netw"},{"key":"87_CR117","doi-asserted-by":"publisher","unstructured":"Jarrett, k., Kavukcuoglu, k., Ranzato, M., Lecun, Y.: What is the best multi-stage architecture for object recognition? In: 12th International Conference on Computer Vision (ICCV), Kyoto, Japan, pp. 2146\u20132153. 2009; https:\/\/doi.org\/10.1109\/ICCV.2009.5459469","DOI":"10.1109\/ICCV.2009.5459469"},{"key":"87_CR118","unstructured":"Glorot, X., Borges, A., Bengio, Y.: Deep sparse rectifier neural networks. In: 14th International Conference on Artificial Intelligence and Statistics (AISTATS), Fort Lauderdale, FL., USA, pp. 315\u2013323, 2011; https:\/\/api.semanticscholar.org\/CorpusID:2239473"},{"key":"87_CR119","first-page":"139","volume":"27","author":"I Goodfellow","year":"2014","unstructured":"Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y. Generative adversarial networks. Adv Neural Inform Process Syst. 2014;27:139\u201344.","journal-title":"Adv Neural Inform Process Syst"},{"key":"87_CR120","doi-asserted-by":"publisher","first-page":"1629","DOI":"10.1007\/s00521-022-07785-2","volume":"35","author":"M Zhu","year":"2023","unstructured":"Zhu M, Chang B, Fu C. Convolutional neural networks combined with Runge-Kutta methods. Neural Comput Appl. 2023;35:1629\u201343. https:\/\/doi.org\/10.1007\/s00521-022-07785-2.","journal-title":"Neural Comput Appl"},{"key":"87_CR121","unstructured":"Lu, Y., Zhong, A., Li, Q., Dong, B.: Beyond finite layer neural networks: Bridging deep architectures and numerical differential equations. In: Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden, pp. 1\u201310; 2018"},{"key":"87_CR122","doi-asserted-by":"publisher","unstructured":"Su, W., Boyd, S., Candes, E.J.: A differential equation for modeling Nesterov\u2019s accelerated gradient method: Theory and insights. arXiv:1503.01243v2, 1\u201343 (2015) https:\/\/doi.org\/10.48550\/arXiv.1503.01243","DOI":"10.48550\/arXiv.1503.01243"},{"key":"87_CR123","doi-asserted-by":"publisher","unstructured":"Goswami, K., Sharma, A., Gupta, R.: Solving differential equations using neural network. In: Proceedings of the 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), Amity University, Noida, India, pp. 1\u20135, 2021; https:\/\/doi.org\/10.1109\/ICRITO51393.2021.9596495.","DOI":"10.1109\/ICRITO51393.2021.9596495."},{"key":"87_CR124","doi-asserted-by":"publisher","unstructured":"Parapari, H.F., Menhaj, M.B.: Solving nonlinear ordinary differential equations using neural networks. In: Proceedings of the 4th International Conference on Control, Instrumentation, and Automation (ICCIA), Qazvin Islamic Azad University, Qazvin, Iran, pp. 351\u2013355. 2016; https:\/\/doi.org\/10.1109\/ICCIAutom.2016.7483187","DOI":"10.1109\/ICCIAutom.2016.7483187"},{"key":"87_CR125","doi-asserted-by":"publisher","unstructured":"Deflorian, M.: On Runge-Kutta neural networks: Training in series-parallel and parallel configuration. In: Proceedings of the 49th IEEE Conference on Decision and Control, Hilton Atlanta Hotel, Atlanta, GA, USA, pp. 4480\u20134485, 2010; https:\/\/doi.org\/10.1109\/CDC.2010.5717492","DOI":"10.1109\/CDC.2010.5717492"},{"key":"87_CR126","doi-asserted-by":"publisher","first-page":"9428","DOI":"10.1109\/ACCESS.2017.2647920","volume":"4","author":"R Jafari","year":"2016","unstructured":"Jafari R, Yu W, Li X. Fuzzy differential equations for nonlinear system modeling with Bernstein neural networks. IEEE Access. 2016;4:9428\u201336.","journal-title":"IEEE Access"},{"key":"87_CR127","doi-asserted-by":"publisher","first-page":"32271","DOI":"10.1109\/ACCESS.2022.3160186","volume":"10","author":"A Sacchetti","year":"2022","unstructured":"Sacchetti A, Bachmann B, Laffel K, Kanzi U-M, Paoli B. Neural networks to solve partial differential equations: a comparison with finite elements. IEEE Access. 2022;10:32271\u20139.","journal-title":"IEEE Access"},{"issue":"4","key":"87_CR128","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1109\/TNNLS.2014.2323218","volume":"26","author":"JC Chedjou","year":"2015","unstructured":"Chedjou JC, Kyamakya K. A universal concept based on cellular neural networks for ultrafast and flexible solving of differential equations. IEEE Trans Neural Netw Learn Syst. 2015;26(4):749\u201362. https:\/\/doi.org\/10.1109\/TNNLS.2014.2323218.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"87_CR129","doi-asserted-by":"publisher","unstructured":"Habiba, M., Pearlmutter, B.A.: Continuous convolutional neural networks: Coupled neural PDE and ODE. In: Proceedings of the International Conference on Electrical, Computer and Energy Technologies (ICECET), Cape Town, South Africa, pp. 1\u20134, 2021; https:\/\/doi.org\/10.1109\/ICECET52533.2021.9698766","DOI":"10.1109\/ICECET52533.2021.9698766"},{"issue":"9","key":"87_CR130","doi-asserted-by":"publisher","first-page":"1356","DOI":"10.1109\/TNNLS.2012.2202126","volume":"23","author":"S Mehrkanoon","year":"2012","unstructured":"Mehrkanoon S, Falck T, Suykens JAK. Approximate solutions to ordinary differential equations using least squares support vector machines. IEEE Trans Neural Netw Learn Syst. 2012;23(9):1356\u201367. https:\/\/doi.org\/10.1109\/TNNLS.2012.2202126.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"87_CR131","doi-asserted-by":"publisher","first-page":"1897","DOI":"10.1109\/LCSYS.2021.3135835","volume":"6","author":"EM Turan","year":"2022","unstructured":"Turan EM, Jaschke J. Multiple shooting for training neural differential equations on time series. IEEE Control Syst Lett. 2022;6:1897\u2013902.","journal-title":"IEEE Control Syst Lett"},{"key":"87_CR132","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/j.cam.2018.04.031","volume":"343","author":"C You","year":"2018","unstructured":"You C, Hao Y. Fuzzy Euler approximation and its local convergence. J Comput Appl Math. 2018;343:55\u201361. https:\/\/doi.org\/10.1016\/j.cam.2018.04.031.","journal-title":"J Comput Appl Math"},{"issue":"6","key":"87_CR133","first-page":"651","volume":"40","author":"MZ Ahmad","year":"2011","unstructured":"Ahmad MZ, Hasan MK. A new fuzzy version of Euler\u2019s method for solving differential equations with fuzzy initial values. Sains Malays. 2011;40(6):651\u20137.","journal-title":"Sains Malays"},{"issue":"4","key":"87_CR134","doi-asserted-by":"publisher","first-page":"2156","DOI":"10.1109\/TNNLS.2021.3106044","volume":"34","author":"M Liu","year":"2023","unstructured":"Liu M, Chen L, Du X, Jin L, Shang M. Activated gradients for deep neural networks. IEEE Tranrs Neural Netw Learn Syst. 2023;34(4):2156\u201368. https:\/\/doi.org\/10.1109\/TNNLS.2021.3106044.","journal-title":"IEEE Tranrs Neural Netw Learn Syst"},{"issue":"4","key":"87_CR135","doi-asserted-by":"publisher","first-page":"1808","DOI":"10.1109\/TNNLS.2020.3006738","volume":"34","author":"L Bai","year":"2023","unstructured":"Bai L, Cui L, Zhang Z, Xu L, Wang Y, Hancock ER. Entropic dynamic time warping kernels for co-evolving financial time series analysis. IEEE Trans Neural Netw Learn Syst. 2023;34(4):1808\u201322.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"6","key":"87_CR136","doi-asserted-by":"publisher","first-page":"2732","DOI":"10.1109\/TNNLS.2021.3107600","volume":"34","author":"Y-J Liu","year":"2023","unstructured":"Liu Y-J, Zhao W, Liu L, Li D, Tong S, Chen CLP. Adaptive neural network control for a class of nonlinear systems with function constraints on states. IEEE Trans Neural Netw Learn Syst. 2023;34(6):2732\u201341. https:\/\/doi.org\/10.1109\/TNNLS.2021.3107600.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"3","key":"87_CR137","doi-asserted-by":"publisher","first-page":"1098","DOI":"10.1109\/TNNLS.2021.3105519","volume":"34","author":"P Liu","year":"2023","unstructured":"Liu P, Wang J, Zeng Z. An overview of the stability analysis of recurrent neural networks with multiple equilibria. IEEE Trans Neural Netw Learn Syst. 2023;34(3):1098\u2013111. https:\/\/doi.org\/10.1109\/TNNLS.2021.3105519.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"10","key":"87_CR138","doi-asserted-by":"publisher","first-page":"7992","DOI":"10.1109\/TNNLS.2022.3148542","volume":"34","author":"X Chen","year":"2023","unstructured":"Chen X, Tao Y, Xu W, Yau SST. Recurrent neural networks are universal approximators with stochastic inputs. IEEE Trans Neural Netw Learn Syst. 2023;34(10):7992\u20138006. https:\/\/doi.org\/10.1109\/TNNLS.2022.3148542.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"87_CR139","unstructured":"Roger\u00a0Jang J-S. Fuzzy modeling using generalized neural networks and kalman filter. In: Proceedings of the Ninth National Conference on Artificial Intelligence (AAAI-91), Anaheim Convention Center, California, pp. 1991;762\u2013767 . https:\/\/api.semanticscholar.org\/CorpusID:40363876"},{"issue":"103125","key":"87_CR140","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1063\/5.0009326","volume":"30","author":"S Mukhopadhyay","year":"2020","unstructured":"Mukhopadhyay S, Banerjee S. Learning dynamical systems in noise using convolutional neural networks. Chaos. 2020;30(103125):1\u201331. https:\/\/doi.org\/10.1063\/5.0009326.","journal-title":"Chaos"},{"key":"87_CR141","doi-asserted-by":"publisher","first-page":"5455","DOI":"10.1007\/s10462-020-09825-6","volume":"53","author":"A Khan","year":"2020","unstructured":"Khan A, Sohail A, Zahoora U, Qureshi AS. A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev. 2020;53:5455\u2013516. https:\/\/doi.org\/10.1007\/s10462-020-09825-6.","journal-title":"Artif Intell Rev"},{"key":"87_CR142","doi-asserted-by":"publisher","first-page":"155417","DOI":"10.1109\/ACCESS.2020.3019336","volume":"8","author":"H Chen","year":"2020","unstructured":"Chen H, Deng Z. Bibliometric analysis of the application of convolutional neural network in computer vision. IEEE Access. 2020;8:155417\u201328. https:\/\/doi.org\/10.1109\/ACCESS.2020.3019336.","journal-title":"IEEE Access"},{"key":"87_CR143","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/s23218956","volume":"23","author":"C Spandonidis","year":"2023","unstructured":"Spandonidis C, Paraskevopoulos D. Evaluation of a deep learning-based index for prognosis of a Vessel\u2019s propeller-hull degradation. Sensors. 2023;23:1\u201317. https:\/\/doi.org\/10.3390\/s23218956.","journal-title":"Sensors"},{"key":"87_CR144","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/app14219814","volume":"14","author":"E Kot","year":"2024","unstructured":"Kot E, Les T, Krawczyk-Borysiak Z, Vykhodtsev A, Siwek K. Semantic segmentation of the prostate based on onefold and joint multimodal medical images using YOLOv4 and u-net. Appl Sci. 2024;14:1\u201312. https:\/\/doi.org\/10.3390\/app14219814.","journal-title":"Appl Sci"},{"key":"87_CR145","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/app14209390","volume":"14","author":"E Huan","year":"2024","unstructured":"Huan E, Dun H. MSMP-net: a multi-scale neural network for end-to-end monkeypox virus skin lesion classification. Appl Sci. 2024;14:1\u201313. https:\/\/doi.org\/10.3390\/app14209390.","journal-title":"Appl Sci"},{"key":"87_CR146","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3346188","author":"MH Mateen","year":"2023","unstructured":"Mateen MH, Alsuraiheed T, Hmissi M. A new algebraic structure of complex pythagorean fuzzy subfield. IEEE Access. 2023. https:\/\/doi.org\/10.1109\/ACCESS.2023.3346188.","journal-title":"IEEE Access"},{"key":"87_CR147","doi-asserted-by":"publisher","first-page":"88778","DOI":"10.1109\/ACCESS.2023.3306028","volume":"11","author":"SM Qurashi","year":"2023","unstructured":"Qurashi SM, Almutairi B, Kanwal RS, Krsti\u0107 MMY. Rough substructures based on overlaps of successor in quantales under serial fuzzy relations. IEEE Access. 2023;11:88778\u201394. https:\/\/doi.org\/10.1109\/ACCESS.2023.3306028.","journal-title":"IEEE Access"},{"key":"87_CR148","doi-asserted-by":"publisher","first-page":"77514","DOI":"10.1109\/ACCESS.2024.3406388","volume":"12","author":"J Ahmmad","year":"2024","unstructured":"Ahmmad J, Labassi F, Alsuraiheed T, Mahmood T, Khan MA. Classification of feature engineering techniques for machine learning under the environment of lattice ordered t-bipolar fuzzy soft rings. IEEE Access. 2024;12:77514\u201322. https:\/\/doi.org\/10.1109\/ACCESS.2024.3406388.","journal-title":"IEEE Access"},{"key":"87_CR149","doi-asserted-by":"publisher","first-page":"96672","DOI":"10.1109\/ACCESS.2024.3425056","volume":"12","author":"F Xiong","year":"2024","unstructured":"Xiong F, Siddique N, Ali Z, Yin S. Conditional aggregation operator defined by the power information concerning type-2 fuzzy deep learning algorithm for financial investment data decision-making. IEEE Access. 2024;12:96672\u201390. https:\/\/doi.org\/10.1109\/ACCESS.2024.3425056.","journal-title":"IEEE Access"},{"issue":"3","key":"87_CR150","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1109\/TNNLS.2019.2910417","volume":"31","author":"GC Calafiore","year":"2020","unstructured":"Calafiore GC, Gaubert S, Possieri C. Log-sum-exp neural networks and posynomial models for convex and log-log-convex data. IEEE Trans Neural Netw Learn Syst. 2020;31(3):827\u201338. https:\/\/doi.org\/10.1109\/TNNLS.2019.2910417.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"12","key":"87_CR151","doi-asserted-by":"publisher","first-page":"5603","DOI":"10.1109\/TNNLS.2020.2975051","volume":"31","author":"GC Calafiore","year":"2020","unstructured":"Calafiore GC, Gaubert S, Possieri C. A universal approximation result for difference of log-sum-exp neural networks. IEEE Trans Neural Netw Learn Syst. 2020;31(12):5603\u201312. https:\/\/doi.org\/10.1109\/TNNLS.2020.2975051.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"2","key":"87_CR152","doi-asserted-by":"publisher","first-page":"2448","DOI":"10.1109\/TNNLS.2022.3190198","volume":"35","author":"J Kim","year":"2024","unstructured":"Kim J, Kim Y. Parameterized convex universal approximators for decision-making pproblems. IEEE Trans Neural Netwo Learn Syst. 2024;35(2):2448\u201359. https:\/\/doi.org\/10.1109\/TNNLS.2022.3190198.","journal-title":"IEEE Trans Neural Netwo Learn Syst"},{"key":"87_CR153","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2024.3378697","author":"J Wang","year":"2024","unstructured":"Wang J, Wu S, Zhang H, Yuan B, Dai C, Pal NR. Universal approximation abilities of a modular differentiable neural network. IEEE Trans Neural Netw Learn Syst. 2024. https:\/\/doi.org\/10.1109\/TNNLS.2024.3378697.","journal-title":"IEEE Trans Neural Netw Learn Syst"}],"container-title":["Human-Centric Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44230-024-00087-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44230-024-00087-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44230-024-00087-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,8]],"date-time":"2025-01-08T15:15:22Z","timestamp":1736349322000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44230-024-00087-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,27]]},"references-count":153,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["87"],"URL":"https:\/\/doi.org\/10.1007\/s44230-024-00087-x","relation":{},"ISSN":["2667-1336"],"issn-type":[{"type":"electronic","value":"2667-1336"}],"subject":[],"published":{"date-parts":[[2024,11,27]]},"assertion":[{"value":"19 June 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 November 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 November 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that no financial interests or social relationships directly affect the work reported in this article. The authors also declare no Conflict of interest regarding the submitted article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The authors declare that they followed all the rules of good scientific practice. An approval Committee for our article is not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"All authors approve of their participation in this work.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"The authors approve the publication of this research.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}},{"value":"This article contains no studies performed by authors with human participants or animals.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Human and Animal Ethics"}}]}}