{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T23:47:32Z","timestamp":1790812052736,"version":"4.1.0"},"reference-count":48,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"2","funder":[{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014036","name":"Multidisciplinary University Research Initiative","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100014036","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Appl. Dyn. Syst."],"published-print":{"date-parts":[[2020,1]]},"abstract":"<jats:p>A systematic mathematical framework for the study of numerical algorithms would allow comparisons, facilitate conjugacy arguments, and enable the discovery of improved, accelerated, data-driven algorithms. Over the course of the past century, the Koopman operator has provided a mathematical framework for the study of dynamical systems which facilitates conjugacy arguments and can provide efficient reduced descriptions. More recently, numerical approximations of the operator have enabled the analysis of a large number of deterministic and stochastic dynamical systems in a completely data-driven, essentially equation-free pipeline. Discrete- or continuous-time numerical algorithms (integrators, nonlinear equation solvers, optimization algorithms are themselves dynamical systems. In this paper, we use this insight to leverage the Koopman operator framework in the data-driven study of such algorithms and discuss benefits for analysis and acceleration of numerical computation. For algorithms acting on high-dimensional spaces by quickly contracting them toward low-dimensional manifolds, we demonstrate how basis functions adapted to the data help to construct efficient reduced representations of the operator. Our illustrative examples include the gradient descent and Nesterov optimization algorithms as well as the Newton--Raphson algorithm.<\/jats:p>","DOI":"10.1137\/19m1277059","type":"journal-article","created":{"date-parts":[[2020,4,21]],"date-time":"2020-04-21T11:44:08Z","timestamp":1587469448000},"page":"860-885","source":"Crossref","is-referenced-by-count":23,"title":["On the Koopman Operator of Algorithms"],"prefix":"10.1137","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2906-1769","authenticated-orcid":true,"given":"Felix","family":"Dietrich","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas N.","family":"Thiem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ioannis G.","family":"Kevrekidis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2020,4,21]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1137\/14097940X"},{"key":"atypb2","first-page":"668","author":"Bhaya A.","year":"2009","journal-title":"Berlin"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1137\/17M116207X"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1016\/0024-3795(91)90021-N"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1517384113"},{"key":"atypb6","doi-asserted-by":"crossref","unstructured":"M. Budisic and I. Mezic,\n                      An approximate parametrization of the ergodic partition using time averaged observables\n                      , in Proceedings of the 48th IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference, IEEE, New York, 2009,https:\/\/doi.org\/10.1109\/cdc.2009.5400512.","DOI":"10.1109\/CDC.2009.5400512"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1063\/1.4772195"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1017\/S0962492906340019"},{"key":"atypb9","doi-asserted-by":"crossref","unstructured":"N. \u010crnjari\u0107-\u017dic, S. Ma\u0107e\u0161i\u0107, and I. Mezi\u0107,\n                      Koopman operator spectrum for random dynamical systems\n                      , J. Nonlinear Sci. (2019),https:\/\/doi.org\/10.1007\/s00332-019-09582-z.","DOI":"10.1007\/s00332-019-09582-z"},{"key":"atypb10","first-page":"85","author":"Duchon J.","year":"1977","journal-title":"Berlin"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpc.2015.08.028"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6544\/aaca8d"},{"key":"atypb13","doi-asserted-by":"crossref","unstructured":"K.J. Engel and R. Nagel,\n                      A Short Course on Operator Semigroups\n                      , Springer, New York, 2006,https:\/\/doi.org\/10.1007\/0-387-36619-9.","DOI":"10.1007\/0-387-36619-9"},{"key":"atypb14","doi-asserted-by":"crossref","unstructured":"D. Giannakis,\n                      Data-driven spectral decomposition and forecasting of ergodic dynamical systems\n                      , Appl. Comput. Harmon. Anal. (2017),https:\/\/doi.org\/10.1016\/j.acha.2017.09.001.","DOI":"10.1016\/j.acha.2017.09.001"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1134\/S0012266116070090"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1137\/100817851"},{"key":"atypb17","doi-asserted-by":"crossref","unstructured":"K. He, X. Zhang, S. Ren, and J. Sun,\n                      Deep residual learning for image recognition\n                      , in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, New York, 2016,https:\/\/doi.org\/10.1109\/cvpr.2016.90.","DOI":"10.1109\/CVPR.2016.90"},{"key":"atypb18","unstructured":"D. Himmelblau,\n                      Applied Nonlinear Programming\n                      , McGraw-Hill, New York, 1972."},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1007\/s00332-017-9437-7"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.17.5.315"},{"key":"atypb21","doi-asserted-by":"crossref","unstructured":"M. Korda, M. Putinar, and I. Mezi\u0107,\n                      Data-driven spectral analysis of the Koopman operator\n                      , Appl. Comput. Harmon. Anal. (2018),https:\/\/doi.org\/10.1016\/j.acha.2018.08.002.","DOI":"10.1016\/j.acha.2018.08.002"},{"key":"atypb22","doi-asserted-by":"crossref","unstructured":"A. Lasota and M. C. Mackey,\n                      Chaos, Fractals, and Noise\n                      , Springer New York, 1994,https:\/\/doi.org\/10.1007\/978-1-4612-4286-4.","DOI":"10.1007\/978-1-4612-4286-4"},{"key":"atypb23","doi-asserted-by":"crossref","unstructured":"B. Leimkuhler, C. Chipot, R. Elber, A. Laaksonen, A. Mark, T. Schlick, C. Sch\u00fctte, and R. Skeel, eds.\n                      New Algorithms for Macromolecular Simulation\n                      , Springer, Berlin, 2005,https:\/\/www.ebook.de\/de\/product\/3996213\/new_algorithms_for_macromolecular_simulation.html.","DOI":"10.1007\/3-540-31618-3"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1063\/1.4993854"},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1016\/j.cam.2015.12.032"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2019.2941433"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1016\/j.physd.2013.06.004"},{"key":"atypb28","doi-asserted-by":"crossref","unstructured":"R. M. Mazo,\n                      Brownian Motion\n                      , Oxford University Press, Oxford, 2008,https:\/\/doi.org\/10.1093\/acprof:oso\/9780199556441.001.0001.","DOI":"10.1093\/acprof:oso\/9780199556441.001.0001"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1007\/s11071-005-2824-x"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-fluid-011212-140652"},{"key":"atypb31","unstructured":"I. Mezic,\n                      Koopman Operator Spectrum and Data Analysis\n                      , preprint, arXiv,https:\/\/arxiv.org\/abs\/1702.07597v1, 2017."},{"key":"atypb32","unstructured":"S. N. Miller,\n                      The Dynamics of Newton's Method on Cubic Polynomials\n                      , Master's thesis, Marshall University, Huntington, WV, 2006."},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1016\/j.cam.2018.04.013"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1002\/mana.3210040124"},{"key":"atypb35","doi-asserted-by":"crossref","unstructured":"N. Noroozi, P. Karimaghaee, A. A. Safavi, and A. Bhaya,\n                      Real-time robust and adaptive solutions to zero finding problems with uncertainty\n                      , in Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference, IEEE, New York, 2009,https:\/\/doi.org\/10.1109\/cdc.2009.5400043.","DOI":"10.1109\/CDC.2009.5400043"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2012.05.007"},{"key":"atypb37","first-page":"409","author":"Rico-Mart\u00ednez R.","year":"1995","journal-title":"Amsterdam"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1080\/00986449208936084"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2017.08.2278"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1017\/S0022112010001217"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.3934\/jcd.2016007"},{"key":"atypb42","unstructured":"A. M. Stuart and A. R. Humphries,\n                      Dynamical Systems and Numerical Analysis\n                      , Cambridge University Press, Cambridge, 1996."},{"key":"atypb43","unstructured":"W. Su, S. Boyd, and E. Cand\u00e8s,\n                      A differential equation for modeling Nesterov's accelerated gradient method: Theory and insights\n                      , in Advances in Neural Information Processing Systems 27, Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, eds., Curran Associates, Red Hook, NY, 2014, pp. 2510-2518."},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1002\/nla.754"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.2307\/1968537"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1007\/s00332-015-9258-5"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.3934\/jcd.2015005"},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1209\/0295-5075\/109\/40007"}],"container-title":["SIAM Journal on Applied Dynamical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/19M1277059","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T14:54:06Z","timestamp":1787237646000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/19M1277059"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,1]]}},"alternative-id":["10.1137\/19M1277059"],"URL":"https:\/\/doi.org\/10.1137\/19m1277059","relation":{},"ISSN":["1536-0040"],"issn-type":[{"value":"1536-0040","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1]]}}}