{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T20:49:52Z","timestamp":1775249392375,"version":"3.50.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T00:00:00Z","timestamp":1716940800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T00:00:00Z","timestamp":1716940800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["P2-0103, J1-3033, J2-2505, J2-4452, J2-4460, J3-3070, J4-3095, J5-4575, J7-4636, J7-4637, and N2-0236."],"award-info":[{"award-number":["P2-0103, J1-3033, J2-2505, J2-4452, J2-4460, J3-3070, J4-3095, J5-4575, J7-4636, J7-4637, and N2-0236."]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Union","doi-asserted-by":"crossref","award":["101059682 (ASSAS), 101120237 (ELIAS), 101057499 (INQUIRE), 101057014 (PARC), 952215 (TAILOR)"],"award-info":[{"award-number":["101059682 (ASSAS), 101120237 (ELIAS), 101057499 (INQUIRE), 101057014 (PARC), 952215 (TAILOR)"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Ordinary differential equations (ODEs) are a widely used formalism for the mathematical modeling of dynamical systems, a task omnipresent in scientific domains. The paper introduces a novel method for inferring ODEs from data, which extends ProGED, a method for equation discovery that allows users to formalize domain-specific knowledge as probabilistic context-free grammars and use it for constraining the space of candidate equations. The extended method can discover ODEs from partial observations of dynamical systems, where only a subset of state variables can be observed. To evaluate the performance of the newly proposed method, we perform a systematic empirical comparison with alternative state-of-the-art methods for equation discovery and system identification from complete and partial observations. The comparison uses Dynobench, a set of ten dynamical systems that extends the standard Strogatz benchmark. We compare the ability of the considered methods to reconstruct the known ODEs from synthetic data simulated at different temporal resolutions. We also consider data with different levels of noise, i.e., signal-to-noise ratios. The improved ProGED compares favourably to state-of-the-art methods for inferring ODEs from data regarding reconstruction abilities and robustness to data coarseness, noise, and completeness.<\/jats:p>","DOI":"10.1007\/s10994-024-06522-1","type":"journal-article","created":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T16:15:41Z","timestamp":1716999341000},"page":"7689-7721","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Probabilistic grammars for modeling dynamical systems from coarse, noisy, and partial data"],"prefix":"10.1007","volume":"113","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1212-1566","authenticated-orcid":false,"given":"Nina","family":"Omejc","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2664-8779","authenticated-orcid":false,"given":"Bo\u0161tjan","family":"Gec","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1065-9912","authenticated-orcid":false,"given":"Jure","family":"Brence","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0037-9260","authenticated-orcid":false,"given":"Ljup\u010do","family":"Todorovski","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2363-712X","authenticated-orcid":false,"given":"Sa\u0161o","family":"D\u017eeroski","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,29]]},"reference":[{"key":"6522_CR1","doi-asserted-by":"publisher","first-page":"89497","DOI":"10.1109\/ACCESS.2020.2990567","volume":"8","author":"J Blank","year":"2020","unstructured":"Blank, J., & Deb, K. (2020). pymoo: Multi-objective optimization in python. IEEE Access, 8, 89497\u201389509.","journal-title":"IEEE Access"},{"key":"6522_CR2","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1016\/j.ins.2023.03.073","volume":"632","author":"J Brence","year":"2023","unstructured":"Brence, J., D\u017eeroski, S., & Todorovski, L. (2023). Dimensionally-consistent equation discovery through probabilistic attribute grammars. Information Sciences, 632, 742\u2013756.","journal-title":"Information Sciences"},{"key":"6522_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.107077","volume":"224","author":"J Brence","year":"2021","unstructured":"Brence, J., Todorovski, L., & D\u017eeroski, S. (2021). Probabilistic grammars for equation discovery. Knowledge-Based Systems, 224, 107077.","journal-title":"Knowledge-Based Systems"},{"issue":"15","key":"6522_CR4","doi-asserted-by":"publisher","first-page":"3932","DOI":"10.1073\/pnas.1517384113","volume":"113","author":"SL Brunton","year":"2016","unstructured":"Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016). Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the national academy of sciences, 113(15), 3932\u20133937.","journal-title":"Proceedings of the national academy of sciences"},{"key":"6522_CR5","unstructured":"\u010cerepnalkoski, D. (2013) Process-based models of dynamical systems: Representation and induction. Ph.D. thesis, Jo\u017eef Stefan International Postgraduate School, Ljubljana, Slovenia."},{"issue":"49","key":"6522_CR24","doi-asserted-by":"publisher","first-page":"2104","DOI":"10.21105\/joss.02104","volume":"5","author":"BM de Silva","year":"2020","unstructured":"de Silva, B. M., Champion, K., Quade, M., Loiseau, J. C., Kutz, J. N., & Brunton, S. L. (2020). Pysindy: A python package for the sparse identification of nonlinear dynamical systems from data. Journal of Open Source Software, 5(49), 2104. https:\/\/doi.org\/10.21105\/joss.02104","journal-title":"Journal of Open Source Software"},{"key":"6522_CR6","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar, J. (2006). Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research, 7, 1\u201330.","journal-title":"The Journal of Machine Learning Research"},{"key":"6522_CR30","doi-asserted-by":"crossref","unstructured":"D\u017eeroski, S., & Todorovski, L. (1993). Discovering dynamics. In Proc. Tenth International Conference on Machine Learning (pp. 97\u2013103). San Mateo, CA: Morgan Kaufmann.","DOI":"10.1016\/B978-1-55860-307-3.50019-8"},{"issue":"1","key":"6522_CR7","doi-asserted-by":"publisher","first-page":"1043","DOI":"10.1038\/s41467-023-36657-z","volume":"14","author":"O Fajardo-Fontiveros","year":"2023","unstructured":"Fajardo-Fontiveros, O., Reichardt, I., De Los R\u00edos, H. R., Duch, J., Sales-Pardo, M., & Guimer\u00e0, R. (2023). Fundamental limits to learning closed-form mathematical models from data. Nature Communications, 14(1), 1043.","journal-title":"Nature Communications"},{"key":"6522_CR8","unstructured":"Hindmarsh, A.C. (1983) Odepack, a systemized collection of ode solvers. Scientific Computing."},{"issue":"3","key":"6522_CR9","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1145\/1089014.1089020","volume":"31","author":"AC Hindmarsh","year":"2005","unstructured":"Hindmarsh, A. C., Brown, P. N., Grant, K. E., Lee, S. L., Serban, R., Shumaker, D. E., & Woodward, C. S. (2005). SUNDIALS: Suite of nonlinear and differential\/algebraic equation solvers. ACM Transactions on Mathematical Software (TOMS), 31(3), 363\u2013396.","journal-title":"ACM Transactions on Mathematical Software (TOMS)"},{"issue":"4","key":"6522_CR10","doi-asserted-by":"publisher","first-page":"917","DOI":"10.1007\/s10618-019-00619-1","volume":"33","author":"HI Fawaz","year":"2019","unstructured":"Fawaz, H. I., Forestier, G., Weber, J., Idoumghar, L., & Muller, P. A. (2019). Deep learning for time series classification: A review. Data Mining and Knowledge Discovery, 33(4), 917\u2013963.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"6522_CR11","unstructured":"Kamienny, P.A., d\u2019Ascoli, S., Lample, G., Charton, F. (2022). End-to-end symbolic regression with transformers."},{"key":"6522_CR12","unstructured":"Kuznetsov, Y.A., Kuznetsov, I.A., Kuznetsov, Y. (1998). Elements of applied bifurcation theory, Vol. 112. Springer."},{"key":"6522_CR13","unstructured":"La\u00a0Cava, W., Orzechowski, P., Burlacu, B., de\u00a0Fran\u00e7a, F.O., Virgolin, M., Jin, Y., Kommenda, M., Moore, J.H. (2021). Contemporary symbolic regression methods and their relative performance. arXiv preprint arXiv:2107.14351"},{"key":"6522_CR14","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.86.046205","volume":"86","author":"S Mangiarotti","year":"2012","unstructured":"Mangiarotti, S., Coudret, R., Drapeau, L., & Jarlan, L. (2012). Polynomial search and global modeling: Two algorithms for modeling chaos. Physical Review E, 86, 046205.","journal-title":"Physical Review E"},{"key":"6522_CR15","doi-asserted-by":"crossref","unstructured":"Mangiarotti, S., Huc, M. (2019). Can the original equations of a dynamical system be retrieved from observational time series? Chaos: An Interdisciplinary Journal of Nonlinear Science 29(2).","DOI":"10.1063\/1.5081448"},{"key":"6522_CR16","doi-asserted-by":"publisher","first-page":"4563","DOI":"10.1007\/s10994-023-06400-2","volume":"112","author":"S Me\u017enar","year":"2023","unstructured":"Me\u017enar, S., D\u017eeroski, S., & Todorovski, L. (2023). Efficient generator of mathematical expressions for symbolic regression. Machine Learing, 112, 4563\u20134596. https:\/\/doi.org\/10.1007\/s10994-023-06400-2","journal-title":"Machine Learing"},{"key":"6522_CR17","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.103","volume":"3","author":"A Meurer","year":"2017","unstructured":"Meurer, A., Smith, C. P., Paprocki, M., \u010cert\u00edk, O., Kirpichev, S. B., Rocklin, M., Kumar, A., Ivanov, S., Moore, J. K., Singh, S., Rathnayake, T., Vig, S., Granger, B. E., Muller, R. P., Bonazzi, F., Gupta, H., Vats, S., Johansson, F., & Pedregosa, F. (2017). Sympy: Symbolic computing in python. PeerJ Computer Science, 3, e103. https:\/\/doi.org\/10.7717\/peerj-cs.103","journal-title":"PeerJ Computer Science"},{"issue":"1","key":"6522_CR18","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1146\/annurev.mi.03.100149.002103","volume":"3","author":"J Monod","year":"1949","unstructured":"Monod, J. (1949). The growth of bacterial cultures. Annual Review of Microbiology, 3(1), 371\u2013394.","journal-title":"Annual Review of Microbiology"},{"key":"6522_CR19","unstructured":"Mundhenk, T., Landajuela, M., Glatt, R., Santiago, C.P., faissol, D., Petersen, B.K. (2021). Symbolic regression via deep reinforcement learning enhanced genetic programming seeding. In: M.\u00a0Ranzato, A.\u00a0Beygelzimer, Y.\u00a0Dauphin, P.\u00a0Liang, J.W. Vaughan (eds.) Advances in Neural Information Processing Systems, vol.\u00a034, pp. 24912\u201324923. Curran Associates, Inc."},{"key":"6522_CR20","unstructured":"Petersen, B.K., Larma, M.L., Mundhenk, T.N., Santiago, C.P., Kim, S.K., Kim, J.T. (2019) Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradients. arXiv preprint arXiv:1912.04871"},{"key":"6522_CR21","volume-title":"Differential Evolution: A Practical Approach to Global Optimization","author":"K Price","year":"2006","unstructured":"Price, K., Storn, R. M., & Lampinen, J. A. (2006). Differential Evolution: A Practical Approach to Global Optimization. NY: Springer Science & Business Media."},{"key":"6522_CR22","doi-asserted-by":"publisher","first-page":"1131","DOI":"10.1090\/S0025-5718-01-01307-2","volume":"70","author":"AG Ramm","year":"2001","unstructured":"Ramm, A. G., & Smirnova, A. B. (2001). On stable numerical differentiation. Mathematics of Computation, 70, 1131\u20131153.","journal-title":"Mathematics of Computation"},{"key":"6522_CR23","doi-asserted-by":"crossref","unstructured":"Romano, J.D., Le, T.T., La\u00a0Cava, W., Gregg, J.T., Goldberg, D.J., Chakraborty, P., Ray, N.L., Himmelstein, D., Fu, W., Moore, J.H. (2021). Pmlb v1.0: An open source dataset collection for benchmarking machine learning methods. arXiv preprint arXiv:2012.00058v2 (2021)","DOI":"10.1093\/bioinformatics\/btab727"},{"key":"6522_CR25","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.105.054209","volume":"105","author":"A Somacal","year":"2022","unstructured":"Somacal, A., Barrera, Y., Boechi, L., Jonckheere, M., Lefieux, V., Picard, D., & Smucler, E. (2022). Uncovering differential equations from data with hidden variables. Physical Review E, 105, 054209.","journal-title":"Physical Review E"},{"key":"6522_CR26","doi-asserted-by":"publisher","first-page":"2685","DOI":"10.1140\/epjst\/e2014-02286-7","volume":"223","author":"T Stankovski","year":"2014","unstructured":"Stankovski, T., Duggento, A., McClintock, P. V., & Stefanovska, A. (2014). A tutorial on time-evolving dynamical Bayesian inference. European Physical Journal: Special Topics, 223, 2685\u20132703. https:\/\/doi.org\/10.1140\/epjst\/e2014-02286-7","journal-title":"European Physical Journal: Special Topics"},{"key":"6522_CR27","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1007\/978-3-540-73920-3_2","volume-title":"Computational Discovery of Scientific Knowledge: Introduction, Techniques, and Applications in Environmental and Life Sciences","author":"R Stolle","year":"2007","unstructured":"Stolle, R., & Bradley, E. (2007). Communicable knowledge in automated system identification. In S. D\u017eeroski & L. Todorovski (Eds.), Computational Discovery of Scientific Knowledge: Introduction, Techniques, and Applications in Environmental and Life Sciences (pp. 17\u201343). Berlin Heidelberg, Berlin, Heidelberg: Springer."},{"issue":"4","key":"6522_CR28","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1023\/A:1008202821328","volume":"11","author":"R Storn","year":"1997","unstructured":"Storn, R., & Price, K. (1997). Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11(4), 341\u2013359.","journal-title":"Journal of Global Optimization"},{"key":"6522_CR29","doi-asserted-by":"publisher","DOI":"10.1201\/9780429492563","volume-title":"Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering","author":"SH Strogatz","year":"2018","unstructured":"Strogatz, S. H. (2018). Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering. Florida: CRC Press."},{"key":"6522_CR31","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","volume":"17","author":"P Virtanen","year":"2020","unstructured":"Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., van der Walt, S. J., Brett, M., Wilson, J., Millman, K. J., Mayorov, N., Nelson, A. R. J., Jones, E., Kern, R., Larson, E., \u2026 van Mulbregt, P. (2020). SciPy 1.0 contributors: SciPy 1.0: Fundamental algorithms for scientific computing in python. Nature Methods, 17, 261\u2013272. https:\/\/doi.org\/10.1038\/s41592-019-0686-2","journal-title":"Nature Methods"},{"key":"6522_CR32","doi-asserted-by":"publisher","first-page":"1404","DOI":"10.1109\/ACCESS.2018.2886528","volume":"7","author":"P Zheng","year":"2018","unstructured":"Zheng, P., Askham, T., Brunton, S. L., Kutz, J. N., & Aravkin, A. Y. (2018). A unified framework for sparse relaxed regularized regression: SR3. IEEE Access, 7, 1404\u20131423.","journal-title":"IEEE Access"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06522-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-024-06522-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06522-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T17:06:26Z","timestamp":1729184786000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-024-06522-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,29]]},"references-count":32,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["6522"],"URL":"https:\/\/doi.org\/10.1007\/s10994-024-06522-1","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2678362\/v1","asserted-by":"object"}]},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,29]]},"assertion":[{"value":"13 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 October 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 May 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participation"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}