{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T15:27:34Z","timestamp":1781969254177,"version":"3.54.5"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1012198","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T00:00:00Z","timestamp":1737936000000}}],"reference-count":37,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2025,1,23]],"date-time":"2025-01-23T00:00:00Z","timestamp":1737590400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Eindhoven AI Systems Institute"},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["645.001.003"],"award-info":[{"award-number":["645.001.003"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Systems biology tackles the challenge of understanding the high complexity in the internal regulation of homeostasis in the human body through mathematical modelling. These models can aid in the discovery of disease mechanisms and potential drug targets. However, on one hand the development and validation of knowledge-based mechanistic models is time-consuming and does not scale well with increasing features in medical data. On the other hand, data-driven approaches such as machine learning models require large volumes of data to produce generalisable models. The integration of neural networks and mechanistic models, forming universal differential equation (UDE) models, enables the automated learning of unknown model terms with less data than neural networks alone. Nevertheless, estimating parameters for these hybrid models remains difficult with sparse data and limited sampling durations that are common in biological applications. In this work, we propose the use of physiology-informed regularisation, penalising biologically implausible model behavior to guide the UDE towards more physiologically plausible regions of the solution space. In a simulation study we show that physiology-informed regularisation not only results in a more accurate forecasting of model behaviour, but also supports training with less data. We also applied this technique to learn a representation of the rate of glucose appearance in the glucose minimal model using meal response data measured in healthy people. In that case, the inclusion of regularisation reduces variability between UDE-embedded neural networks that were trained from different initial parameter guesses.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012198","type":"journal-article","created":{"date-parts":[[2025,1,23]],"date-time":"2025-01-23T18:35:56Z","timestamp":1737657356000},"page":"e1012198","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":10,"title":["Physiology-informed regularisation enables training of universal differential equation systems for biological applications"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-1298-7385","authenticated-orcid":true,"given":"Max","family":"de Rooij","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8643-4915","authenticated-orcid":true,"given":"Bal\u00e1zs","family":"Erd\u0151s","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Natal A. W.","family":"van Riel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2253-4903","authenticated-orcid":true,"given":"Shauna D.","family":"O\u2019Donovan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2025,1,23]]},"reference":[{"issue":"9","key":"pcbi.1012198.ref001","doi-asserted-by":"crossref","first-page":"e74335","DOI":"10.1371\/journal.pone.0074335","article-title":"Lessons learned from quantitative dynamical modeling in systems biology","volume":"8","author":"A Raue","year":"2013","journal-title":"PLoS One"},{"issue":"4","key":"pcbi.1012198.ref002","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/j.cell.2005.04.020","article-title":"Systems biology: its practice and challenges","volume":"121","author":"A Aderem","year":"2005","journal-title":"Cell"},{"issue":"4","key":"pcbi.1012198.ref003","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1093\/bib\/bbl040","article-title":"Dynamic modelling and analysis of biochemical networks: mechanism-based models and model-based experiments","volume":"7","author":"NAW van Riel","year":"2006","journal-title":"Brief Bioinform"},{"issue":"12","key":"pcbi.1012198.ref004","doi-asserted-by":"crossref","first-page":"1074","DOI":"10.1016\/j.cels.2023.10.010","article-title":"Context-dependent regulation of lipid accumulation in adipocytes by a HIF1\u03b1-PPAR\u03b3 feedback network","volume":"14","author":"T Kudo","year":"2023","journal-title":"Cell Syst"},{"key":"pcbi.1012198.ref005","doi-asserted-by":"crossref","first-page":"536957","DOI":"10.3389\/fbioe.2020.536957","article-title":"Metabolic Modeling Combined With Machine Learning Integrates Longitudinal Data and Identifies the Origin of LXR-Induced Hepatic Steatosis","volume":"8","author":"NAW van Riel","year":"2021","journal-title":"Front Bioeng Biotechnol"},{"issue":"5","key":"pcbi.1012198.ref006","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","article-title":"Multilayer feedforward networks are universal approximators","volume":"2","author":"K Hornik","year":"1989","journal-title":"Neural Networks"},{"key":"pcbi.1012198.ref007","article-title":"Universal differential equations for scientific machine learning","author":"C Rackauckas","year":"2021","journal-title":"arXiv"},{"key":"pcbi.1012198.ref008","doi-asserted-by":"crossref","first-page":"22014","DOI":"10.1109\/ACCESS.2021.3055353","article-title":"Incorporating Unmodeled Dynamics Into First-Principles Models Through Machine Learning","volume":"9","author":"W Quaghebeur","year":"2021","journal-title":"IEEE Access"},{"key":"pcbi.1012198.ref009","article-title":"Capturing missing physics in climate model parameterizations using neural differential equations","author":"A Ramadhan","year":"2020","journal-title":"arXiv"},{"issue":"22","key":"pcbi.1012198.ref010","doi-asserted-by":"crossref","first-page":"6671","DOI":"10.5194\/gmd-16-6671-2023","article-title":"Universal differential equations for glacier ice flow modelling","volume":"16","author":"J Bolibar","year":"2023","journal-title":"Geosci Model Dev"},{"issue":"2","key":"pcbi.1012198.ref011","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1515\/sagmb-2020-0025","article-title":"Collocation based training of neural ordinary differential equations","volume":"20","author":"E Roesch","year":"2021","journal-title":"Stat Appl Genet Mol Biol"},{"issue":"8","key":"pcbi.1012198.ref012","doi-asserted-by":"crossref","first-page":"2256","DOI":"10.1890\/0012-9658(2002)083[2256:FPDMTT]2.0.CO;2","article-title":"Fitting population dynamic models to time-series data by gradient matching","volume":"83","author":"SP Ellner","year":"2002","journal-title":"Ecology"},{"issue":"1","key":"pcbi.1012198.ref013","doi-asserted-by":"crossref","first-page":"20394","DOI":"10.1038\/s41598-021-99609-x","article-title":"A trajectory-based loss function to learn missing terms in bifurcating dynamical systems","volume":"11","author":"R Vortmeyer-Kley","year":"2021","journal-title":"Sci Rep"},{"key":"pcbi.1012198.ref014","first-page":"61897","article-title":"Multiple Shooting for Training Neural Differential Equations on Time Series","author":"EM Turan","year":"2022","journal-title":"IEEE Control Syst Lett"},{"issue":"11","key":"pcbi.1012198.ref015","doi-asserted-by":"crossref","first-page":"105206","DOI":"10.1016\/j.isci.2022.105206","article-title":"Quantifying the contribution of triglycerides to metabolic resilience through the mixed meal model","volume":"25","author":"SD O\u2019Donovan","year":"2022","journal-title":"iScience"},{"issue":"4","key":"pcbi.1012198.ref016","doi-asserted-by":"crossref","first-page":"e25363","DOI":"10.1016\/j.heliyon.2024.e25363","article-title":"Predicting Covid-19 pandemic waves with biologically and behaviorally informed universal differential equations","volume":"10","author":"B Kuwahara","year":"2024","journal-title":"Heliyon"},{"key":"pcbi.1012198.ref017","doi-asserted-by":"crossref","first-page":"583016","DOI":"10.3389\/fendo.2020.583016","article-title":"Origins and History of the Minimal Model of Glucose Regulation","volume":"11","author":"RN Bergman","year":"2021","journal-title":"Front Endocrinol (Lausanne)"},{"issue":"1","key":"pcbi.1012198.ref018","first-page":"15","volume":"5","year":"2017"},{"key":"pcbi.1012198.ref019","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","article-title":"Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations","volume":"378","author":"M Raissi","year":"2019","journal-title":"Journal of Computational Physics"},{"issue":"17","key":"pcbi.1012198.ref020","doi-asserted-by":"crossref","first-page":"1861","DOI":"10.1101\/gad.1945410","article-title":"Classic and contemporary approaches to modeling biochemical reactions","volume":"24","author":"WW Chen","year":"2010","journal-title":"Genes Dev"},{"issue":"1","key":"pcbi.1012198.ref021","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1137\/141000671","article-title":"Julia: A Fresh Approach to Numerical Computing","volume":"59","author":"J Bezanson","year":"2017","journal-title":"SIAM Rev"},{"issue":"2","key":"pcbi.1012198.ref022","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1016\/j.camwa.2011.06.002","article-title":"Runge-Kutta pairs of order 5(4) satisfying only the first column simplifying assumption","volume":"62","author":"Ch Tsitouras","year":"2011","journal-title":"Computers & Mathematics with Applications"},{"key":"pcbi.1012198.ref023"},{"key":"pcbi.1012198.ref024"},{"key":"pcbi.1012198.ref025"},{"issue":"1","key":"pcbi.1012198.ref026","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1093\/imamat\/6.1.76","article-title":"The Convergence of a Class of Double-rank Minimization Algorithms 1","volume":"6","author":"CG BROYDEN","year":"1970","journal-title":"General Considerations. IMA J Appl Math"},{"issue":"3","key":"pcbi.1012198.ref027","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1093\/comjnl\/13.3.317","article-title":"A new approach to variable metric algorithms","volume":"13","author":"R Fletcher","year":"1970","journal-title":"The Computer Journal"},{"issue":"109","key":"pcbi.1012198.ref028","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1090\/S0025-5718-1970-0258249-6","article-title":"A family of variable-metric methods derived by variational means","volume":"24","author":"D Goldfarb","year":"1970","journal-title":"Math Comp"},{"issue":"111","key":"pcbi.1012198.ref029","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1090\/S0025-5718-1970-0274029-X","article-title":"Conditioning of quasi-Newton methods for function minimization","volume":"24","author":"DF Shanno","year":"1970","journal-title":"Math Comp"},{"key":"pcbi.1012198.ref030"},{"issue":"4","key":"pcbi.1012198.ref031","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.2337\/db13-1198","article-title":"The oral minimal model method","volume":"63","author":"C Cobelli","year":"2014","journal-title":"Diabetes"},{"issue":"6","key":"pcbi.1012198.ref032","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1038\/s41591-020-0934-0","article-title":"Human postprandial responses to food and potential for precision nutrition","volume":"26","author":"SE Berry","year":"2020","journal-title":"Nat Med"},{"issue":"6","key":"pcbi.1012198.ref033","doi-asserted-by":"crossref","first-page":"e1007982","DOI":"10.1371\/journal.pcbi.1007982","article-title":"It\u2019s about time: Analysing simplifying assumptions for modelling multi-step pathways in systems biology","volume":"16","author":"N Korsbo","year":"2020","journal-title":"PLoS Comput Biol"},{"issue":"5923","key":"pcbi.1012198.ref034","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1126\/science.1165893","article-title":"Distilling free-form natural laws from experimental data","volume":"324","author":"M Schmidt","year":"2009","journal-title":"Science"},{"issue":"15","key":"pcbi.1012198.ref035","doi-asserted-by":"crossref","first-page":"3932","DOI":"10.1073\/pnas.1517384113","article-title":"Discovering governing equations from data by sparse identification of nonlinear dynamical systems","volume":"113","author":"SL Brunton","year":"2016","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"11","key":"pcbi.1012198.ref036","doi-asserted-by":"crossref","first-page":"e1007575","DOI":"10.1371\/journal.pcbi.1007575","article-title":"Systems biology informed deep learning for inferring parameters and hidden dynamics","volume":"16","author":"A Yazdani","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1012198.ref037","doi-asserted-by":"crossref","unstructured":"Moreira A, Philipps M, Riel Nv. Parameter Estimation Of A Physiological Diabetes Model Using Neural Networks. In: 2023 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB); 2023. p. 1\u20138. Available from: https:\/\/ieeexplore.ieee.org\/document\/10264904","DOI":"10.1109\/CIBCB56990.2023.10264904"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1012198","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T00:00:00Z","timestamp":1737936000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012198","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T18:59:12Z","timestamp":1738004352000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012198"}},"subtitle":[],"editor":[{"given":"Varun","family":"Dutt","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,1,23]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1,23]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012198","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1012198","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,23]]}}}