{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T04:46:30Z","timestamp":1769316390354,"version":"3.49.0"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"S14","license":[{"start":{"date-parts":[[2021,11,12]],"date-time":"2021-11-12T00:00:00Z","timestamp":1636675200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,12]],"date-time":"2021-11-12T00:00:00Z","timestamp":1636675200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Horizon 2020 Research and Innovation","award":["826121"],"award-info":[{"award-number":["826121"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The aim of the present paper is to construct an emulator of a complex biological system simulator using a machine learning approach. More specifically, the simulator is a patient-specific model that integrates metabolic, nutritional, and lifestyle data to predict the metabolic and inflammatory processes underlying the development of type-2 diabetes in absence of familiarity. Given the very high incidence of type-2 diabetes, the implementation of this predictive model on mobile devices could provide a useful instrument to assess the risk of the disease for aware individuals. The high computational cost of the developed model, being a mixture of agent-based and ordinary differential equations and providing a dynamic multivariate output, makes the simulator executable only on powerful workstations but not on mobile devices. Hence the need to implement an emulator with a reduced computational cost that can be executed on mobile devices to provide real-time self-monitoring.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Similarly to our previous work, we propose an emulator based on a machine learning algorithm but here we consider a different approach which turn out to have better performances, indeed in terms of root mean square error we have an improvement of two order magnitude. We tested the proposed emulator on samples containing different number of simulated trajectories, and it turned out that the fitted trajectories are able to predict with high accuracy the entire dynamics of the simulator output variables. We apply the emulator to control the level of inflammation while leveraging on the nutritional input.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The proposed emulator can be implemented and executed on mobile health devices to perform quick-and-easy self-monitoring assessments.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-021-04354-7","type":"journal-article","created":{"date-parts":[[2021,11,12]],"date-time":"2021-11-12T09:03:46Z","timestamp":1636707826000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Emulating complex simulations by machine learning methods"],"prefix":"10.1186","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3688-5464","authenticated-orcid":false,"given":"Paola","family":"Stolfi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Filippo","family":"Castiglione","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,11,12]]},"reference":[{"key":"4354_CR1","doi-asserted-by":"crossref","unstructured":"Sacks J, Welch WJ, Mitchell TJ, Wynn HP. Design and analysis of computer experiments. Stat Sci. 1989;409\u2013423.","DOI":"10.1214\/ss\/1177012413"},{"issue":"4","key":"4354_CR2","doi-asserted-by":"publisher","first-page":"1638","DOI":"10.1016\/j.csda.2010.10.011","volume":"55","author":"P Reichert","year":"2011","unstructured":"Reichert P, White G, Bayarri MJ, Pitman EB. Mechanism-based emulation of dynamic simulation models: concept and application in hydrology. Comput Stat Data Anal. 2011;55(4):1638\u201355.","journal-title":"Comput Stat Data Anal"},{"issue":"2","key":"4354_CR3","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1049\/iet-est.2016.0040","volume":"7","author":"T Mesbahi","year":"2017","unstructured":"Mesbahi T, Rizoug N, Khenfri F, Bartholome\u00fcs P, Le Moigne P. Dynamical modelling and emulation of li-ion batteries-supercapacitors hybrid power supply for electric vehicle applications. IET Electr Syst Transp. 2017;7(2):161\u20139.","journal-title":"IET Electr Syst Transp"},{"issue":"3","key":"4354_CR4","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1111\/1467-9868.00294","volume":"63","author":"MC Kennedy","year":"2001","unstructured":"Kennedy MC, O\u2019Hagan A. Bayesian calibration of computer models. J R Stat Soc Ser B (Stat Methodol). 2001;63(3):425\u201364.","journal-title":"J R Stat Soc Ser B (Stat Methodol)"},{"key":"4354_CR5","first-page":"248","volume-title":"Gaussian processes for machine learning. Adaptive computation and machine learning","author":"C Rasmussen","year":"2006","unstructured":"Rasmussen C, Williams C. Gaussian processes for machine learning. Adaptive computation and machine learning. Cambridge: MIT Press; 2006. p. 248."},{"issue":"416","key":"4354_CR6","doi-asserted-by":"publisher","first-page":"953","DOI":"10.1080\/01621459.1991.10475138","volume":"86","author":"C Currin","year":"1991","unstructured":"Currin C, Mitchell T, Morris M, Ylvisaker D. Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J Am Stat Assoc. 1991;86(416):953\u201363. https:\/\/doi.org\/10.1080\/01621459.1991.10475138.","journal-title":"J Am Stat Assoc"},{"key":"4354_CR7","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1016\/j.compchemeng.2017.09.017","volume":"108","author":"A Bhosekar","year":"2018","unstructured":"Bhosekar A, Ierapetritou M. Advances in surrogate based modeling, feasibility analysis, and optimization: a review. Comput Chem Eng. 2018;108:250\u201367. https:\/\/doi.org\/10.1016\/j.compchemeng.2017.09.017.","journal-title":"Comput Chem Eng"},{"key":"4354_CR8","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1016\/j.compchemeng.2014.05.021","volume":"68","author":"J Eason","year":"2014","unstructured":"Eason J, Cremaschi S. Adaptive sequential sampling for surrogate model generation with artificial neural networks. Comput Chem Eng. 2014;68:220\u201332.","journal-title":"Comput Chem Eng"},{"key":"4354_CR9","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.simpat.2018.12.006","volume":"92","author":"M Edali","year":"2019","unstructured":"Edali M, Y\u00fccel G. Exploring the behavior space of agent-based simulation models using random forest metamodels and sequential sampling. Simul Model Practice Theory. 2019;92:62\u201381.","journal-title":"Simul Model Practice Theory"},{"issue":"17","key":"4354_CR10","first-page":"1","volume":"21","author":"P Stolfi","year":"2020","unstructured":"Stolfi P, Valentini I, Palumbo MC, Tieri P, Grignolio A, Castiglione F. Potential predictors of type-2 diabetes risk: machine learning, synthetic data and wearable health devices. BMC Bioinformat. 2020;21(17):1\u201319.","journal-title":"BMC Bioinformat"},{"issue":"1","key":"4354_CR11","doi-asserted-by":"publisher","first-page":"3","DOI":"10.2196\/ijmr.2092","volume":"2","author":"F Castiglione","year":"2013","unstructured":"Castiglione F, Diaz V, Gaggioli A, Li\u00f2 P, Mazz\u00e0 C, Merelli E, Meskers CGM, Pappalardo F, von Ammon R. Physio-environmental sensing and live modeling. Interact J Med Res. 2013;2(1):3. https:\/\/doi.org\/10.2196\/ijmr.2092.","journal-title":"Interact J Med Res"},{"key":"4354_CR12","doi-asserted-by":"crossref","unstructured":"Stolfi P, Castiglione F. Emulation of dynamic multi-output simulator of risk of type-2 diabetes. In: 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM); 2020. IEEE, p. 340\u2013345","DOI":"10.1109\/BIBM49941.2020.9313162"},{"issue":"2","key":"4354_CR13","doi-asserted-by":"publisher","first-page":"44","DOI":"10.2196\/resprot.2854","volume":"2","author":"F Castiglione","year":"2013","unstructured":"...Castiglione F, Tieri P, De Graaf A, Franceschi C, Li\u00f2 P, Van Ommen B, Mazz\u00e0 C, Tuchel A, Bernaschi M, Samson C, Colombo T, Castellani GC, Capri M, Garagnani P, Salvioli S, Nguyen VA, Bobeldijk-Pastorova I, Krishnan S, Cappozzo A, Sacchetti M, Morettini M, Ernst M. The onset of type 2 diabetes: proposal for a multi-scale model. JMIR Res Protoc. 2013;2(2):44. https:\/\/doi.org\/10.2196\/resprot.2854.","journal-title":"JMIR Res Protoc"},{"key":"4354_CR14","unstructured":"Palumbo M, Morettini M, Tieri P, de Graaf A, Krishnan S, Castiglione F. Modeling meal consumption and physical exercise for fuel homeostasis; 2020 (in preparation)."},{"key":"4354_CR15","doi-asserted-by":"crossref","unstructured":"Palumbo MC, Morettini M, Tieri P, Diele F, Sacchetti M, Castiglione F. Personalizing physical exercise in a computational model of fuel homeostasis. PLoS Computat Biol. 2018;14(4).","DOI":"10.1371\/journal.pcbi.1006073"},{"key":"4354_CR16","unstructured":"Palumbo M, Morettini M, Tieri P, de Graaf A, Li\u00f2 P, Diele F, Castiglione F. An integrated multi-scale model for the simulation and prediction of metabolic and inflammatory processes in the onset and progress of type 2 diabetes; 2020 (in preparation)."},{"issue":"2","key":"4354_CR17","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1093\/ajcn\/51.2.241","volume":"51","author":"MD Mifflin","year":"1990","unstructured":"Mifflin MD, St Jeor ST, Hill LA, Scott BJ, Daugherty SA, Koh YO. A new predictive equation for resting energy expenditure in healthy individuals. Am J Clin Nutr. 1990;51(2):241\u20137. https:\/\/doi.org\/10.1093\/ajcn\/51.2.241.","journal-title":"Am J Clin Nutr"},{"issue":"3","key":"4354_CR18","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1079\/BJN19950037","volume":"73","author":"KR Westerterp","year":"1995","unstructured":"Westerterp KR, Donkers JHHLM, Fredrix EWHM, Oekhoudt P. Energy intake, physical activity and body weight: a simulation model. Br J Nutr. 1995;73(3):337\u201347. https:\/\/doi.org\/10.1079\/BJN19950037.","journal-title":"Br J Nutr"},{"key":"4354_CR19","doi-asserted-by":"crossref","unstructured":"Prana V, Tieri P, Palumbo MC, Mancini E, Castiglione F. Modeling the effect of high calorie diet on the interplay between adipose tissue, inflammation, and diabetes. Comput Math Methods Med. 2019;2019.","DOI":"10.1155\/2019\/7525834"},{"key":"4354_CR20","doi-asserted-by":"crossref","unstructured":"Morettini M, Palumbo MC, Sacchetti M, Castiglione F, Mazza C. A system model of the effects of exercise on plasma interleukin-6 dynamics in healthy individuals: role of skeletal muscle and adipose tissue. PloS One. 2017;12(7).","DOI":"10.1371\/journal.pone.0181224"},{"key":"4354_CR21","doi-asserted-by":"publisher","DOI":"10.1201\/b18274","volume-title":"Immune system modeling and simulation","author":"F Castiglione","year":"2015","unstructured":"Castiglione F, Celada F. Immune system modeling and simulation. Boca Raton: CRC Press; 2015."},{"issue":"11","key":"4354_CR22","doi-asserted-by":"publisher","first-page":"1371","DOI":"10.1093\/bioinformatics\/btm044","volume":"23","author":"F Castiglione","year":"2007","unstructured":"Castiglione F, Duca K, Jarrah A, Laubenbacher R, Hochberg D, Thorley-Lawson D. Simulating Epstein-Barr virus infection with C-ImmSim. Bioinformatics. 2007;23(11):1371\u20137. https:\/\/doi.org\/10.1093\/bioinformatics\/btm044.","journal-title":"Bioinformatics"},{"key":"4354_CR23","doi-asserted-by":"crossref","unstructured":"Mancini E, Quax R, De Luca A, Fidler S, Stohr W, Sloot PM. A study on the dynamics of temporary hiv treatment to assess the controversial outcomes of clinical trials: an in-silico approach. PloS one. 2018;13(7).","DOI":"10.1371\/journal.pone.0200892"},{"issue":"19","key":"4354_CR24","doi-asserted-by":"publisher","first-page":"3065","DOI":"10.1093\/bioinformatics\/btx341","volume":"33","author":"A Madonia","year":"2017","unstructured":"Madonia A, Melchiorri C, Bonamano S, Marcelli M, Bulfon C, Castiglione F, Galeotti M, Volpatti D, Mosca F, Tiscar P-G, Romano N. Computational modeling of immune system of the fish for a more effective vaccination in aquaculture. Bioinformatics. 2017;33(19):3065\u201371. https:\/\/doi.org\/10.1093\/bioinformatics\/btx341.","journal-title":"Bioinformatics"},{"issue":"3","key":"4354_CR25","doi-asserted-by":"publisher","first-page":"640","DOI":"10.1016\/j.jspi.2009.08.006","volume":"140","author":"S Conti","year":"2010","unstructured":"Conti S, O\u2019Hagan A. Bayesian emulation of complex multi-output and dynamic computer models. J Stat Plan Inference. 2010;140(3):640\u201351. https:\/\/doi.org\/10.1016\/j.jspi.2009.08.006.","journal-title":"J Stat Plan Inference"},{"issue":"4","key":"4354_CR26","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1198\/106186008X384032","volume":"17","author":"J Rougier","year":"2008","unstructured":"Rougier J. Efficient emulators for multivariate deterministic functions. J Comput Graph Stat. 2008;17(4):827\u201343.","journal-title":"J Comput Graph Stat"},{"issue":"2","key":"4354_CR27","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1214\/09-BA415","volume":"4","author":"F Liu","year":"2009","unstructured":"Liu F, West M, et al. A dynamic modelling strategy for Bayesian computer model emulation. Bayesian Anal. 2009;4(2):393\u2013411.","journal-title":"Bayesian Anal"},{"issue":"4","key":"4354_CR28","doi-asserted-by":"publisher","first-page":"1638","DOI":"10.1016\/j.csda.2010.10.011","volume":"55","author":"P Reichert","year":"2011","unstructured":"Reichert P, White G, Bayarri MJ, Pitman EB. Mechanism-based emulation of dynamic simulation models: concept and application in hydrology. Comput Stat Data Anal. 2011;55(4):1638\u201355. https:\/\/doi.org\/10.1016\/j.csda.2010.10.011.","journal-title":"Comput Stat Data Anal"},{"issue":"4","key":"4354_CR29","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1214\/07-BA232","volume":"2","author":"S Bhattacharya","year":"2007","unstructured":"Bhattacharya S, et al. A simulation approach to Bayesian emulation of complex dynamic computer models. Bayesian Anal. 2007;2(4):783\u2013815.","journal-title":"Bayesian Anal"},{"issue":"3","key":"4354_CR30","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1093\/biomet\/asp028","volume":"96","author":"S Conti","year":"2009","unstructured":"Conti S, Gosling JP, Oakley JE, O\u2019Hagan A. Gaussian process emulation of dynamic computer codes. Biometrika. 2009;96(3):663\u201376.","journal-title":"Biometrika"},{"key":"4354_CR31","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1016\/j.csda.2019.05.006","volume":"139","author":"H Mohammadi","year":"2019","unstructured":"Mohammadi H, Challenor P, Goodfellow M. Emulating dynamic non-linear simulators using gaussian processes. Comput Stat Data Anal. 2019;139:178\u201396. https:\/\/doi.org\/10.1016\/j.csda.2019.05.006.","journal-title":"Comput Stat Data Anal"},{"issue":"5","key":"4354_CR32","doi-asserted-by":"publisher","first-page":"1874","DOI":"10.1214\/009053607000000163","volume":"35","author":"M Bayarri","year":"2007","unstructured":"Bayarri M, Berger J, Cafeo J, Garcia-Donato G, Liu F, Palomo J, Parthasarathy R, Paulo R, Sacks J, Walsh D, et al. Computer model validation with functional output. Ann Stat. 2007;35(5):1874\u2013906.","journal-title":"Ann Stat"},{"issue":"1","key":"4354_CR33","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L. Random forests. Mach Learn. 2001;45(1):5\u201332.","journal-title":"Mach Learn"},{"issue":"5","key":"4354_CR34","doi-asserted-by":"publisher","first-page":"2058","DOI":"10.1214\/aos\/1069362310","volume":"24","author":"W-L Loh","year":"1996","unstructured":"Loh W-L, et al. On latin hypercube sampling. Ann Stat. 1996;24(5):2058\u201380.","journal-title":"Ann Stat"},{"key":"4354_CR35","first-page":"1","volume":"57","author":"RJ Tibshirani","year":"1993","unstructured":"Tibshirani RJ, Efron B. An introduction to the bootstrap. Monogr Stat Appl Probab. 1993;57:1\u2013436.","journal-title":"Monogr Stat Appl Probab"},{"issue":"8","key":"4354_CR36","doi-asserted-by":"publisher","first-page":"1600","DOI":"10.1249\/MSS.0b013e31828ba942","volume":"45","author":"EL Melanson","year":"2013","unstructured":"Melanson EL, Keadle SK, Donnelly JE, Braun B, King NA. Resistance to exercise-induced weight loss: compensatory behavioral adaptations. Med Sci Sports Exer. 2013;45(8):1600.","journal-title":"Med Sci Sports Exer"},{"issue":"1","key":"4354_CR37","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1186\/1743-7075-1-5","volume":"1","author":"KR Westerterp","year":"2004","unstructured":"Westerterp KR. Diet induced thermogenesis. Nutr Metab. 2004;1(1):5.","journal-title":"Nutr Metab"},{"key":"4354_CR38","unstructured":"Organization WH. Media Centre. Accessed 27 Sept 2016. http:\/\/who.int\/mediacentre\/factsheets\/fs312\/en\/"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04354-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-021-04354-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04354-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T17:15:39Z","timestamp":1669310139000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-021-04354-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,12]]},"references-count":38,"journal-issue":{"issue":"S14","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["4354"],"URL":"https:\/\/doi.org\/10.1186\/s12859-021-04354-7","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,12]]},"assertion":[{"value":"11 August 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 August 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 November 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"483"}}