{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T05:59:21Z","timestamp":1790315961722,"version":"4.1.0"},"reference-count":26,"publisher":"SAGE Publications","issue":"7","license":[{"start":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T00:00:00Z","timestamp":1781049600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T00:00:00Z","timestamp":1781049600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Med Decis Making"],"published-print":{"date-parts":[[2026,10]]},"abstract":"<jats:p>\n                    <jats:bold>Background.<\/jats:bold>\n                    Simulation calibration is the process of configuring a simulation model\u2019s parameters to improve the agreement between the model output and the desired calibration targets (e.g., observed historical data). For most realistic simulation models, this calibration process can be quite computationally expensive, as it requires running the simulation model for each parameter combination. To alleviate this problem, metamodels offer a tradeoff between accuracy and computational efficiency for extensive simulative analysis with a highly complex parameter space.\n                    <jats:bold>Method.<\/jats:bold>\n                    In this study, we examine 4 simulation calibration approaches. Randomly-Simulate (RS) is a simulation-based benchmark widely used in the literature. Optimally-Predict (OP) is an optimization-based approach that we adapt to the simulation calibration setting. Building on these 2 baselines, we introduce 2 hybrid strategies, Predict-then-Simulate (PtS) and Simulate-then-Predict (StP), which combine simulation runs and metamodel-based optimization in complementary orders. We compare all 4 methods in terms of calibration accuracy and computational cost.\n                    <jats:bold>Results.<\/jats:bold>\n                    While the metamodel-based OP approach substantially reduced computational cost relative to RS and identified parameter combinations near the optimal configuration, the hybrid strategies delivered superior calibration performance. In particular, the PtS approach, which combines metamodel-based optimization with targeted simulation refinement, achieved on average a 46% reduction in total actual error compared with the RS benchmark, while maintaining computational efficiency.\n                    <jats:bold>Conclusions.<\/jats:bold>\n                    The study introduces a novel metamodel-based optimization approach to simulation calibration and illustrates its potential benefits for computationally expensive studies. While developed for deterministic targets, the method provides a foundation for future extensions to settings involving stochastic simulation outputs and other forms of model uncertainty. An open-access Python implementation of the proposed framework is provided to facilitate adoption and reproducibility.\n                  <\/jats:p>\n                  <jats:sec>\n                    <jats:title>Highlights<\/jats:title>\n                    <jats:list list-type=\"bullet\">\n                      <jats:list-item>\n                        <jats:p>A metamodel-based optimization approach is proposed for calibrating simulation model parameters, which can offer computational advantages particularly in cases in which direct calibration is expensive due to complex or high-dimensional simulation models.<\/jats:p>\n                      <\/jats:list-item>\n                      <jats:list-item>\n                        <jats:p>A hybrid approach that narrows down the search space via metamodel-based optimization and then uses simulation runs for fine-tuning offers a sweet spot in the tradeoff between computational efficiency and accuracy.<\/jats:p>\n                      <\/jats:list-item>\n                    <\/jats:list>\n                  <\/jats:sec>","DOI":"10.1177\/0272989x261452258","type":"journal-article","created":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T10:28:36Z","timestamp":1781087316000},"page":"897-908","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["A Metamodel-Based General-Purpose Autocalibration Tool for Simulation Models"],"prefix":"10.1177","volume":"46","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2160-0553","authenticated-orcid":false,"given":"Taghi","family":"Khaniyev","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, Bilkent University, Ankara, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elif Sena","family":"I\u015f\u0131k","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Bilkent University, Ankara, Turkey"},{"name":"Department of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8741-4430","authenticated-orcid":false,"given":"Jagpreet","family":"Chhatwal","sequence":"additional","affiliation":[{"name":"Institute for Technology Assessment, Massachusetts General Hospital, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"\u0130smail Fatih","family":"Y\u0131ld\u0131r\u0131m","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, MA, USA (JC); Value Analytics Lab, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Turgay","family":"Ayer","sequence":"additional","affiliation":[{"name":"Department of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,6,10]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2014.10.004"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2020.102859"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-5690-2_688"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3799-8"},{"issue":"1","key":"e_1_3_2_6_2","article-title":"Literature review on calibration of building energy simulation programs: uses, problems, procedure, uncertainty, and tools","volume":"112","author":"Reddy TA.","year":"2006","unstructured":"Reddy TA. Literature review on calibration of building energy simulation programs: uses, problems, procedure, uncertainty, and tools. ASHRAE Trans. 2006;112(1):226\u201340.","journal-title":"ASHRAE Trans"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2017.09.009"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.energy.2019.116046"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00294"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1198\/004017007000000092"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40273-017-0507-4"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1101\/2023.02.27.23286525"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1002\/sam.11507"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0927-0507(06)13018-2"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/s0952-1976(03)00043-5"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2019.102016"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-0346(03)00005-3"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.3389\/fphys.2021.662314"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1012485416856"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X231184175"},{"key":"e_1_3_2_21_2","doi-asserted-by":"crossref","unstructured":"Anderson R Huchette J Will M Tjandraatmadja C Vielma JP. Strong mixed-integer programming formulations for trained neural networks. Math Program 2020; 183(1): 3\u20139.","DOI":"10.1007\/s10107-020-01474-5"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1000656"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1162\/106365606776022733"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.8679"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008306431147"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00346"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1201\/9780367815493"}],"container-title":["Medical Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X261452258","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0272989X261452258","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X261452258","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T05:16:21Z","timestamp":1790313381000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0272989X261452258"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,10]]},"references-count":26,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,10]]}},"alternative-id":["10.1177\/0272989X261452258"],"URL":"https:\/\/doi.org\/10.1177\/0272989x261452258","relation":{},"ISSN":["0272-989X","1552-681X"],"issn-type":[{"value":"0272-989X","type":"print"},{"value":"1552-681X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,10]]}}}