{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T13:15:01Z","timestamp":1769087701410,"version":"3.49.0"},"reference-count":17,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T00:00:00Z","timestamp":1768435200000},"content-version":"vor","delay-in-days":9,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,1,6]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>Identifying dynamic treatment regimes (DTRs) is a key objective in precision medicine. Value search approaches, including (Bayesian) dynamic marginal structural models offer an attractive approach to estimation by mapping candidate regimes to their expected outcome. As parametric models for the expected outcomes may be mis-specified and lead to incorrect conclusions, a grid search over candidate DTRs has been proposed, but this may be computationally prohibitive and also subject to high uncertainty in the estimated value function. These inferential challenges can be addressed using Gaussian process ($\\mathcal {GP}$) optimization methods with estimators for the causal effect of adherence to a specified DTR. We demonstrate how to identify optimal DTRs using this approach in a variety of settings, including when the value function is multi-modal and show that the $\\mathcal {GP}$ modeling approach that recognizes noise in the estimated response surface leads to improved results as compared to a grid search approach. Further, we show that a grid search may not yield a robust solution and that it often utilizes information less efficiently than a $\\mathcal {GP}$ approach. The proposed approach is used to understand tailoring of HIV therapy to optimize CD4 cell counts.<\/jats:p>","DOI":"10.1093\/biomtc\/ujaf174","type":"journal-article","created":{"date-parts":[[2025,12,25]],"date-time":"2025-12-25T12:51:48Z","timestamp":1766667108000},"source":"Crossref","is-referenced-by-count":0,"title":["Estimating optimal dynamic treatment regimes with Gaussian process emulation"],"prefix":"10.1093","volume":"82","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7270-2787","authenticated-orcid":false,"given":"Daniel Rodriguez","family":"Duque","sequence":"first","affiliation":[{"name":"McGill University Department of Epidemiology and Biostatistics, , QC H3A 1G1 ,","place":["Canada"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9811-7140","authenticated-orcid":false,"given":"David A","family":"Stephens","sequence":"additional","affiliation":[{"name":"McGill University Department of Mathematics and Statistics, , QC H3A 0B9 ,","place":["Canada"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7225-3977","authenticated-orcid":false,"given":"Erica E M","family":"Moodie","sequence":"additional","affiliation":[{"name":"McGill University Department of Epidemiology and Biostatistics, , QC H3A 1G1 ,","place":["Canada"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2026,1,15]]},"reference":[{"issue":"2","key":"2026011508085105700_bib1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2202\/1557-4679.1204","article-title":"Optimal dynamic regimes: presenting a case for predictive inference","volume":"6","author":"Arjas","year":"2010","journal-title":"The International Journal of Biostatistics"},{"key":"2026011508085105700_bib2","doi-asserted-by":"crossref","first-page":"2331","DOI":"10.2514\/1.20068","article-title":"Design and analysis of \u201cnoisy\u201d computer experiments","volume":"44","author":"Forrester","year":"2006","journal-title":"AIAA Journal"},{"key":"2026011508085105700_bib3","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/978-3-319-23871-5_3","article-title":"Bayesian optimization for materials design","volume-title":"Information Science for Materials Discovery and Design","author":"Frazier","year":"2016"},{"key":"2026011508085105700_bib4","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1056\/NEJM199610103351501","article-title":"A trial comparing nucleoside monotherapy with combination therapy in HIV-infected adults with CD4 cell counts from 200 to 500 per cubic millimeter","volume":"335","author":"Hammer","year":"1996","journal-title":"New England Journal of Medicine"},{"key":"2026011508085105700_bib5","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1007\/s10898-005-2454-3","article-title":"Global optimization of stochastic black-box systems via sequential kriging meta-models","volume":"34","author":"Huang","year":"2006","journal-title":"Journal of Global Optimization"},{"key":"2026011508085105700_bib6","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1023\/A:1008306431147","article-title":"Efficient global optimization of expensive black-box functions","volume":"13","author":"Jones","year":"1998","journal-title":"Journal of Global Optimization"},{"key":"2026011508085105700_bib7","volume-title":"LongCART: Recursive Partitioning for Longitudinal Data and Right Censored Data using Baseline Covariates","author":"Kundu","year":"2021"},{"key":"2026011508085105700_bib8","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1023\/A:1008294716304","article-title":"Bayesian algorithms for one-dimensional global optimization","volume":"10","author":"Locatelli","year":"1997","journal-title":"Journal of Global Optimization"},{"key":"2026011508085105700_bib9","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1080\/01621459.2017.1340887","article-title":"A Bayesian machine learning approach for optimizing dynamic treatment regimes","volume":"113","author":"Murray","year":"2018","journal-title":"Journal of the American Statistical Association"},{"key":"2026011508085105700_bib10","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1093\/oso\/9780198504856.003.0022","article-title":"Uncertainty analysis and other inference tools for complex computer codes","volume-title":"Bayesian Statistics 6: Proceedings of the Sixth Valencia International Meeting","author":"O\u2019Hagan","year":"1999"},{"key":"2026011508085105700_bib11","first-page":"Article 8","article-title":"Dynamic regime marginal structural mean models for estimation of optimal dynamic treatment regimes, part I: main content","volume":"6","author":"Orellana","year":"2010","journal-title":"The International Journal of Biostatistics"},{"key":"2026011508085105700_bib12","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1093\/biostatistics\/kxac007","article-title":"Semiparametric Bayesian inference for dynamic treatment regimes via dynamic regime marginal structural models","volume":"24","author":"Rodriguez\u00a0Duque","year":"2023","journal-title":"Biostatistics"},{"key":"2026011508085105700_bib13","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1214\/aos\/1176345338","article-title":"The Bayesian bootstrap","volume":"9","author":"Rubin","year":"1981","journal-title":"The Annals of Statistics"},{"key":"2026011508085105700_bib14","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1111\/biom.12269","article-title":"On Bayesian estimation of marginal structural models","volume":"71","author":"Saarela","year":"2015","journal-title":"Biometrics"},{"key":"2026011508085105700_bib15","doi-asserted-by":"crossref","DOI":"10.1201\/b11038","volume-title":"Gaussian Process Regression Analysis for Functional Data","author":"Shi","year":"2011"},{"key":"2026011508085105700_bib16","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1080\/01621459.2015.1086353","article-title":"Bayesian nonparametric estimation for dynamic treatment regimes with sequential transition times","volume":"111","author":"Xu","year":"2016","journal-title":"Journal of the American Statistical Association"},{"key":"2026011508085105700_bib17","doi-asserted-by":"crossref","first-page":"3450","DOI":"10.1109\/TSP.2020.2997940","article-title":"Improved most likely heteroscedastic Gaussian process regression via Bayesian residual moment estimator","volume":"68","author":"Zhang","year":"2020","journal-title":"IEEE Transactions on Signal Processing"}],"container-title":["Biometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/biometrics\/article-pdf\/82\/1\/ujaf174\/66420715\/ujaf174.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biometrics\/article-pdf\/82\/1\/ujaf174\/66420715\/ujaf174.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T13:08:58Z","timestamp":1768482538000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biometrics\/article\/doi\/10.1093\/biomtc\/ujaf174\/8426278"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,6]]},"references-count":17,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,6]]}},"URL":"https:\/\/doi.org\/10.1093\/biomtc\/ujaf174","relation":{},"ISSN":["0006-341X","1541-0420"],"issn-type":[{"value":"0006-341X","type":"print"},{"value":"1541-0420","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,3]]},"published":{"date-parts":[[2026,1,6]]},"article-number":"ujaf174"}}