{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T14:27:26Z","timestamp":1791296846406,"version":"4.1.0"},"reference-count":23,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T00:00:00Z","timestamp":1716854400000},"content-version":"vor","delay-in-days":62,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 GM124104"],"award-info":[{"award-number":["R01 GM124104"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 MH123487"],"award-info":[{"award-number":["R01 MH123487"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 NS073671"],"award-info":[{"award-number":["R01 NS073671"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["1-U24-AR076730"],"award-info":[{"award-number":["1-U24-AR076730"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,3,27]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Sequential multiple assignment randomized trials (SMARTs) are the gold standard for estimating optimal dynamic treatment regimes (DTRs), but are costly and require a large sample size. We introduce the multi-stage augmented Q-learning estimator (MAQE) to improve efficiency of estimation of optimal DTRs by augmenting SMART data with observational data. Our motivating example comes from the Back Pain Consortium, where one of the overarching aims is to learn how to tailor treatments for chronic low back pain to individual patient phenotypes, knowledge which is lacking clinically. The Consortium-wide collaborative SMART and observational studies within the Consortium collect data on the same participant phenotypes, treatments, and outcomes at multiple time points, which can easily be integrated. Previously published single-stage augmentation methods for integration of trial and observational study (OS) data were adapted to estimate optimal DTRs from SMARTs using Q-learning. Simulation studies show the MAQE, which integrates phenotype, treatment, and outcome information from multiple studies over multiple time points, more accurately estimates the optimal DTR, and has a higher average value than a comparable Q-learning estimator without augmentation. We demonstrate this improvement is robust to a wide range of trial and OS sample sizes, addition of noise variables, and effect sizes.<\/jats:p>","DOI":"10.1093\/biomtc\/ujae046","type":"journal-article","created":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T09:41:11Z","timestamp":1716889271000},"source":"Crossref","is-referenced-by-count":1,"title":["Integrating randomized and observational studies to estimate optimal dynamic treatment regimes"],"prefix":"10.1093","volume":"80","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5644-0951","authenticated-orcid":false,"given":"Anna","family":"Batorsky","sequence":"first","affiliation":[{"name":"Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill , NC 27599 , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kevin J","family":"Anstrom","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill , NC 27599 , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Donglin","family":"Zeng","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, School of Public Health, University of Michigan , Ann Arbor, MI 48109 , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,5,28]]},"reference":[{"key":"2024061316210506800_bib1","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1007\/s13142-014-0265-0","article-title":"Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research","volume":"4","author":"Almirall","year":"2014","journal-title":"Translational Behavioral Medicine"},{"key":"2024061316210506800_bib2","doi-asserted-by":"crossref","first-page":"S95","DOI":"10.1093\/pm\/pnad008","article-title":"The Back Pain Consortium (BACPAC) research program data harmonization: Rationale for data elements and standards","volume":"24","author":"Batorsky","year":"2023","journal-title":"Pain Medicine"},{"key":"2024061316210506800_bib3","first-page":"679","article-title":"A markovian decision process","volume":"6","author":"Bellman","year":"1957","journal-title":"Journal of Mathematics and Mechanics"},{"key":"2024061316210506800_bib4","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1146\/annurev-statistics-022513-115553","article-title":"Dynamic treatment regimes","volume":"1","author":"Chakraborty","year":"2014","journal-title":"Annual Review of Statistics and Its Application"},{"key":"2024061316210506800_bib5","first-page":"271","article-title":"Statistical learning methods for optimizing dynamic treatment regimes in subgroup identification","volume-title":"Design and Analysis of Subgroups with Biopharmaceutical Applications, Emerging Topics in Statistics and Biostatistics","author":"Chen","year":"2020"},{"key":"2024061316210506800_bib6","article-title":"Causal inference methods for combining randomized trials and observational studies: a review","author":"Colnet","year":"2021"},{"key":"2024061316210506800_bib7","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1146\/annurev-statistics-030718-105251","article-title":"Precision medicine","volume":"6","author":"Kosorok","year":"2019","journal-title":"Annual Review of Statistics and Its Application"},{"key":"2024061316210506800_bib8","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1007\/s11606-009-0981-1","article-title":"Development and initial validation of the PEG, a three-item scale assessing pain intensity and interference","volume":"24","author":"Krebs","year":"2009","journal-title":"Journal of General Internal Medicine"},{"key":"2024061316210506800_bib9","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1191\/1740774S04cn002oa","article-title":"Dynamic treatment regimes: practical design considerations","volume":"1","author":"Lavori","year":"2004","journal-title":"Clinical Trials"},{"key":"2024061316210506800_bib10","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/S0006-3223(00)00946-X","article-title":"Flexible treatment strategies in chronic disease: clinical and research implications","volume":"48","author":"Lavori","year":"2000","journal-title":"Biological Psychiatry"},{"key":"2024061316210506800_bib11","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1177\/17407745231174544","article-title":"Overview of modern approaches for identifying and evaluating heterogeneous treatment effects from clinical data","volume":"20","author":"Lipkovich","year":"2023","journal-title":"Clinical Trials (London, England)"},{"key":"2024061316210506800_bib12","doi-asserted-by":"crossref","first-page":"2937","DOI":"10.1002\/sim.1903","article-title":"Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study","volume":"23","author":"Lunceford","year":"2004","journal-title":"Statistics in Medicine"},{"key":"2024061316210506800_bib13","doi-asserted-by":"crossref","first-page":"2491","DOI":"10.1038\/npp.2010.115","article-title":"What have we learned about trial design from NIMH-Funded pragmatic trials?","volume":"35","author":"March","year":"2010","journal-title":"Neuropsychopharmacology"},{"key":"2024061316210506800_bib14","doi-asserted-by":"crossref","first-page":"S3","DOI":"10.1093\/pm\/pnac202","article-title":"The back pain consortium (BACPAC) research program: structure, research priorities, and methods","volume":"24","author":"Mauck","year":"2023","journal-title":"Pain Medicine"},{"key":"2024061316210506800_bib15","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1002\/cjs.11162","article-title":"Q-learning for estimating optimal dynamic treatment rules from observational data","volume":"40","author":"Moodie","year":"2012","journal-title":"The Canadian Journal of Statistics = Revue Canadienne de Statistique"},{"key":"2024061316210506800_bib16","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.1002\/sim.2022","article-title":"An experimental design for the development of adaptive treatment strategies","volume":"24","author":"Murphy","year":"2005","journal-title":"Statistics in Medicine"},{"key":"2024061316210506800_bib17","doi-asserted-by":"crossref","first-page":"S24","DOI":"10.1016\/j.drugalcdep.2006.09.008","article-title":"Developing adaptive treatment strategies in substance abuse research","volume":"88","author":"Murphy","year":"2007","journal-title":"Drug and Alcohol Dependence"},{"key":"2024061316210506800_bib18","article-title":"Back Pain Consortium (BACPAC) research program","author":"NIH HEAL Initiative.","year":"2019"},{"key":"2024061316210506800_bib19","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1016\/0270-0255(86)90088-6","article-title":"A new approach to causal inference in mortality studies with a sustained exposure period\u2014application to control of the healthy worker survivor effect","volume":"7","author":"Robins","year":"1986","journal-title":"Mathematical Modelling"},{"key":"2024061316210506800_bib20","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1214\/13-STS450","article-title":"Q- and A-learning methods for estimating optimal dynamic treatment regimes","volume":"29","author":"Schulte","year":"2014","journal-title":"Statistical Science: A Review Journal of the Institute of Mathematical Statistics"},{"key":"2024061316210506800_bib21","article-title":"Low back pain online study | BACKHOME study","author":"University of California San Francisco.","year":"2023"},{"key":"2024061316210506800_bib22","doi-asserted-by":"crossref","first-page":"S36","DOI":"10.1093\/pm\/pnad009","article-title":"Toward the identification of distinct phenotypes: research protocol for the low back pain biological, biomechanical, and behavioral (LB3P) cohort study and the BACPAC mechanistic research center at the University of Pittsburgh","volume":"24","author":"Vo","year":"2023","journal-title":"Pain Medicine"},{"key":"2024061316210506800_bib23","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.jpain.2021.08.005","article-title":"NIH\u2019s Helping to End Addiction Long-term initiative (NIH HEAL initiative) clinical pain management common data element program","volume":"23","author":"Wandner","year":"2022","journal-title":"The Journal of Pain"}],"container-title":["Biometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/biometrics\/article-pdf\/80\/2\/ujae046\/58227807\/ujae046.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biometrics\/article-pdf\/80\/2\/ujae046\/58227807\/ujae046.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T10:47:08Z","timestamp":1718362028000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biometrics\/article\/doi\/10.1093\/biomtc\/ujae046\/7683417"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,27]]},"references-count":23,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,3,27]]}},"URL":"https:\/\/doi.org\/10.1093\/biomtc\/ujae046","relation":{},"ISSN":["0006-341X","1541-0420"],"issn-type":[{"value":"0006-341X","type":"print"},{"value":"1541-0420","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,6]]},"published":{"date-parts":[[2024,3,27]]},"article-number":"ujae046"}}