{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T20:26:08Z","timestamp":1772742368160,"version":"3.50.1"},"reference-count":45,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T00:00:00Z","timestamp":1640649600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["1R01AI130460"],"award-info":[{"award-number":["1R01AI130460"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["1R01AG073435"],"award-info":[{"award-number":["1R01AG073435"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["1R56AG074604"],"award-info":[{"award-number":["1R56AG074604"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["1R01LM013519"],"award-info":[{"award-number":["1R01LM013519"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["1R56AG069880"],"award-info":[{"award-number":["1R56AG069880"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["R21CA227613"],"award-info":[{"award-number":["R21CA227613"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["R21CA143242"],"award-info":[{"award-number":["R21CA143242"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["R01CA093772"],"award-info":[{"award-number":["R01CA093772"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["R01CA120562"],"award-info":[{"award-number":["R01CA120562"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["U01CA063731"],"award-info":[{"award-number":["U01CA063731"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Patient-Centered Outcomes Research Institute (PCORI) Project Program Awards","award":["ME-2019C3-18315"],"award-info":[{"award-number":["ME-2019C3-18315"]}]},{"name":"Patient-Centered Outcomes Research Institute (PCORI) Project Program Awards","award":["ME-2018C3-14899"],"award-info":[{"award-number":["ME-2018C3-14899"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,13]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>Electronic health records (EHRs) enable investigation of the association between phenotypes and risk factors. However, studies solely relying on potentially error-prone EHR-derived phenotypes (ie, surrogates) are subject to bias. Analyses of low prevalence phenotypes may also suffer from poor efficiency. Existing methods typically focus on one of these issues but seldom address both. This study aims to simultaneously address both issues by developing new sampling methods to select an optimal subsample to collect gold standard phenotypes for improving the accuracy of association estimation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We develop a surrogate-assisted two-wave (SAT) sampling method, where a surrogate-guided sampling (SGS) procedure and a modified optimal subsampling procedure motivated from A-optimality criterion (OSMAC) are employed sequentially, to select a subsample for outcome validation through manual chart review subject to budget constraints. A model is then fitted based on the subsample with the true phenotypes. Simulation studies and an application to an EHR dataset of breast cancer survivors are conducted to demonstrate the effectiveness of SAT.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We found that the subsample selected with the proposed method contains informative observations that effectively reduce the mean squared error of the resultant estimator of the association.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>The proposed approach can handle the problem brought by the rarity of cases and misclassification of the surrogate in phenotype-absent EHR-based association studies. With a well-behaved surrogate, SAT successfully boosts the case prevalence in the subsample and improves the efficiency of estimation.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab267","type":"journal-article","created":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T21:00:08Z","timestamp":1637701208000},"page":"918-927","source":"Crossref","is-referenced-by-count":8,"title":["SAT: a Surrogate-Assisted Two-wave case boosting sampling method, with application to EHR-based association studies"],"prefix":"10.1093","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6920-5598","authenticated-orcid":false,"given":"Xiaokang","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Biostatistics, Epidemiology and Informatics, The University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jessica","family":"Chubak","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Washington Health Research Institute, Seattle, Washington, USA"},{"name":"Department of Epidemiology, University of Washington, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebecca A","family":"Hubbard","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Epidemiology and Informatics, The University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0835-0788","authenticated-orcid":false,"given":"Yong","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Epidemiology and Informatics, The University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2021,12,28]]},"reference":[{"issue":"23","key":"2022041311583076400_ocab267-B1","doi-asserted-by":"crossref","first-page":"2293","DOI":"10.1056\/NEJMsb1609216","article-title":"Real-world evidence\u2014what is it and what can it tell us","volume":"375","author":"Sherman","year":"2016","journal-title":"N Engl J Med"},{"key":"2022041311583076400_ocab267-B2","year":"2021"},{"issue":"6","key":"2022041311583076400_ocab267-B3","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1038\/nrg3208","article-title":"Mining electronic health records: towards better research applications and clinical care","volume":"13","author":"Jensen","year":"2012","journal-title":"Nat Rev Genet"},{"issue":"9","key":"2022041311583076400_ocab267-B4","doi-asserted-by":"crossref","first-page":"2171","DOI":"10.1111\/j.1572-0241.2008.01890.x","article-title":"Using technology to promote gastrointestinal outcomes research: a case for electronic health records","volume":"103","author":"Atreja","year":"2008","journal-title":"Am J Gastroenterol"},{"issue":"7","key":"2022041311583076400_ocab267-B5","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1002\/ajmg.b.32548","article-title":"The use of electronic health records for psychiatric phenotyping and genomics","volume":"177","author":"Smoller","year":"2018","journal-title":"Am J Med Genet B Neuropsychiatr Genet"},{"issue":"4","key":"2022041311583076400_ocab267-B6","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1016\/j.ajhg.2010.03.003","article-title":"Robust replication of genotype-phenotype associations across multiple diseases in an electronic medical record","volume":"86","author":"Ritchie","year":"2010","journal-title":"Am J Hum Genet"},{"issue":"10","key":"2022041311583076400_ocab267-B7","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1093\/jamia\/ocz084","article-title":"A regression framework to uncover pleiotropy in large-scale electronic health record data","volume":"26","author":"Li","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2022041311583076400_ocab267-B8","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1038\/d41573-019-00180-y","article-title":"How many rare diseases are there?","volume":"19","author":"Haendel","year":"2020","journal-title":"Nat Rev Drug Discov"},{"key":"2022041311583076400_ocab267-B9","year":"2021"},{"issue":"7","key":"2022041311583076400_ocab267-B10","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1038\/ng.859","article-title":"Identification of common variants influencing risk of the tauopathy progressive supranuclear palsy","volume":"43","author":"H\u00f6glinger","year":"2011","journal-title":"Nat Genet"},{"key":"2022041311583076400_ocab267-B11","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1186\/s13024-018-0267-3","article-title":"Replication of progressive supranuclear palsy genome-wide association study identifies SLCO1A2 and DUSP10 as new susceptibility loci","volume":"13","author":"Sanchez-Contreras","year":"2018","journal-title":"Mol Neurodegener"},{"issue":"4","key":"2022041311583076400_ocab267-B12","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1093\/biomet\/86.4.843","article-title":"Bias and efficiency loss due to misclassified responses in binary regression","volume":"86","author":"Neuhaus","year":"1999","journal-title":"Biometrika"},{"key":"2022041311583076400_ocab267-B13","first-page":"1764","article-title":"An empirical study for impacts of measurement errors on EHR based association studies","volume":"2016","author":"Duan","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"issue":"5","key":"2022041311583076400_ocab267-B14","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1093\/oxfordjournals.aje.a112408","article-title":"Bias due to misclassification in the estimation of relative risk","volume":"105","author":"Copeland","year":"1977","journal-title":"Am J Epidemiol"},{"issue":"22","key":"2022041311583076400_ocab267-B15","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1002\/sim.3971","article-title":"Sensitivity analysis for misclassification in logistic regression via likelihood methods and predictive value weighting","volume":"29","author":"Lyles","year":"2010","journal-title":"Stat Med"},{"key":"2022041311583076400_ocab267-B16","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1093\/oxfordjournals.aje.a009251","article-title":"Logistic regression when the outcome is measured with uncertainty","volume":"146","author":"Laurence","year":"1997","journal-title":"Am J Epidemiol"},{"issue":"4","key":"2022041311583076400_ocab267-B17","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1097\/EDE.0b013e3182117c85","article-title":"Validation data-based adjustments for outcome misclassification in logistic regression: an illustration","volume":"22","author":"Lyles","year":"2011","journal-title":"Epidemiology"},{"issue":"2","key":"2022041311583076400_ocab267-B18","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1093\/jamia\/ocz180","article-title":"An augmented estimation procedure for EHR-based association studies accounting for differential misclassification","volume":"27","author":"Tong","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"e2","key":"2022041311583076400_ocab267-B19","doi-asserted-by":"crossref","first-page":"e206","DOI":"10.1136\/amiajnl-2013-002428","article-title":"Electronic health records-driven phenotyping: challenges, recent advances, and perspectives","volume":"20","author":"Pathak","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2022041311583076400_ocab267-B20","year":"2021"},{"issue":"2","key":"2022041311583076400_ocab267-B21","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1136\/amiajnl-2011-000439","article-title":"Use of diverse electronic medical record systems to identify genetic risk for type 2 diabetes within a genome-wide association study","volume":"19","author":"Kho","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"13","key":"2022041311583076400_ocab267-B22","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1161\/CIRCULATIONAHA.112.000604","article-title":"Genome- and phenome-wide analyses of cardiac conduction identifies markers of arrhythmia risk","volume":"127","author":"Ritchie","year":"2013","journal-title":"Circulation"},{"issue":"6","key":"2022041311583076400_ocab267-B23","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1093\/jamia\/ocw028","article-title":"Learning statistical models of phenotypes using noisy labeled training data","volume":"23","author":"Agarwal","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2022041311583076400_ocab267-B24","author":"Weiss","year":"2001"},{"issue":"7","key":"2022041311583076400_ocab267-B25","doi-asserted-by":"crossref","first-page":"e67863","DOI":"10.1371\/journal.pone.0067863","article-title":"The role of balanced training and testing data sets for binary classifiers in bioinformatics","volume":"8","author":"Wei","year":"2013","journal-title":"PLoS One"},{"issue":"1","key":"2022041311583076400_ocab267-B26","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/bib\/bbs006","article-title":"Class-imbalanced classifiers for high-dimensional data","volume":"14","author":"Lin","year":"2013","journal-title":"Brief Bioinform"},{"key":"2022041311583076400_ocab267-B27","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1016\/j.ecolind.2017.10.030","article-title":"A study on the effects of unbalanced data when fitting logistic regression models in ecology","volume":"85","author":"Salas-Eljatib","year":"2018","journal-title":"Ecol Indicators"},{"key":"2022041311583076400_ocab267-B28","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"JAIR"},{"issue":"1","key":"2022041311583076400_ocab267-B29","doi-asserted-by":"crossref","first-page":"79","DOI":"10.32614\/RJ-2014-008","article-title":"ROSE: a package for binary imbalanced learning","volume":"6","author":"Lunardon","year":"2014","journal-title":"R J"},{"key":"2022041311583076400_ocab267-B30","author":"Tan","year":"2019"},{"issue":"5","key":"2022041311583076400_ocab267-B31","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1214\/14-AOS1220","article-title":"Local case-control sampling: efficient subsampling in imbalanced data sets","volume":"42","author":"Fithian","year":"2014","journal-title":"Ann Stat"},{"issue":"522","key":"2022041311583076400_ocab267-B32","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1080\/01621459.2017.1292914","article-title":"Optimal subsampling for large sample logistic regression","volume":"113","author":"Wang","year":"2018","journal-title":"J Am Stat Assoc"},{"issue":"1","key":"2022041311583076400_ocab267-B33","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1080\/10618600.2020.1778483","article-title":"Optimal sampling for generalized linear models under measurement constraints","volume":"30","author":"Zhang","year":"2021","journal-title":"J Comput Graph Stat"},{"issue":"2","key":"2022041311583076400_ocab267-B34","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1007\/s10549-014-2870-5","article-title":"Comparative safety of cardiovascular medication use and breast cancer outcomes among women with early stage breast cancer","volume":"144","author":"Boudreau","year":"2014","journal-title":"Breast Cancer Res Treat"},{"issue":"12","key":"2022041311583076400_ocab267-B35","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1093\/jnci\/djs233","article-title":"Administrative data algorithms to identify second breast cancer events following early-stage invasive breast cancer","volume":"104","author":"Chubak","year":"2012","journal-title":"J Natl Cancer Inst"},{"key":"2022041311583076400_ocab267-B36","article-title":"A cost-effective chart review sampling design to account for phenotyping error in electronic health records (EHR) data","author":"Yin","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"486","key":"2022041311583076400_ocab267-B37","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1198\/jasa.2009.0017","article-title":"Random effects models in a meta-analysis of the accuracy of two diagnostic tests without a gold standard","volume":"104","author":"Chu","year":"2009","journal-title":"J Am Stat Assoc"},{"issue":"2","key":"2022041311583076400_ocab267-B38","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1111\/biom.12264","article-title":"A unification of models for meta-analysis of diagnostic accuracy studies without a gold standard","volume":"71","author":"Liu","year":"2015","journal-title":"Biometrics"},{"issue":"1","key":"2022041311583076400_ocab267-B39","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1093\/jamia\/ocx111","article-title":"Enabling phenotypic big data with PheNorm","volume":"25","author":"Yu","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"2022041311583076400_ocab267-B40","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1093\/jamia\/ocaa079","article-title":"sureLDA: a multidisease automated phenotyping method for the electronic health record","volume":"27","author":"Ahuja","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2022041311583076400_ocab267-B41","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1093\/jamia\/ocv034","article-title":"Toward high-throughput phenotyping: unbiased automated feature extraction and selection from knowledge sources","volume":"22","author":"Yu","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2022041311583076400_ocab267-B42","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1093\/jamia\/ocw028","article-title":"Learning statistical models of phenotypes using noisy labeled training data","volume":"23","author":"Agarwal","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"e1","key":"2022041311583076400_ocab267-B43","doi-asserted-by":"crossref","first-page":"e143","DOI":"10.1093\/jamia\/ocw135","article-title":"Surrogate-assisted feature extraction for high-throughput phenotyping","volume":"24","author":"Yu","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"11","key":"2022041311583076400_ocab267-B44","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1093\/jamia\/ocz066","article-title":"High-throughput multimodal automated phenotyping (MAP) with application to PheWAS","volume":"26","author":"Liao","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"11","key":"2022041311583076400_ocab267-B45","doi-asserted-by":"crossref","first-page":"1675","DOI":"10.1093\/jamia\/ocaa104","article-title":"PheMap: a multi-resource knowledge base for high-throughput phenotyping within electronic health records","volume":"27","author":"Zheng","year":"2020","journal-title":"J Am Med Inform Assoc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/5\/918\/43372401\/ocab267.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/5\/918\/43372401\/ocab267.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,13]],"date-time":"2022-04-13T12:19:02Z","timestamp":1649852342000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/29\/5\/918\/6485152"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,28]]},"references-count":45,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,12,28]]},"published-print":{"date-parts":[[2022,4,13]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab267","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,5,1]]},"published":{"date-parts":[[2021,12,28]]}}}