{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T00:11:30Z","timestamp":1782259890088,"version":"3.54.5"},"reference-count":20,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2019,9,25]],"date-time":"2019-09-25T00:00:00Z","timestamp":1569369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000062","name":"National Institute of Diabetes and Digestive and Kidney Diseases","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000062","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Electronic health records (EHR) data have become a central data source for clinical research. One concern for using EHR data is that the process through which individuals engage with the health system, and find themselves within EHR data, can be informative. We have termed this process informed presence. In this study we use simulation and real data to assess how the informed presence can impact inference.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We first simulated a visit process where a series of biomarkers were observed informatively and uninformatively over time. We further compared inference derived from a randomized control trial (ie, uninformative visits) and EHR data (ie, potentially informative visits).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We find that only when there is both a strong association between the biomarker and the outcome as well as the biomarker and the visit process is there bias. Moreover, once there are some uninformative visits this bias is mitigated. In the data example we find, that when the \u201ctrue\u201d associations are null, there is no observed bias.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>These results suggest that an informative visit process can exaggerate an association but cannot induce one. Furthermore, careful study design can, mitigate the potential bias when some noninformative visits are included.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>While there are legitimate concerns regarding biases that \u201cmessy\u201d EHR data may induce, the conditions for such biases are extreme and can be accounted for.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocz148","type":"journal-article","created":{"date-parts":[[2019,7,24]],"date-time":"2019-07-24T11:25:23Z","timestamp":1563967523000},"page":"1609-1617","source":"Crossref","is-referenced-by-count":39,"title":["How and when informative visit processes can bias inference when using electronic health records data for clinical research"],"prefix":"10.1093","volume":"26","author":[{"given":"Benjamin A","family":"Goldstein","sequence":"first","affiliation":[{"name":"Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina, USA"},{"name":"Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Phelan","sequence":"additional","affiliation":[{"name":"Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neha J","family":"Pagidipati","sequence":"additional","affiliation":[{"name":"Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina, USA"},{"name":"Department of Medicine, Duke University, Durham, North Carolina, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah B","family":"Peskoe","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2019,9,25]]},"reference":[{"key":"2020110612592143600_ocz148-B1","doi-asserted-by":"crossref","first-page":"S30","DOI":"10.1097\/MLR.0b013e31829b1dbd","article-title":"Caveats for the use of operational electronic health record data in comparative effectiveness research","volume":"51 (8 Suppl 3)","author":"Hersh","year":"2013","journal-title":"Med Care"},{"issue":"11","key":"2020110612592143600_ocz148-B2","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1093\/aje\/kww112","article-title":"Controlling for informed presence bias due to the number of health encounters in an electronic health record","volume":"184","author":"Goldstein","year":"2016","journal-title":"Am J Epidemiol"},{"issue":"1","key":"2020110612592143600_ocz148-B3","first-page":"22.","article-title":"Illustrating informed presence bias in electronic health records data: how patient interactions with a health system can impact inference","volume":"5","author":"Phelan","year":"2017","journal-title":"EGEMS (Wash DC)"},{"key":"2020110612592143600_ocz148-B4","first-page":"1472","article-title":"Sick patients have more data: the non-random completeness of electronic health records","volume":"2013","author":"Weiskopf","year":"2013","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"2020110612592143600_ocz148-B5","first-page":"1203.","article-title":"A general framework for considering selection bias in EHR-based studies: what data are observed and why?","volume":"4","author":"Haneuse","year":"2016","journal-title":"EGEMS (Wash DC)"},{"issue":"3","key":"2020110612592143600_ocz148-B6","first-page":"1035.","article-title":"Strategies for handling missing data in electronic health record derived data","volume":"1","author":"Wells","year":"2013","journal-title":"EGEMS (Wash DC)"},{"issue":"4","key":"2020110612592143600_ocz148-B7","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1111\/biom.12501","article-title":"Biased and unbiased estimation in longitudinal studies with informative visit processes","volume":"72","author":"McCulloch","year":"2016","journal-title":"Biometrics"},{"issue":"29","key":"2020110612592143600_ocz148-B8","doi-asserted-by":"crossref","first-page":"4457","DOI":"10.1002\/sim.7932","article-title":"Analysis of longitudinal data from outcome-dependent visit processes: failure of proposed methods in realistic settings and potential improvements","volume":"37","author":"Neuhaus","year":"2018","journal-title":"Stat Med"},{"key":"2020110612592143600_ocz148-B9","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3294-8","volume-title":"Modeling Survival Data: Extending the Cox Model","author":"Therneau","year":"2000"},{"issue":"4","key":"2020110612592143600_ocz148-B10","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1016\/j.ahj.2008.05.017","article-title":"Prevention of diabetes and cardiovascular disease in patients with impaired glucose tolerance: rationale and design of the Nateglinide And Valsartan in Impaired Glucose Tolerance Outcomes Research (NAVIGATOR) trial","volume":"156","author":"Califf","year":"2008","journal-title":"Am Heart J"},{"issue":"9","key":"2020110612592143600_ocz148-B11","doi-asserted-by":"crossref","first-page":"1608","DOI":"10.1377\/hlthaff.2012.1199","article-title":"Geographic health information systems: a platform to support the \u201ctriple aim\u201d","volume":"32","author":"Miranda","year":"2013","journal-title":"Health Aff (Millwood)"},{"issue":"e1","key":"2020110612592143600_ocz148-B12","doi-asserted-by":"crossref","first-page":"e121","DOI":"10.1093\/jamia\/ocw123","article-title":"Assessing electronic health record phenotypes against gold-standard diagnostic criteria for diabetes mellitus","volume":"24","author":"Spratt","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2020110612592143600_ocz148-B13","doi-asserted-by":"crossref","first-page":"463","DOI":"10.4338\/ACI-2013-12-RA-0105","article-title":"A distribution-based method for assessing the differences between clinical trial target populations and patient populations in electronic health records","volume":"5","author":"Weng","year":"2014","journal-title":"Appl Clin Inform"},{"issue":"5","key":"2020110612592143600_ocz148-B14","first-page":"510","article-title":"Varied forms of bias due to nondifferential error in measuring exposure","volume":"5","author":"Brenner","year":"1994","journal-title":"Epidemiology"},{"issue":"8","key":"2020110612592143600_ocz148-B15","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1136\/oem.52.8.557","article-title":"Non-differential misclassification and bias towards the null: a clarification","volume":"52","author":"Wacholder","year":"1995","journal-title":"Occup Environ Med"},{"issue":"17","key":"2020110612592143600_ocz148-B16","doi-asserted-by":"crossref","first-page":"2750","DOI":"10.1002\/sim.7308","article-title":"A comparison of risk prediction methods using repeated observations: an application to electronic health records for hemodialysis","volume":"36","author":"Goldstein","year":"2017","journal-title":"Stat Med"},{"key":"2020110612592143600_ocz148-B17","author":"Gasparini"},{"issue":"3","key":"2020110612592143600_ocz148-B18","doi-asserted-by":"crossref","first-page":"939","DOI":"10.2307\/2531694","article-title":"Estimation and comparison of changes in the presence of informative right censoring: conditional linear model","volume":"45","author":"Wu","year":"1989","journal-title":"Biometrics"},{"issue":"1","key":"2020110612592143600_ocz148-B19","doi-asserted-by":"crossref","first-page":"133.","DOI":"10.1186\/s12874-017-0418-1","article-title":"Longitudinal studies that use data collected as part of usual care risk reporting biased results: a systematic review","volume":"17","author":"Farzanfar","year":"2017","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"2020110612592143600_ocz148-B20","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1177\/0962280208092345","article-title":"Observation plans in longitudinal studies with time-varying treatments","volume":"18","author":"Hern\u00e1n","year":"2009","journal-title":"Stat Methods Med Res"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/12\/1609\/34152153\/ocz148.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/12\/1609\/34152153\/ocz148.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T18:37:11Z","timestamp":1604687831000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/12\/1609\/5573796"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,25]]},"references-count":20,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2019,9,25]]},"published-print":{"date-parts":[[2019,12,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz148","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,12]]},"published":{"date-parts":[[2019,9,25]]}}}