{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,6]],"date-time":"2026-11-06T20:59:22Z","timestamp":1793998762250,"version":"4.8.0"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T00:00:00Z","timestamp":1604620800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T00:00:00Z","timestamp":1604620800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n              <jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Wearable biometric monitoring devices (BMDs) have the potential to transform the conduct of randomized controlled trials (RCTs) by shifting the collection of outcome data from single measurements at predefined time points to dense continuous measurements.<\/jats:p>\n              <\/jats:sec>\n              <jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Methodological systematic review to understand how recent RCTs used BMDs to measure outcomes and to describe the reporting of these RCTs. Electronic search was performed in the Cochrane Central Register of Controlled Trials, PubMed, and EMBASE and completed a page-by-page hand search in five leading medical journals between January 1, 2018, and December 31, 2018. Three reviewers independently extracted all primary and secondary outcomes collected using BMDs, and assessed (1) the definitions used to summarize BMD outcome data; (2) whether the validity, reliability, and responsiveness of sensors was reported; (3) the discrepancy with outcomes prespecified in public clinical trial registries; and (4) the methods used to manage missing and incomplete BMD outcome data.<\/jats:p>\n              <\/jats:sec>\n              <jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Of the 4562 records screened, 75 RCTs were eligible. Among them, 24% tested a pharmacological intervention and 57% used an inertial measurement sensor to measure physical activity. Included trials involved 464 outcomes (average of 6 [SD\u2009=\u20098] outcomes per trial). In total, 35 trials used a BMD to measure a primary outcome. Several issues affected the value and transparency of trials using BMDs to measure outcomes. First, the definition of outcomes used in the trials was highly heterogeneous (e.g., 21 diabetes trials had 266 outcomes and 153 had different unique definitions to measure diabetes control), which limited the combination and comparison of results. Second, information on the validity, reliability, and responsiveness of sensors used was lacking in 74% of trials. Third, half (53%) of the outcomes measured with BMDs had not been prespecified, with a high risk of outcome reporting bias. Finally, reporting on the management of incomplete outcome data (e.g., due to suboptimal compliance with the BMD) was absent in 68% of RCTs.<\/jats:p>\n              <\/jats:sec>\n              <jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Use of BMDs to measure outcomes is becoming the norm rather than the exception in many fields. Yet, trialists need to account for several methodological issues when specifying and conducting RCTs using these novel tools.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12916-020-01773-w","type":"journal-article","created":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T02:03:05Z","timestamp":1604628185000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["Use of wearable biometric monitoring devices to measure outcomes in randomized clinical trials: a methodological systematic review"],"prefix":"10.1186","volume":"18","author":[{"given":"Carolina","family":"Gra\u00f1a Possamai","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philippe","family":"Ravaud","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lina","family":"Ghosn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1863-6739","authenticated-orcid":false,"given":"Viet-Thi","family":"Tran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,11,6]]},"reference":[{"issue":"5","key":"1773_CR1","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1038\/nbt.3222","volume":"33","author":"E Elenko","year":"2015","unstructured":"Elenko E, Underwood L, Zohar D. Defining digital medicine. Nat Biotechnol. 2015;33(5):456\u201361.","journal-title":"Nat Biotechnol"},{"issue":"1","key":"1773_CR2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1111\/nyas.13117","volume":"1375","author":"B Munos","year":"2016","unstructured":"Munos B, Baker PC, Bot BM, et al. Mobile health: the power of wearables, sensors, and apps to transform clinical trials. Ann N Y Acad Sci. 2016;1375(1):3\u201318.","journal-title":"Ann N Y Acad Sci"},{"issue":"2","key":"1773_CR3","doi-asserted-by":"publisher","first-page":"744","DOI":"10.1111\/biom.12781","volume":"74","author":"J Bai","year":"2018","unstructured":"Bai J, Sun Y, Schrack JA, Crainiceanu CM, Wang MC. A two-stage model for wearable device data. Biometrics. 2018;74(2):744\u201352.","journal-title":"Biometrics"},{"issue":"6","key":"1773_CR4","doi-asserted-by":"publisher","first-page":"631","DOI":"10.1016\/j.jval.2017.09.012","volume":"21","author":"B Byrom","year":"2018","unstructured":"Byrom B, Watson C, Doll H, et al. Selection of and evidentiary considerations for wearable devices and their measurements for use in regulatory decision making: recommendations from the ePRO Consortium. Value Health. 2018;21(6):631\u20139.","journal-title":"Value Health"},{"issue":"1","key":"1773_CR5","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1159\/000486347","volume":"2","author":"B Perry","year":"2018","unstructured":"Perry B, Herrington W, Goldsack JC, et al. Use of mobile devices to measure outcomes in clinical research, 2010-2016: a systematic literature review. Digit Biomarkers. 2018;2(1):11\u201330.","journal-title":"Digit Biomarkers"},{"issue":"6","key":"1773_CR6","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1056\/NEJMoa1805233","volume":"379","author":"L Bally","year":"2018","unstructured":"Bally L, Thabit H, Hartnell S, et al. Closed-loop insulin delivery for glycemic control in noncritical care. N Engl J Med. 2018;379(6):547\u201356.","journal-title":"N Engl J Med"},{"key":"1773_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1200\/CCI.17.00147","volume":"2","author":"SM Cox","year":"2018","unstructured":"Cox SM, Lane A, Volchenboum SL. Use of wearable, mobile, and sensor technology in cancer clinical trials. JCO Clin Cancer Inform. 2018;2:1\u201311.","journal-title":"JCO Clin Cancer Inform"},{"key":"1773_CR8","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1016\/j.trci.2018.04.003","volume":"4","author":"M Gold","year":"2018","unstructured":"Gold M, Amatniek J, Carrillo MC, et al. Digital technologies as biomarkers, clinical outcomes assessment, and recruitment tools in Alzheimer\u2019s disease clinical trials. Alzheimers Dement (New York, N Y). 2018;4:234\u201342.","journal-title":"Alzheimers Dement (New York, N Y)"},{"issue":"1","key":"1773_CR9","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1002\/cpt.1077","volume":"104","author":"B Byrom","year":"2018","unstructured":"Byrom B, McCarthy M, Schueler P, Muehlhausen W. Brain monitoring devices in neuroscience clinical research: the potential of remote monitoring using sensors, wearables, and mobile devices. Clin Pharmacol Ther. 2018;104(1):59\u201371.","journal-title":"Clin Pharmacol Ther"},{"issue":"10","key":"1773_CR10","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1038\/nrd.2017.153","volume":"16","author":"SP Arneric","year":"2017","unstructured":"Arneric SP, Cedarbaum JM, Khozin S, et al. Biometric monitoring devices for assessing end points in clinical trials: developing an ecosystem. Nat Rev Drug Discov. 2017;16(10):736.","journal-title":"Nat Rev Drug Discov"},{"issue":"10","key":"1773_CR11","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1038\/nrd.2016.202","volume":"15","author":"K Kingwell","year":"2016","unstructured":"Kingwell K. FDA eyes new diabetes end points. Nat Rev Drug Discov. 2016;15(10):666\u20137.","journal-title":"Nat Rev Drug Discov"},{"key":"1773_CR12","unstructured":"Food and Drug Administration. Real-world evidence program. Silver Spring: Food and Drug Administration; 2018."},{"issue":"1","key":"1773_CR13","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1002\/cpt.966","volume":"104","author":"ES Izmailova","year":"2018","unstructured":"Izmailova ES, Wagner JA, Perakslis ED. Wearable devices in clinical trials: hype and hypothesis. Clin Pharmacol Ther. 2018;104(1):42\u201352.","journal-title":"Clin Pharmacol Ther"},{"key":"1773_CR14","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.cct.2017.11.002","volume":"64","author":"G Gresham","year":"2018","unstructured":"Gresham G, Schrack J, Gresham LM, et al. Wearable activity monitors in oncology trials: current use of an emerging technology. Contemp Clin Trials. 2018;64:13\u201321.","journal-title":"Contemp Clin Trials"},{"issue":"5","key":"1773_CR15","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0195797","volume":"13","author":"LA Polgreen","year":"2018","unstructured":"Polgreen LA, Anthony C, Carr L, et al. The effect of automated text messaging and goal setting on pedometer adherence and physical activity in patients with diabetes: a randomized controlled trial. PLoS One. 2018;13(5):e0195797.","journal-title":"PLoS One"},{"key":"1773_CR16","first-page":"2529","volume":"2019","author":"T Feng","year":"2019","unstructured":"Feng T, Narayanan S. Imputing missing data in large-scale multivariate biomedical wearable recordings using bidirectional recurrent neural networks with temporal activation regularization. Conf Proc. 2019;2019:2529\u201334.","journal-title":"Conf Proc"},{"issue":"1","key":"1773_CR17","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1186\/s13643-016-0384-4","volume":"5","author":"M Ouzzani","year":"2016","unstructured":"Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210.","journal-title":"Syst Rev"},{"issue":"9","key":"1773_CR18","doi-asserted-by":"publisher","first-page":"852","DOI":"10.1056\/NEJMsa1012065","volume":"364","author":"DA Zarin","year":"2011","unstructured":"Zarin DA, Tse T, Williams RJ, Califf RM, Ide NC. The ClinicalTrials.gov results database--update and key issues. N Engl J Med. 2011;364(9):852\u201360.","journal-title":"N Engl J Med"},{"issue":"9","key":"1773_CR19","doi-asserted-by":"publisher","first-page":"940","DOI":"10.1001\/jama.2015.10516","volume":"314","author":"CD Newgard","year":"2015","unstructured":"Newgard CD, Lewis RJ. Missing data: how to best account for what is not known. JAMA. 2015;314(9):940\u20131.","journal-title":"JAMA"},{"key":"1773_CR20","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1038\/s41746-019-0121-1","volume":"2","author":"JL Hicks","year":"2019","unstructured":"Hicks JL, Althoff T, Sosic R, et al. Best practices for analyzing large-scale health data from wearables and smartphone apps. NPJ Digit Med. 2019;2:45.","journal-title":"NPJ Digit Med"},{"key":"1773_CR21","doi-asserted-by":"publisher","unstructured":"Takahashi H, Nishimura R, Tsujino D, Utsunomiya K. Which is better, high-dose metformin monotherapy or low-dose metformin\/linagliptin combination therapy, in improving glycemic variability in type 2 diabetes patients with insufficient glycemic control despite low-dose metformin monotherapy? A randomized, cross-over, continuous glucose monitoring-based pilot study. J Diabetes Investig. 2019;10(3):714-22. \n                  https:\/\/doi.org\/10.1111\/jdi.12922\n                  \n                . Epub 2018 Oct 9.","DOI":"10.1111\/jdi.12922"},{"key":"1773_CR22","doi-asserted-by":"publisher","unstructured":"Golsteijn RHJ, Bolman C, Volders E, Peels DA, De Vries H, Lechner L. Short-term efficacy of a computer-tailored physical activity intervention for prostate and colorectal cancer patients and survivors: a randomized controlled trial. Int J Behav Nutr Phys Act. 2018;15(1):106. \n                  https:\/\/doi.org\/10.1186\/s12966-018-0734-9\n                  \n                .","DOI":"10.1186\/s12966-018-0734-9"},{"issue":"10155","key":"1773_CR23","doi-asserted-by":"publisher","first-page":"1321","DOI":"10.1016\/S0140-6736(18)31947-0","volume":"392","author":"M Tauschmann","year":"2018","unstructured":"Tauschmann M, Thabit H, Bally L, et al. Closed-loop insulin delivery in suboptimally controlled type 1 diabetes: a multicentre, 12-week randomised trial. Lancet (London, England). 2018;392(10155):1321\u20139.","journal-title":"Lancet (London, England)"},{"issue":"1","key":"1773_CR24","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1111\/jdi.12661","volume":"9","author":"S Takeishi","year":"2018","unstructured":"Takeishi S, Tsuboi H, Takekoshi S. Comparison of morning basal + 1 bolus insulin therapy (insulin glulisine + insulin glargine 300 U\/mL vs insulin lispro + insulin glargine biosimilar) using continuous glucose monitoring: a randomized crossover study. J Diabetes Investig. 2018;9(1):91\u20139.","journal-title":"J Diabetes Investig"},{"issue":"5","key":"1773_CR25","doi-asserted-by":"publisher","first-page":"1306","DOI":"10.1111\/dom.13209","volume":"20","author":"MC Gerards","year":"2018","unstructured":"Gerards MC, Venema GE, Patberg KW, et al. Dapagliflozin for prednisone-induced hyperglycaemia in acute exacerbation of chronic obstructive pulmonary disease. Diabetes Obes Metab. 2018;20(5):1306\u201310.","journal-title":"Diabetes Obes Metab"},{"issue":"1","key":"1773_CR26","doi-asserted-by":"publisher","first-page":"1082","DOI":"10.1186\/s12889-018-5975-7","volume":"18","author":"CJJ Kloek","year":"2018","unstructured":"Kloek CJJ, van Dongen JM, de Bakker DH, Bossen D, Dekker J, Veenhof C. Cost-effectiveness of a blended physiotherapy intervention compared to usual physiotherapy in patients with hip and\/or knee osteoarthritis: a cluster randomized controlled trial. BMC Public Health. 2018;18(1):1082.","journal-title":"BMC Public Health"},{"issue":"1","key":"1773_CR27","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1186\/s12916-018-1083-x","volume":"16","author":"Y Yordanov","year":"2018","unstructured":"Yordanov Y, Dechartres A, Atal I, et al. Avoidable waste of research related to outcome planning and reporting in clinical trials. BMC Med. 2018;16(1):87.","journal-title":"BMC Med"},{"issue":"12","key":"1773_CR28","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0209869","volume":"13","author":"E Gargon","year":"2018","unstructured":"Gargon E, Gorst SL, Harman NL, Smith V, Matvienko-Sikar K, Williamson PR. Choosing important health outcomes for comparative effectiveness research: 4th annual update to a systematic review of core outcome sets for research. PLoS One. 2018;13(12):e0209869.","journal-title":"PLoS One"},{"issue":"10128","key":"1773_CR29","doi-asserted-by":"publisher","first-page":"1367","DOI":"10.1016\/S0140-6736(18)30297-6","volume":"391","author":"L Heinemann","year":"2018","unstructured":"Heinemann L, Freckmann G, Ehrmann D, et al. Real-time continuous glucose monitoring in adults with type 1 diabetes and impaired hypoglycaemia awareness or severe hypoglycaemia treated with multiple daily insulin injections (HypoDE): a multicentre, randomised controlled trial. Lancet (London, England). 2018;391(10128):1367\u201377.","journal-title":"Lancet (London, England)"},{"issue":"1","key":"1773_CR30","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1186\/s13063-017-2364-y","volume":"18","author":"M Byrne","year":"2017","unstructured":"Byrne M, O\u2019Connell A, Egan AM, et al. A core outcomes set for clinical trials of interventions for young adults with type 1 diabetes: an international, multi-perspective Delphi consensus study. Trials. 2017;18(1):602.","journal-title":"Trials"},{"issue":"1","key":"1773_CR31","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1186\/s13063-017-2317-5","volume":"18","author":"NL Harman","year":"2017","unstructured":"Harman NL, James R, Wilding J, Williamson PR. SCORE-IT (Selecting Core Outcomes for Randomised Effectiveness trials In Type 2 diabetes): a systematic review of registered trials. Trials. 2017;18(1):597.","journal-title":"Trials"},{"issue":"9","key":"1773_CR32","doi-asserted-by":"publisher","first-page":"977","DOI":"10.1001\/jama.2009.1242","volume":"302","author":"S Mathieu","year":"2009","unstructured":"Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P. Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009;302(9):977\u201384.","journal-title":"JAMA"},{"key":"1773_CR33","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.jclinepi.2018.08.020","volume":"104","author":"L Calmejane","year":"2018","unstructured":"Calmejane L, Dechartres A, Tran VT, Ravaud P. Making protocols available with the article improved evaluation of selective outcome reporting. J Clin Epidemiol. 2018;104:95\u2013102.","journal-title":"J Clin Epidemiol"},{"issue":"4","key":"1773_CR34","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1093\/annonc\/mdw682","volume":"28","author":"AS Perlmutter","year":"2017","unstructured":"Perlmutter AS, Tran VT, Dechartres A, Ravaud P. Statistical controversies in clinical research: comparison of primary outcomes in protocols, public clinical-trial registries and publications: the example of oncology trials. Ann Oncol. 2017;28(4):688\u201395.","journal-title":"Ann Oncol"},{"issue":"3","key":"1773_CR35","doi-asserted-by":"publisher","first-page":"200","DOI":"10.7326\/0003-4819-158-3-201302050-00583","volume":"158","author":"AW Chan","year":"2013","unstructured":"Chan AW, Tetzlaff JM, Altman DG, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200\u20137.","journal-title":"Ann Intern Med"},{"issue":"5","key":"1773_CR36","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1001\/jama.2017.21903","volume":"319","author":"M Calvert","year":"2018","unstructured":"Calvert M, Kyte D, Mercieca-Bebber R, et al. Guidelines for inclusion of patient-reported outcomes in clinical trial protocols: the SPIRIT-PRO extension. JAMA. 2018;319(5):483\u201394.","journal-title":"JAMA"},{"key":"1773_CR37","doi-asserted-by":"publisher","first-page":"c332","DOI":"10.1136\/bmj.c332","volume":"340","author":"KF Schulz","year":"2010","unstructured":"Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ (Clinical research ed). 2010;340:c332.","journal-title":"BMJ (Clinical research ed)"},{"key":"1773_CR38","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/1471-2288-6-2","volume":"6","author":"LB Mokkink","year":"2006","unstructured":"Mokkink LB, Terwee CB, Knol DL, et al. Protocol of the COSMIN study: COnsensus-based Standards for the selection of health Measurement INstruments. BMC Med Res Methodol. 2006;6:2.","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"1773_CR39","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1001\/jamacardio.2016.4395","volume":"2","author":"MV McConnell","year":"2017","unstructured":"McConnell MV, Shcherbina A, Pavlovic A, et al. Feasibility of obtaining measures of lifestyle from a smartphone app: the MyHeart Counts Cardiovascular Health Study. JAMA Cardiol. 2017;2(1):67\u201376.","journal-title":"JAMA Cardiol"}],"container-title":["BMC Medicine"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-020-01773-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12916-020-01773-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-020-01773-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T02:03:09Z","timestamp":1604628189000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedicine.biomedcentral.com\/articles\/10.1186\/s12916-020-01773-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,6]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["1773"],"URL":"https:\/\/doi.org\/10.1186\/s12916-020-01773-w","relation":{},"ISSN":["1741-7015"],"issn-type":[{"value":"1741-7015","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,6]]},"assertion":[{"value":"18 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 September 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"310"}}