{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T02:28:12Z","timestamp":1776824892130,"version":"3.51.2"},"reference-count":58,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,7,31]],"date-time":"2020-07-31T00:00:00Z","timestamp":1596153600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,31]],"date-time":"2020-07-31T00:00:00Z","timestamp":1596153600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Clinical trials are a fundamental tool used to evaluate the efficacy and safety of new drugs and medical devices and other health system interventions. The traditional clinical trials system acts as a quality funnel for the development and implementation of new drugs, devices and health system interventions. The concept of a \u201cdigital clinical trial\u201d involves leveraging digital technology to improve participant access, engagement, trial-related measurements, and\/or interventions, enable concealed randomized intervention allocation, and has the potential to transform clinical trials and to lower their cost. In April 2019, the US National Institutes of Health (NIH) and the National Science Foundation (NSF) held a workshop bringing together experts in clinical trials, digital technology, and digital analytics to discuss strategies to implement the use of digital technologies in clinical trials while considering potential challenges. This position paper builds on this workshop to describe the current state of the art for digital clinical trials including (1) defining and outlining the composition and elements of digital trials; (2) describing recruitment and retention using digital technology; (3) outlining data collection elements including mobile health, wearable technologies, application programming interfaces (APIs), digital transmission of data, and consideration of regulatory oversight and guidance for data security, privacy, and remotely provided informed consent; (4) elucidating digital analytics and data science approaches leveraging artificial intelligence and machine learning algorithms; and (5) setting future priorities and strategies that should be addressed to successfully harness digital methods and the myriad benefits of such technologies for clinical research.<\/jats:p>","DOI":"10.1038\/s41746-020-0302-y","type":"journal-article","created":{"date-parts":[[2020,7,31]],"date-time":"2020-07-31T10:05:51Z","timestamp":1596189951000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":295,"title":["Digitizing clinical trials"],"prefix":"10.1038","volume":"3","author":[{"given":"O. T.","family":"Inan","sequence":"first","affiliation":[]},{"given":"P.","family":"Tenaerts","sequence":"additional","affiliation":[]},{"given":"S. A.","family":"Prindiville","sequence":"additional","affiliation":[]},{"given":"H. R.","family":"Reynolds","sequence":"additional","affiliation":[]},{"given":"D. S.","family":"Dizon","sequence":"additional","affiliation":[]},{"given":"K.","family":"Cooper-Arnold","sequence":"additional","affiliation":[]},{"given":"M.","family":"Turakhia","sequence":"additional","affiliation":[]},{"given":"M. J.","family":"Pletcher","sequence":"additional","affiliation":[]},{"given":"K. L.","family":"Preston","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2046-127X","authenticated-orcid":false,"given":"H. M.","family":"Krumholz","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2626-3410","authenticated-orcid":false,"given":"B. M.","family":"Marlin","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9781-0477","authenticated-orcid":false,"given":"K. D.","family":"Mandl","sequence":"additional","affiliation":[]},{"given":"P.","family":"Klasnja","sequence":"additional","affiliation":[]},{"given":"B.","family":"Spring","sequence":"additional","affiliation":[]},{"given":"E.","family":"Iturriaga","sequence":"additional","affiliation":[]},{"given":"R.","family":"Campo","sequence":"additional","affiliation":[]},{"given":"P.","family":"Desvigne-Nickens","sequence":"additional","affiliation":[]},{"given":"Y.","family":"Rosenberg","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9256-7914","authenticated-orcid":false,"given":"S. R.","family":"Steinhubl","sequence":"additional","affiliation":[]},{"given":"R. M.","family":"Califf","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,7,31]]},"reference":[{"key":"302_CR1","doi-asserted-by":"publisher","first-page":"2720","DOI":"10.1001\/jama.291.22.2720","volume":"291","author":"VH Murthy","year":"2004","unstructured":"Murthy, V. H., Krumholz, H. M. & Gross, C. P. Participation in cancer clinical trials: race-, sex-, and age-based disparities. JAMA 291, 2720\u20132726 (2004).","journal-title":"JAMA"},{"key":"302_CR2","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1093\/jnci\/djy221","volume":"111","author":"JM Unger","year":"2019","unstructured":"Unger, J. M., Vaidya, R., Hershman, D. L., Minasian, L. M. & Fleury, M. E. Systematic review and meta-analysis of the magnitude of structural, clinical, and physician and patient barriers to cancer clinical trial participation. J. Natl. Cancer Inst. 111, 245\u2013255 (2019).","journal-title":"J. Natl. Cancer Inst."},{"key":"302_CR3","unstructured":"Anderson, D. Digital R&D: Four Ways to Maximize Patient Engagement in Clinical Trials, Deloitte Consulting LLP. 25 Jun 2018."},{"key":"302_CR4","unstructured":"NIH NHLBI. Digital Clinical Trials Workshop: Creating a Vision for the Future. https:\/\/www.nhlbi.nih.gov\/events\/2019\/digital-clinical-trials-workshop-creating-vision-future. Accessed 10 Jun 2020."},{"key":"302_CR5","unstructured":"National Institutes of Health, National Center for Complementary and Integrative Health. The NIH Collaboratory Launches a New Resource on Methods and Best Practices for Pragmatic Clinical Trials. https:\/\/nccih.nih.gov\/research\/blog\/collaboratory-living-textbook. Accessed 23 Mar 2020."},{"key":"302_CR6","unstructured":"National Institutes of Health, Office of Science Policy. Clinical Trials Policy. https:\/\/osp.od.nih.gov\/clinical-research\/clinical-trials\/. Accessed 16 Aug 2019."},{"key":"302_CR7","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1016\/j.ahj.2013.12.003","volume":"167","author":"MS Lauer","year":"2014","unstructured":"Lauer, M. S. & Bonds, D. Eliminating the \u201cexpensive\u201d adjective for clinical trials. Am. Heart J. 167, 419\u2013420 (2014).","journal-title":"Am. Heart J."},{"key":"302_CR8","unstructured":"US Senate Help Committee, 21st Century Cures Act. US House Energy and Commerce Committee. http:\/\/docs.house.gov\/billsthisweek\/20161128\/CPRT-114-HPRT-RU00-SAHR34.pdf. Accessed 4 Aug 2019."},{"key":"302_CR9","unstructured":"US Food and Drug Administration. Prescription Drug User Fee Act (PDUFA). https:\/\/www.fda.gov\/forindustry\/userfees\/prescriptiondruguserfee\/. Accessed 4 Aug 2019."},{"key":"302_CR10","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1001\/jama.2014.17841","volume":"313","author":"MA Case","year":"2015","unstructured":"Case, M. A., Burwick, H. A., Volpp, K. G. & Patel, M. S. Accuracy of smartphone applications and wearable devices for tracking physical activity data. JAMA 313, 625\u2013626 (2015).","journal-title":"JAMA"},{"key":"302_CR11","doi-asserted-by":"publisher","first-page":"343","DOI":"10.5664\/jcsm.5580","volume":"12","author":"E Toon","year":"2016","unstructured":"Toon, E., Davey, M. J., Hollis, S. L., Nixon, G. M. & Horne, R. S. et al. Comparison of commercial wrist-based and smartphone accelerometers, actigraphy, and PSG in a clinical cohort of children and adolescents. J. Clin. Sleep Med. 12, 343\u2013350 (2016).","journal-title":"J. Clin. Sleep Med."},{"key":"302_CR12","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3390\/jpm7020003","volume":"7","author":"A Shcherbina","year":"2017","unstructured":"Shcherbina, A., Mattsson, C. M., Waggott, D., Salisbury, H. & Christle, J. W. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Pers. Med. 7, 3 (2017).","journal-title":"J. Pers. Med."},{"key":"302_CR13","doi-asserted-by":"publisher","first-page":"1932","DOI":"10.1111\/jan.12400","volume":"70","author":"LG Park","year":"2014","unstructured":"Park, L. G., Howie\u2010Esquivel, J. & Dracup, K. A quantitative systematic review of the efficacy of mobile phone interventions to improve medication adherence. J. Adv. Nurs. 70, 1932\u20131953 (2014).","journal-title":"J. Adv. Nurs."},{"key":"302_CR14","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1002\/ppul.21416","volume":"46","author":"FQ AL\u2010Khalidi","year":"2011","unstructured":"AL\u2010Khalidi, F. Q., Saatchi, R., Burke, D., Elphick, H. & Tan, S. Respiration rate monitoring methods: a review. Pediatr. Pulmonol. 46, 523\u2013529 (2011).","journal-title":"Pediatr. Pulmonol."},{"key":"302_CR15","doi-asserted-by":"crossref","unstructured":"Boulware, D. R, Pullen, M. F., Bangdiwala, A. S., Pastick K. A., Lofgren S. M. et al. A randomized trial of hydroxychloroquine as postexposure prophylaxis for Covid-19. New Eng. J. Med. (2020). https:\/\/www.nejm.org\/doi\/full\/10.1056\/NEJMoa2016638.","DOI":"10.1056\/NEJMoa2016638"},{"key":"302_CR16","doi-asserted-by":"publisher","DOI":"10.1186\/s13063-015-1023-4","volume":"16","author":"T Kennedy-Martin","year":"2015","unstructured":"Kennedy-Martin, T., Curtis, S., Faries, D., Robinson, S. & Johnston, J. A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results. Trials 16, 495 (2015).","journal-title":"Trials"},{"key":"302_CR17","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1016\/j.trci.2018.04.003","volume":"4","author":"M Gold","year":"2018","unstructured":"Gold, M., Amatniek, J., Carrillo, M. C., Cedarbaum, J. M. & Hendrix, J. A. et al. Digital technologies as biomarkers, clinical outcomes assessment, and recruitment tools in Alzheimer\u2019s disease clinical trials. Alzheimer\u2019s Dement. 4, 234\u2013242 (2018).","journal-title":"Alzheimer\u2019s Dement."},{"key":"302_CR18","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1200\/EDBK_243729","volume":"39","author":"RD Nipp","year":"2019","unstructured":"Nipp, R. D., Hong, K. & Paskett, E. D. Overcoming barriers to clinical trial enrollment. Am. Soc. Clin. Oncol. Educ. Book. 39, 105\u2013114 (2019).","journal-title":"Am. Soc. Clin. Oncol. Educ. Book."},{"key":"302_CR19","doi-asserted-by":"publisher","first-page":"3737","DOI":"10.1200\/JCO.2017.73.7916","volume":"35","author":"ES Kim","year":"2017","unstructured":"Kim, E. S., Bruinooge, S. S., Roberts, S., Ison, G. & Lin, N. U. et al. Broadening eligibility criteria to make clinical trials more representative: American Society of Clinical Oncology and Friends of Cancer Research Joint Research Statement. J. Clin. Oncol. 35, 3737 (2017).","journal-title":"J. Clin. Oncol."},{"key":"302_CR20","unstructured":"US Food and Drug Administration (FDA). Use of Electronic Informed Consent Questions and Answers: Guidance for Institutional Review Boards, Investigators, and Sponsors. https:\/\/www.fda.gov\/media\/116850\/download. Accessed 10 Jun 2020."},{"key":"302_CR21","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1200\/CCI.19.00128","volume":"4","author":"KS Gunturu","year":"2020","unstructured":"Gunturu, K. S., Dizon, D. S., Johnson, J., Mercurio, A. M. & Mason, G. et al. Clinical trials in the era of digital engagement: A SWOG call to action. JCO Clin. Cancer Informat. 4, 254\u2013258 (2020).","journal-title":"JCO Clin. Cancer Informat"},{"key":"302_CR22","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/j.conctc.2018.08.001","volume":"11","author":"DB Fogel","year":"2018","unstructured":"Fogel, D. B. Factors associated with clinical trials that fail and opportunities for improving the likelihood of success: a review. Contemp. Clin. Trials Commun. 11, 156\u2013164 (2018).","journal-title":"Contemp. Clin. Trials Commun."},{"key":"302_CR23","doi-asserted-by":"publisher","unstructured":"Liu, P., Astudillo, K., Velez, D., Kelley, L., Cobbs-Lomax, D. et al. Use of mobile health apps in low-income populatoins: a prospective study of facilitators and barriers. medRxiv. (2019) https:\/\/doi.org\/10.1101\/2019.12.22.19015636.","DOI":"10.1101\/2019.12.22.19015636"},{"key":"302_CR24","doi-asserted-by":"crossref","unstructured":"Cohen, L. L., Cousins, L. & Martin, S. Procedural pain distraction. (eds McGrath, P. J., Stevens, B. J., Walker, S. M. & Zempsky, W.) (Oxford Textbook of Paediatric Pain, 2013).","DOI":"10.1093\/med\/9780199642656.003.0053"},{"key":"302_CR25","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1200\/EDBK_100021","volume":"39","author":"B Nazha","year":"2019","unstructured":"Nazha, B., Mishra, M., Pentz, R. & Owonikoko, T. K. Enrollment of racial minorities in clinical trials: old problem assumes new urgency in the age of immunotherapy. Am. Soc. Clin. Oncol. Educ. Book. 39, 3\u201310 (2019).","journal-title":"Am. Soc. Clin. Oncol. Educ. Book."},{"key":"302_CR26","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1097\/ACM.0000000000002027","volume":"93","author":"SE Geller","year":"2018","unstructured":"Geller, S. E., Koch, A. R., Roesch, P., Filut, A. & Hallgren, E. et al. The more things change, the more they stay the same: a study to evaluate compliance with inclusion and assessment of women and minorities in randomized controlled trials. Acad. Med. 93, 630 (2018).","journal-title":"Acad. Med."},{"key":"302_CR27","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1038\/ncpcardio1387","volume":"5","author":"ME Farkouh","year":"2008","unstructured":"Farkouh, M. E. & Fuster, V. Time to welcome the elderly into clinical trials. Nat. Clin. Pract. Cardiovas. Med. 5, 673\u2013673 (2008).","journal-title":"Nat. Clin. Pract. Cardiovas. Med."},{"key":"302_CR28","doi-asserted-by":"publisher","first-page":"184","DOI":"10.4103\/2229-3485.167099","volume":"6","author":"P Shenoy","year":"2015","unstructured":"Shenoy, P. & Harugeri, A. Elderly patients\u2019 participation in clinical trials. Perspect. Clin. Res. 6, 184 (2015).","journal-title":"Perspect. Clin. Res."},{"key":"302_CR29","doi-asserted-by":"crossref","unstructured":"Wagle, N., Painter, C., Krevalin, M., Oh, C. & Anderka, K. et al. The metastatic breast cancer project: a national direct-to-patient initiative to accelerate genomics research. J. Clin. Oncol. 34(8-suppl) (2016).","DOI":"10.1200\/JCO.2016.34.15_suppl.LBA1519"},{"key":"302_CR30","doi-asserted-by":"crossref","unstructured":"Bentley, F., Tollmar, K., Stephenson, P., Levy, L. & Jones, B. et al. Health Mashups: Presenting statistical patterns between wellbeing data and context in natural language to promote behavior change. ACM Trans. Comput.-Human Interaction 20, 1\u201327 (2013).","DOI":"10.1145\/2503823"},{"key":"302_CR31","doi-asserted-by":"crossref","unstructured":"Dhruva, S. S., Ross, J. S., Akar, J. G., Caldwell, B. & Childers, K. et al. Aggregating multiple real-world data sources using a patient-centered health data sharing platform: an 8-week cohort study among patients undergoing bariatric surgery or catheter ablation of atrial fibrillation. medRxiv. 3, 19010348 (2019).","DOI":"10.1101\/19010348"},{"key":"302_CR32","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-019-0090-4","volume":"2","author":"A Coravos","year":"2019","unstructured":"Coravos, A., Khozin, S. & Mandl, K. D. Developing and adopting safe and effective digital biomarkers to improve patient outcomes. NPJ Digital Med. 2, 14 (2019).","journal-title":"NPJ Digital Med."},{"key":"302_CR33","doi-asserted-by":"crossref","unstructured":"Kalali, A., Richerson, S., Ouzunova, E. Westphal, R. & Miller, B. Digital biomarkers in clinical drug development. In Handbook of Behavioral Neuroscience. Vol. 29, 229\u2013238 (Elsevier, 2019).","DOI":"10.1016\/B978-0-12-803161-2.00016-3"},{"key":"302_CR34","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1038\/nature16521","volume":"529","author":"W Gao","year":"2016","unstructured":"Gao, W., Emaminejad, S., Nyein, H. Y. Y., Challa, S. & Chen, K. et al. Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis. Nature 529, 509 (2016).","journal-title":"Nature"},{"key":"302_CR35","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCHEARTFAILURE.117.004313","volume":"11","author":"OT Inan","year":"2018","unstructured":"Inan, O. T., Baran Pouyan, M., Javaid, A. Q., Dowling, S. & Etemadi, M. et al. Novel wearable seismocardiography and machine learning algorithms can assess clinical status of heart failure patients. Circ. Heart Fail. 11, e004313 (2018).","journal-title":"Circ. Heart Fail."},{"key":"302_CR36","doi-asserted-by":"crossref","unstructured":"Whittingslow, D. C., Jeong, H.-K., Ganti, V. G., Kirkpatrick, N. J. & Kogler, G. F. et al. Acoustic emissions as a non-invasive biomarker of the structural health of the knee. Ann. Biomed. Eng. 48, 1\u201311 (2019).","DOI":"10.1007\/s10439-019-02333-x"},{"key":"302_CR37","doi-asserted-by":"publisher","first-page":"876","DOI":"10.1001\/jamaneurol.2018.0809","volume":"75","author":"A Zhan","year":"2018","unstructured":"Zhan, A., Mohan, S., Tarolli, C., Schneider, R. B. & Adams, J. L. et al. Using smartphones and machine learning to quantify Parkinson disease severity: the mobile Parkinson disease score. JAMA Neurol. 75, 876\u2013880 (2018).","journal-title":"JAMA Neurol."},{"key":"302_CR38","doi-asserted-by":"publisher","first-page":"1141","DOI":"10.1089\/neu.2016.4583","volume":"34","author":"M Brogioli","year":"2017","unstructured":"Brogioli, M., Popp, W. L., Schneider, S., Albisser, U. & Brust, A. K. et al. Multi-day recordings of wearable sensors are valid and sensitive measures of function and independence in human spinal cord injury. J. Neurotrauma 34, 1141\u20131148 (2017).","journal-title":"J. Neurotrauma"},{"key":"302_CR39","unstructured":"U.S. Food and Drug Administration. ECG App: Electrocardiograph Software for Over-the-Counter Use. https:\/\/www.accessdata.fda.gov\/cdrh_docs\/pdf18\/DEN180044.pdf. Accessed 10 Jun 2020."},{"key":"302_CR40","unstructured":"U.S. Food and Drug Administration. Irregular Rhythm Notification Feature: Photoplethysmograph Analysis Software for Over-the-Counter Use. https:\/\/www.accessdata.fda.gov\/cdrh_docs\/pdf18\/DEN180042.pdf. Accessed 10 Jun 2020."},{"key":"302_CR41","unstructured":"Clinical Trials Transformation Initiative. CTTI Recommendations: Advancing the Use of Mobile Technologies for Data Capture & Improved Clinical Trials. https:\/\/www.ctti-clinicaltrials.org\/sites\/www.ctti-clinicaltrials.org\/files\/mobile-devices-recommendations.pdf#Pg7Ln5. Accessed 5 Feb 2020."},{"key":"302_CR42","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.drugalcdep.2013.09.007","volume":"134","author":"DH Epstein","year":"2014","unstructured":"Epstein, D. H., Tyburski, M., Craig, I. M., Phillips, K. A. & Jobes, M. L. et al. Real-time tracking of neighborhood surroundings and mood in urban drug misusers: application of a new method to study behavior in its geographical context. Drug alcohol Depend. 134, 22\u201329 (2014).","journal-title":"Drug alcohol Depend."},{"key":"302_CR43","unstructured":"US Food and Drug Administration (FDA). The FDA\u2019s Role in Medical Device Cybersecurity. https:\/\/www.fda.gov\/media\/123052\/download. Accessed 10 Jun 2020."},{"key":"302_CR44","unstructured":"Interstate Medical Licensure Compact. https:\/\/www.imlcc.org\/. Accessed 10 Jun 2020."},{"key":"302_CR45","doi-asserted-by":"publisher","first-page":"1905","DOI":"10.1056\/NEJMp1700235","volume":"376","author":"KD Mandl","year":"2017","unstructured":"Mandl, K. D. & Kohane, I. S. A 21st-Century Health IT System-creating a real-world information economy. N. Engl. J. Med. 376, 1905\u20131907 (2017).","journal-title":"N. Engl. J. Med."},{"key":"302_CR46","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.cels.2015.05.001","volume":"1","author":"KD Mandl","year":"2015","unstructured":"Mandl, K. D., Mandel, J. C. & Kohane, I. S. Driving innovation in health systems through an apps-based information economy. Cell Syst. 1, 8\u201313 (2015).","journal-title":"Cell Syst."},{"key":"302_CR47","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1093\/jamia\/ocv189","volume":"23","author":"JC Mandel","year":"2016","unstructured":"Mandel, J. C., Kreda, D. A., Mandl, K. D., Kohane, I. S. & Ramoni, R. B. et al. SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J. Am. Med. Inform. Assoc. 23, 899\u2013908 (2016).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"302_CR48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-020-0218-6","volume":"3","author":"R Sayeed","year":"2020","unstructured":"Sayeed, R., Gottlieb, D. & Mandl, K. D. SMART Markers: collecting patient-generated health data as a standardized property of health information technology. npj Digital Med. 3, 1\u20138 (2020).","journal-title":"npj Digital Med."},{"key":"302_CR49","unstructured":"Meeting to Advance Push Button Population Health. SMART\/HL7 Bulk Data Export\/FLAT FHIR. http:\/\/smarthealthit.org\/wp-content\/uploads\/SMART-2019_FHIR-Bulk-Data-Meeting_final.pdf. Accessed 7 Feb 2020."},{"key":"302_CR50","unstructured":"Duke University. Duke University Margolis Center for Health Policy, Determining Real-World Data\u2019s Fitness for Use and the Role of Reliability. https:\/\/healthpolicy.duke.edu\/sites\/default\/files\/u31\/rwd_reliability.pdf. Accessed 7 Feb 2020."},{"key":"302_CR51","unstructured":"OHDSI. Observational Health Data Sciences and Informatics OMOP Common Data Model. https:\/\/www.ohdsi.org\/data-standardization\/the-common-data-model\/. Accessed 25 Mar 2020."},{"key":"302_CR52","unstructured":"pcornet: The National Patient-Centered Clinical Research Network. Real-World Data. https:\/\/pcornet.org\/data-driven-common-model\/. Accessed 25 Mar 2020."},{"key":"302_CR53","doi-asserted-by":"crossref","unstructured":"Rabbi, M., Klasnja. P., Choudhury, T., Tewari, A. & Murphy, S. Optimizing mHealth interventions with a bandit. Digital Phenotyping and Mobile Sensing. 277\u2013291 (Springer, 2019).","DOI":"10.1007\/978-3-030-31620-4_18"},{"key":"302_CR54","doi-asserted-by":"publisher","first-page":"825","DOI":"10.1016\/j.amepre.2016.06.013","volume":"51","author":"EB Hekler","year":"2016","unstructured":"Hekler, E. B., Michie, S., Pavel, M., Rivera, D. E. & Collins, L. M. et al. Advancing models and theories for digital behavior change interventions. Am. J. Prevent. Med. 51, 825\u2013832 (2016).","journal-title":"Am. J. Prevent. Med."},{"key":"302_CR55","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1002\/da.22646","volume":"34","author":"MH Aung","year":"2017","unstructured":"Aung, M. H., Matthews, M. & Choudhury, T. Sensing behavioral symptoms of mental health and delivering personalized interventions using mobile technologies. Depression Anxiety 34, 603\u2013609 (2017).","journal-title":"Depression Anxiety"},{"key":"302_CR56","doi-asserted-by":"publisher","first-page":"1220","DOI":"10.1037\/hea0000305","volume":"34","author":"P Klasnja","year":"2015","unstructured":"Klasnja, P., Hekler, E. B., Shiffman, S., Boruvka, A. & Almirall, D. et al. Microrandomized trials: an experimental design for developing just-in-time adaptive interventions. Health Psychol. 34, 1220 (2015).","journal-title":"Health Psychol."},{"key":"302_CR57","doi-asserted-by":"publisher","first-page":"1944","DOI":"10.1002\/sim.6847","volume":"35","author":"P Liao","year":"2016","unstructured":"Liao, P., Klasnja, P., Tewari, A. & Murphy, S. A. Sample size calculations for micro\u2010randomized trials in mHealth. Stat. Med. 35, 1944\u20131971 (2016).","journal-title":"Stat. Med."},{"key":"302_CR58","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3381007","volume":"4","author":"P Liao","year":"2020","unstructured":"Liao, P., Greenewald, K., Klasnja, P. & Murphy, S. Personalized heartsteps: a reinforcement learning algorithm for optimizing physical activity. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 1\u201322 (2020).","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0302-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0302-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0302-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T02:27:06Z","timestamp":1670380026000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0302-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,31]]},"references-count":58,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["302"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-0302-y","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,31]]},"assertion":[{"value":"15 April 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 July 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"M.T. reports grants from Janssen Inc, personal fees from Medtronic Inc, grants from AstraZeneca, other from AliveCor, personal fees from Abbott, grants from Boehringer Ingelheim, personal fees from Precision Health Economics, personal fees from iBeat Inc, grants and personal fees from Cardiva Medical, personal fees from iRhythm, grants from Bristol Myers Squibb, grants from American Heart Association, grants from SentreHeart, personal fees from Novartis, personal fees from Biotronik, personal fees from Sanofi-Aventis, personal fees from Pfizer, grants from Apple, outside the submitted work; and Dr. M.T. is an editor for <i>JAMA Cardiology<\/i>. B. Spring is on the Scientific Advisory Board for Actigraph. O.T.I. is a Scientific Advisor for Physiowave, Inc. and a Co-Founder and Scientific Advisor for Cardiosense, has research funding for his lab from Hill-Rom Services, Inc. and Murata Americas, and has IP licensed by Physiowave, TandemLaunch, and Cardiosense. Dr. K.D.M.\u2019s research lab receives philanthropic support from Eli Lily and he has consulted on using real world evidence for Merck. M.J.P. is supported by the NIH to develop and maintain a research platform to support digital trials and mHealth data collection. S.R.S. has served as a medical advisor for Janssen, Otsuka, Livongo, DynoSense, BioSense, and Spry Health. H.R. has received donations of OCT catheters for a research study from Abbott Vascular and telemetry monitors from BioTelemetry, Inc. Dr. Krumholz works under contract with the Centers for Medicare & Medicaid Services to support quality measurement programs; was a recipient of a research grant, through Yale, from Medtronic and the Food and Drug Administration to develop methods for post-market surveillance of medical devices; was a recipient of a research grant with Medtronic and is the recipient of a research grant from Johnson & Johnson, through Yale University, to support clinical trial data sharing; was a recipient of a research agreement, through Yale University, from the Shenzhen Center for Health Information for work to advance intelligent disease prevention and health promotion; collaborates with the National Center for Cardiovascular Diseases in Beijing; receives payment from the Arnold & Porter Law Firm for work related to the Sanofi clopidogrel litigation, from the Martin\/Baughman Law Firm for work related to the Cook Celect IVC filter litigation, and from the Siegfried and Jensen Law Firm for work related to Vioxx litigation; chairs a Cardiac Scientific Advisory Board for UnitedHealth; was a participant\/participant representative of the IBM Watson Health Life Sciences Board; is a member of the Advisory Board for Element Science, the Advisory Board for Facebook, and the Physician Advisory Board for Aetna; and is the co-founder of HugoHealth, a personal health information platform, and co-founder of Refactor Health, an enterprise healthcare AI-augmented data management company.R.C. reports employment with Verily Life Sciences and Google Health, board membership at Cytokinetics, and status of former commissioner of the US FDA.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"101"}}