{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T08:43:00Z","timestamp":1784623380105,"version":"3.55.0"},"reference-count":92,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,17]],"date-time":"2020-02-17T00:00:00Z","timestamp":1581897600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,17]],"date-time":"2020-02-17T00:00:00Z","timestamp":1581897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000025","name":"U.S. Department of Health & Human Services | NIH | National Institute of Mental Health","doi-asserted-by":"publisher","award":["MH100466"],"award-info":[{"award-number":["MH100466"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000867","name":"Robert Wood Johnson Foundation","doi-asserted-by":"publisher","award":["73205"],"award-info":[{"award-number":["73205"]}],"id":[{"id":"10.13039\/100000867","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000867","name":"Robert Wood Johnson Foundation","doi-asserted-by":"publisher","award":["73205"],"award-info":[{"award-number":["73205"]}],"id":[{"id":"10.13039\/100000867","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000867","name":"Robert Wood Johnson Foundation","doi-asserted-by":"publisher","award":["73205"],"award-info":[{"award-number":["73205"]}],"id":[{"id":"10.13039\/100000867","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000867","name":"Robert Wood Johnson Foundation","doi-asserted-by":"publisher","award":["73205"],"award-info":[{"award-number":["73205"]}],"id":[{"id":"10.13039\/100000867","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000867","name":"Robert Wood Johnson Foundation","doi-asserted-by":"publisher","award":["73205"],"award-info":[{"award-number":["73205"]}],"id":[{"id":"10.13039\/100000867","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000867","name":"Robert Wood Johnson Foundation","doi-asserted-by":"publisher","award":["73205"],"award-info":[{"award-number":["73205"]}],"id":[{"id":"10.13039\/100000867","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000867","name":"Robert Wood Johnson Foundation","doi-asserted-by":"publisher","award":["73205"],"award-info":[{"award-number":["73205"]}],"id":[{"id":"10.13039\/100000867","id-type":"DOI","asserted-by":"publisher"}]},{"name":"American Sleep Apnea Foundation, Washington, DC"},{"DOI":"10.13039\/100006108","name":"U.S. Department of Health & Human Services | NIH | National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["1UL1TR002319-01"],"award-info":[{"award-number":["1UL1TR002319-01"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Digital technologies such as smartphones are transforming the way scientists conduct biomedical research. Several remotely conducted studies have recruited thousands of participants over a span of a few months allowing researchers to collect real-world data at scale and at a fraction of the cost of traditional research. Unfortunately, remote studies have been hampered by substantial participant attrition, calling into question the representativeness of the collected data including generalizability of outcomes. We report the findings regarding recruitment and retention from eight remote digital health studies conducted between 2014\u20132019 that provided individual-level study-app usage data from more than 100,000 participants completing nearly 3.5 million remote health evaluations over cumulative participation of 850,000 days. Median participant retention across eight studies varied widely from 2\u201326 days (median across all studies\u2009=\u20095.5 days). Survival analysis revealed several factors significantly associated with increase in participant retention time, including (i) referral by a clinician to the study (increase of 40 days in median retention time); (ii) compensation for participation (increase of 22 days, 1 study); (iii) having the clinical condition of interest in the study (increase of 7 days compared with controls); and (iv) older age (increase of 4 days). Additionally, four distinct patterns of daily app usage behavior were identified by unsupervised clustering, which were also associated with participant demographics. Most studies were not able to recruit a sample that was representative of the race\/ethnicity or geographical diversity of the US. Together these findings can help inform recruitment and retention strategies to enable equitable participation of populations in future digital health research.<\/jats:p>","DOI":"10.1038\/s41746-020-0224-8","type":"journal-article","created":{"date-parts":[[2020,2,17]],"date-time":"2020-02-17T11:07:02Z","timestamp":1581937622000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":421,"title":["Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants"],"prefix":"10.1038","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5289-6932","authenticated-orcid":false,"given":"Abhishek","family":"Pratap","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elias Chaibub","family":"Neto","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Phil","family":"Snyder","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carl","family":"Stepnowsky","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"No\u00e9mie","family":"Elhadad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Grant","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew H.","family":"Mohebbi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"Mooney","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christine","family":"Suver","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Wilbanks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lara","family":"Mangravite","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick J.","family":"Heagerty","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pat","family":"Are\u00e1n","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4719-9120","authenticated-orcid":false,"given":"Larsson","family":"Omberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,2,17]]},"reference":[{"key":"224_CR1","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/j.conctc.2018.08.001","volume":"11","author":"DB Fogel","year":"2018","unstructured":"Fogel, D. B. Factors associated with clinical trials that fail and opportunities for improving the likelihood of success: a review. Contemp. Clin. Trials Commun. 11, 156\u2013164 (2018).","journal-title":"Contemp. Clin. Trials Commun."},{"key":"224_CR2","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.jclinepi.2016.07.016","volume":"80","author":"M Briel","year":"2016","unstructured":"Briel, M. et al. A systematic review of discontinued trials suggested that most reasons for recruitment failure were preventable. J. Clin. Epidemiol. 80, 8\u201315 (2016).","journal-title":"J. Clin. Epidemiol."},{"key":"224_CR3","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1136\/jnnp.2002.002576","volume":"75","author":"J Bradshaw","year":"2004","unstructured":"Bradshaw, J., Saling, M., Hopwood, M., Anderson, V. & Brodtmann, A. Fluctuating cognition in dementia with Lewy bodies and Alzheimer\u2019s disease is qualitatively distinct. J. Neurol. Neurosurg. Psychiatry 75, 382\u2013387 (2004).","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"224_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/s2589-7500(19)30109-8","author":"M Snyder","year":"2019","unstructured":"Snyder, M. & Zhou, W. Big data and health. Lancet Digital Health. https:\/\/doi.org\/10.1016\/s2589-7500(19)30109-8 (2019).","journal-title":"Lancet Digital Health"},{"key":"224_CR5","doi-asserted-by":"publisher","first-page":"956","DOI":"10.1056\/NEJMra1806949","volume":"381","author":"I Sim","year":"2019","unstructured":"Sim, I. Mobile devices and health. N. Engl. J. Med. 381, 956\u2013968 (2019).","journal-title":"N. Engl. J. Med."},{"key":"224_CR6","doi-asserted-by":"publisher","first-page":"283rv3","DOI":"10.1126\/scitranslmed.aaa3487","volume":"7","author":"SR Steinhubl","year":"2015","unstructured":"Steinhubl, S. R., Muse, E. D. & Topol, E. J. The emerging field of mobile health. Sci. Transl. Med. 7, 283rv3 (2015).","journal-title":"Sci. Transl. Med."},{"key":"224_CR7","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.1389","author":"MK ElZarrad","year":"2019","unstructured":"ElZarrad, M. K., Khair ElZarrad, M. & Corrigan-Curay, J. The US Food and Drug Administration\u2019s Real\u2010World Evidence Framework: A Commitment for Engagement and Transparency on Real-World Evidence. Clin. Pharmacol. Therapeutics. https:\/\/doi.org\/10.1002\/cpt.1389 (2019).","journal-title":"Clin. Pharmacol. Therapeutics"},{"key":"224_CR8","doi-asserted-by":"publisher","DOI":"10.1038\/d41591-019-00008-7","author":"M May","year":"2019","unstructured":"May, M. Clinical trial costs go under the microscope. Nat. Med. https:\/\/doi.org\/10.1038\/d41591-019-00008-7 (2019).","journal-title":"Nat. Med."},{"key":"224_CR9","unstructured":"Smartphone Ownership Is Growing Rapidly Around the World, but Not Always Equally. Pew Research Center\u2019s Global Attitudes Project. https:\/\/www.pewresearch.org\/global\/2019\/02\/05\/smartphone-ownership-is-growing-rapidly-around-the-world-but-not-always-equally\/ (2019)."},{"key":"224_CR10","unstructured":"Turner, B. A. Smartphone Addiction & Cell Phone Usage Statistics in 2018. BankMyCell. https:\/\/www.bankmycell.com\/blog\/smartphone-addiction\/ (2018)."},{"key":"224_CR11","unstructured":"Global time spent on social media daily 2018 | Statista. Statista. https:\/\/www.statista.com\/statistics\/433871\/daily-social-media-usage-worldwide\/."},{"key":"224_CR12","doi-asserted-by":"publisher","first-page":"20175","DOI":"10.1038\/s41746-017-0005-1","volume":"1","author":"SR Steinhubl","year":"2018","unstructured":"Steinhubl, S. R. & Topol, E. J. Digital medicine, on its way to being just plain medicine. npj Digit Med. 1, 20175 (2018).","journal-title":"npj Digit Med."},{"key":"224_CR13","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1159\/000486347","volume":"2","author":"B Perry","year":"2018","unstructured":"Perry, B. et al. Use of mobile devices to measure outcomes in clinical research, 2010\u20132016: a systematic literature review. Digit Biomark. 2, 11\u201330 (2018).","journal-title":"Digit Biomark."},{"key":"224_CR14","doi-asserted-by":"publisher","unstructured":"Trister, A., Dorsey, E. & Friend, S. Smartphones as new tools in the management and understanding of Parkinson\u2019s disease. npj Parkinson\u2019s Dis. 2, 16006 (2016). https:\/\/doi.org\/10.1038\/npjparkd.2016.6.","DOI":"10.1038\/npjparkd.2016.6"},{"key":"224_CR15","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1097\/ACM.0000000000001205","volume":"92","author":"ER Dorsey","year":"2017","unstructured":"Dorsey, E. R. et al. The use of smartphones for health research. Acad. Med. 92, 157\u2013160 (2017).","journal-title":"Acad. Med."},{"key":"224_CR16","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.11","volume":"3","author":"BM Bot","year":"2016","unstructured":"Bot, B. M. et al. The mPower study, Parkinson disease mobile data collected using ResearchKit. Sci. Data 3, 160011 (2016).","journal-title":"Sci. Data"},{"key":"224_CR17","doi-asserted-by":"publisher","unstructured":"Webster, D., Suver, C., Doerr, M. et al. The Mole Mapper Study, mobile phone skin imaging and melanoma risk data collected using ResearchKit. Sci. Data 4, 170005 (2017). https:\/\/doi.org\/10.1038\/sdata.2017.5.","DOI":"10.1038\/sdata.2017.5"},{"key":"224_CR18","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.9656","volume":"6","author":"M Crouthamel","year":"2018","unstructured":"Crouthamel, M. et al. Using a ResearchKit smartphone app to collect rheumatoid arthritis symptoms from real-world participants: feasibility study. JMIR mHealth uHealth 6, e177 (2018).","journal-title":"JMIR mHealth uHealth"},{"key":"224_CR19","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1001\/jamacardio.2016.4395","volume":"2","author":"MV McConnell","year":"2017","unstructured":"McConnell, M. V. et al. Feasibility of obtaining measures of lifestyle from a Smartphone App: the MyHeart Counts Cardiovascular Health Study. JAMA Cardiol. 2, 67\u201376 (2017).","journal-title":"JAMA Cardiol."},{"key":"224_CR20","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1038\/nbt.3826","volume":"35","author":"Y-FY Chan","year":"2017","unstructured":"Chan, Y.-F. Y. et al. The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit. Nat. Biotechnol. 35, 354\u2013362 (2017).","journal-title":"Nat. Biotechnol."},{"key":"224_CR21","doi-asserted-by":"crossref","unstructured":"McKillop, M., Mamykina, L. & Elhadad, N. Designing in the Dark: Eliciting Self-tracking Dimensions for Understanding Enigmatic Disease. in Proc 2018 CHI Conference on Human Factors in Computing Systems - CHI \u201918 1\u201315 (ACM Press, 2018).","DOI":"10.1145\/3173574.3174139"},{"key":"224_CR22","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0215468","volume":"14","author":"J Waalen","year":"2019","unstructured":"Waalen, J. et al. Real world usage characteristics of a novel mobile health self-monitoring device: results from the Scanadu Consumer Health Outcomes (SCOUT) Study. PLoS ONE 14, e0215468 (2019).","journal-title":"PLoS ONE"},{"key":"224_CR23","doi-asserted-by":"publisher","DOI":"10.2196\/10130","volume":"20","author":"A Pratap","year":"2018","unstructured":"Pratap, A. et al. Using mobile apps to assess and treat depression in Hispanic and Latino Populations: fully remote randomized clinical trial. J. Med. Internet Res. 20, e10130 (2018).","journal-title":"J. Med. Internet Res."},{"key":"224_CR24","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1136\/bmjinnov-2015-000098","volume":"2","author":"JA Anguera","year":"2016","unstructured":"Anguera, J. A., Jordan, J. T., Castaneda, D., Gazzaley, A. & Are\u00e1n, P. A. Conducting a fully mobile and randomised clinical trial for depression: access, engagement and expense. BMJ Innov. 2, 14\u201321 (2016).","journal-title":"BMJ Innov."},{"key":"224_CR25","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1038\/nbt0718-561","volume":"36","author":"E Smalley","year":"2018","unstructured":"Smalley, E. Clinical trials go virtual, big pharma dives in. Nat. Biotechnol. 36, 561\u2013562 (2018).","journal-title":"Nat. Biotechnol."},{"key":"224_CR26","unstructured":"Virtual Clinical Trials Challenges and Opportunities: Proceedings of a Workshop: Health and Medicine Division. (2019). http:\/\/www.nationalacademies.org\/hmd\/Reports\/2019\/virtual-clinical-trials-challenges-and-opportunities-pw.aspx."},{"key":"224_CR27","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.cct.2014.04.009","volume":"38","author":"M Orri","year":"2014","unstructured":"Orri, M., Lipset, C. H., Jacobs, B. P., Costello, A. J. & Cummings, S. R. Web-based trial to evaluate the efficacy and safety of tolterodine ER 4 mg in participants with overactive bladder: REMOTE trial. Contemp. Clin. Trials 38, 190\u2013197 (2014).","journal-title":"Contemp. Clin. Trials"},{"key":"224_CR28","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7014","volume":"5","author":"S Moore","year":"2017","unstructured":"Moore, S. et al. Consent processes for mobile app mediated research: systematic review. JMIR Mhealth Uhealth 5, e126 (2017).","journal-title":"JMIR Mhealth Uhealth"},{"key":"224_CR29","doi-asserted-by":"publisher","first-page":"211","DOI":"10.2147\/JMDH.S104807","volume":"9","author":"A Althubaiti","year":"2016","unstructured":"Althubaiti, A. Information bias in health research: definition, pitfalls, and adjustment methods. J. Multidiscip. Healthc. 9, 211\u2013217 (2016).","journal-title":"J. Multidiscip. Healthc."},{"key":"224_CR30","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.rdc.2019.01.004","volume":"45","author":"KL Druce","year":"2019","unstructured":"Druce, K. L., Dixon, W. G. & McBeth, J. Maximizing engagement in mobile health studies: lessons learned and future directions. Rheum. Dis. Clin. North Am. 45, 159\u2013172 (2019).","journal-title":"Rheum. Dis. Clin. North Am."},{"key":"224_CR31","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6.4.e46","volume":"6","author":"H Christensen","year":"2004","unstructured":"Christensen, H., Griffiths, K. M., Korten, A. E., Brittliffe, K. & Groves, C. A comparison of changes in anxiety and depression symptoms of spontaneous users and trial participants of a cognitive behavior therapy website. J. Med. Internet Res. 6, e46 (2004).","journal-title":"J. Med. Internet Res."},{"key":"224_CR32","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1136\/bmj.37945.566632.EE","volume":"328","author":"H Christensen","year":"2004","unstructured":"Christensen, H., Griffiths, K. M. & Jorm, A. F. Delivering interventions for depression by using the internet: randomised controlled trial. BMJ 328, 265 (2004).","journal-title":"BMJ"},{"key":"224_CR33","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.7.1.e11","volume":"7","author":"G Eysenbach","year":"2005","unstructured":"Eysenbach, G. The law of attrition. J. Med. Internet Res. 7, e11 (2005).","journal-title":"J. Med. Internet Res."},{"key":"224_CR34","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8.3.e20","volume":"8","author":"H Christensen","year":"2006","unstructured":"Christensen, H. & Mackinnon, A. The law of attrition revisited. J. Med. Internet Res. 8, e20 (2006).","journal-title":"J. Med. Internet Res."},{"key":"224_CR35","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8.3.e21","volume":"8","author":"G Eysenbach","year":"2006","unstructured":"Eysenbach, G. The law of attrition revisited\u2014Author\u2019s -reply. J. Med. Internet Res. 8, e21 (2006).","journal-title":"J. Med. Internet Res."},{"key":"224_CR36","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1111\/cts.12178","volume":"7","author":"RM Kaplan","year":"2014","unstructured":"Kaplan, R. M., Chambers, D. A. & Glasgow, R. E. Big data and large sample size: a cautionary note on the potential for bias. Clin. Transl. Sci. 7, 342\u2013346 (2014).","journal-title":"Clin. Transl. Sci."},{"key":"224_CR37","doi-asserted-by":"publisher","unstructured":"Neto, E. C. et al. A Permutation Approach to Assess Confounding in Machine Learning Applications for Digital Health. in Proc 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining - KDD \u201919, https:\/\/doi.org\/10.1145\/3292500.3330903 (2019).","DOI":"10.1145\/3292500.3330903"},{"key":"224_CR38","doi-asserted-by":"publisher","first-page":"842","DOI":"10.1590\/1809-4503201400040004","volume":"17","author":"SM Dainesi","year":"2014","unstructured":"Dainesi, S. M. & Goldbaum, M. Reasons behind the participation in biomedical research: a brief review. Rev. Bras. Epidemiol. 17, 842\u2013851 (2014).","journal-title":"Rev. Bras. Epidemiol."},{"key":"224_CR39","unstructured":"Balachandran, M. Way To Health. (2019). https:\/\/www.waytohealth.org\/."},{"key":"224_CR40","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1136\/jme.2002.001594","volume":"30","author":"JP Bentley","year":"2004","unstructured":"Bentley, J. P. & Thacker, P. G. The influence of risk and monetary payment on the research participation decision making process. J. Med. Ethics 30, 293\u2013298 (2004).","journal-title":"J. Med. Ethics"},{"key":"224_CR41","doi-asserted-by":"publisher","unstructured":"Laport-L\u00f3pez, F., Serrano, E., Bajo, J. & Campbell, A. T. A review of mobile sensing systems, applications, and opportunities. Knowl. Inf. Syst. (2019). https:\/\/doi.org\/10.1007\/s10115-019-01346-1.","DOI":"10.1007\/s10115-019-01346-1"},{"key":"224_CR42","doi-asserted-by":"publisher","first-page":"169","DOI":"10.2147\/CLEP.S188752","volume":"11","author":"DRT Laursen","year":"2019","unstructured":"Laursen, D. R. T., Paludan-M\u00fcller, A. S. & Hr\u00f3bjartsson, A. Randomized clinical trials with run-in periods: frequency, characteristics and reporting. Clin. Epidemiol. 11, 169\u2013184 (2019).","journal-title":"Clin. Epidemiol."},{"key":"224_CR43","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1001\/jama.279.3.222","volume":"279","author":"A Pablos-M\u00e9ndez","year":"1998","unstructured":"Pablos-M\u00e9ndez, A., Barr, R. G. & Shea, S. Run-in periods in randomized trials: implications for the application of results in clinical practice. JAMA 279, 222\u2013225 (1998).","journal-title":"JAMA"},{"key":"224_CR44","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1056\/NEJM199907153410312","volume":"341","author":"N Dickert","year":"1999","unstructured":"Dickert, N. & Grady, C. What\u2019s the price of a research subject? Approaches to payment for research participation. N. Engl. J. Med. 341, 198\u2013203 (1999).","journal-title":"N. Engl. J. Med."},{"key":"224_CR45","doi-asserted-by":"publisher","first-page":"766","DOI":"10.1056\/NEJMsb1710591","volume":"378","author":"L Gelinas","year":"2018","unstructured":"Gelinas, L. et al. A framework for ethical payment to research participants. N. Engl. J. Med. 378, 766\u2013771 (2018).","journal-title":"N. Engl. J. Med."},{"key":"224_CR46","unstructured":"A guide to actively involving young people in research\u2014INVOLVE. (2004). https:\/\/www.invo.org.uk\/posttypepublication\/a-guide-to-actively-involving-young-people-in-research\/."},{"key":"224_CR47","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1016\/j.cct.2011.01.007","volume":"32","author":"LM Nicholson","year":"2011","unstructured":"Nicholson, L. M. et al. Recruitment and retention strategies in longitudinal clinical studies with low-income populations. Contemp. Clin. Trials 32, 353\u2013362 (2011).","journal-title":"Contemp. Clin. Trials"},{"key":"224_CR48","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.cct.2015.07.008","volume":"45","author":"LM Nicholson","year":"2015","unstructured":"Nicholson, L. M., Schwirian, P. M. & Groner, J. A. Recruitment and retention strategies in clinical studies with low-income and minority populations: progress from 2004\u20132014. Contemp. Clin. Trials 45, 34\u201340 (2015).","journal-title":"Contemp. Clin. Trials"},{"key":"224_CR49","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.8162","volume":"5","author":"KL Druce","year":"2017","unstructured":"Druce, K. L. et al. Recruitment and ongoing engagement in a UK smartphone study examining the association between weather and pain: cohort study. JMIR mHealth uHealth 5, e168 (2017).","journal-title":"JMIR mHealth uHealth"},{"key":"224_CR50","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.4874","volume":"6","author":"H-E Liu","year":"2018","unstructured":"Liu, H.-E. & Li, M.-C. Factors influencing the willingness to participate in medical research: a nationwide survey in Taiwan. PeerJ 6, e4874 (2018).","journal-title":"PeerJ"},{"key":"224_CR51","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1002\/1097-0142(20010101)91:1+<233::AID-CNCR10>3.0.CO;2-8","volume":"91","author":"VL Shavers","year":"2001","unstructured":"Shavers, V. L., Lynch, C. F. & Burmeister, L. F. Factors that influence African-Americans\u2019 willingness to participate in medical research studies. Cancer 91, 233\u2013236 (2001).","journal-title":"Cancer"},{"key":"224_CR52","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1300\/J045v12n02_02","volume":"12","author":"JM Trauth","year":"2000","unstructured":"Trauth, J. M., Musa, D., Siminoff, L., Jewell, I. K. & Ricci, E. Public attitudes regarding willingness to participate in medical research studies. J. Health Soc. Policy 12, 23\u201343 (2000).","journal-title":"J. Health Soc. Policy"},{"key":"224_CR53","unstructured":"5 key findings about public trust in scientists in the U.S. Pew Research Center. (2019). https:\/\/www.pewresearch.org\/fact-tank\/2019\/08\/05\/5-key-findings-about-public-trust-in-scientists-in-the-u-s\/."},{"key":"224_CR54","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.6494","volume":"5","author":"C Nebeker","year":"2017","unstructured":"Nebeker, C., Murray, K., Holub, C., Haughton, J. & Arredondo, E. M. Acceptance of mobile health in communities underrepresented in biomedical research: barriers and ethical considerations for scientists. JMIR Mhealth Uhealth 5, e87 (2017).","journal-title":"JMIR Mhealth Uhealth"},{"key":"224_CR55","first-page":"1f","volume":"8","author":"M Christopher Gibbons","year":"2011","unstructured":"Christopher Gibbons, M. Use of health information technology among racial and ethnic underserved communities. Perspect. Health Inf. Manag. 8, 1f (2011).","journal-title":"Perspect. Health Inf. Manag."},{"key":"224_CR56","doi-asserted-by":"publisher","unstructured":"Massoud, M. R., Rashad Massoud, M. & Kimble, L. Faculty of 1000 evaluation for Global burden of diseases, injuries, and risk factors for young people\u2019s health during 1990\u20132013: a systematic analysis for the Global Burden of Disease Study 2013. F1000 - Post-Publ. Peer Rev. Biomed. Lit. (2016). https:\/\/doi.org\/10.3410\/f.726353640.793525182.","DOI":"10.3410\/f.726353640.793525182"},{"key":"224_CR57","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1001918","volume":"12","author":"SS Oh","year":"2015","unstructured":"Oh, S. S. et al. Diversity in clinical and biomedical research: a promise yet to be fulfilled. PLoS Med. 12, e1001918 (2015).","journal-title":"PLoS Med."},{"key":"224_CR58","doi-asserted-by":"publisher","first-page":"b4471","DOI":"10.1136\/bmj.b4471","volume":"339","author":"N Kondo","year":"2009","unstructured":"Kondo, N. et al. Income inequality, mortality, and self rated health: meta-analysis of multilevel studies. BMJ 339, b4471 (2009).","journal-title":"BMJ"},{"key":"224_CR59","doi-asserted-by":"publisher","first-page":"1655","DOI":"10.2105\/AJPH.93.10.1655","volume":"93","author":"N Krieger","year":"2003","unstructured":"Krieger, N., Chen, J. T., Waterman, P. D., Rehkopf, D. H. & Subramanian, S. V. Race\/ethnicity, gender, and monitoring socioeconomic gradients in health: a comparison of area-based socioeconomic measures\u2014The Public Health Disparities Geocoding Project. Am. J. Public Health 93, 1655\u20131671 (2003).","journal-title":"Am. J. Public Health"},{"key":"224_CR60","doi-asserted-by":"publisher","first-page":"1976","DOI":"10.1001\/jama.2017.4150","volume":"317","author":"GA Roth","year":"2017","unstructured":"Roth, G. A. et al. Trends and patterns of geographic variation in cardiovascular mortality among US Counties, 1980\u20132014. JAMA 317, 1976\u20131992 (2017).","journal-title":"JAMA"},{"key":"224_CR61","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.15717","volume":"2","author":"A Pratap","year":"2019","unstructured":"Pratap, A. et al. Contemporary views of research participant willingness to participate and share digital data in biomedical research. JAMA Netw. Open 2, e1915717 (2019).","journal-title":"JAMA Netw. Open"},{"key":"224_CR62","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1056\/NEJMsr1809937","volume":"381","author":"All of Us Research Program Investigators et al.","year":"2019","unstructured":"All of Us Research Program Investigators et al. The \u2018All of Us\u2019 Research Program. N. Engl. J. Med. 381, 668\u2013676 (2019).","journal-title":"N. Engl. J. Med."},{"key":"224_CR63","doi-asserted-by":"publisher","unstructured":"Rogers, E. M., Singhal, A. & Quinlan, M. M. in An Integrated Approach to Communication Theory and Research. Taylor & Francis Group. (2019). https:\/\/doi.org\/10.4324\/9780203710753-35.","DOI":"10.4324\/9780203710753-35"},{"key":"224_CR64","doi-asserted-by":"publisher","unstructured":"Karni, E. & Safra, Z. in Risk, Decision and Rationality. Taylor & Francis Group. (1988). https:\/\/doi.org\/10.1007\/978-94-009-4019-2_11.","DOI":"10.1007\/978-94-009-4019-2_11"},{"key":"224_CR65","doi-asserted-by":"publisher","first-page":"a1786","DOI":"10.1136\/bmj.a1786","volume":"337","author":"T Greenhalgh","year":"2008","unstructured":"Greenhalgh, T. et al. Introduction of shared electronic records: multi-site case study using diffusion of innovation theory. BMJ 337, a1786 (2008).","journal-title":"BMJ"},{"key":"224_CR66","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1016\/j.hlpt.2013.07.002","volume":"2","author":"R Ward","year":"2013","unstructured":"Ward, R. The application of technology acceptance and diffusion of innovation models in healthcare informatics. Health Policy Technol. 2, 222\u2013228 (2013).","journal-title":"Health Policy Technol."},{"key":"224_CR67","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2278","volume":"14","author":"S Emani","year":"2012","unstructured":"Emani, S. et al. Patient perceptions of a personal health record: a test of the diffusion of innovation model. J. Med. Internet Res. 14, e150 (2012).","journal-title":"J. Med. Internet Res."},{"key":"224_CR68","unstructured":"National Academies of Sciences, Engineering, and Medicine, Health and Medicine Division, Board on Health Sciences Policy & Committee on the Return of Individual-Specific Research Results Generated in Research Laboratories. Returning Individual Research Results to Participants: Guidance for a New Research Paradigm. (National Academies Press, 2018)."},{"key":"224_CR69","unstructured":"Mobile Apps: What\u2019s A Good Retention Rate? (2018). http:\/\/info.localytics.com\/blog\/mobile-apps-whats-a-good-retention-rate."},{"key":"224_CR70","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.4055","volume":"17","author":"L Yardley","year":"2015","unstructured":"Yardley, L., Morrison, L., Bradbury, K. & Muller, I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J. Med. Internet Res. 17, e30 (2015).","journal-title":"J. Med. Internet Res."},{"key":"224_CR71","doi-asserted-by":"crossref","unstructured":"O\u2019Connor, S. et al. Understanding factors affecting patient and public engagement and recruitment to digital health interventions: a systematic review of qualitative studies. BMC Medical Informatics and Decision Making 16 (2016).","DOI":"10.1186\/s12911-016-0359-3"},{"key":"224_CR72","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1007\/s13142-013-0234-z","volume":"3","author":"S Pagoto","year":"2013","unstructured":"Pagoto, S. & Bennett, G. G. How behavioral science can advance digital health. Transl. Behav. Med. 3, 271\u2013276 (2013).","journal-title":"Transl. Behav. Med."},{"key":"224_CR73","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1007\/s12160-016-9830-8","volume":"52","author":"I Nahum-Shani","year":"2018","unstructured":"Nahum-Shani, I. et al. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann. Behav. Med. 52, 446\u2013462 (2018).","journal-title":"Ann. Behav. Med."},{"key":"224_CR74","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2018.96","volume":"5","author":"Y-FY Chan","year":"2018","unstructured":"Chan, Y.-F. Y. et al. The asthma mobile health study, smartphone data collected using ResearchKit. Sci. Data 5, 180096 (2018).","journal-title":"Sci. Data"},{"key":"224_CR75","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-019-0016-7","volume":"6","author":"SG Hershman","year":"2019","unstructured":"Hershman, S. G. et al. Physical activity, sleep and cardiovascular health data for 50,000 individuals from the MyHeart Counts Study. Sci. Data 6, 24 (2019).","journal-title":"Sci. Data"},{"key":"224_CR76","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1038\/nbt.3516","volume":"34","author":"J Wilbanks","year":"2016","unstructured":"Wilbanks, J. & Friend, S. H. First, design for data sharing. Nat. Biotechnol. 34, 377\u2013379 (2016).","journal-title":"Nat. Biotechnol."},{"key":"224_CR77","unstructured":"SleepHealth Study and Mobile App - SleepHealth. SleepHealth. (2019). https:\/\/www.sleephealth.org\/sleephealthapp\/."},{"key":"224_CR78","unstructured":"Website. (2019). https:\/\/www.goodrx.com\/."},{"key":"224_CR79","unstructured":"Phendo. (2019). http:\/\/citizenendo.org\/phendo\/."},{"key":"224_CR80","unstructured":"elevateMS. (2019). http:\/\/www.elevatems.org\/."},{"key":"224_CR81","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1197\/jamia.M1480","volume":"11","author":"E Coiera","year":"2003","unstructured":"Coiera, E. e-Consent: the design and implementation of consumer consent mechanisms in an electronic environment. J. Am. Med. Inform. Assoc. 11, 129\u2013140 (2003).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"224_CR82","unstructured":"Electronic Code of Federal Regulations (eCFR). Electronic Code of Federal Regulations (eCFR). (2019). https:\/\/www.ecfr.gov\/."},{"key":"224_CR83","unstructured":"ResearchKit and CareKit. Apple. (2019). http:\/\/www.apple.com\/researchkit\/."},{"key":"224_CR84","unstructured":"Apple Inc. HealthKit - Apple Developer. (2019). https:\/\/developer.apple.com\/healthkit\/."},{"key":"224_CR85","doi-asserted-by":"publisher","DOI":"10.1186\/cc2955","volume":"8","author":"V Bewick","year":"2004","unstructured":"Bewick, V., Cheek, L. & Ball, J. Statistics review 12: survival analysis. Crit. Care 8, 389 (2004).","journal-title":"Crit. Care"},{"key":"224_CR86","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/ije\/28.1.1","volume":"28","author":"M Blettner","year":"1999","unstructured":"Blettner, M. Traditional reviews, meta-analyses and pooled analyses in epidemiology. Int. J. Epidemiol. 28, 1\u20139 (1999).","journal-title":"Int. J. Epidemiol."},{"key":"224_CR87","doi-asserted-by":"publisher","first-page":"1073","DOI":"10.1136\/bmj.328.7447.1073","volume":"328","author":"JM Bland","year":"2004","unstructured":"Bland, J. M. & Altman, D. G. The logrank test. BMJ 328, 1073 (2004).","journal-title":"BMJ"},{"key":"224_CR88","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1016\/j.otohns.2010.05.007","volume":"143","author":"JT Rich","year":"2010","unstructured":"Rich, J. T. et al. A practical guide to understanding Kaplan-Meier curves. Otolaryngol. Head. Neck Surg. 143, 331\u2013336 (2010).","journal-title":"Otolaryngol. Head. Neck Surg."},{"key":"224_CR89","doi-asserted-by":"crossref","unstructured":"Parsons, S. Introduction to Machine Learning by Ethem Alpaydin, MIT Press, 0-262-01211-1, 400 pp., $50.00\/\u00a332.95. The Knowledge Engineering Review. 432\u2013433 (2005).","DOI":"10.1017\/S0269888906220745"},{"key":"224_CR90","unstructured":"US Census Bureau. 2018 National and State Population Estimates. https:\/\/www.census.gov\/newsroom\/press-kits\/2018\/pop-estimates-national-state.html."},{"key":"224_CR91","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/0951-8320(94)90010-8","volume":"44","author":"D Kumar","year":"1994","unstructured":"Kumar, D. & Klefsj\u00f6, B. Proportional hazards model: a review. Reliab. Eng. Syst. Saf. 44, 177\u2013188 (1994).","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"224_CR92","unstructured":"R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. (2013). http:\/\/www.R-project.org\/."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0224-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0224-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0224-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T01:54:11Z","timestamp":1670378051000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0224-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,17]]},"references-count":92,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["224"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-0224-8","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,17]]},"assertion":[{"value":"1 October 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"21"}}