{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T15:12:22Z","timestamp":1784214742390,"version":"3.55.0"},"reference-count":29,"publisher":"American Medical Association (AMA)","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"<jats:sec>\n                    <jats:title>Importance<\/jats:title>\n                    <jats:p>Prospective clinical research studies are challenged by low enrollment rates and underrepresentation of individuals from racial and ethnic minority groups.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To determine the effect of electronic message content on study enrollment among racial and ethnic groups.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design, Setting, and Participants<\/jats:title>\n                    <jats:p>Four sequential randomized clinical trials (RCTs) were conducted between October 30, 2023, and November 13, 2024, in which University of Pennsylvania Health System patients (aged \u226518 years) were contacted electronically via email, text message, or both. The most effective arm from each RCT served as the control in the subsequent observational study. This analysis of all 4 RCTs was performed on the intention-to-treat principle from December 2024 through September 2025.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Intervention<\/jats:title>\n                    <jats:p>Messages varied by method, source, framing, and incentive structure.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Main Outcomes and Measures<\/jats:title>\n                    <jats:p>The primary outcome was enrollment fraction (number enrolled divided by total contacted) among Black and Hispanic participants. Overall enrollment fraction was a secondary outcome.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Overall, 26\u202f215 patients were contacted and 26\u202f029 were offered enrollment in the Penn Medicine BioBank; 63.2% were Black and 7.2% were Hispanic. Their mean (SD) age was 60.5 (17.9) years, and 60.1% were female. In the first recruitment RCT (RCT 1) (n\u2009=\u20098038), the enrollment fraction among 4581 Black and Hispanic patients was 0% with email, 0.5% with text, and 0.2% with email\u2009plus\u2009text (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009=\u2009.06 for text vs email;\n                      <jats:italic>P<\/jats:italic>\n                      =\u2009.20 for email\u2009plus\u2009text vs email). Due to technical issues, more than 80% of participants who attempted to consent in RCT 1 failed; consent attempts were higher with text (4.8%) and email\u2009plus\u2009text (4.4%) than email alone (0.6%) (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&amp;amp;lt;\u2009.001 for text vs email and email\u2009plus\u2009text vs email). In RCT 2 (n\u2009=\u20094271), the enrollment fraction among 1902 Black and Hispanic patients was 1.0% with research team outreach and 1.8% with clinical team outreach (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009=\u2009.12). In RCT 3 (n\u2009=\u20093217 Black and Hispanic patients), the enrollment fraction was 3.2% with a control message, 3.6% with an appeal to altruism, and 4.1% with an appeal to social proof (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&amp;amp;gt;\u2009.05 for all comparisons). In RCT 4 (n\u2009=\u200910\u202f689), the enrollment fraction among 8629 Black and Hispanic patients was 2.5% with no incentive, 6.8% with $25, 5.5% with $15\u2009plus\u2009a 5% chance at $200, 5.8% with a 5% chance at $500, and 6.5% with a 1% chance at $2500 (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&amp;amp;lt;\u2009.001 for each incentive vs no incentive;\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&amp;amp;gt;\u2009.05 for each incentive compared with another).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions and Relevance<\/jats:title>\n                    <jats:p>In this series of RCTs, the enrollment fraction among Black and Hispanic patients was improved with outreach by text message and with an incentive.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Trial Registration<\/jats:title>\n                    <jats:p>\n                      ClinicalTrials.gov Identifier:\n                      <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/clinicaltrials.gov\/study\/NCT05827718?term=NCT05827718&amp;amp;amp;viewType=Card&amp;amp;amp;rank=1\">NCT05827718<\/jats:ext-link>\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2026.22773","type":"journal-article","created":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T15:00:21Z","timestamp":1784214021000},"page":"e2622773","source":"Crossref","is-referenced-by-count":0,"title":["Messaging Informed by Behavioral Economics and Representativeness in Clinical Research Enrollment"],"prefix":"10.1001","volume":"9","author":[{"given":"Alexander C.","family":"Fanaroff","sequence":"first","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"},{"name":"Center for Health Incentives and Behavioral Economics, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nirali","family":"Patel","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Casey","family":"Whitman","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adina","family":"Lieberman","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shira","family":"Blady","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Colleen","family":"Morse Kripke","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Penn Medicine Biobank, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nawar","family":"Naseer","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Penn Medicine Biobank, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joellen","family":"Weaver","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Penn Medicine Biobank, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Modele","family":"Ogunniyi","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Division of Cardiology, Emory University School of Medicine, Atlanta, Georgia"},{"name":"Grady Health System, Atlanta, Georgia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rachel","family":"Kohn","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alanna A.","family":"Morris","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Bayer Pharma, Whippany, New Jersey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alisa","family":"Stephens-Shields","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"},{"name":"Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kevin G.","family":"Volpp","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"},{"name":"Center for Health Incentives and Behavioral Economics, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Department of Medical Ethics and Health Policy, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Scott D.","family":"Halpern","sequence":"additional","affiliation":[{"name":"Behavioral Economics to Transform Trial Enrollment Representativeness Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"},{"name":"Center for Health Incentives and Behavioral Economics, Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2026,7,16]]},"reference":[{"issue":"11","key":"zoi260637r1","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.119.015594","article-title":"Ten-year trends in enrollment of women and minorities in pivotal trials supporting recent US Food and Drug Administration approval of novel cardiometabolic drugs.","volume":"9","author":"Khan","year":"2020","journal-title":"J Am Heart Assoc"},{"issue":"3","key":"zoi260637r2","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1111\/pace.14178","article-title":"Representation of women, older patients, ethnic, and racial minorities in trials of atrial fibrillation.","volume":"44","author":"Khan","year":"2021","journal-title":"Pacing Clin Electrophysiol"},{"issue":"10","key":"zoi260637r3","doi-asserted-by":"publisher","first-page":"1011","DOI":"10.1001\/jamacardio.2018.2559","article-title":"Enrollment of older patients, women, and racial and ethnic minorities in contemporary heart failure clinical trials: a systematic review.","volume":"3","author":"Tahhan","year":"2018","journal-title":"JAMA Cardiol"},{"issue":"6","key":"zoi260637r4","doi-asserted-by":"publisher","first-page":"714","DOI":"10.1001\/jamacardio.2020.0359","article-title":"Enrollment of older patients, women, and racial\/ethnic minority groups in contemporary acute coronary syndrome clinical trials: a systematic review.","volume":"5","author":"Tahhan","year":"2020","journal-title":"JAMA Cardiol"},{"issue":"9","key":"zoi260637r5","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1001\/jamacardio.2023.2098","article-title":"Enrollment of older patients, women, and racial and ethnic minority individuals in valvular heart disease clinical trials: a systematic review.","volume":"8","author":"Reddy","year":"2023","journal-title":"JAMA Cardiol"},{"issue":"21","key":"zoi260637r6","doi-asserted-by":"publisher","first-page":"1639","DOI":"10.1161\/CIRCULATIONAHA.124.069531","article-title":"Effect of gamification, financial incentives, or both to increase physical activity among patients at high risk of cardiovascular events: the BE ACTIVE randomized controlled trial.","volume":"149","author":"Fanaroff","year":"2024","journal-title":"Circulation"},{"key":"zoi260637r7","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1016\/j.ahj.2024.06.003","article-title":"Investigating racial and gender disparities in virtual randomized clinical trial enrollment: insights from the BE ACTIVE study.","volume":"276","author":"Fortunato","year":"2024","journal-title":"Am Heart J"},{"key":"zoi260637r8","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1016\/j.ahj.2025.03.016","article-title":"A series of randomized trials of behavioral economic interventions to increase racial and ethnic diversity of research participants: rationale and design of ITERATE.","volume":"286","author":"Patel","year":"2025","journal-title":"Am Heart J"},{"issue":"12","key":"zoi260637r9","doi-asserted-by":"publisher","first-page":"1974","DOI":"10.3390\/jpm12121974","article-title":"The Penn Medicine BioBank: towards a genomics-enabled learning healthcare system to accelerate precision medicine in a diverse population.","volume":"12","author":"Verma","year":"2022","journal-title":"J Pers Med"},{"issue":"7","key":"zoi260637r12","doi-asserted-by":"publisher","first-page":"592","DOI":"10.1056\/NEJMp1506311","article-title":"Innovation as discipline, not fad.","volume":"373","author":"Asch","year":"2015","journal-title":"N Engl J Med"},{"issue":"9","key":"zoi260637r13","first-page":"1","article-title":"On the Way to Health.","volume":"17","author":"Asch","year":"2012","journal-title":"LDI Issue Brief"},{"issue":"2","key":"zoi260637r14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0030019","article-title":"Are racial and ethnic minorities less willing to participate in health research?","volume":"3","author":"Wendler","year":"2006","journal-title":"PLoS Med"},{"issue":"2","key":"zoi260637r15","doi-asserted-by":"publisher","first-page":"151","DOI":"10.3390\/diagnostics11020151","article-title":"Enhancing patient centricity and advancing innovation in clinical research with virtual randomized clinical trials (vRCTs).","volume":"11","author":"Yaakov","year":"2021","journal-title":"Diagnostics (Basel)"},{"issue":"2","key":"zoi260637r16","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/S0027-9684(15)30261-3","article-title":"Different types of distrust in clinical research among Whites and African Americans.","volume":"103","author":"Durant","year":"2011","journal-title":"J Natl Med Assoc"},{"key":"zoi260637r17","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.jclinepi.2021.01.014","article-title":"Transparency, trust and minimizing burden to increase recruitment and retention in trials: a systematic review.","volume":"134","author":"Natale","year":"2021","journal-title":"J Clin Epidemiol"},{"issue":"3","key":"zoi260637r18","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1053\/j.ajkd.2016.10.017","article-title":"Automated reminders and physician notification to promote immunosuppression adherence among kidney transplant recipients: a randomized trial.","volume":"69","author":"Reese","year":"2017","journal-title":"Am J Kidney Dis"},{"issue":"1","key":"zoi260637r19","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.jesp.2010.09.003","article-title":"More than fair: outcome dependence, system justification, and the perceived legitimacy of authority figures.","volume":"47","author":"van der Toorn","year":"2011","journal-title":"J Exp Soc Psychol"},{"key":"zoi260637r21","doi-asserted-by":"publisher","first-page":"74","DOI":"10.3389\/fcell.2019.00074","article-title":"A qualitative study exploring barriers and facilitators of enrolling underrepresented populations in clinical trials and biobanking.","volume":"7","author":"Davis","year":"2019","journal-title":"Front Cell Dev Biol"},{"issue":"5","key":"zoi260637r22","doi-asserted-by":"publisher","first-page":"1663","DOI":"10.1111\/j.1475-6773.2011.01264.x","article-title":"Lottery-based versus fixed incentives to increase clinicians\u2019 response to surveys.","volume":"46","author":"Halpern","year":"2011","journal-title":"Health Serv Res"},{"issue":"2","key":"zoi260637r23","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1016\/j.ahj.2012.05.005","article-title":"Randomized trial of lottery-based incentives to improve warfarin adherence.","volume":"164","author":"Kimmel","year":"2012","journal-title":"Am Heart J"},{"issue":"7","key":"zoi260637r24","doi-asserted-by":"publisher","first-page":"1568","DOI":"10.1177\/0890117118758932","article-title":"A randomized, controlled trial of lottery-based financial incentives to increase physical activity among overweight and obese adults.","volume":"32","author":"Patel","year":"2018","journal-title":"Am J Health Promot"},{"issue":"11","key":"zoi260637r25","doi-asserted-by":"publisher","first-page":"1479","DOI":"10.1001\/jamainternmed.2021.5450","article-title":"Effectiveness and ethics of incentives for research participation: 2 randomized clinical trials.","volume":"181","author":"Halpern","year":"2021","journal-title":"JAMA Intern Med"},{"issue":"3","key":"zoi260637r26","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1257\/aeri.20230195","article-title":"Nonrepresentativeness in population health research: evidence from a COVID-19 antibody study.","volume":"6","author":"Dutz","year":"2024","journal-title":"American Economic Review Insights"},{"issue":"12","key":"zoi260637r27","doi-asserted-by":"publisher","first-page":"1848","DOI":"10.1038\/s41395-018-0151-3","article-title":"A randomized controlled trial of opt-in versus opt-out colorectal cancer screening outreach.","volume":"113","author":"Mehta","year":"2018","journal-title":"Am J Gastroenterol"},{"issue":"7","key":"zoi260637r28","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1001\/jamacardio.2016.2374","article-title":"Participation rates with opt-out enrollment in a remote monitoring intervention for patients with myocardial infarction.","volume":"1","author":"Mehta","year":"2016","journal-title":"JAMA Cardiol"},{"key":"zoi260637r29","doi-asserted-by":"publisher","DOI":"10.1016\/j.ahj.2025.107285","article-title":"Effect of opt-in versus opt-out framing on trial recruitment: a study within a trial of the GAMEPAD randomized trial.","volume":"292","author":"Shah","year":"2026","journal-title":"Am Heart J"},{"key":"zoi260637r20","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/978-3-319-93224-8_3","volume-title":"Cognitive Errors and Diagnostic Mistakes: A Case-Based Guide to Critical Thinking in Medicine","author":"Howard","year":"2019"},{"key":"zoi260637r10","unstructured":"Disparities in health care in Medicare Advantage associated with dual eligibility or eligibility for a low-income subsidy and disability. Centers for Medicare & Medicaid Services. Accessed November 5, 2025. https:\/\/www.cms.gov\/files\/document\/2023-disparities-health-care-medicare-advantage-associated-dual-eligibility-or-eligibility-low.pdf"},{"key":"zoi260637r11","unstructured":"2015 Area Deprivation Index v2.0. University of Wisconsin School of Medicine and Public Health. Accessed January 10, 2022. https:\/\/www.neighborhoodatlas.medicine.wisc.edu"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2851714\/fanaroff_2026_oi_260637_1783614612.6767.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T15:00:23Z","timestamp":1784214023000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2851714"}},"subtitle":["Four Randomized Clinical Trials"],"short-title":[],"issued":{"date-parts":[[2026,7,16]]},"references-count":29,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2026.22773","relation":{},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,16]]}}}