{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T05:10:17Z","timestamp":1792905017873,"version":"4.5.0"},"reference-count":40,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,7]]},"abstract":"<jats:sec>\n            <jats:title>Background:<\/jats:title>\n            <jats:p>The <jats:italic toggle=\"yes\">All of Us<\/jats:italic> Research Program is building a national longitudinal cohort and collecting data from multiple information sources (e.g., biospecimens, electronic health records, and mobile\/wearable technologies) to advance precision medicine. Participant-provided information, collected via surveys, will complement and augment these information sources. We report the process used to develop and refine the initial three surveys for this program.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods:<\/jats:title>\n            <jats:p>The <jats:italic toggle=\"yes\">All of Us<\/jats:italic> survey development process included: (1) prioritization of domains for scientific needs, (2) examination of existing validated instruments, (3) content creation, (4) evaluation and refinement via cognitive interviews and online testing, (5) content review by key stakeholders, and (6) launch in the <jats:italic toggle=\"yes\">All of Us<\/jats:italic> electronic participant portal. All content was translated into Spanish.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results:<\/jats:title>\n            <jats:p>We conducted cognitive interviews in English and Spanish with 169 participants, and 573 individuals completed online testing. Feedback led to over 40 item content changes. Lessons learned included: (1) validated survey instruments performed well in diverse populations reflective of <jats:italic toggle=\"yes\">All of Us<\/jats:italic>; (2) parallel evaluation of multiple languages can ensure optimal survey deployment; (3) recruitment challenges in diverse populations required multiple strategies; and (4) key stakeholders improved integration of surveys into larger Program context.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions:<\/jats:title>\n            <jats:p>This efficient, iterative process led to successful testing, refinement, and launch of three <jats:italic toggle=\"yes\">All of Us<\/jats:italic> surveys. Reuse of <jats:italic toggle=\"yes\">All of Us<\/jats:italic> surveys, available at http:\/\/researchallofus.org, may facilitate large consortia targeting diverse populations in English and Spanish to capture participant-provided information to supplement other data, such as genetic, physical measurements, or data from electronic health records.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/ede.0000000000001028","type":"journal-article","created":{"date-parts":[[2019,5,2]],"date-time":"2019-05-02T11:34:00Z","timestamp":1556796840000},"page":"597-608","source":"Crossref","is-referenced-by-count":84,"title":["Development of the Initial Surveys for the All of Us Research Program"],"prefix":"10.1097","volume":"30","author":[{"given":"Robert M.","family":"Cronin","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics and Internal Medicine, Vanderbilt University Medical Center, Nashville, TN"},{"name":"Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rebecca N.","family":"Jerome","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brandy","family":"Mapes","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Regina","family":"Andrade","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rebecca","family":"Johnston","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Ayala","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Schlundt","sequence":"additional","affiliation":[{"name":"Department of Psychology, Vanderbilt University, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kemberlee","family":"Bonnet","sequence":"additional","affiliation":[{"name":"Department of Psychology, Vanderbilt University, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sunil","family":"Kripalani","sequence":"additional","affiliation":[{"name":"Department of Medicine, Vanderbilt University School of Medicine, Nashville, TN"},{"name":"Center for Clinical Quality and Implementation Research, Vanderbilt University Medical Center, Nashville, TN"},{"name":"Center for Effective Health Communication, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathryn","family":"Goggins","sequence":"additional","affiliation":[{"name":"Department of Medicine, Vanderbilt University School of Medicine, Nashville, TN"},{"name":"Center for Clinical Quality and Implementation Research, Vanderbilt University Medical Center, Nashville, TN"},{"name":"Center for Effective Health Communication, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kenneth A.","family":"Wallston","sequence":"additional","affiliation":[{"name":"Institute for Medicine and Public Health, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mick P.","family":"Couper","sequence":"additional","affiliation":[{"name":"Survey Research Center, University of Michigan. Ann Arbor, MI"},{"name":"Joint Program in Survey Methodology, University of Maryland, College Park, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael R.","family":"Elliott","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, School of Public Health, University of Michigan, Ann Arbor, MI"},{"name":"Survey Research Center, Institute for Social Research, University of Michigan, Ann Arbor, MI"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Harris","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Begale","sequence":"additional","affiliation":[{"name":"Vibrent Health, Fairfax, VA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fatima","family":"Munoz","sequence":"additional","affiliation":[{"name":"Department of Research and Health Promotion, San Ysidro Health, San Diego, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Lopez-Class","sequence":"additional","affiliation":[{"name":"National Institutes of Health, Office of the Director, Bethesda, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Cella","sequence":"additional","affiliation":[{"name":"Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Condon","sequence":"additional","affiliation":[{"name":"Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mona","family":"AuYoung","sequence":"additional","affiliation":[{"name":"Scripps Whittier Diabetes Institute, Scripps Health, San Diego, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathleen M.","family":"Mazor","sequence":"additional","affiliation":[{"name":"Meyers Primary Care Institute, Worcester, MA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steve","family":"Mikita","sequence":"additional","affiliation":[{"name":"Spinal Muscular Atrophy Foundation, New York, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Manganiello","sequence":"additional","affiliation":[{"name":"HCM Strategists, Washington, DC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas","family":"Borselli","sequence":"additional","affiliation":[{"name":"HCM Strategists, Washington, DC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie","family":"Fowler","sequence":"additional","affiliation":[{"name":"National Institutes of Health, Office of the Director, Bethesda, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joni L.","family":"Rutter","sequence":"additional","affiliation":[{"name":"National Institutes of Health, Office of the Director, Bethesda, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joshua C.","family":"Denny","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics and Internal Medicine, Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth W.","family":"Karlson","sequence":"additional","affiliation":[{"name":"Division of Rheumatology, Allergy, and Immunology, Department of Medicine, Section of Clinical Sciences, Brigham and Women\u2019s Hospital, Boston, MA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian K.","family":"Ahmedani","sequence":"additional","affiliation":[{"name":"Center for Health Policy & Health Services Research, Henry Ford Health System, Detroit, MI"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher J.","family":"O\u2019Donnell","sequence":"additional","affiliation":[{"name":"Cardiology Section, Department of Medicine, Veterans Affairs Boston Healthcare System, Boston, MA"},{"name":"Cardiovascular Medicine Division, Department of Medicine, Brigham and Women\u2019s Hospital, Harvard Medical School, Boston, MA."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","reference":[{"key":"R1-20230908","doi-asserted-by":"crossref","first-page":"D896","DOI":"10.1093\/nar\/gkw1133","article-title":"The new NHGRI-EBI Catalog of published genome-wide association studies (GWAS Catalog).","volume":"45","author":"MacArthur","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"R2-20230908","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1038\/clpt.2011.221","article-title":"Predicting clopidogrel response using DNA samples linked to an electronic health record.","volume":"91","author":"Delaney","year":"2012","journal-title":"Clin Pharmacol Ther"},{"key":"R3-20230908","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1038\/clpt.2012.66","article-title":"Optimizing drug outcomes through pharmacogenetics: a case for preemptive genotyping.","volume":"92","author":"Schildcrout","year":"2012","journal-title":"Clin Pharmacol Ther"},{"key":"R4-20230908","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1038\/clpt.2012.57","article-title":"The clinical pharmacogenomics implementation consortium: CPIC guideline for SLCO1B1 and simvastatin-induced myopathy.","volume":"92","author":"Wilke","year":"2012","journal-title":"Clin Pharmacol Ther"},{"key":"R5-20230908","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1056\/NEJMoa0706135","article-title":"HLA-B*5701 screening for hypersensitivity to abacavir.","volume":"358","author":"Mallal","year":"2008","journal-title":"N Engl J Med"},{"key":"R6-20230908","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.jcin.2017.07.022","article-title":"Multisite investigation of outcomes with implementation of CYP2C19 genotype-guided antiplatelet therapy after percutaneous coronary intervention.","volume":"11","author":"Cavallari","year":"2018","journal-title":"JACC Cardiovasc Interv"},{"key":"R7-20230908","first-page":"1","article-title":"Design and estimation for the National Health Interview Survey 1985\u201394.","author":"Massey","year":"1989","journal-title":"Vital Health Stat 2"},{"key":"R8-20230908","first-page":"165:1","article-title":"Design and estimation for the National Health Interview Survey, 2006\u20132015.","author":"Parsons","year":"2014","journal-title":"Vital Health Stat 2"},{"key":"R9-20230908","doi-asserted-by":"crossref","first-page":"e1001779","DOI":"10.1371\/journal.pmed.1001779","article-title":"UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age.","volume":"12","author":"Sudlow","year":"2015","journal-title":"PLoS Med"},{"key":"R10-20230908","doi-asserted-by":"crossref","first-page":"e1001779","DOI":"10.1371\/journal.pmed.1001779","article-title":"UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age.","volume":"12","author":"Sudlow","year":"2015","journal-title":"PLoS Med"},{"key":"R11-20230908","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1038\/nrg3208","article-title":"Mining electronic health records: towards better research applications and clinical care.","volume":"13","author":"Jensen","year":"2012","journal-title":"Nat Rev Genet"},{"key":"R12-20230908","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1377\/hlthaff.2014.0041","article-title":"Big data in health care: using analytics to identify and manage high-risk and high-cost patients.","volume":"33","author":"Bates","year":"2014","journal-title":"Health Aff (Millwood)"},{"key":"R13-20230908","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1136\/amiajnl-2012-001145","article-title":"Next-generation phenotyping of electronic health records.","volume":"20","author":"Hripcsak","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"R14-20230908","first-page":"14","article-title":"Big data in medicine is driving big changes.","volume":"9","author":"Martin-Sanchez","year":"2014","journal-title":"Yearb Med Inform"},{"key":"R15-20230908","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s10916-017-0760-1","article-title":"A systematic review of wearable patient monitoring systems\u2014current challenges and opportunities for clinical adoption.","volume":"41","author":"Baig","year":"2017","journal-title":"J Med Syst"},{"key":"R16-20230908","doi-asserted-by":"crossref","first-page":"2027","DOI":"10.3390\/s18072027","article-title":"Ambient sensors for elderly care and independent living: a survey.","volume":"18","author":"Uddin","year":"2018","journal-title":"Sensors (Basel)"},{"key":"R17-20230908","doi-asserted-by":"crossref","first-page":"pii: E1613","DOI":"10.3390\/s18051613","article-title":"Type and location of wearable sensors for monitoring falls during static and dynamic tasks in healthy elderly: a review.","volume":"18","author":"Rucco","year":"2018","journal-title":"Sensors (Basel)"},{"key":"R18-20230908","doi-asserted-by":"crossref","first-page":"pii: E873","DOI":"10.3390\/s18030873","article-title":"Trends supporting the in-field use of wearable inertial sensors for sport performance evaluation: a systematic review.","volume":"18","author":"Camomilla","year":"2018","journal-title":"Sensors (Basel)"},{"key":"R19-20230908","doi-asserted-by":"crossref","first-page":"1740","DOI":"10.1007\/s00415-018-8786-y","article-title":"Wearable sensors for clinical applications in epilepsy, Parkinson\u2019s disease, and stroke: a mixed-methods systematic review.","volume":"265","author":"Johansson","year":"2018","journal-title":"J Neurol"},{"key":"R20-20230908","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.jbiomech.2017.09.037","article-title":"Wearable technology for spine movement assessment: a systematic review.","volume":"64","author":"Papi","year":"2017","journal-title":"J Biomech"},{"key":"R21-20230908","doi-asserted-by":"crossref","first-page":"555","DOI":"10.3389\/fnins.2017.00555","article-title":"How wearable sensors can support parkinson\u2019s disease diagnosis and treatment: a systematic review.","volume":"11","author":"Rovini","year":"2017","journal-title":"Front Neurosci"},{"key":"R22-20230908","doi-asserted-by":"crossref","first-page":"pii: E35","DOI":"10.3390\/bios8020035","article-title":"Sensors based on bio and biomimetic receptors in medical diagnostic, environment, and food analysis.","volume":"8","author":"Kozitsina","year":"2018","journal-title":"Biosensors (Basel)"},{"key":"R23-20230908","doi-asserted-by":"crossref","first-page":"1321","DOI":"10.1109\/JSEN.2014.2370945","article-title":"Wearable sensors for human activity monitoring: a review.","volume":"15","author":"Mukhopadhyay","year":"2015","journal-title":"IEEE Sensors J"},{"key":"R24-20230908","article-title":"The precision medicine initiative cohort program-building a research foundation for 21st century medicine.","author":"Hudson","year":"2015","journal-title":"Precision Medicine Initiative (PMI) Working Group Report to the Advisory Committee to the Director"},{"key":"R26-20230908","article-title":"The All of Us Research Program\u2014Building a Foundation for 21st Century Precision Health.","year":"2018","journal-title":"In: Personal Communication Cronin R"},{"key":"R27-20230908","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1002\/cncr.23157","article-title":"Barriers to recruiting underrepresented populations to cancer clinical trials: a systematic review.","volume":"112","author":"Ford","year":"2008","journal-title":"Cancer"},{"key":"R28-20230908","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.cct.2014.08.004","article-title":"Strategies addressing barriers to clinical trial enrollment of underrepresented populations: a systematic review.","volume":"39","author":"Heller","year":"2014","journal-title":"Contemp Clin Trials"},{"key":"R30-20230908","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1093\/jamia\/ocv035","article-title":"Informatics to support the IOM social and behavioral domains and measures.","volume":"22","author":"Hripcsak","year":"2015","journal-title":"J Am Med Inform Assoc"},{"key":"R31-20230908","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1093\/poq\/nfm006","article-title":"Research synthesis: the practice of cognitive interviewing.","volume":"71","author":"Beatty","year":"2007","journal-title":"Publ Opin Quart"},{"key":"R32-20230908","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1586\/erp.11.103","article-title":"Successful implementation of cognitive interviews in special populations.","volume":"12","author":"DeMuro","year":"2012","journal-title":"Expert Rev Pharmacoecon Outcomes Res"},{"key":"R35-20230908","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.jbi.2008.08.010","article-title":"Research electronic data capture (REDCap)\u2014a metadata-driven methodology and workflow process for providing translational research informatics support.","volume":"42","author":"Harris","year":"2009","journal-title":"J Biomed Inform"},{"key":"R36-20230908","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF02310555","article-title":"Coefficient alpha and the internal structure of tests.","volume":"16","author":"Cronbach","year":"1951","journal-title":"Psychometrika"},{"key":"R38-20230908","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1016\/j.jclinepi.2015.09.016","article-title":"Million veteran program: a mega-biobank to study genetic influences on health and disease.","volume":"70","author":"Gaziano","year":"2016","journal-title":"J Clin Epidemiol"},{"key":"R39-20230908","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1016\/j.jclinepi.2010.04.011","article-title":"The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008.","volume":"63","author":"Cella","year":"2010","journal-title":"J Clin Epidemiol"},{"key":"R40-20230908","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s11606-013-2568-0","article-title":"Psychometric properties of the brief health literacy screen in clinical practice.","volume":"29","author":"Wallston","year":"2014","journal-title":"J Gen Intern Med"},{"key":"R41-20230908","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1001\/jamainternmed.2017.0906","article-title":"Emergency department query for patient-centered approaches to sexual orientation and gender identity: the EQUALITY study.","volume":"177","author":"Haider","year":"2017","journal-title":"JAMA Intern Med"},{"key":"R42-20230908","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1093\/aje\/kwg006","article-title":"Validation of self-reported cancers in the California Teachers Study.","volume":"157","author":"Parikh-Patel","year":"2003","journal-title":"Am J Epidemiol"},{"key":"R43-20230908","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1177\/0193945906287215","article-title":"Increasing minority research participation through community organization outreach.","volume":"28","author":"Alvarez","year":"2006","journal-title":"West J Nurs Res"},{"issue":"suppl 1","key":"R44-20230908","doi-asserted-by":"crossref","first-page":"S134","DOI":"10.1093\/geront\/gnq098","article-title":"An interdisciplinary outreach model of African American recruitment for Alzheimer\u2019s disease research.","volume":"51","author":"Williams","year":"2011","journal-title":"Gerontologist"},{"issue":"suppl 1","key":"R45-20230908","doi-asserted-by":"crossref","first-page":"S29","DOI":"10.1097\/00002093-199904001-00008","article-title":"Gaining and sustaining minority participation in longitudinal research projects.","volume":"13","author":"Gauthier","year":"1999","journal-title":"Alzheimer Dis Assoc Disord"}],"container-title":["Epidemiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/00001648-201907000-00019","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,8]],"date-time":"2023-09-08T11:29:27Z","timestamp":1694172567000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/00001648-201907000-00019"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019]]}},"URL":"https:\/\/doi.org\/10.1097\/ede.0000000000001028","relation":{},"ISSN":["1044-3983"],"issn-type":[{"value":"1044-3983","type":"print"}],"subject":[],"published":{"date-parts":[[2019,7]]}}}