{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T15:23:32Z","timestamp":1786116212247,"version":"build-2736575974"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T00:00:00Z","timestamp":1784073600000},"content-version":"vor","delay-in-days":8,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Institutes of Health through the Implementing a Maternal health and PRegnancy Outcomes Vision for Everyone","award":["U24HD113136"],"award-info":[{"award-number":["U24HD113136"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,7,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background and Significance<\/jats:title>\n                    <jats:p>Generating real-world evidence (RWE) approaches across federated evidence networks based on real-world data requires learning new methodological skills. However, standardized frameworks for defining and assessing competencies for large-scale RWE research remain limited. This study aims to develop an assessment framework for RWE studies and evaluate the competencies of RWE research professionals.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We adapted the Joint Task Force (JTF) Core Competency Framework for RWE research using the Observational Medical Outcomes Partnership (OMOP) Common Data Model. Through iterative expert review, 4 new domains were created, including Ethics and Governance, Protocol Development, Study Operations, and Data Analysis and Informatics, and 4 original JTF domains were adapted. Participants completed pre- and post-training self-assessments on a 10-point scale. Paired t-tests with effect sizes were used to evaluate changes in competency scores.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Seventeen participants from academic, data, and clinical roles completed the assessment. Mean self-reported competency scores increased by 2.5 points across the 8 competency domains, with statistically significant changes observed in all domains. The largest gain was observed in Leadership and Professionalism (mean increase 3.66; 95% CI, 2.69-4.62).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>The RWE research competency assessment tool captured changes in self-reported skill proficiency, perceived readiness to conduct RWE studies, and methodological knowledge gaps. These findings suggest the potential to identify competency gaps, tailor educational interventions, and inform quality benchmarks for RWE research training programs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This study developed and evaluated a competency assessment framework specifically designed for RWE research using standardized healthcare data, providing a tool for training program evaluation and workforce development support.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamiaopen\/ooag128","type":"journal-article","created":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T04:50:03Z","timestamp":1784091003000},"source":"Crossref","is-referenced-by-count":0,"title":["Assessment of real-world evidence research competencies in federated research networks: a maternal health fellowship program evaluation"],"prefix":"10.1093","volume":"9","author":[{"given":"Haeun","family":"Lee","sequence":"first","affiliation":[{"name":"Biomedical Informatics and Data Science, Johns Hopkins School of Medicine, Johns Hopkins University , Baltimore, MD, 21205,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Martin","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Data Science, Johns Hopkins School of Medicine, Johns Hopkins University , Baltimore, MD, 21205,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreea A","family":"Creanga","sequence":"additional","affiliation":[{"name":"Department of Gynecology and Obstetrics, The Johns Hopkins University School of Medicine , Baltimore, MD, 21287,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Evan","family":"Minty","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, O\u2019Brien Institute for Public Health, University of Calgary , Calgary, Alberta, 2500,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asieh","family":"Golozar","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Data Science, Johns Hopkins School of Medicine, Johns Hopkins University , Baltimore, MD, 21205,","place":["United States"]},{"name":"Nemesis Health , New York, NY, 10009,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cindy X","family":"Cai","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Data Science, Johns Hopkins School of Medicine, Johns Hopkins University , Baltimore, MD, 21205,","place":["United States"]},{"name":"Wilmer Eye Institute, Johns Hopkins School of Medicine, Johns Hopkins University , Baltimore, MD,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cynthia","family":"Sung","sequence":"additional","affiliation":[{"name":"Center of Regulatory Excellence, Duke-NUS Medical School ,","place":["Singapore"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"O\u2019Rilley","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Data Science, Johns Hopkins School of Medicine, Johns Hopkins University , Baltimore, MD, 21205,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Khyzer","family":"Aziz","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Data Science, Johns Hopkins School of Medicine, Johns Hopkins University , Baltimore, MD, 21205,","place":["United States"]},{"name":"Department of Neonatology, The Johns Hopkins University School of Medicine , Baltimore, MD,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Nagy","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Data Science, Johns Hopkins School of Medicine, Johns Hopkins University , Baltimore, MD, 21205,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,7,14]]},"reference":[{"key":"2026080604265218400_ooag128-B1","doi-asserted-by":"publisher","first-page":"517","DOI":"10.2183\/pjab.98.026","article-title":"Clinical epidemiology and pharmacoepidemiology studies with real-world databases","volume":"98","author":"Yoshida","year":"2022","journal-title":"Proc Jpn Acad Ser B Phys Biol Sci"},{"key":"2026080604265218400_ooag128-B2","doi-asserted-by":"publisher","first-page":"e70153","DOI":"10.1111\/eci.70153","article-title":"Real-world evidence and observational studies: methodological challenges in clinical research","volume":"56","author":"Zoccali","year":"2026","journal-title":"Eur J Clin Invest"},{"key":"2026080604265218400_ooag128-B3","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1007\/s42081-022-00156-0","article-title":"Real world data and data science in medical research: present and future","volume":"5","author":"Togo","year":"2022","journal-title":"Jpn J Stat Data Sci"},{"key":"2026080604265218400_ooag128-B4","doi-asserted-by":"publisher","first-page":"2293","DOI":"10.1056\/NEJMsb1609216","article-title":"Real-world evidence\u2013what is it and what can it tell us?","volume":"375","author":"Sherman","year":"2016","journal-title":"N Engl J Med"},{"key":"2026080604265218400_ooag128-B5","first-page":"1a","article-title":"Big data analytics in healthcare: investigating the diffusion of innovation","volume":"16","author":"Dolezel","year":"2019","journal-title":"Perspect Health Inf Manag"},{"key":"2026080604265218400_ooag128-B6","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1097\/01.NAJ.0000803196.49507.08","article-title":"Overview: cohort study designs","volume":"121","author":"Capili","year":"2021","journal-title":"Am J Nurs"},{"key":"2026080604265218400_ooag128-B7","doi-asserted-by":"publisher","first-page":"1636","DOI":"10.1016\/j.cell.2024.02.012","article-title":"Generating and using real-world data: a worthwhile uphill battle","volume":"187","author":"Verkerk","year":"2024","journal-title":"Cell"},{"key":"2026080604265218400_ooag128-B8","doi-asserted-by":"publisher","first-page":"10159","DOI":"10.3390\/ijerph191610159","article-title":"Real-world evidence\u2014current developments and perspectives","volume":"19","author":"Schad","year":"2022","journal-title":"Int J Environ Res Public Health"},{"key":"2026080604265218400_ooag128-B9","year":"2025"},{"key":"2026080604265218400_ooag128-B10","doi-asserted-by":"publisher","first-page":"1236462","DOI":"10.3389\/fmed.2023.1236462","article-title":"Real-world evidence for regulatory decision-making: updated guidance from around the world","volume":"10","author":"Burns","year":"2023","journal-title":"Front Med (Lausanne)"},{"key":"2026080604265218400_ooag128-B11","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1177\/1932296819832661","article-title":"The new FDA real-world evidence program to support development of drugs and biologics","volume":"14","author":"Klonoff","year":"2020","journal-title":"J Diabetes Sci Technol"},{"key":"2026080604265218400_ooag128-B12","doi-asserted-by":"publisher","first-page":"ooac100","DOI":"10.1093\/jamiaopen\/ooac100","article-title":"Evaluating a novel approach to stimulate open science collaborations: a case series of \u201cstudy-a-thon\u201d events within the OHDSI and European IMI communities","volume":"5","author":"Hughes","year":"2022","journal-title":"JAMIA Open"},{"key":"2026080604265218400_ooag128-B13","author":"Education-OHDSI","year":"2025"},{"key":"2026080604265218400_ooag128-B14","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1136\/ejhpharm-2021-003081","article-title":"Toward a better understanding about real-world evidence","volume":"29","author":"Liu","year":"2022","journal-title":"Eur J Hosp Pharm Sci Pract"},{"key":"2026080604265218400_ooag128-B15","doi-asserted-by":"publisher","first-page":"e16941","DOI":"10.2196\/16941","article-title":"Teaching real-world evidence: protocol for a systematic review","volume":"9","author":"Lam","year":"2020","journal-title":"JMIR Res Protoc"},{"key":"2026080604265218400_ooag128-B16","doi-asserted-by":"publisher","first-page":"5126","DOI":"10.1038\/s41467-022-32310-3","article-title":"Reproducibility of real-world evidence studies using clinical practice data to inform regulatory and coverage decisions","volume":"13","author":"Wang","year":"2022","journal-title":"Nat Commun"},{"key":"2026080604265218400_ooag128-B17","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1055\/s-0041-1726481","article-title":"Drawing reproducible conclusions from observational clinical data with OHDSI","volume":"30","author":"Hripcsak","year":"2021","journal-title":"Yearb Med Inform"},{"key":"2026080604265218400_ooag128-B18","doi-asserted-by":"publisher","first-page":"1148","DOI":"10.3389\/fphar.2018.01148","article-title":"Joint task force for clinical trial competency and clinical research professional workforce development","volume":"9","author":"Sonstein","year":"2018","journal-title":"Front Pharmacol"},{"key":"2026080604265218400_ooag128-B19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s43441-019-00024-2","article-title":"Leveling the joint task force core competencies for clinical research professionals","volume":"54","author":"Sonstein","year":"2020","journal-title":"Ther Innov Regul Sci"},{"key":"2026080604265218400_ooag128-B20","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/s40290-022-00456-6","article-title":"Real-world evidence: a primer","volume":"37","author":"Dang","year":"2023","journal-title":"Pharmaceut Med"},{"key":"2026080604265218400_ooag128-B21","doi-asserted-by":"publisher","first-page":"S79","DOI":"10.7326\/M19-0873","article-title":"Research and reporting considerations for observational studies using electronic health record data","volume":"172","author":"Callahan","year":"2020","journal-title":"Ann Intern Med"},{"key":"2026080604265218400_ooag128-B22","doi-asserted-by":"publisher","first-page":"185","DOI":"10.2147\/CLEP.S129879","article-title":"Confounding in observational studies based on large health care databases: problems and potential solutions\u2014a primer for the clinician","volume":"9","author":"N\u00f8rgaard","year":"2017","journal-title":"Clin Epidemiol"},{"key":"2026080604265218400_ooag128-B23","doi-asserted-by":"publisher","first-page":"1561","DOI":"10.1093\/jamia\/ocad115","article-title":"Potential bias and lack of generalizability in electronic health record data: reflections on health equity from the National Institutes of Health Pragmatic Trials Collaboratory","volume":"30","author":"Boyd","year":"2023","journal-title":"J Am Med Inform Assoc JAMIA"},{"key":"2026080604265218400_ooag128-B24","doi-asserted-by":"publisher","first-page":"12","DOI":"10.4103\/picr.picr_217_21","article-title":"Observational designs for real-world evidence studies","volume":"13","author":"Taur","year":"2022","journal-title":"Perspect Clin Res"},{"key":"2026080604265218400_ooag128-B25","doi-asserted-by":"publisher","first-page":"5413","DOI":"10.1002\/sim.6265","article-title":"STRengthening analytical thinking for observational studies: the STRATOS initiative","volume":"33","author":"Sauerbrei","year":"2014","journal-title":"Stat Med"},{"key":"2026080604265218400_ooag128-B26","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1186\/s12874-022-01768-6","article-title":"Real-world data: a brief review of the methods, applications, challenges and opportunities","volume":"22","author":"Liu","year":"2022","journal-title":"BMC Med Res Methodol"},{"key":"2026080604265218400_ooag128-B27","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1093\/jamia\/ocad247","article-title":"OHDSI standardized vocabularies-a large-scale centralized reference ontology for international data harmonization","volume":"31","author":"Reich","year":"2024","journal-title":"J Am Med Inform Assoc JAMIA"},{"key":"2026080604265218400_ooag128-B28","doi-asserted-by":"publisher","first-page":"712569","DOI":"10.3389\/fpubh.2021.712569","article-title":"Federated networks for distributed analysis of health data","volume":"9","author":"Hallock","year":"2021","journal-title":"Front Public Health"},{"key":"2026080604265218400_ooag128-B29","doi-asserted-by":"publisher","first-page":"46","DOI":"10.18203\/2349-3259.ijct20180130","article-title":"Competency indices to assess the knowledge, skills and abilities of clinical research professionals","volume":"5","author":"Hornung","year":"2018","journal-title":"Int J Clin Trials"},{"key":"2026080604265218400_ooag128-B30","doi-asserted-by":"publisher","first-page":"101326","DOI":"10.1016\/j.mex.2021.101326","article-title":"Method of preparing a document for survey instrument validation by experts","volume":"8","author":"Elangovan","year":"2021","journal-title":"MethodsX"},{"key":"2026080604265218400_ooag128-B31","doi-asserted-by":"publisher","first-page":"1291667","DOI":"10.3389\/fmed.2024.1291667","article-title":"The competency index for clinical research professionals: a potential tool for competency-based clinical research academic program evaluation","volume":"11","author":"Jones","year":"2024","journal-title":"Front Med (Lausanne)"},{"key":"2026080604265218400_ooag128-B32","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1017\/cts.2016.2","article-title":"Education and training of clinical and translational study investigators and research coordinators: a competency-based approach","volume":"1","author":"Calvin-Naylor","year":"2017","journal-title":"J Clin Transl Sci"},{"key":"2026080604265218400_ooag128-B33","author":"Best Practices for Survey Research","year":"2025"},{"key":"2026080604265218400_ooag128-B34","first-page":"574","article-title":"Observational health data sciences and informatics (OHDSI): opportunities for observational researchers","volume":"216","author":"Hripcsak","year":"2015","journal-title":"Stud Health Technol Inform"},{"key":"2026080604265218400_ooag128-B35","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1093\/jamia\/ocaa103","article-title":"Principles of large-scale evidence generation and evaluation across a network of databases (LEGEND)","volume":"27","author":"Schuemie","year":"2020","journal-title":"J Am Med Inform Assoc JAMIA"},{"key":"2026080604265218400_ooag128-B36","doi-asserted-by":"publisher","first-page":"1104","DOI":"10.1093\/ije\/dyp164","article-title":"Ethics and observational studies in medical research: various rules in a common framework","volume":"38","author":"Claudot","year":"2009","journal-title":"Int J Epidemiol"},{"key":"2026080604265218400_ooag128-B37","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1111\/j.1475-6773.2005.00458.x","article-title":"Impact of institutional review board practice variation on observational health services research","volume":"41","author":"Green","year":"2006","journal-title":"Health Serv Res"},{"key":"2026080604265218400_ooag128-B38","doi-asserted-by":"publisher","first-page":"1148","DOI":"10.1378\/chest.15-0706","article-title":"Institutional review boards","volume":"148","author":"Grady","year":"2015","journal-title":"Chest"}],"container-title":["JAMIA Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article-pdf\/9\/4\/ooag128\/68840759\/ooag128.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article-pdf\/9\/4\/ooag128\/68840759\/ooag128.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,6]],"date-time":"2026-08-06T08:26:59Z","timestamp":1786004819000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article\/doi\/10.1093\/jamiaopen\/ooag128\/8734403"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,7]]},"references-count":38,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,7,7]]}},"URL":"https:\/\/doi.org\/10.1093\/jamiaopen\/ooag128","relation":{},"ISSN":["2574-2531"],"issn-type":[{"value":"2574-2531","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,8]]},"published":{"date-parts":[[2026,7,7]]},"article-number":"ooag128"}}