{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T08:24:52Z","timestamp":1787041492558,"version":"build-2736575974"},"reference-count":19,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T00:00:00Z","timestamp":1783900800000},"content-version":"vor","delay-in-days":12,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T00:00:00Z","timestamp":1782864000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Learning Health Systems"],"published-print":{"date-parts":[[2026,7]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Learning Health Systems (LHSs) depend on the ability to effectively evaluate programs and translate data into practice. Within the Veterans Affairs (VA) health system, formal mandates require programmatic decision\u2010making to be data\u2010driven; however, opportunities for staff to develop applied program evaluation skills that support LHS learning cycles remain limited.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>To address this need, the synchronous virtual Evaluation Bootcamp Training (EBcT) was developed to equip learners with practical, applied evaluation skills. This manuscript describes the design rationale, structure, and core concepts of the training, emphasizing design decisions intended to support evaluation capacity building within a large and complex health system.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>EBcT was delivered over 4\u2009days across 2 training cohorts (8 learners in 4 project teams from Cohort 1; 12 learners in 5 project teams from Cohort 2). Project teams addressed a range of clinical and operational initiatives within VA. Learners represented diverse professional roles, including lead evaluators, clinical subject matter experts, project managers, operational leaders, and analysts. Learners reported high satisfaction throughout the training, with full attendance at application sessions and strong participation in didactic components. A majority reported meeting predefined evaluation learning targets at the end of the training.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Findings suggest that structured, team\u2010based training models such as EBcT can strengthen evaluation capacity and support LHS functioning by equipping project teams to engage in repeated cycles of measurement, learning, and performance improvement.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/lrh2.70102","type":"journal-article","created":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T00:35:13Z","timestamp":1783989313000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Developing a Program Evaluation Training Within a National Federal Healthcare Setting: Veterans Affairs Evaluation Bootcamp Training"],"prefix":"10.1002","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7656-3158","authenticated-orcid":false,"given":"Nardeen M.","family":"Shafik","sequence":"first","affiliation":[{"name":"VA QUERI Center for Evaluation and Implementation Resources  Ann Arbor Michigan USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John P.","family":"Donnelly","sequence":"additional","affiliation":[{"name":"VA QUERI Center for Evaluation and Implementation Resources  Ann Arbor Michigan USA"},{"name":"VA HSR Center for Clinical Management Research  Ann Arbor Michigan USA"},{"name":"Department of Learning Health Sciences University of Michigan  Ann Arbor Michigan USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica","family":"Johnson","sequence":"additional","affiliation":[{"name":"VA QUERI Center for Evaluation and Implementation Resources  Ann Arbor Michigan USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linda M.","family":"Kawentel","sequence":"additional","affiliation":[{"name":"VA QUERI Center for Evaluation and Implementation Resources  Ann Arbor Michigan USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas W.","family":"Bowersox","sequence":"additional","affiliation":[{"name":"VA QUERI Center for Evaluation and Implementation Resources  Ann Arbor Michigan USA"},{"name":"VA HSR Center for Clinical Management Research  Ann Arbor Michigan USA"},{"name":"Department of Learning Health Sciences University of Michigan  Ann Arbor Michigan USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,7,13]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.7326\/0003\u20104819\u2010157\u20103\u2010201208070\u201000012"},{"key":"e_1_2_9_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/lrh2.10265"},{"key":"e_1_2_9_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/lrh2.10405"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/lrh2.10482"},{"key":"e_1_2_9_6_1","unstructured":"H.R.4174 \u201c115th Congress (2017\u20132018): Foundations for Evidence\u2010Based Policymaking Act of 2018 \u201d2019) https:\/\/www.congress.gov\/bill\/115th\u2010congress\/house\u2010bill\/4174."},{"key":"e_1_2_9_7_1","volume-title":"VHA Operations Activities That May Constitute Research (Program Guide No. 1200.21)","author":"VA Office of Research & Development","year":"2011"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/1098214008324182"},{"issue":"11","key":"e_1_2_9_9_1","first-page":"1","article-title":"Framework for Program Evaluation in Public Health","volume":"48","author":"Centers for Disease Control and Prevention","year":"1999","journal-title":"Morbidity and Mortality Weekly Report"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.15585\/mmwr.rr7306a1"},{"key":"e_1_2_9_11_1","volume-title":"Quality Enhancement Research Initiative (QUERI) Evaluation Guide: Developing and Implementing a High\u2010Quality Evaluation","author":"Bowersox N. W.","year":"2021"},{"key":"e_1_2_9_12_1","volume-title":"An Introduction to the New World Kirkpatrick Model","author":"Kirkpatrick J.","year":"2015"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2008.08.010"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/1609406920964345"},{"key":"e_1_2_9_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/lrh2.10333"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.1177\/00333549231163529"},{"key":"e_1_2_9_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/1098214009356022"},{"issue":"1","key":"e_1_2_9_18_1","first-page":"213","article-title":"Improving Data Visualization Skills: A Curriculum Design","volume":"18","author":"Asamoah D.","year":"2022","journal-title":"International Journal of Education and Development using Information and Communication Technology"},{"key":"e_1_2_9_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.iheduc.2010.10.001"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjet.12268"}],"container-title":["Learning Health Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lrh2.70102","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/lrh2.70102","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lrh2.70102","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T07:35:05Z","timestamp":1787038505000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/lrh2.70102"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7]]},"references-count":19,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,7]]}},"alternative-id":["10.1002\/lrh2.70102"],"URL":"https:\/\/doi.org\/10.1002\/lrh2.70102","archive":["Portico"],"relation":{},"ISSN":["2379-6146","2379-6146"],"issn-type":[{"value":"2379-6146","type":"print"},{"value":"2379-6146","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7]]},"assertion":[{"value":"2025-06-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-25","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70102"}}