{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T01:44:18Z","timestamp":1790127858043,"version":"4.0.1"},"reference-count":10,"publisher":"Oxford University Press (OUP)","issue":"7-8","funder":[{"DOI":"10.13039\/100014054","name":"Army Public Health Center","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100014054","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,7,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n               <jats:p>Service Members and military beneficiaries face complex and ill-structured challenges, including suicide, sexual violence, increasing health care costs, and the evolving coronavirus pandemic. Military and other government practitioners must identify effective programs, policies, and initiatives to preserve the health and ensure the readiness of our Force. Both research and program evaluation are critical to identify interventions best positioned to prevent disease, protect the public\u2019s health, and promote health and well-being within our ranks to retain a medically ready force and reduce the global burden of disease. While military and medical leaders are typically well versed in research and understand the role of research in evidence-informed decisions, they may be less aware of program evaluation. Program evaluation is the systematic application of scientific methods to assess the design, implementation, improvement, or outcomes of a program, policy, or initiative. Although program evaluators commonly utilize scientific or research methods to answer evaluation questions, evaluation ultimately differs from research in its intent. Several recently published federal and Department of Defense policies specifically reference program evaluation, emphasizing its importance to the military and government as a whole. The Army is uniquely positioned to conduct medical and public health evaluation activities and there are several Army organizations and entities that routinely perform this work. For example, the United States Army Public Health Center (APHC) is among recognized military experts in public health assessment and program evaluation. Given the breadth of our work, the APHC understands the challenges to conducting evaluation studies in the Army and we have thoughtfully examined the conditions common to successful evaluation studies. In this commentary, we share our lessons learned to assist military colleagues, potential partners, and others in successfully evaluating the programs, policies, and initiatives necessary to keep our Service Members and beneficiaries healthy and ready. There are several challenges to executing evaluation studies in the Army that may be relevant across all Services. These include but are not limited to frequent Army leadership transitions, urgency to report study results, lack of program documentation and adequate planning for evaluation, expectation management to ensure stakeholders are well-informed about the evaluation process, and a disorganized data landscape. These challenges may hinder the successful execution of evaluation studies, or prevent them from being attempted in the first place, depriving Army leaders of quality, actionable information to make evidence-informed decisions. Despite the aforementioned challenges, we have identified a number of best practices to overcome these challenges and conduct successful evaluation studies. These facilitators of successful evaluations can be summarized as: collaboration with engaged stakeholders who understand the value of evaluation, evaluation studies aligned with larger strategic priorities, agile methodology, thoughtful evaluation planning, and effective communication with stakeholders. We wholeheartedly recommend and encourage program evaluation at every opportunity, and we anticipate the call for evaluation and evidence-informed decisions to continually increase. Our hope is that others \u2013 to include partners and stakeholders within and external to the military \u2013 will be able to leverage and apply this information, especially the identified best practices, in their evaluation efforts to ensure success.<\/jats:p>","DOI":"10.1093\/milmed\/usab516","type":"journal-article","created":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T10:14:32Z","timestamp":1640686472000},"page":"189-195","source":"Crossref","is-referenced-by-count":2,"title":["The Role of Program Evaluation in Keeping Army Health \u201cArmy Strong\u201d: Translating Lessons Learned Into Best Practices"],"prefix":"10.1093","volume":"187","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4694-6195","authenticated-orcid":false,"given":"Theresa Jackson","family":"Santo","sequence":"first","affiliation":[{"name":"Public Health Assessment Division, Health Promotion and Wellness Directorate, U.S. Army Public Health Center , Aberdeen Proving Ground-EA, MD 21010, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jill A","family":"Brown","sequence":"additional","affiliation":[{"name":"Former Public Health Scientist, Public Health Assessment Division, Health Promotion and Wellness Directorate, U.S. Army Public Health Center , Aberdeen Proving Ground-EA, MD 21010, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie A Q","family":"Gomez","sequence":"additional","affiliation":[{"name":"Public Health Assessment Division, Health Promotion and Wellness Directorate, U.S. Army Public Health Center , Aberdeen Proving Ground-EA, MD 21010, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren A","family":"Shirey","sequence":"additional","affiliation":[{"name":"Public Health Assessment Division, Health Promotion and Wellness Directorate, U.S. Army Public Health Center , Aberdeen Proving Ground-EA, MD 21010, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,12,28]]},"reference":[{"key":"2022070112164981000_R1","volume-title":"Evaluation: A Systematic Approach","author":"Rossi","year":"1993","edition":"5th"},{"key":"2022070112164981000_R2","article-title":"10 essential public health services","author":"Centers for Disease Control and Prevention"},{"key":"2022070112164981000_R3","article-title":"Evaluation flash cards: embedding evaluative thinking in organizational culture","volume-title":"Otto Bremer Foundation","author":"Patton","year":"2017"},{"key":"2022070112164981000_R4","first-page":"183","volume-title":"Fundamental Issues in Evaluation","author":"Mathison","year":"2007"},{"key":"2022070112164981000_R5","article-title":"John LaVelle on describing evaluation","volume-title":"AEA365: A Tip-a-Day By and For Evaluators Blog","author":"LaVelle","year":"2010"},{"key":"2022070112164981000_R6","article-title":"Four differences between research and program evaluation","volume-title":"Nonprofit Capacity Building Blog","author":"Small","year":"2012"},{"key":"2022070112164981000_R7","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00934","article-title":"The Person-Event Data Environment (PDE): leveraging big data for studies of psychological strengths in soldiers","volume":"4","author":"Vie","year":"2013","journal-title":"Front Psychol"},{"key":"2022070112164981000_R8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1089\/big.2014.00","article-title":"The U.S. Army Person-Event Data Environment: a military-civilian big data enterprise","volume":"3","author":"Vie","year":"2015","journal-title":"Big Data"},{"key":"2022070112164981000_R9","volume-title":"Understanding the Military: The Institution, the Culture, and the People","author":"Halvorson","year":"2010"},{"key":"2022070112164981000_R10","volume-title":"US Army Culture: An Introduction for Behavioral Health Researchers","author":"Meyer","year":"2017"}],"container-title":["Military Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/milmed\/article-pdf\/187\/7-8\/189\/44369614\/usab516.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/milmed\/article-pdf\/187\/7-8\/189\/44369614\/usab516.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T12:17:50Z","timestamp":1656677870000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/milmed\/article\/187\/7-8\/189\/6485114"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,28]]},"references-count":10,"journal-issue":{"issue":"7-8","published-online":{"date-parts":[[2021,12,28]]},"published-print":{"date-parts":[[2022,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/milmed\/usab516","relation":{},"ISSN":["0026-4075","1930-613X"],"issn-type":[{"value":"0026-4075","type":"print"},{"value":"1930-613X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,7,1]]},"published":{"date-parts":[[2021,12,28]]}}}