{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T12:35:21Z","timestamp":1792931721580,"version":"4.5.0"},"reference-count":40,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T00:00:00Z","timestamp":1792627200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Health Promotion Practice"],"abstract":"<jats:p>\n                    Examining the relationship between determinants and implementation outcomes is key to advancing implementation science. However, the vast number of approaches, determinants, and outcomes make it difficult to synthesize findings. The aim of this exploratory paper was to assess the association between key determinants and outcomes across diverse health interventions. To that end, the Implementation Determinants and Outcomes Questionnaire (IDOQ) was developed, refined with face validity, and administered to implementation researchers (\n                    <jats:italic toggle=\"yes\">N<\/jats:italic>\n                    \u2009=\u2009208). The IDOQ asks participants to rate the success of a recent implementation project for five outcomes (Feasibility, Adoption, Fidelity, Penetration, and Sustainability) and the impact of five determinants (Available Resources, Compatibility, Leadership Engagement, Formal Internal Implementation Leaders, and External Implementation Change Agents) on those outcomes. We examined the relationship between determinants and outcomes using multiple regression analyses. While exploratory, all five determinants were found to be significant predictors of at least one outcome\u2014in 10 instances as barriers and in nine instances as facilitators (out of 50 possible pairings). Available Resources, functioning as a barrier, was found to be a significant predictor for every outcome. Overall, Available Resources and Compatibility were the most common significant predictors of implementation outcomes. In conclusion, by examining the relationship between key determinants and outcomes across program type and setting, we can more systematically understand these complex relationships. This may lead to causal frameworks and models, further advancing the power of implementation science. In addition, the nuance of whether determinants functioned as a barrier or a facilitator may support more adaptive approaches to implementation and sustainment across diverse health interventions.\n                  <\/jats:p>","DOI":"10.1177\/15248399261494553","type":"journal-article","created":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T11:29:33Z","timestamp":1792668573000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Researchers\u2019 Perceived Impact of Determinants on Implementation Outcomes: Questionnaire Development and Retrospective Cross-Sectional Study Across Diverse Health Interventions"],"prefix":"10.1177","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2604-7854","authenticated-orcid":false,"given":"Marin E.","family":"Schmitt","sequence":"first","affiliation":[{"name":"Medical College of Wisconsin, Milwaukee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3566-9631","authenticated-orcid":false,"given":"Rose","family":"Hennessy Garza","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Milwaukee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3526-3129","authenticated-orcid":false,"given":"Shawna N.","family":"Smith","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4632-0934","authenticated-orcid":false,"given":"Young","family":"Cho","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Milwaukee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5535-9809","authenticated-orcid":false,"given":"Lance S.","family":"Weinhardt","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Milwaukee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Florsheim","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Milwaukee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,10,22]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"crossref","unstructured":"Beidas R. S. Dorsey S. Lewis C. C. Lyon A. R. Powell B. J. Purtle J. Saldana L. Shelton R. C. Stirman S. W. Lane-Fall M. B. (2022). Promises and pitfalls in implementation science from the perspective of US-based researchers: Learning from a pre-mortem. Implementation Science 17(1) 55. https:\/\/doi.org\/10.1186\/s13012-022-01226-3","DOI":"10.1186\/s13012-022-01226-3"},{"key":"e_1_3_3_3_1","doi-asserted-by":"crossref","unstructured":"Bozsik F. Berman M. Shook R. Summar S. DeWit E. Carlson J. (2018). Implementation contextual factors related to youth advocacy for healthy eating and active living. Translational Behavioral Medicine 18(5) 696\u2013705. https:\/\/doi.org\/10.1093\/tbm\/ibx006","DOI":"10.1093\/tbm\/ibx006"},{"key":"e_1_3_3_4_1","doi-asserted-by":"crossref","unstructured":"Breitenstein S. M. Laurent S. Pabalan L. Risser H. J. Roper P. Saba M. T. Schoeny M. (2019). Implementation findings from an effectiveness-implementation trial of tablet-based parent training in pediatric primary care. Families Systems & Health: The Journal of Collaborative Family Healthcare 37(4) 282\u2013290. https:\/\/doi.org\/10.1037\/fsh0000447","DOI":"10.1037\/fsh0000447"},{"key":"e_1_3_3_5_1","volume-title":"Statistical power analysis for the behavioral sciences","author":"Cohen J.","year":"1988","unstructured":"Cohen J. (1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum."},{"key":"e_1_3_3_6_1","doi-asserted-by":"crossref","unstructured":"Cowie J. Nicoll A. Dimova E. D. Campbell P. Duncan E. A. (2020). The barriers and facilitators influencing the sustainability of hospital-based interventions: A systematic review. BMC Health Services Research 20(1) 588. https:\/\/doi.org\/10.1186\/s12913-020-05434-9","DOI":"10.1186\/s12913-020-05434-9"},{"key":"e_1_3_3_7_1","doi-asserted-by":"crossref","unstructured":"Damschroder L. J. (2020). Clarity out of chaos: Use of theory in implementation research. Psychiatry Research 283 112461. https:\/\/doi.org\/10.1016\/j.psychres.2019.06.036","DOI":"10.1016\/j.psychres.2019.06.036"},{"key":"e_1_3_3_8_1","doi-asserted-by":"crossref","unstructured":"Damschroder L. J. Aron D. C. Keith R. E. Kirsh S. R. Alexander J. A. Lowery J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science 4(1) 50. https:\/\/doi.org\/10.1186\/1748-5908-4-50","DOI":"10.1186\/1748-5908-4-50"},{"key":"e_1_3_3_9_1","doi-asserted-by":"crossref","unstructured":"Damschroder L. J. Lowery J. C. (2013). Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implementation Science 8(1) 51. https:\/\/doi.org\/10.1186\/1748-5908-8-51","DOI":"10.1186\/1748-5908-8-51"},{"key":"e_1_3_3_10_1","doi-asserted-by":"crossref","unstructured":"Damschroder L. J. Reardon C. M. AuYoung M. Moin T. Datta S. K. Sparks J. B. Maciejewski M. L. Steinle N. I. Weinreb J. E. Hughes M. Pinault L. F. Xiang X. M. Billington C. Richardson C. R. (2017). Implementation findings from a hybrid III implementation-effectiveness trial of the Diabetes Prevention Program (DPP) in the Veterans Health Administration (VHA). Implementation Science 12(1) 94. https:\/\/doi.org\/10.1186\/s13012-017-0619-3","DOI":"10.1186\/s13012-017-0619-3"},{"key":"e_1_3_3_11_1","doi-asserted-by":"crossref","unstructured":"Damschroder L. J. Reardon C. M. Widerquist M. A. O. Lowery J. (2022a). Conceptualizing outcomes for use with the consolidated framework for implementation research (CFIR): The CFIR outcomes addendum. Implementation Science 17(1) 7. https:\/\/doi.org\/10.1186\/s13012-021-01181-5","DOI":"10.1186\/s13012-021-01181-5"},{"key":"e_1_3_3_12_1","doi-asserted-by":"crossref","unstructured":"Damschroder L. J. Reardon C. M. Widerquist M. A. O. Lowery J. (2022b). The updated Consolidated Framework for Implementation Research based on user feedback. Implementation Science 17(1) 75. https:\/\/doi.org\/10.1186\/s13012-022-01245-0","DOI":"10.1186\/s13012-022-01245-0"},{"key":"e_1_3_3_13_1","doi-asserted-by":"crossref","unstructured":"Faul F. Erdfelder E. Lang A.-G. Buchner A. (2007). G*Power 3: A flexible statistical power analysis program for the social behavioral and biomedical sciences. Behavior Research Methods 39(2) 175\u2013191. https:\/\/doi.org\/10.3758\/BF03193146","DOI":"10.3758\/BF03193146"},{"key":"e_1_3_3_14_1","doi-asserted-by":"crossref","unstructured":"Freund J. Titzler I. Thielecke J. Braun L. Baumeister H. Berking M. Ebert D. D. (2020). Implementing internet- and tele-based interventions to prevent mental health disorders in farmers foresters and gardeners (ImplementIT): Study protocol for the multi-level evaluation of a nationwide project. BMC Psychiatry 20(1) 424. https:\/\/doi.org\/10.1186\/s12888-020-02800-z","DOI":"10.1186\/s12888-020-02800-z"},{"key":"e_1_3_3_15_1","doi-asserted-by":"crossref","unstructured":"Glasgow R. E. Vogt T. M. Boles S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health 89(9) 1322\u20131327. https:\/\/doi.org\/10.2105\/AJPH.89.9.1322","DOI":"10.2105\/AJPH.89.9.1322"},{"key":"e_1_3_3_16_1","doi-asserted-by":"crossref","unstructured":"Kerins C. McHugh S. McSharry J. Reardon C. M. Hayes C. Perry I. J. Geaney F. Seery S. Kelly C. (2020). Barriers and facilitators to implementation of menu labelling interventions from a food service industry perspective: A mixed methods systematic review. International Journal of Behavioral Nutrition and Physical Activity 17(1) 48. https:\/\/doi.org\/10.1186\/s12966-020-00948-1","DOI":"10.1186\/s12966-020-00948-1"},{"key":"e_1_3_3_17_1","doi-asserted-by":"crossref","unstructured":"King D. K. Shoup J. A. Raebel M. A. Anderson C. B. Wagner N. M. Ritzwoller D. P. Bender B. G. (2020). Planning for implementation success using RE-AIM and CFIR frameworks: A qualitative study. Frontiers in Public Health 8 59. https:\/\/doi.org\/10.3389\/fpubh.2020.00059","DOI":"10.3389\/fpubh.2020.00059"},{"key":"e_1_3_3_18_1","doi-asserted-by":"crossref","unstructured":"Kirk M. A. Kelley C. Yankey N. Birken S. A. Abadie B. Damschroder L. (2015). A systematic review of the use of the consolidated framework for implementation research. Implementation Science 11(1) 72. https:\/\/doi.org\/10.1186\/s13012-016-0437-z","DOI":"10.1186\/s13012-016-0437-z"},{"key":"e_1_3_3_19_1","doi-asserted-by":"crossref","unstructured":"Kislov R. Pope C. Martin G. P. Wilson P. M. (2019). Harnessing the power of theorising in implementation science. Implementation Science 14(1) 103. https:\/\/doi.org\/10.1186\/s13012-019-0957-4","DOI":"10.1186\/s13012-019-0957-4"},{"key":"e_1_3_3_20_1","doi-asserted-by":"crossref","unstructured":"Lau R. Stevenson F. Ong B. N. Dziedzic K. Treweek S. Eldridge S. Everitt H. Kennedy A. Qureshi N. Rogers A. Peacock R. Murray E. (2016). Achieving change in primary care\u2014Causes of the evidence to practice gap: Systematic reviews of reviews. Implementation Science 11(1) 40. https:\/\/doi.org\/10.1186\/s13012-016-0396-4","DOI":"10.1186\/s13012-016-0396-4"},{"key":"e_1_3_3_21_1","doi-asserted-by":"crossref","unstructured":"Lengnick-Hall R. Gerke D. R. Proctor E. K. Bunger A. C. Phillips R. J. Martin J. K. Swanson J. C. (2022). Six practical recommendations for improved implementation outcomes reporting. Implementation Science 17(1) 16. https:\/\/doi.org\/10.1186\/s13012-021-01183-","DOI":"10.1186\/s13012-021-01183-3"},{"key":"e_1_3_3_22_1","doi-asserted-by":"crossref","unstructured":"Lim W. M. (2024). A typology of validity: Content face convergent discriminant nomological and predictive validity. Journal of Trade Science 12(3) 155\u2013179. https:\/\/doi.org\/10.1108\/JTS-03-2024-0016","DOI":"10.1108\/JTS-03-2024-0016"},{"key":"e_1_3_3_23_1","doi-asserted-by":"crossref","unstructured":"Madrigal L. Manders O. C. Kegler M. Haard\u00f6rfer R. Piper S. Blais L. M. Weber M. B. Escoffery C. (2022). Inner and outer setting factors that influence the implementation of the National Diabetes Prevention Program (National DPP) using the Consolidated Framework for Implementation Research (CFIR): A qualitative study. Implementation Science Communications 3(1) 104. https:\/\/doi.org\/10.1186\/s43058-022-00350-x","DOI":"10.1186\/s43058-022-00350-x"},{"key":"e_1_3_3_24_1","doi-asserted-by":"crossref","unstructured":"McLoughlin G. M. Sweeney R. Liechty L. Lee J. A. Rosenkranz R. R. Welk G. J. (2022). Evaluation of a Large-Scale School Wellness Intervention Through the Consolidated Framework for Implementation Research (CFIR): Implications for Dissemination and Sustainability. Frontiers in Health Services 2 881639. https:\/\/doi.org\/10.3389\/frhs.2022.881639","DOI":"10.3389\/frhs.2022.881639"},{"key":"e_1_3_3_25_1","unstructured":"Moore D. J. E. Khan S. (2023). Promises and pitfalls of bridging the implementation science to practice gap from the perspective of implementation support practitioners [White Paper]. The Center for Implementation. https:\/\/thecenterforimplementation.com\/toolbox\/white-paper-promises-and-pitfalls"},{"key":"e_1_3_3_26_1","doi-asserted-by":"crossref","unstructured":"Nilsen P. (2015). Making sense of implementation theories models and frameworks. Implementation Science 10(1) 53. https:\/\/doi.org\/10.1186\/s13012-015-0242-0","DOI":"10.1186\/s13012-015-0242-0"},{"key":"e_1_3_3_27_1","doi-asserted-by":"crossref","unstructured":"Nilsen P. Bernhardsson S. (2019). Context matters in implementation science: A scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Services Research 19(1) 189. https:\/\/doi.org\/10.1186\/s12913-019-4015-3","DOI":"10.1186\/s12913-019-4015-3"},{"key":"e_1_3_3_28_1","doi-asserted-by":"crossref","unstructured":"Perry C. K. Damschroder L. J. Hemler J. R. Woodson T. T. Ono S. S. Cohen D. J. (2019). Specifying and comparing implementation strategies across seven large implementation interventions: A practical application of theory. Implementation Science 14(1) 32. https:\/\/doi.org\/10.1186\/s13012-019-0876-4","DOI":"10.1186\/s13012-019-0876-4"},{"key":"e_1_3_3_29_1","doi-asserted-by":"crossref","unstructured":"Possemato K. Kuhn E. Johnson E. M. Hoffman J. E. Brooks E. (2017). Development and refinement of a clinician intervention to facilitate primary care patient use of the PTSD Coach app. Translational Behavioral Medicine 7(1) 116\u2013126. https:\/\/doi.org\/10.1007\/s13142-016-0393-9","DOI":"10.1007\/s13142-016-0393-9"},{"key":"e_1_3_3_30_1","doi-asserted-by":"crossref","unstructured":"Powell B. J. Fernandez M. E. Williams N. J. Aarons G. A. Beidas R. S. Lewis C. C. McHugh S. M. Weiner B. J. (2019). Enhancing the impact of implementation strategies in healthcare: A research agenda. Frontiers in Public Health 7 3. https:\/\/doi.org\/10.3389\/fpubh.2019.00003","DOI":"10.3389\/fpubh.2019.00003"},{"key":"e_1_3_3_31_1","doi-asserted-by":"crossref","unstructured":"Powell B. J. Waltz T. J. Chinman M. J. Damschroder L. J. Smith J. L. Matthieu M. M. Proctor E. K. Kirchner J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science 10(1) 21. https:\/\/doi.org\/10.1186\/s13012-015-0209-1","DOI":"10.1186\/s13012-015-0209-1"},{"key":"e_1_3_3_32_1","doi-asserted-by":"crossref","unstructured":"Proctor E. Silmere H. Raghavan R. Hovmand P. Aarons G. Bunger A. Griffey R. Hensley M. (2011). Outcomes for implementation research: Conceptual distinctions measurement challenges and research agenda. Administration and Policy in Mental Health and Mental Health Services Research 38(2) 65\u201376. https:\/\/doi.org\/10.1007\/s10488-010-0319-7","DOI":"10.1007\/s10488-010-0319-7"},{"key":"e_1_3_3_33_1","doi-asserted-by":"crossref","unstructured":"Rapport F. Smith J. Hutchinson K. Clay-Williams R. Churruca K. Bierbaum M. Braithwaite J. (2022). Too much theory and not enough practice? The challenge of implementation science application in healthcare practice. Journal of Evaluation in Clinical Practice 28(6) 991\u20131002. https:\/\/doi.org\/10.1111\/jep.13600","DOI":"10.1111\/jep.13600"},{"key":"e_1_3_3_34_1","doi-asserted-by":"crossref","unstructured":"Reardon C. M. Damschroder L. J. Ashcraft L. E. Kerins C. Bachrach R. L. Nevedal A. L. Domlyn A. M. Dodge J. Chinman M. Rogal S. (2025). The Consolidated Framework for Implementation Research (CFIR) user guide: A five-step guide for conducting implementation research using the framework. Implementation Science 20(1) 39. https:\/\/doi.org\/10.1186\/s13012-025-01450-7","DOI":"10.1186\/s13012-025-01450-7"},{"key":"e_1_3_3_35_1","doi-asserted-by":"crossref","unstructured":"Robinson C. Damschroder L. J. (2023). A Pragmatic Context Assessment Tool (pCAT): Using a think aloud method to develop a practical assessment of contextual barriers to change. Implementation Science Communications 4(1) 3. https:\/\/doi.org\/10.1186\/s43058-022-00380-5","DOI":"10.1186\/s43058-022-00380-5"},{"key":"e_1_3_3_36_1","doi-asserted-by":"crossref","unstructured":"Ross J. Stevenson F. Lau R. Murray E. (2016). Factors that influence the implementation of e-health: A systematic review of systematic reviews (an update). Implementation Science 11(1) 146. https:\/\/doi.org\/10.1186\/s13012-016-0510-7","DOI":"10.1186\/s13012-016-0510-7"},{"key":"e_1_3_3_37_1","doi-asserted-by":"crossref","unstructured":"Santos W. J. Graham I. D. Lalonde M. Demery Varin M. Squires J. E. (2022). The effectiveness of champions in implementing innovations in health care: A systematic review. Implementation Science Communications 3(1) 80. https:\/\/doi.org\/10.1186\/s43058-022-00315-0","DOI":"10.1186\/s43058-022-00315-0"},{"key":"e_1_3_3_38_1","doi-asserted-by":"publisher","DOI":"10.1186\/s43058-025-00712-1"},{"key":"e_1_3_3_39_1","doi-asserted-by":"crossref","unstructured":"Stevens E. R. Shelley D. Boden-Albala B. (2021). Barriers to engagement in implementation science research: A national survey. Translational Behavioral Medicine 11(2) 408\u2013418. https:\/\/doi.org\/10.1093\/tbm\/ibz193","DOI":"10.1093\/tbm\/ibz193"},{"key":"e_1_3_3_40_1","doi-asserted-by":"crossref","unstructured":"Waltz T. J. Powell B. J. Fern\u00e1ndez M. E. Abadie B. Damschroder L. J. (2019). Choosing implementation strategies to address contextual barriers: Diversity in recommendations and future directions. Implementation Science 14(1) 42. https:\/\/doi.org\/10.1186\/s13012-019-0892-4","DOI":"10.1186\/s13012-019-0892-4"},{"key":"e_1_3_3_41_1","doi-asserted-by":"crossref","unstructured":"Wang Y. Wong E. L.-Y. Nilsen P. Chung V. C. Tian Y. Yeoh E.-K. (2023). A scoping review of implementation science theories models and frameworks\u2014An appraisal of purpose characteristics usability applicability and testability. Implementation Science 18(1) 43. https:\/\/doi.org\/10.1186\/s13012-023-01296-x","DOI":"10.1186\/s13012-023-01296-x"}],"container-title":["Health Promotion Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15248399261494553","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/15248399261494553","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15248399261494553","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T12:20:23Z","timestamp":1792930823000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/15248399261494553"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,22]]},"references-count":40,"alternative-id":["10.1177\/15248399261494553"],"URL":"https:\/\/doi.org\/10.1177\/15248399261494553","relation":{},"ISSN":["1524-8399","1552-6372"],"issn-type":[{"value":"1524-8399","type":"print"},{"value":"1552-6372","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,22]]},"article-number":"15248399261494553"}}