{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T11:25:15Z","timestamp":1790853915075,"version":"4.1.0"},"reference-count":49,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Edith Murphy Foundation","award":["1026062"],"award-info":[{"award-number":["1026062"]}]},{"name":"the Edith Murphy Foundation","award":["1080154"],"award-info":[{"award-number":["1080154"]}]},{"name":"St. Basils","award":["1026062"],"award-info":[{"award-number":["1026062"]}]},{"name":"St. Basils","award":["1080154"],"award-info":[{"award-number":["1080154"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Underpinned by the New World Kirkpatrick model, and in the context of a community-based sport psychology programme (My Strengths Training for Life\u2122) for young people experiencing homelessness, this process evaluation investigated (1) young peoples\u2019 reactions (i.e., program and facilitator evaluation, enjoyment, attendance, and engagement) and learning (i.e., mental skills and transfer intention), (2) the relationship between reaction and learning variables, and (3) the mediators underpinning this relationship. A total of 301 young people living in a West Midlands housing service completed questionnaires on demographics and reaction and learning variables. Higher levels of programme engagement were positively associated with more favourable reactions to the programme. Enjoyment positively predicted learning outcomes, which was mediated by transfer intention. Recommendations are made for (1) a balance between rigor and flexibility for evaluation methods with disadvantaged youth, (2) including engagement as well as attendance as indicators of meaningful programme participation, (3) measuring programme experiences (e.g., enjoyment) to understand programme effectiveness, and (4) providing opportunities for skill transfer during and after programme participation. Our findings have implications for researchers, programme commissioners, and policymakers designing and evaluating programmes in community-based settings.<\/jats:p>","DOI":"10.3390\/ijerph191811320","type":"journal-article","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T20:50:27Z","timestamp":1662670227000},"page":"11320","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A Kirkpatrick Model Process Evaluation of Reactions and Learning from My Strengths Training for Life\u2122"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0636-6957","authenticated-orcid":false,"given":"Mary L.","family":"Quinton","sequence":"first","affiliation":[{"name":"School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham B15 2TT, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Grace","family":"Tidmarsh","sequence":"additional","affiliation":[{"name":"School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham B15 2TT, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1173-4814","authenticated-orcid":false,"given":"Benjamin J.","family":"Parry","sequence":"additional","affiliation":[{"name":"School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham B15 2TT, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5655-7842","authenticated-orcid":false,"given":"Jennifer","family":"Cumming","sequence":"additional","affiliation":[{"name":"School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham B15 2TT, UK"},{"name":"Institute for Mental Health, University of Birmingham, Birmingham B15 2TT, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"112","DOI":"10.3389\/fpubh.2018.00112","article-title":"Do programs for runaway and homeless youth work? A qualitative exploration from the perspectives of youth clients in diverse settings","volume":"6","author":"Gwadz","year":"2018","journal-title":"Front. Public Health"},{"key":"ref_2","unstructured":"Homeless Link (2020, August 02). Young and Homeless. Available online: https:\/\/homeless.org.uk\/knowledge-hub\/young-and-homeless-2021\/."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1002\/yd.20110","article-title":"Using relational developmental systems theory to link program goals, activities, and outcomes: The sample case of the 4-H Study of Positive Youth Development","volume":"144","author":"Lerner","year":"2014","journal-title":"New Dir. Youth Dev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e28","DOI":"10.1016\/j.puhe.2022.02.006","article-title":"Hard to reach? Language matters when describing populations underserved by health and social care research","volume":"205","author":"Routen","year":"2022","journal-title":"Public Health"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Boneveski, B., Randell, M., Paul, C., Chapman, K., Twyman, L., Bryant, J., Brozek, I., and Hughes, C. (2014). Reaching the hard-to-reach: A systematic review of strategies for improving health and medical research with socially disadvantaged groups. BMC Med. Res. Methodol., 14.","DOI":"10.1186\/1471-2288-14-42"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"106","DOI":"10.5195\/jyd.2022.1156","article-title":"Process evaluations of positive youth development programmes for disadvantaged young people: A systematic review","volume":"17","author":"Tidmarsh","year":"2022","journal-title":"J. Youth Dev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1176\/appi.ps.201300425","article-title":"Fidelity of a strengths-based intervention used by Dutch shelters for homeless young adults","volume":"66","author":"Krabbenborg","year":"2015","journal-title":"Psychiatr. Serv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102045","DOI":"10.1016\/j.evalprogplan.2021.102045","article-title":"The My Strengths Training for Life program: Rationale, logic model, and description of a strengths-based intervention for young people experiencing homelessness","volume":"91","author":"Cumming","year":"2022","journal-title":"Eval. Program Plann."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1002\/jcop.22517","article-title":"An evaluation of My Strengths Training for Life (TM) for improving resilience and well-being of young people experiencing homelessness","volume":"49","author":"Quinton","year":"2021","journal-title":"J. Community Psychol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2036","DOI":"10.3389\/fpsyg.2019.02036","article-title":"The Experiences of Homeless Youth When Using Strengths Profiling to Identify Their Character Strengths","volume":"10","author":"Cooley","year":"2019","journal-title":"Front. Psychol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Cumming, J., Clarke, F.J., Holland, M.J.G., Parry, B.J., Quinton, M.L., and Cooley, S.J. (2022). A Feasibility Study of the My Strengths Training for Life\u2122 (MST4Life\u2122) Program for Young People Experiencing Homelessness. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph19063320"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"105793","DOI":"10.1016\/j.childyouth.2020.105793","article-title":"Improving outcomes in young people experiencing homelessness with My Strengths Training for Life (TM) (MST4Life (TM)): A qualitative realist evaluation","volume":"121","author":"Parry","year":"2021","journal-title":"Child. Youth Serv. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"157","DOI":"10.5195\/jyd.2021.1061","article-title":"Promoting Personal Growth in Young People Experiencing Homelessness Through an Outdoors-Based Program","volume":"16","author":"Parry","year":"2021","journal-title":"J. Youth Dev."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"73","DOI":"10.53841\/bpssepr.2022.17.1.73","article-title":"A platform for youth voice in MST4Life: A vital component of process evaluations","volume":"17","author":"Tidmarsh","year":"2022","journal-title":"Sport Exerc. Psychol. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"102150","DOI":"10.1016\/j.evalprogplan.2022.102150","article-title":"Assessing the fidelity of delivery style of a mental skills training programme for young people experiencing homelessness","volume":"94","author":"Tidmarsh","year":"2022","journal-title":"Eval. Program Plan."},{"key":"ref_16","unstructured":"Jabbour, L., and Siu, J. (2020, August 02). Economic Evaluation of Psychologically Informed Environments: Cost-Benefit Analysis of BOOST and MST4Life\u2122 Programs. Available online: https:\/\/www.sprintproject.org\/impact."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1136\/jech-2013-202869","article-title":"Process evaluation in complex public health intervention studies: The need for guidance","volume":"2","author":"Moore","year":"2014","journal-title":"J. Epidemiol. Community Health"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1177\/1468794110380522","article-title":"Process evaluation: The new miracle ingredient in public health research?","volume":"10","author":"Munro","year":"2010","journal-title":"Qual. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1080\/0145935X.2021.1884542","article-title":"An adapted life skills empowerment program for homeless youth: Preliminary findings","volume":"42","year":"2021","journal-title":"Child Youth Serv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kirkpatrick, J., and Kirkpatrick, W. (2020, August 02). An Introduction to the New World Kirkpatrick Model. Available online: https:\/\/www.kirkpatrickpartners.com\/wp-content\/uploads\/2021\/11\/Introduction-to-the-Kirkpatrick-New-World-Model.pdf.","DOI":"10.4324\/9781003128755-1"},{"key":"ref_21","unstructured":"Clarke, F.J., Parry, B.J., Quinton, M.L., and Cumming, J. (2020, August 02). Mental Skills Training Commissioning and Evaluation Toolkit. Available online: https:\/\/www.sprintproject.org\/toolkit."},{"key":"ref_22","unstructured":"Kirkpatrick, D. (1994). Evaluating Training Programs: The Four Levels, Berrett-Koehler."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1108\/EJTD-06-2014-0046","article-title":"Developing the Model for Optimal Learning and Transfer (MOLT) following an evaluation of outdoor groupwork skills programmes","volume":"39","author":"Cooley","year":"2015","journal-title":"Eur. J. Train. Dev."},{"key":"ref_24","first-page":"999","article-title":"Has the new Kirkpatrick generation built a better hammer for our evaluation toolbox?","volume":"39","author":"Moreau","year":"2017","journal-title":"Med. Teach."},{"key":"ref_25","first-page":"329","article-title":"Using outdoor adventure education to develop students\u2019 groupwork skills: A quantitative exploration of reaction and learning","volume":"39","author":"Cooley","year":"2016","journal-title":"J. Exp. Educ."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1177\/1744987118786019","article-title":"The evaluation of a home-based paediatric nursing service: Concept and design development using the Kirkpatrick model","volume":"23","author":"Jones","year":"2018","journal-title":"J. Res. Nurs."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1002\/yd.20112","article-title":"Moving beyond attendance: Lessons learned from assessing engagement in afterschool contexts","volume":"144","author":"Fredricks","year":"2014","journal-title":"New Dir. Youth Dev."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/j.drugalcdep.2012.01.011","article-title":"The Washington circle engagement performance measures\u2019 association with adolescent treatment outcomes","volume":"124","author":"Garnick","year":"2012","journal-title":"Drug Alcohol Depend."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1111\/j.1467-8624.2005.00879.x","article-title":"An ecological analysis of after-school program participation in the development of academic performance and motivational attributes for disadvantaged children","volume":"76","author":"Mahoney","year":"2005","journal-title":"Child Dev."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1111\/j.1751-7893.2011.00338.x","article-title":"Does engagement with an intensive outreach service predict better treatment outcomes in \u2018high-risk\u2019 youth?","volume":"6","author":"Schley","year":"2012","journal-title":"Early Interv. Psychiatry"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1016\/j.jadohealth.2016.11.019","article-title":"A review of effective youth engagement strategies for mental health and substance use interventions","volume":"60","author":"Dunne","year":"2017","journal-title":"J. Adolesc. Health"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.evalprogplan.2018.02.009","article-title":"Homeless youth: Barriers and facilitators for service referrals","volume":"68","author":"Black","year":"2018","journal-title":"Eval. Program Plann."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1080\/00461520.2012.696438","article-title":"The import of knowledge export: Connecting findings and theories of transfer of learning","volume":"47","author":"Day","year":"2012","journal-title":"Educ. Psychol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1037\/0003-066X.55.1.68","article-title":"Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being","volume":"55","author":"Ryan","year":"2000","journal-title":"Am. Psychol."},{"key":"ref_35","unstructured":"APA (2020, August 02). Racial and Ethnic Identity. Available online: https:\/\/apastyle.apa.org\/style-grammar-guidelines\/bias-free-language\/racial-ethnic-minorities."},{"key":"ref_36","unstructured":"Foundation, M.H. (2020, August 02). Available online: https:\/\/www.mencap.org.uk\/learning-disability-explained\/learning-difficulties."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1080\/01443410802337794","article-title":"Teacher support, student motivation, student need satisfaction, and college teacher course evaluations: Testing a sequential path model","volume":"28","author":"Filak","year":"2008","journal-title":"Educ. Psychol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1037\/0022-3514.43.3.450","article-title":"Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory","volume":"43","author":"Ryan","year":"1982","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_39","unstructured":"Hansen, D.M., and Larson, R. (2020, August 02). The Youth Experience Survey 2.0: Instrument Revisions and Validity Testing. Available online: http:\/\/youthdev.illinois.edu\/wp-content\/uploads\/2013\/11\/YES-2.0-Instrument.pdf."},{"key":"ref_40","unstructured":"Tabachnick, B.G., and Fidell, L.S. (2019). Using Multivariate Statistics, Pearson Education Limited."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1198","DOI":"10.1080\/01621459.1988.10478722","article-title":"A test of missing completely at random for multivariate data with missing values","volume":"83","author":"Little","year":"1998","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc."},{"key":"ref_43","unstructured":"Bird, G.A., Quinton, M.L., and Cumming, J. (2021). Promoting Athlete Mental Health: The Role of Emotion Regulation. J. Clin. Sport Psychol., 1\u201320."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1657","DOI":"10.3389\/fpsyg.2019.01657","article-title":"Investigating the Protective Role of Mastery Imagery Ability in Buffering Debilitative Stress Responses","volume":"10","author":"Quinton","year":"2019","journal-title":"Front. Psychol."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Pallant, J. (2020). SPSS Survival Manual: A Step by Step Guide to Data Analysis Using SPSS, McGraw-Hill Education. [7th ed.].","DOI":"10.4324\/9781003117452"},{"key":"ref_46","unstructured":"Hayes, A.F. (2013). Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach, Guildford Press."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1984","DOI":"10.3389\/fpsyg.2017.01984","article-title":"On the interpretation and use of mediation: Multiple perspectives on mediation analysis","volume":"8","author":"Agler","year":"2017","journal-title":"Front. Psychol."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Hayes, A.F., Slater, M.D., and Snyder, L.B. (2008). Contemporary approaches to assessing mediation in communication research. The Sage Sourcebook of Advanced Data Analysis Methods for Communication Research, Sage.","DOI":"10.4135\/9781452272054"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1186\/s12889-018-5175-5","article-title":"\u2018This is the beginning of the new me\u2019: Process evaluation of a group fitness intervention to promote wellbeing in formerly homeless individuals","volume":"18","author":"Sofija","year":"2018","journal-title":"BMC Public Health"}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/19\/18\/11320\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:27:50Z","timestamp":1760142470000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/19\/18\/11320"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":49,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["ijerph191811320"],"URL":"https:\/\/doi.org\/10.3390\/ijerph191811320","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints202208.0367.v1","asserted-by":"object"}]},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,8]]}}}