{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,6,26]],"date-time":"2024-06-26T15:13:47Z","timestamp":1719414827274},"reference-count":70,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T00:00:00Z","timestamp":1710547200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T00:00:00Z","timestamp":1710547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"John and Margaret Lillie Chair in Childhood Disability Research"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Health Serv Res"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Establishing the most important outcomes for school-based speech-language therapy is essential to guide future research and program evaluation for these services. Many health disciplines have developed core outcomes sets (COS) for this purpose. A COS encompasses the most important outcomes for particular health services as identified by appropriate interested parties. These interested parties usually represent health care providers and those with the health condition. In this paper, we report the development of a guiding framework for a COS for speech-language therapy services in schools in a Canadian context.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Using a group concept mapping method, we identified the outcomes for inclusion in the COS guiding framework through the elicited opinions of key interested parties: speech-language therapists, teachers, and family members of children with speech, language, and communication needs. We extracted 103 statements (potential outcomes) from a previous data set of interview transcripts. We then asked participants to sort the statements into conceptually similar groups, which were aggregated and transformed into a cluster map using multidimensional scaling followed by hierarchical cluster analysis. Participants also rated each statement on 5-point scales for importance and feasibility. We calculated mean ratings for individual statements and for all statements in a cluster, for all participants and for participant groups separately.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We identified seven core outcomes for school-based speech-language services in Ontario, Canada. These included: classroom-based services, a holistic approach, support for teachers, care coordination, accessible services, family supports, and student success. All outcomes were rated highly for importance. Feasibility ratings were consistently below importance ratings. All participant groups concurred that a holistic approach was the most important outcome and accessible services was the least feasible outcome to achieve.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The seven outcomes identified in this study are recommended to guide the development of a full COS to direct future research and program evaluation for school-based speech-language services. These outcomes have not been widely included in previous research and should be incorporated into future research alongside specific intervention outcomes. Data for some outcomes may be available from non-traditional sources such as administrative data sets. Consequently, their use for program evaluations should be accompanied by appropriate institutional support to allow speech-language therapists to make meaningful use of appropriate outcomes data.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12913-024-10821-7","type":"journal-article","created":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T02:01:49Z","timestamp":1710554509000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Core outcomes for speech-language services in Ontario schools: a group concept mapping study and guiding framework"],"prefix":"10.1186","volume":"24","author":[{"given":"Peter T.","family":"Cahill","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark A.","family":"Ferro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stella","family":"Ng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lyn S.","family":"Turkstra","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenonah N.","family":"Campbell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,3,16]]},"reference":[{"issue":"4","key":"10821_CR1","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1111\/j.1468-0009.2005.00397.x","volume":"83","author":"A Donabedian","year":"2005","unstructured":"Donabedian A. Evaluating the quality of medical care. Milbank Q. 2005;83(4):691\u2013729.","journal-title":"Milbank Q"},{"issue":"11","key":"10821_CR2","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1016\/S0097-5990(16)30560-7","volume":"18","author":"A Donabedian","year":"1992","unstructured":"Donabedian A. The role of outcomes in quality assessment and assurance. Qual Rev Bull. 1992;18(11):356\u201360.","journal-title":"Qual Rev Bull."},{"issue":"3","key":"10821_CR3","first-page":"169","volume":"27","author":"GD Schiff","year":"2001","unstructured":"Schiff GD, Rucker TD. Beyond structure-process-outcome: Donabedian\u2019s seven pillars and eleven buttresses of quality. J Qual Improv. 2001;27(3):169\u201374.","journal-title":"J Qual Improv"},{"issue":"6","key":"10821_CR4","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1093\/intqhc\/13.6.433","volume":"13","author":"N Klazinga","year":"2001","unstructured":"Klazinga N, Stronks K, Delnoij D, Verhoeff A. Indicators without a cause. Reflections on the development and use of indicators in health care from a public health perspective. Int J Qual Heal Care. 2001;13(6):433\u20138.","journal-title":"Int J Qual Heal Care"},{"issue":"2","key":"10821_CR5","first-page":"52","volume":"12","author":"R Deber","year":"2016","unstructured":"Deber R, Schwartz R. What\u2019s measured is not necessarily what matters: a cautionary story from public health. Healthc Policy. 2016;12(2):52\u201364.","journal-title":"Healthc Policy"},{"issue":"3","key":"10821_CR6","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1111\/j.1467-9299.2006.00600.x","volume":"84","author":"G Bevan","year":"2006","unstructured":"Bevan G, Hood C. What\u2019s measured is what matters: targets and gaming in the English public health care system. Public Adm. 2006;84(3):517\u201338.","journal-title":"Public Adm"},{"issue":"February","key":"10821_CR7","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1044\/2019_AJSLP-19-00076","volume":"29","author":"ML Cohen","year":"2020","unstructured":"Cohen ML, Hula WD. Patient-reported outcomes and evidence-based practice in speech-language pathology. Am J Speech-Lang Pathol. 2020;29(February):357\u201370.","journal-title":"Am J Speech-Lang Pathol"},{"issue":"4","key":"10821_CR8","first-page":"275","volume":"16","author":"PC Coyte","year":"1992","unstructured":"Coyte PC. Outcome measurement in speech-language pathology and audiology. Can J Speech-Lang Pathol Audiol. 1992;16(4):275\u201385.","journal-title":"Can J Speech-Lang Pathol Audiol"},{"issue":"1","key":"10821_CR9","doi-asserted-by":"publisher","first-page":"37","DOI":"10.3109\/14417049909167152","volume":"1","author":"A Hesketh","year":"1999","unstructured":"Hesketh A, Sage K. For better, for worse: outcome measurement in speech and language therapy. Adv Speech-Lang Pathol. 1999;1(1):37\u201345.","journal-title":"Adv Speech-Lang Pathol"},{"issue":"1","key":"10821_CR10","doi-asserted-by":"publisher","first-page":"63","DOI":"10.3109\/14417049909167158","volume":"1","author":"P Enderby","year":"1999","unstructured":"Enderby P. For richer for poorer: outcome measurement in speech and language therapy. Adv Speech-Lang Pathol. 1999;1(1):63\u20135.","journal-title":"Adv Speech-Lang Pathol"},{"issue":"1","key":"10821_CR11","doi-asserted-by":"publisher","first-page":"36","DOI":"10.3109\/17549507.2010.497562","volume":"13","author":"A John","year":"2011","unstructured":"John A. Therapy outcome measures: where are we now? Int J Speech Lang Pathol. 2011;13(1):36\u201342.","journal-title":"Int J Speech Lang Pathol"},{"issue":"2","key":"10821_CR12","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1080\/13682820701449984","volume":"43","author":"J Skeat","year":"2008","unstructured":"Skeat J, Perry A. Exploring the implementation and use of outcome measurement in practice: a qualitative study. Int J Lang Commun Disord. 2008;43(2):110\u201325.","journal-title":"Int J Lang Commun Disord"},{"issue":"2","key":"10821_CR13","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1007\/s10995-011-0751-7","volume":"16","author":"DZ Kuo","year":"2012","unstructured":"Kuo DZ, Houtrow AJ, Arango P, Kuhlthau KA, Simmons JM, Neff JM. Family-centered care: current applications and future directions in pediatric health care. Matern Child Health J. 2012;16(2):297\u2013305.","journal-title":"Matern Child Health J"},{"issue":"Suppl 3","key":"10821_CR14","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1186\/s13063-017-1978-4","volume":"18","author":"PR Williamson","year":"2017","unstructured":"Williamson PR, Altman DG, Bagley H, Barnes KL, Blazeby JM, Brookes ST, et al. The COMET Handbook: Version 1.0. Trials. 2017;18(Suppl 3):280.","journal-title":"Trials"},{"key":"10821_CR15","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1186\/1745-6215-13-132","volume":"13","author":"PR Williamson","year":"2012","unstructured":"Williamson PR, Altman DG, Blazeby JM, Clarke M, Devane D, Gargon E, et al. Developing core outcome sets for clinical trials: issues to consider. Trials. 2012;13:132.","journal-title":"Trials"},{"issue":"12","key":"10821_CR16","doi-asserted-by":"publisher","first-page":"e0168403","DOI":"10.1371\/journal.pone.0168403","volume":"11","author":"SL Gorst","year":"2016","unstructured":"Gorst SL, Gargon E, Clarke M, Smith V, Williamson PR. Choosing important health outcomes for comparative effectiveness research: an updated review and identification of gaps. PLoS One. 2016;11(12):e0168403.","journal-title":"PLoS One"},{"issue":"4","key":"10821_CR17","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1111\/ajr.12336","volume":"25","author":"MI McDonald","year":"2017","unstructured":"McDonald MI, Lawson KD. Doing it hard in the bush: aligning what gets measured with what matters. Aust J Rural Health. 2017;25(4):246\u201351.","journal-title":"Aust J Rural Health"},{"key":"10821_CR18","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1186\/s12955-015-0284-7","volume":"13","author":"C Morris","year":"2015","unstructured":"Morris C, Janssens A, Shilling V, Allard A, Fellowes A, Tomlinson R, et al. Meaningful health outcomes for paediatric neurodisability: Stakeholder prioritisation and appropriateness of patient reported outcome measures. Health Qual Life Outcomes. 2015;13:87.","journal-title":"Health Qual Life Outcomes"},{"issue":"5","key":"10821_CR19","doi-asserted-by":"publisher","first-page":"857","DOI":"10.1111\/epi.14735","volume":"60","author":"H Crudgington","year":"2019","unstructured":"Crudgington H, Rogers M, Bray L, Carter B, Currier J, Dunkley C, et al. Core Health Outcomes in Childhood Epilepsy (CHOICE): Development of a core outcome set using systematic review methods and a Delphi survey consensus. Epilepsia. 2019;60(5):857\u201371.","journal-title":"Epilepsia"},{"issue":"24","key":"10821_CR20","doi-asserted-by":"publisher","first-page":"2282","DOI":"10.3109\/09638288.2015.1021021","volume":"37","author":"SL Ng","year":"2015","unstructured":"Ng SL, Lingard L, Hibbert K, Regan S, Phelan S, Stooke R, et al. Supporting children with disabilities at school: Implications for the advocate role in professional practice and education. Disabil Rehabil. 2015;37(24):2282\u201390.","journal-title":"Disabil Rehabil"},{"key":"10821_CR21","unstructured":"Speech-Language and Audiology Canada. SAC position statement on the role of speech-language pathologists in schools. Ottawa; 2019. Available from: \nhttps:\/\/www.sac-oac.ca\/sites\/default\/files\/resources\/sac_s-lps_in_schools_position_statement_en.pdf."},{"key":"10821_CR22","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1044\/0161-1461.2904.250","volume":"29","author":"TM Gallagher","year":"1998","unstructured":"Gallagher TM, Swigert NB, Baum HM. Collecting outcomes data in schools: Needs and challenges. Lang Speech Hear Serv Sch. 1998;29:250\u20136.","journal-title":"Lang Speech Hear Serv Sch"},{"issue":"3","key":"10821_CR23","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1080\/08856257.2013.768452","volume":"28","author":"M Grosche","year":"2013","unstructured":"Grosche M, Volpe RJ. Response-to-intervention (RTI) as a model to facilitate inclusion for students with learning and behaviour problems. Eur J Spec Needs Educ. 2013;28(3):254\u201369.","journal-title":"Eur J Spec Needs Educ"},{"issue":"1","key":"10821_CR24","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1177\/0829573511400857","volume":"26","author":"K McIntosh","year":"2011","unstructured":"McIntosh K, MacKay LD, Andreou T, Brown JA, Mathews S, Gietz C, et al. Response to Intervention in Canada: definitions, the evidence base, and future directions. Can J Sch Psychol. 2011;26(1):18\u201343.","journal-title":"Can J Sch Psychol"},{"issue":"1","key":"10821_CR25","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1111\/cch.12621","volume":"45","author":"DR Anaby","year":"2019","unstructured":"Anaby DR, Campbell WN, Missiuna CA, Shaw SR, Bennett S, Khan S, et al. Recommended practices to organize and deliver school-based services for children with disabilities: a scoping review. Child Care Health Dev. 2019;45(1):15\u201327.","journal-title":"Child Care Health Dev"},{"key":"10821_CR26","unstructured":"Speech Pathology Australia. Position Statment on Speech Pathology in Education. 2022; Available from: \nhttps:\/\/www.pc.gov.au\/__data\/assets\/pdf_file\/0009\/341100\/sub011-school-agreement-attachment.pdf."},{"key":"10821_CR27","doi-asserted-by":"publisher","first-page":"3647397","DOI":"10.1155\/2019\/3647397","volume":"2019","author":"VC Kaelin","year":"2019","unstructured":"Kaelin VC, Ray-Kaeser S, Moioli S, Kocher Stalder C, Santinelli L, Echsel A, et al. Occupational therapy practice in mainstream schools: results from an online survey in Switzerland. Occup Ther Int. 2019;2019:3647397.","journal-title":"Occup Ther Int"},{"issue":"4","key":"10821_CR28","first-page":"267","volume":"45","author":"S Terreberry","year":"2021","unstructured":"Terreberry S, Dix L, Cahill PT, Passaretti B, Campbell WN. Moving towards a tiered model of speech and language services in Ontario schools: Perspectives of school-board speech-language pathologists. Can J Speech-Lang Pathol Audiol. 2021;45(4):267\u201382.","journal-title":"Can J Speech-Lang Pathol Audiol"},{"key":"10821_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-1-4899-7568-3","volume-title":"Handbook of Response to Intervention: The science and practice of multi-tiered systems of support","author":"SR Jimerson","year":"2016","unstructured":"Jimerson SR, Burns MK, VanDerHeyden AM. From Response to Intervention to Multi-Tiered Systems of Support: Advances in the science and practice of assessment and intervention. In: Jimerson SR, Burns MK, VanDerHeyden AM, editors. Handbook of Response to Intervention: The science and practice of multi-tiered systems of support. 2nd ed. New York: Springer Science+Business Media; 2016. p. 1\u20136.","edition":"2"},{"issue":"1","key":"10821_CR30","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1111\/1460-6984.12387","volume":"54","author":"SH Ebbels","year":"2019","unstructured":"Ebbels SH, McCartney E, Slonims V, Dockrell JE, Norbury CF. Evidence-based pathways to intervention for children with language disorders. Int J Lang Commun Disord. 2019;54(1):3\u201319.","journal-title":"Int J Lang Commun Disord"},{"issue":"1","key":"10821_CR31","doi-asserted-by":"publisher","first-page":"41","DOI":"10.2182\/cjot.2012.79.1.6","volume":"79","author":"CA Missiuna","year":"2012","unstructured":"Missiuna CA, Pollock NA, Levac DE, Campbell WN, Whalen SDS, Bennett SM, et al. Partnering for Change: An innovative school-based occupational therapy service delivery model for children with developmental coordination disorder. Can J Occup Ther. 2012;79(1):41\u201350.","journal-title":"Can J Occup Ther"},{"key":"10821_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2396941516680369","volume":"2","author":"LM Archibald","year":"2017","unstructured":"Archibald LM. SLP-educator classroom collaboration: a review to inform reason-based practice. Autism Dev Lang Impair. 2017;2:1\u201317.","journal-title":"Autism Dev Lang Impair"},{"key":"10821_CR33","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1044\/0161-1461(2009\/08-0128)","volume":"41","author":"FM Cirrin","year":"2010","unstructured":"Cirrin FM, Schooling TL, Nelson NW, Diehl SF, Perry FF, Staskowski M, et al. Evidence-based systematic review: effects of different service delivery models on communication outcomes for elementary school-age children. Lang Speech Hear Serv Sch. 2010;41:233\u201364.","journal-title":"Lang Speech Hear Serv Sch"},{"issue":"1","key":"10821_CR34","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1111\/1460-6984.12425","volume":"54","author":"CA Murphy","year":"2019","unstructured":"Murphy CA. The limits of evidence and the implications of context: considerations when implementing pathways to intervention for children with language disorders. Int J Lang Commun Disord. 2019;54(1):20\u20133.","journal-title":"Int J Lang Commun Disord"},{"issue":"4","key":"10821_CR35","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1111\/1460-6984.12469","volume":"54","author":"AL Gallagher","year":"2019","unstructured":"Gallagher AL, Murphy CA, Conway P, Perry A. Consequential differences in perspectives and practices concerning children with developmental language disorders: an integrative review. Int J Lang Commun Disord. 2019;54(4):529\u201352.","journal-title":"Int J Lang Commun Disord"},{"issue":"4","key":"10821_CR36","doi-asserted-by":"publisher","first-page":"540","DOI":"10.1080\/1034912X.2021.1895975","volume":"70","author":"S VanderKaay","year":"2021","unstructured":"VanderKaay S, Dix L, Rivard L, Missiuna C, Ng S, Pollock N, et al. Tiered approaches to rehabilitation services in education settings: Towards developing an explanatory programme theory. Int J Disabil Dev Educ. 2021;70(4):540\u201361.","journal-title":"Int J Disabil Dev Educ."},{"key":"10821_CR37","first-page":"116","volume-title":"Outcomes in Speech-Language Pathology","author":"J Blosser","year":"2013","unstructured":"Blosser J. Outcomes matter in school service delivery. In: Frattali CM, Golper LAC, editors. Outcomes in Speech-Language Pathology. 2nd ed. New York: Thieme Medical Publishers, Inc.; 2013. p. 116\u201340.","edition":"2"},{"key":"10821_CR38","doi-asserted-by":"publisher","first-page":"786","DOI":"10.1111\/1460-6984.12822","volume":"58","author":"PT Cahill","year":"2022","unstructured":"Cahill PT, Ng S, Dix L, Ferro MA, Turkstra L, Campbell WN. Outcomes management practices in tiered school-based speech\u2013language therapy: A Canadian example. Int J Lang Commun Disord. 2022;58:786\u2013801.","journal-title":"Int J Lang Commun Disord"},{"issue":"Summer","key":"10821_CR39","first-page":"5","volume":"14","author":"AM Pope","year":"2010","unstructured":"Pope AM, Finney SJ, Bare AK. The essential role of program theory: Fostering theory-driven practice and high-quality outocmes assessment in student affairs. Res Pract Assess. 2010;14(Summer):5\u201317.","journal-title":"Res Pract Assess"},{"key":"10821_CR40","doi-asserted-by":"publisher","first-page":"1290800","DOI":"10.3389\/fresc.2024.1290800","volume":"5","author":"PT Cahill","year":"2024","unstructured":"Cahill PT, Ng S, Turkstra LS, Ferro MA, Campbell WN. Exploring the valued outocmes of school-based speech-language therapy services: a sequential iterative design. Front Rehabil Sci. 2024;5:1290800.","journal-title":"Front Rehabil Sci"},{"issue":"3","key":"10821_CR41","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1093\/intqhc\/mzi038","volume":"17","author":"W Trochim","year":"2005","unstructured":"Trochim W, Kane M. Concept mapping: an introduction to structured conceptualization in health care. Int J Qual Heal Care. 2005;17(3):187\u201391.","journal-title":"Int J Qual Heal Care"},{"issue":"10","key":"10821_CR42","doi-asserted-by":"publisher","first-page":"1392","DOI":"10.1177\/1049732305278876","volume":"15","author":"JG Burke","year":"2005","unstructured":"Burke JG, O\u2019Campo P, Peak GL, Gielen AC, McDonnell KA, Trochim WMK. An introduction to concept mapping as a participatory public health research method. Qual Health Res. 2005;15(10):1392\u2013410.","journal-title":"Qual Health Res"},{"key":"10821_CR43","doi-asserted-by":"publisher","DOI":"10.4135\/9781412983730","volume-title":"Concept mapping for planning and evaluation","author":"M Kane","year":"2007","unstructured":"Kane M, Trochim W. Concept mapping for planning and evaluation. Thousand Oaks: SAGE Publications, Inc.; 2007."},{"issue":"6","key":"10821_CR44","doi-asserted-by":"publisher","first-page":"1687","DOI":"10.1007\/s11136-013-0614-3","volume":"23","author":"C Sj\u00f6dahl Hammarlund","year":"2014","unstructured":"Sj\u00f6dahl Hammarlund C, Nilsson MH, Idvall M, Rosas SR, Hagell P. Conceptualizing and prioritizing clinical trial outcomes from the perspectives of people with Parkinson\u2019s disease versus health care professionals: a concept mapping study. Qual Life Res. 2014;23(6):1687\u2013700.","journal-title":"Qual Life Res"},{"issue":"3","key":"10821_CR45","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1007\/s11136-011-9995-3","volume":"21","author":"C Sj\u00f6dahl Hammarlund","year":"2012","unstructured":"Sj\u00f6dahl Hammarlund C, Nilsson MH, Hagell P. Measuring outcomes in Parkinson\u2019s disease: a multi-perspective concept mapping study. Qual Life Res. 2012;21(3):453\u201363.","journal-title":"Qual Life Res"},{"issue":"4","key":"10821_CR46","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1002\/jcop.21617","volume":"42","author":"R Orsi","year":"2014","unstructured":"Orsi R. A method for articulating grassroots community organizing outcomes. J Community Psychol. 2014;42(4):398\u2013413.","journal-title":"J Community Psychol"},{"issue":"1","key":"10821_CR47","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1177\/109821400302400102","volume":"24","author":"FL Leeuw","year":"2003","unstructured":"Leeuw FL. Reconstruction program theories: methods available and problems to be solved. Am J Eval. 2003;24(1):5\u201320.","journal-title":"Am J Eval"},{"issue":"11","key":"10821_CR48","first-page":"1772","volume":"20","author":"SJ Gentles","year":"2015","unstructured":"Gentles SJ, Charles C, Ploeg J, Ann McKibbon K. Sampling in qualitative research: Insights from an overview of the methods literature. Qual Rep. 2015;20(11):1772\u201389.","journal-title":"Qual Rep"},{"issue":"1","key":"10821_CR49","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1016\/j.dss.2012.08.008","volume":"54","author":"C Macharis","year":"2012","unstructured":"Macharis C, Turcksin L, Lebeau K. Multi actor multi criteria analysis (MAMCA) as a tool to support sustainable decisions: state of use. Decis Support Syst. 2012;54(1):610\u201320.","journal-title":"Decis Support Syst"},{"key":"10821_CR50","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1002\/(SICI)1099-1743(199801\/02)15:1<15::AID-SRES179>3.0.CO;2-B","volume":"15","author":"C Banville","year":"1998","unstructured":"Banville C, Landry M, Martel J-M, Boulaire C. A stakeholder approach to MCDA. Syst Res Behav Sci. 1998;15:15\u201332.","journal-title":"Syst Res Behav Sci"},{"issue":"3","key":"10821_CR51","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1177\/1049732307310995","volume":"18","author":"JM Morse","year":"2009","unstructured":"Morse JM. \u201cWhat\u2019s your favorite color?\u201d Reporting irrelevant demographics in qualitative research. Qual Health Res. 2009;18(3):299\u2013300.","journal-title":"Qual Health Res"},{"issue":"9","key":"10821_CR52","doi-asserted-by":"publisher","first-page":"1277","DOI":"10.1177\/1049732305276687","volume":"15","author":"HF Hsieh","year":"2005","unstructured":"Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277\u201388.","journal-title":"Qual Health Res"},{"issue":"1","key":"10821_CR53","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1111\/j.1365-2648.2007.04569.x","volume":"62","author":"S Elo","year":"2008","unstructured":"Elo S, Kyng\u00e4s H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107\u201315.","journal-title":"J Adv Nurs"},{"key":"10821_CR54","unstructured":"Concept Systems Incorporated. groupwisdomTM. Ithaca; 2021."},{"issue":"2","key":"10821_CR55","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1016\/j.evalprogplan.2011.10.003","volume":"35","author":"SR Rosas","year":"2012","unstructured":"Rosas SR, Kane M. Quality and rigor of the concept mapping methodology: a pooled study analysis. Eval Program Plann. 2012;35(2):236\u201345.","journal-title":"Eval Program Plann"},{"key":"10821_CR56","unstructured":"Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. Harlow: Pearson Education Limited; 2014."},{"key":"10821_CR57","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1016\/j.evalprogplan.2016.08.017","volume":"60","author":"R Orsi","year":"2017","unstructured":"Orsi R. Use of multiple cluster analysis methods to explore the validity of a community outcomes concept map. Eval Program Plann. 2017;60:277\u201383.","journal-title":"Eval Program Plann"},{"issue":"1","key":"10821_CR58","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1177\/1525822X0001200104","volume":"12","author":"K Sturrock","year":"2000","unstructured":"Sturrock K, Rocha J. A multidimensional scaling stress evaluation table. Field Methods. 2000;12(1):49\u201360.","journal-title":"Field Methods"},{"issue":"6","key":"10821_CR59","doi-asserted-by":"publisher","first-page":"2057","DOI":"10.1111\/hsc.13866","volume":"30","author":"KE Harding","year":"2022","unstructured":"Harding KE, Camden C, Lewis AK, Perreault K, Taylor NF. Service redesign interventions to reduce waiting time for paediatric rehabilitation and therapy services: a systematic review of the literature. Health Soc Care Community. 2022;30(6):2057\u201370.","journal-title":"Health Soc Care Community."},{"issue":"3","key":"10821_CR60","first-page":"15","volume":"66","author":"V Fryer","year":"2019","unstructured":"Fryer V, Wright-St Clair VA, Bright F. Waiting for community occupational therapy services: a review. New Zeal J Occup Ther. 2019;66(3):15\u201321.","journal-title":"New Zeal J Occup Ther"},{"issue":"5","key":"10821_CR61","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1111\/jir.12469","volume":"62","author":"G Gallego","year":"2018","unstructured":"Gallego G, Dew A, Lincoln M, Bundy A, Bulkeley K, Brentnall J, et al. Carers\u2019 preferences for the delivery of therapy services for people with disability in rural Australia: evidence from a discrete choice experiment. J Intellect Disabil Res. 2018;62(5):371\u201381.","journal-title":"J Intellect Disabil Res"},{"issue":"1","key":"10821_CR62","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1177\/1356389007084674","volume":"14","author":"PJ Rogers","year":"2008","unstructured":"Rogers PJ. Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation. 2008;14(1):29\u201348.","journal-title":"Evaluation"},{"key":"10821_CR63","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1007\/0-306-47559-6_13","volume-title":"Evaluation Models: Evaluation in Education and Human Services","author":"PJ Rogers","year":"2000","unstructured":"Rogers PJ. Program theory: Not whether programs work but how they work. In: Stufflebeam DL, Madaus GF, Kellaghan T, editors. Evaluation Models: Evaluation in Education and Human Services, vol. 49. Dordrecht: Springer; 2000. p. 209\u201332."},{"key":"10821_CR64","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1186\/s12913-019-4051-z","volume":"19","author":"AL Gallagher","year":"2019","unstructured":"Gallagher AL, Murphy C, Conway PF, Perry A. Engaging multiple stakeholders to improve speech and language therapy services in schools: An appreciative inquiry-based study. BMC Health Serv Res. 2019;19:26.","journal-title":"BMC Health Serv Res"},{"issue":"February","key":"10821_CR65","first-page":"446","volume":"60","author":"BJ Cunningham","year":"2017","unstructured":"Cunningham BJ, Washington KN, Binns A, Rolfe K, Robertson B, Rosenbaum P. Current methods of evaluating speech-language outcomes for preschoolers with communication disorders: a scoping review using the ICF-CY. J Speech Lang Hear Res. 2017;60(February):446\u201364.","journal-title":"J Speech Lang Hear Res"},{"issue":"July","key":"10821_CR66","doi-asserted-by":"publisher","first-page":"732","DOI":"10.1044\/2022_LSHSS-21-00132","volume":"53","author":"E Baker","year":"2022","unstructured":"Baker E, Masso S, Huynh K, Sugden E. Optimizing outcomes for children with phonological impairment: a systematic search and review of outcome and experience measures reported in intervention research. Lang Speech Hear Serv Sch. 2022;53(July):732\u201348.","journal-title":"Lang Speech Hear Serv Sch"},{"key":"10821_CR67","doi-asserted-by":"publisher","first-page":"101680","DOI":"10.1016\/j.evalprogplan.2019.101680","volume":"76","author":"L Dare","year":"2019","unstructured":"Dare L, Nowicki E. Engaging children and youth in research and evaluation using group concept mapping. Eval Program Plann. 2019;76:101680.","journal-title":"Eval Program Plann"},{"key":"10821_CR68","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1002\/ev.1181","volume":"87","author":"PJ Rogers","year":"2000","unstructured":"Rogers PJ. Causal models in program theory evaluation. New Dir Eval. 2000;87:47\u201355.","journal-title":"New Dir Eval"},{"issue":"5","key":"10821_CR69","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1016\/j.acap.2013.06.010","volume":"13","author":"K Albright","year":"2013","unstructured":"Albright K, Gechter K, Kempe A. Importance of mixed methods in pragmatic trials and dissemination and implementation research. Acad Pediatr. 2013;13(5):400\u20137.","journal-title":"Acad Pediatr"},{"key":"10821_CR70","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1146\/annurev-publhealth-040218-044215","volume":"40","author":"LA Palinkas","year":"2019","unstructured":"Palinkas LA, Mendon SJ, Hamilton AB. Innovations in mixed methods evaluations. Annu Rev Public Health. 2019;40:423\u201342.","journal-title":"Annu Rev Public Health"}],"container-title":["BMC Health Services Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-024-10821-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12913-024-10821-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-024-10821-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T03:05:08Z","timestamp":1710558308000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmchealthservres.biomedcentral.com\/articles\/10.1186\/s12913-024-10821-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,16]]},"references-count":70,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["10821"],"URL":"https:\/\/doi.org\/10.1186\/s12913-024-10821-7","relation":{},"ISSN":["1472-6963"],"issn-type":[{"value":"1472-6963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,16]]},"assertion":[{"value":"2 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All methods and materials for this study were reviewed by the Hamilton Integrated Research Ethics Board (project number: 13906), which is affiliated with McMaster University, as well as all the research ethics committees of all partnering school boards. Methods and materials followed these reviewed ethical guidelines and regulations. All participants provided written informed consent prior to completing any research tasks.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable as data is anonymized and does not include private information.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"347"}}