{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T23:12:14Z","timestamp":1773270734602,"version":"3.50.1"},"reference-count":60,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,11,13]],"date-time":"2023-11-13T00:00:00Z","timestamp":1699833600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Res. Metr. Anal."],"abstract":"<jats:p>Meta-analysis is of increasing importance as this quantitative synthesis technique has the potential to summarize a tremendous amount of research evidence, which can help making evidence-based decisions in policy, practice, and theory. This paper examines the single-case meta-analyses within the Education and Psychology fields. The amount of methodological studies related to the meta-analysis of Single-Case Experimental Designs (SCEDs) is increasing rapidly, especially in these fields. This underscores the necessity of a succinct summary to help methodologists identify areas for further development in Education and Psychology research. It also aids applied researchers and research synthesists in discerning when to use meta-analytic techniques for SCED studies based on criteria such as bias, mean squared error, 95% confidence intervals, Type I error rates, and statistical power. Based on the summary of empirical evidence from 18 reports identified through a systematic search procedure, information related to meta-analytic techniques, data generation and analysis models, design conditions, statistical properties, conditions under which the meta-analytic technique is appropriate, and the study purpose(s) were extracted. The results indicate that three-level hierarchical linear modeling is the most empirically validated SCED meta-analytic technique, and parameter bias is the most prominent statistical property investigated. A large number of primary studies (more than 30) and at least 20 measurement occasions per participant are recommended for usage of SCED meta-analysis in Education and Psychology fields.<\/jats:p>","DOI":"10.3389\/frma.2023.1190362","type":"journal-article","created":{"date-parts":[[2023,11,14]],"date-time":"2023-11-14T02:18:16Z","timestamp":1699928296000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Single-case design meta-analyses in education and psychology: a systematic review of methodology"],"prefix":"10.3389","volume":"8","author":[{"given":"Mariola","family":"Moeyaert","sequence":"first","affiliation":[]},{"given":"Marzieh","family":"Dehghan-Chaleshtori","sequence":"additional","affiliation":[]},{"given":"Xinyun","family":"Xu","sequence":"additional","affiliation":[]},{"given":"Panpan","family":"Yang","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,11,13]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1080\/09362835.2020.1850457","article-title":"Multilevel meta-analysis of the effectiveness of self-regulated strategy development in writing for children with ASD","volume":"29","author":"Asaro-Saddler","year":"2021","journal-title":"Exceptionality"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1080\/00220973.2020.1821342","article-title":"Issues and solutions in meta-analysis of single-case design with multiple dependent variables using multilevel modeling","author":"Baek","year":"2020","journal-title":"J. Exp. Educ"},{"key":"B3","first-page":"221","article-title":"Effect sizes for continuous data","volume":"2","author":"Borenstein","year":"2009","journal-title":"Handb. Res. Synth. Meta Anal."},{"key":"B4","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1007\/s10488-019-00924-3","article-title":"Effects of fidelity-focused consultation on clinicians' implementation: an exploratory multiple baseline design","volume":"46","author":"Caron","year":"2019","journal-title":"Administr. Policy Mental Health Serv. Res."},{"key":"B5","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1177\/002246698501900404","article-title":"A methodology for the quantitative synthesis of intra-subject design research","volume":"19","author":"Center","year":"1985","journal-title":"J. Spec. Educ."},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1037\/met0000510","article-title":"Multi-level meta-analysis of single-case experimental designs using robust variance estimation","author":"Chen","year":"2022","journal-title":"Psychol. Methods"},{"key":"B7","doi-asserted-by":"publisher","first-page":"e87752","DOI":"10.1371\/journal.pone.0087752","article-title":"A comparison of four methods for the analysis of N-of-1 trials","volume":"9","author":"Chen","year":"2014","journal-title":"PLoS ONE"},{"key":"B8","doi-asserted-by":"crossref","DOI":"10.4324\/9780203771587","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen","year":"2013"},{"key":"B9","first-page":"68","volume-title":"A Simulation Study of the Piecewise Hierarchical Model Approach to Meta-analysis of Single-Subject Data, Vol","author":"Coleman","year":"2006"},{"key":"B10","first-page":"14","article-title":"Conceiving the research question and developing the study plan","volume":"4","author":"Cummings","year":"2013","journal-title":"Design. Clin. Res."},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1080\/00273171.2020.1822148","article-title":"Multilevel meta-analysis of individual participant data of single-case experimental designs: One-stage versus two-stage methods","author":"Declercq","year":"2020","journal-title":"Multivar. Behav. Res"},{"key":"B12","doi-asserted-by":"publisher","first-page":"2477","DOI":"10.3758\/s13428-018-1091-y","article-title":"Analysis of single-case experimental count data using the linear mixed effects model: a simulation study","volume":"51","author":"Declercq","year":"2019","journal-title":"Behav. Res. Methods"},{"key":"B13","volume-title":"Encyclopedia of Statistics in Behavioral Science\u2013Vol. 2","author":"Everitt","year":"2021"},{"key":"B14","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1177\/10883576221081076","article-title":"Training individuals to implement discrete trials with fidelity: a meta-analysis","volume":"37","author":"Fingerhut","year":"2022","journal-title":"Focus Autism Other Dev. Disabl."},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.4135\/9781483384450.n1","article-title":"Fundamentals of hierarchical linear and multilevel modeling","author":"Garson","year":"2013","journal-title":"Hierarch. Linear Model. Guide Appl."},{"key":"B16","first-page":"427","article-title":"Meta-analysis: the quantitative synthesis of research findings","volume-title":"Handbook of Complementary Methods in Education Research","author":"Glass","year":"2012"},{"key":"B17","unstructured":"HammondD.\n            GastD. L.\n          Descriptive analysis of single subject research designs: 1983\u20132007. Educ. Train. Autism Dev. Disabil. 45, 187\u20132022010"},{"key":"B18","author":"Higgins","year":"2021","journal-title":"Handbook for Systematic Reviews of Interventions, Version 6.2"},{"key":"B19","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1037\/0033-2909.110.2.291","article-title":"Autocorrelation estimation and inference with small samples","volume":"110","author":"Huitema","year":"1991","journal-title":"Psychol. Bull."},{"key":"B20","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1177\/00131640021970358","article-title":"Design specification issues in time-series intervention models","volume":"60","author":"Huitema","year":"2000","journal-title":"Educ. Psychol. Meas."},{"key":"B21","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1177\/0013164406294774","article-title":"Identifying autocorrelation generated by various error processes in interrupted time-series regression designs: a comparison of AR1 and portmanteau tests","volume":"67","author":"Huitema","year":"2007","journal-title":"Educ. Psychol. Meas."},{"key":"B22","volume-title":"The Comparison of Three Meta-Analytic Metrics for Single-Subject Research","author":"Idleman","year":"1993"},{"key":"B23","doi-asserted-by":"publisher","first-page":"2008","DOI":"10.3758\/s13428-020-01380-w","article-title":"Multilevel meta-analysis of multiple regression coefficients from single-case experimental studies","volume":"52","author":"Jamshidi","year":"2020","journal-title":"Behav. Res. Methods"},{"key":"B24","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1080\/00220973.2019.1658568","article-title":"Bias adjustment in multilevel meta-analysis of standardized single-case experimental data","volume":"89","author":"Jamshidi","year":"2021","journal-title":"J. Exp. Educ."},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1080\/17489539.2022.2089334","article-title":"A systematic review of single-case experimental design meta-analyses: characteristics of study designs, data, and analyses","author":"Jamshidi","year":"2022","journal-title":"Evid. Based Commun. Assess. Intervent."},{"key":"B26","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1080\/00220973.2017.1409181","article-title":"Approaches for specifying the level-1 error structure when synthesizing single-case data","volume":"87","author":"Joo","year":"2019","journal-title":"J. Exp. Educ."},{"key":"B27","doi-asserted-by":"crossref","first-page":"131","DOI":"10.3102\/10769986211035507","article-title":"Comparison of within-and between-series effect estimates in the meta-analysis of multiple baseline studies","volume":"47","author":"Joo","year":"2021","journal-title":"J. Educ. Behav. Stat."},{"key":"B28","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.3758\/s13428-013-0440-0","article-title":"Weighting strategies in the meta-analysis of single-case studies","volume":"46","author":"Manolov","year":"2014","journal-title":"Behav. Res. Methods"},{"key":"B29","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1037\/met0000078","article-title":"On the unnecessary ubiquity of hierarchical linear modeling","volume":"22","author":"McNeish","year":"2017","journal-title":"Psychol. Methods"},{"key":"B30","unstructured":"Microsoft Excel2018"},{"key":"B31","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1177\/0198742918806926","article-title":"Quantitative synthesis of research evidence: multilevel meta-analysis","volume":"44","author":"Moeyaert","year":"2019","journal-title":"Behav. Disord."},{"key":"B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/00220973.2012.745470","article-title":"Three-level analysis of single-case experimental data: empirical validation","volume":"82","author":"Moeyaert","year":"2014","journal-title":"J. Exp. Educ."},{"key":"B33","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1080\/00273171.2013.816621","article-title":"The three-level synthesis of standardized single-subject experimental data: a Monte Carlo simulation study","volume":"48","author":"Moeyaert","year":"","journal-title":"Multivariate Behav. Res."},{"key":"B34","doi-asserted-by":"publisher","first-page":"547","DOI":"10.3758\/s13428-012-0274-1","article-title":"Modeling external events in the three-level analysis of multiple-baseline across-participants designs: a simulation study","volume":"45","author":"Moeyaert","year":"","journal-title":"Behav. Res. Methods"},{"key":"B35","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1080\/00220973.2015.1065216","article-title":"The misspecification of the covariance structures in multilevel models for single-case data: a Monte Carlo simulation study","volume":"84","author":"Moeyaert","year":"2016","journal-title":"J. Exp. Educ."},{"key":"B36","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1037\/spq0000068","article-title":"Estimating intervention effects across different types of single-subject experimental designs: empirical illustration","volume":"30","author":"Moeyaert","year":"2015","journal-title":"Sch. Psychol. Q."},{"key":"B37","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1007\/s40614-021-00304-z","article-title":"The power to explain variability in intervention effectiveness in single-case research using hierarchical linear modeling","volume":"45","author":"Moeyaert","year":"2022","journal-title":"Perspect. Behav. Sci."},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1177\/01454455211002111","article-title":"Characteristics of moderators in meta-analyses of single-case experimental design studies","author":"Moeyaert","year":"2021","journal-title":"Behav. Modif."},{"key":"B39","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1016\/S0022-2496(02)00028-7","article-title":"Tutorial on maximum likelihood estimation","volume":"47","author":"Myung","year":"2003","journal-title":"J. Math. Psychol."},{"key":"B40","doi-asserted-by":"crossref","first-page":"1850","DOI":"10.1002\/0470013192.bsa625","article-title":"\u201cSingle-case designs,\u201d","volume-title":"Encyclopedia of Statistics in Behavioral Science. Vol. 4","author":"Onghena","year":"2005"},{"key":"B41","author":"Owens","year":"2011","journal-title":"Meta-Analysis of Single-Case Data: A Monte Carlo Investigation of a Three Level Model."},{"key":"B42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13643-021-01626-4","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"10","author":"Page","year":"2021","journal-title":"Syst. Rev."},{"key":"B43","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1007\/978-0-387-21812-0_3","article-title":"\u201cMaximum likelihood estimation,\u201d","volume-title":"Growth Curve Models and Statistical Diagnostics","author":"Pan","year":"2002"},{"key":"B44","author":"Petit-Bois","year":"2014","journal-title":"A Monte Carlo Study: The Consequences of the Misspecification of the Level-1 Error Structure when Meta-Analyzing Single-Case Designs"},{"key":"B45","doi-asserted-by":"publisher","first-page":"803","DOI":"10.3758\/s13428-015-0612-1","article-title":"The consequences of modeling autocorrelation when synthesizing single-case studies using a three-level model","volume":"48","author":"Petit-Bois","year":"2016","journal-title":"Behav. Res. Methods"},{"key":"B46","doi-asserted-by":"publisher","first-page":"594277","DOI":"10.3389\/fpsyg.2020.594277","article-title":"Compassion-focused group therapy for treatment-resistant OCD: initial evaluation using a multiple baseline design","volume":"11","author":"Petrocchi","year":"2021","journal-title":"Front. Psychol."},{"key":"B47","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1016\/j.beth.2007.12.002","article-title":"Greater expectations: Using hierarchical linear modeling to examine expectancy for treatment outcome as a predictor of treatment response","volume":"39","author":"Price","year":"2008","journal-title":"Behav. Ther."},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-016-0384-4","article-title":"Rayyan \u2014 a web and mobile app for systematic reviews","author":"Quzzani","year":"2016","journal-title":"Syst. Rev"},{"key":"B49","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.jsp.2013.12.003","article-title":"Nonlinear Bayesian analysis for single case designs","volume":"52","author":"Rindskopf","year":"2014","journal-title":"J. Sch. Psychol."},{"key":"B50","volume-title":"Encyclopedia of Statistics in Behavioral Science","author":"Rosenbaum","year":"2005"},{"key":"B51","doi-asserted-by":"crossref","DOI":"10.1002\/9781118771075","volume-title":"Mathematical Statistics: An Introduction to Likelihood Based Inference","author":"Rossi","year":"2018"},{"key":"B52","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1037\/a0032964","article-title":"Analyzing data from single-case designs using multilevel models: new applications and some agenda items for future research","volume":"18","author":"Shadish","year":"2013","journal-title":"Psychol. Methods"},{"key":"B53","doi-asserted-by":"publisher","first-page":"971","DOI":"10.3758\/s13428-011-0111-y","article-title":"Characteristics of single-case designs used to assess intervention effects in 2008","volume":"43","author":"Shadish","year":"2011","journal-title":"Behav. Res. Methods"},{"key":"B54","volume-title":"Using Multilevel Modeling in Synthesizing Single-Subject Research Data With Trend\u2014A Monte Carlo Study","author":"Tsai","year":"2011"},{"key":"B55","doi-asserted-by":"publisher","first-page":"1244","DOI":"10.3758\/s13428-012-0213-1","article-title":"Multilevel meta-analysis of single-subject experimental designs: a simulation study","volume":"44","author":"Ugille","year":"2012","journal-title":"Behav. Res. Methods"},{"key":"B56","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1080\/00220973.2013.813366","article-title":"Bias corrections for standardized effect size estimates used with single-subject experimental designs","volume":"82","author":"Ugille","year":"2014","journal-title":"J. Exp. Educ."},{"key":"B57","doi-asserted-by":"publisher","first-page":"7","DOI":"10.22237\/jmasm\/1051747620","article-title":"A parametric bootstrap version of Hedges' homogeneity test","volume":"2","author":"Van den Noortgate","year":"","journal-title":"J. Mod. Appl. Stat. Methods"},{"key":"B58","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1521\/scpq.18.3.325.22577","article-title":"Combining single-case experimental data using hierarchical linear models","volume":"18","author":"Van den Noortgate","year":"","journal-title":"Sch. Psychol. Q."},{"key":"B59","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1037\/h0100613","article-title":"The aggregation of single-case results using hierarchical linear models","volume":"8","author":"Van den Noortgate","year":"2007","journal-title":"Behav. Anal. Today"},{"key":"B60","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1080\/17489530802505362","article-title":"A multilevel meta-analysis of single-subject experimental design studies","volume":"2","author":"Van den Noortgate","year":"2008","journal-title":"Evid. Based Commun. Assess. Interv."}],"container-title":["Frontiers in Research Metrics and Analytics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2023.1190362\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,14]],"date-time":"2023-11-14T02:18:31Z","timestamp":1699928311000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2023.1190362\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,13]]},"references-count":60,"alternative-id":["10.3389\/frma.2023.1190362"],"URL":"https:\/\/doi.org\/10.3389\/frma.2023.1190362","relation":{},"ISSN":["2504-0537"],"issn-type":[{"value":"2504-0537","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,13]]},"article-number":"1190362"}}