{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T08:02:48Z","timestamp":1746259368791,"version":"3.37.3"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T00:00:00Z","timestamp":1722556800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T00:00:00Z","timestamp":1722556800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"German Research Foundation","doi-asserted-by":"crossref","award":["PA-2409 7-1","FR-3070 3-1"],"award-info":[{"award-number":["PA-2409 7-1","FR-3070 3-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100016378","name":"Technische Universit\u00e4t Dortmund","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100016378","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Stat"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Meta-analysis is an important statistical technique for synthesizing the results of multiple studies regarding the same or closely related research question. So-called meta-regression extends meta-analysis models by accounting for study-level covariates. Mixed-effects meta-regression models provide a powerful tool for evidence synthesis, by appropriately accounting for between-study heterogeneity. In fact, modelling the study effect in terms of random effects and moderators not only allows to examine the impact of the moderators, but often leads to more accurate estimates of the involved parameters. Nevertheless, due to the often small number of studies on a specific research topic, interactions are often neglected in meta-regression. In this work we consider the research questions (i) how moderator interactions influence inference in mixed-effects meta-regression models and (ii) whether some inference methods are more reliable than others. Here we review robust methods for confidence intervals in meta-regression models including interaction effects. These methods are based on the application of robust sandwich estimators of Hartung-Knapp-Sidik-Jonkman (<jats:bold>HKSJ<\/jats:bold>) or heteroscedasticity-consistent (<jats:bold>HC<\/jats:bold>)-type for estimating the variance-covariance matrix of the vector of model coefficients. Furthermore, we compare different versions of these robust estimators in an extensive simulation study. We thereby investigate coverage and width of seven different confidence intervals under varying conditions. Our simulation study shows that the coverage rates as well as the interval widths of the parameter estimates are only slightly affected by adjustment of the parameters. It also turned out that using the Satterthwaite approximation for the degrees of freedom seems to be advantageous for accurate coverage rates. In addition, different to previous analyses for simpler models, the <jats:inline-formula><jats:alternatives><jats:tex-math>$$\\textbf{HKSJ}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                <mml:mi>HKSJ<\/mml:mi>\n              <\/mml:math><\/jats:alternatives><\/jats:inline-formula>-estimator shows a worse performance in this more complex setting compared to some of the <jats:inline-formula><jats:alternatives><jats:tex-math>$$\\textbf{HC}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                <mml:mi>HC<\/mml:mi>\n              <\/mml:math><\/jats:alternatives><\/jats:inline-formula>-estimators.<\/jats:p>","DOI":"10.1007\/s00180-024-01530-0","type":"journal-article","created":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T14:11:06Z","timestamp":1722607866000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Robust confidence intervals for meta-regression with interaction effects"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8710-6857","authenticated-orcid":false,"given":"Maria","family":"Thurow","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6223-5698","authenticated-orcid":false,"given":"Thilo","family":"Welz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6134-1624","authenticated-orcid":false,"given":"Eric","family":"Knop","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5347-7441","authenticated-orcid":false,"given":"Tim","family":"Friede","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0976-7190","authenticated-orcid":false,"given":"Markus","family":"Pauly","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,8,2]]},"reference":[{"key":"1530_CR1","volume-title":"Multiple regression: testing and interpreting interactions","author":"LS Aiken","year":"1991","unstructured":"Aiken LS, West SG, Reno RR (1991) Multiple regression: testing and interpreting interactions. Sage Publications, California"},{"key":"1530_CR2","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1038\/s41562-017-0189-z","volume":"2","author":"DJ Benjamin","year":"2018","unstructured":"Benjamin DJ, Berger J, Johannesson M, Nosek B, Wagenmakers E, Berk R, Johnson V (2018) Redefine statistical significance. Nat Hum Behav 2:6\u201310","journal-title":"Nat Hum Behav"},{"key":"1530_CR3","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/S0167-9473(02)00366-3","volume":"452","author":"F Cribari-Neto","year":"2004","unstructured":"Cribari-Neto F (2004) Asymptotic inference under heteroskedasticity of unknown form. Comput Stat Data Anal 452:215\u2013233","journal-title":"Comput Stat Data Anal"},{"key":"1530_CR4","doi-asserted-by":"publisher","first-page":"1877","DOI":"10.1080\/03610920601126589","volume":"3610","author":"F Cribari-Neto","year":"2007","unstructured":"Cribari-Neto F, Souza TC, Vasconcellos KLP (2007) Inference under heteroskedasticity and leveraged data. Commun Stat- Theo Methods 3610:1877\u20131888. https:\/\/doi.org\/10.1080\/03610920601126589","journal-title":"Commun Stat- Theo Methods"},{"key":"1530_CR5","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/0197-2456(86)90046-2","volume":"73","author":"R DerSimonian","year":"1986","unstructured":"DerSimonian R, Laird N (1986) Meta-analysis in clinical trials. Control Clin Trials 73:177\u2013188","journal-title":"Control Clin Trials"},{"key":"1530_CR6","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611970319","volume-title":"The jackknife, the bootstrap and other resampling plans","author":"B Efron","year":"1982","unstructured":"Efron B (1982) The jackknife, the bootstrap and other resampling plans. SIAM, Philadelphia"},{"key":"1530_CR7","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1002\/jrsm.1217","volume":"81","author":"T Friede","year":"2017","unstructured":"Friede T, R\u00f6ver C, Wandel S, Neuenschwander B (2017) Meta-analysis of few small studies in orphan diseases. Res Synth Methods 81:79\u201391","journal-title":"Res Synth Methods"},{"key":"1530_CR8","volume-title":"Econometrics","author":"F Hayashi","year":"2000","unstructured":"Hayashi F (2000) Econometrics. Princeton University Press, Princeton, NJ"},{"key":"1530_CR9","doi-asserted-by":"publisher","first-page":"107","DOI":"10.3102\/10769986006002107","volume":"62","author":"LV Hedges","year":"1981","unstructured":"Hedges LV (1981) Distribution theory for glass\u2019s estimator of effect size and related estimators. J Educ Stat 62:107\u2013128","journal-title":"J Educ Stat"},{"key":"1530_CR10","doi-asserted-by":"publisher","DOI":"10.1016\/c2009-0-03396-0","volume-title":"Statistical methods for meta-analysis","author":"LV Hedges","year":"1985","unstructured":"Hedges LV, Olkin I (1985) Statistical methods for meta-analysis. Elsevier, Amsterdam. https:\/\/doi.org\/10.1016\/c2009-0-03396-0"},{"key":"1530_CR11","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1002\/jrsm.5","volume":"11","author":"LV Hedges","year":"2010","unstructured":"Hedges LV, Tipton E, Johnson MC (2010) Robust variance estimation in meta-regression with dependent effect size estimates. Res Synth Methods 11:39\u201365","journal-title":"Res Synth Methods"},{"key":"1530_CR12","doi-asserted-by":"crossref","unstructured":"Johnson VE (2013) Revised standards for statistical evidence. In: Proceedings of the national academy of sciences 11048:19313\u201319317","DOI":"10.1073\/pnas.1313476110"},{"key":"1530_CR13","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1002\/ejhf.2103","volume":"233","author":"A Kimmoun","year":"2021","unstructured":"Kimmoun A, Takagi K, Gall E, Ishihara S, Hammoum P, El B\u00e8ze N (2021) Temporal trends in mortality and readmission after acute heart failure: a systematic review and meta-regression in the past four decades. Euro J Heart Fail 233:420\u2013431","journal-title":"Euro J Heart Fail"},{"key":"1530_CR14","doi-asserted-by":"publisher","first-page":"2693","DOI":"10.1002\/sim.1482","volume":"2217","author":"G Knapp","year":"2003","unstructured":"Knapp G, Hartung J (2003) Improved tests for a random effects meta-regression with a single covariate. Stat Med 2217:2693\u20132710","journal-title":"Stat Med"},{"key":"1530_CR15","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1002\/jrsm.1643","volume":"144","author":"ES Knop","year":"2023","unstructured":"Knop ES, Pauly M, Friede T, Welz T (2023) The consequences of neglected confounding and interactions in mixed-effects meta-regression: an illustrative example. Res Synth Methods 144:647\u2013651. https:\/\/doi.org\/10.1002\/jrsm.1643","journal-title":"Res Synth Methods"},{"key":"1530_CR16","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1177\/0962280210392008","volume":"214","author":"E Kontopantelis","year":"2012","unstructured":"Kontopantelis E, Reeves D (2012) Performance of statistical methods for meta-analysis when true study effects are non-normally distributed: a simulation study. Stat Methods Med Res 214:409\u2013426","journal-title":"Stat Methods Med Res"},{"key":"1530_CR17","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1111\/bmsp.12088","volume":"701","author":"X Li","year":"2017","unstructured":"Li X, Dusseldorp E, Meulman JJ (2017) Meta-cart: a tool to identify interactions between moderators in meta-analysis. Br J Math Stat Psychol 701:118\u2013136. https:\/\/doi.org\/10.1111\/bmsp.12088","journal-title":"Br J Math Stat Psychol"},{"key":"1530_CR18","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1002\/sim.8781","volume":"402","author":"L Lin","year":"2021","unstructured":"Lin L, Aloe AM (2021) Evaluation of various estimators for standardized mean difference in meta-analysis. Stat Med 402:403\u2013426","journal-title":"Stat Med"},{"key":"1530_CR19","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1177\/1745691620964193","volume":"162","author":"AH Linden","year":"2021","unstructured":"Linden AH, H\u00f6nekopp J (2021) Heterogeneity of research results: a new perspective from which to assess and promote progress in psychological science. Perspect Psychol Sci 162:358\u2013376. https:\/\/doi.org\/10.1177\/1745691620964193","journal-title":"Perspect Psychol Sci"},{"key":"1530_CR20","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1007\/978-1-4614-1653-1_17","volume-title":"Recent advances and future directions in causality, prediction, and specification analysis","author":"JG MacKinnon","year":"2013","unstructured":"MacKinnon JG (2013) Thirty years of heteroskedasticity-robust inference: essays in honor of Halbert L. White Jr. In: Chen X, Swanson N (eds) Recent advances and future directions in causality, prediction, and specification analysis. Springer, New York, pp 437\u2013461"},{"key":"1530_CR21","first-page":"305","volume":"293","author":"JG MacKinnon","year":"1985","unstructured":"MacKinnon JG, White H (1985) Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties. J Econ 293:305\u2013325","journal-title":"J Econ"},{"key":"1530_CR22","doi-asserted-by":"publisher","first-page":"2074","DOI":"10.1002\/sim.8086","volume":"3811","author":"TP Morris","year":"2019","unstructured":"Morris TP, White IR, Crowther MJ (2019) Using simulation studies to evaluate statistical methods. Stat Med 3811:2074\u20132102","journal-title":"Stat Med"},{"key":"1530_CR23","doi-asserted-by":"publisher","first-page":"2712","DOI":"10.3758\/s13428-021-01595-5","volume":"536","author":"K Noguchi","year":"2021","unstructured":"Noguchi K, Konietschke F, Marmolejo-Ramos F, Pauly M (2021) Permutation tests are robust and powerful at 0.5% and 5% significance levels. Behav Res Methods 536:2712\u20132724","journal-title":"Behav Res Methods"},{"key":"1530_CR24","first-page":"295","volume":"2","author":"SW Raudenbush","year":"2009","unstructured":"Raudenbush SW (2009) Analyzing effect sizes: random-effects models. Handb Res Synth Meta-Anal 2:295\u2013316","journal-title":"Handb Res Synth Meta-Anal"},{"key":"1530_CR25","doi-asserted-by":"publisher","first-page":"823","DOI":"10.1081\/BIP-200067915","volume":"155","author":"K Sidik","year":"2005","unstructured":"Sidik K, Jonkman JN (2005a) A note on variance estimation in random effects meta-regression. J Biopharm Stat 155:823\u2013838. https:\/\/doi.org\/10.1081\/BIP-200067915","journal-title":"J Biopharm Stat"},{"key":"1530_CR26","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1111\/j.1467-9876.2005.00489.x","volume":"542","author":"K Sidik","year":"2005","unstructured":"Sidik K, Jonkman JN (2005b) Simple heterogeneity variance estimation for meta-analysis. J R Stat Soc: Ser C (Appl Stat) 542:367\u2013384","journal-title":"J R Stat Soc: Ser C (Appl Stat)"},{"key":"1530_CR27","doi-asserted-by":"publisher","first-page":"3681","DOI":"10.1016\/j.csda.2005.07.019","volume":"5012","author":"K Sidik","year":"2006","unstructured":"Sidik K, Jonkman JN (2006) Robust variance estimation for random effects meta-analysis. Comput Stat & Data Anal 5012:3681\u20133701. https:\/\/doi.org\/10.1016\/j.csda.2005.07.019","journal-title":"Comput Stat & Data Anal"},{"key":"1530_CR28","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1007\/978-3-319-50742-2_9","volume-title":"Robustness in econometrics","author":"M Sterchi","year":"2017","unstructured":"Sterchi M, Wolf M (2017) Weighted least squares and adaptive least squares: further empirical evidence. In: Vladik K, Songsak S, Van-Nam H (eds) Robustness in econometrics. Springer, Cham, pp 135\u2013167"},{"key":"1530_CR29","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1037\/met0000011","volume":"203","author":"E Tipton","year":"2015","unstructured":"Tipton E (2015) Small sample adjustments for robust variance estimation with meta-regression. Psychol Methods 203:375\u2013393. https:\/\/doi.org\/10.1037\/met0000011","journal-title":"Psychol Methods"},{"key":"1530_CR30","doi-asserted-by":"publisher","first-page":"604","DOI":"10.3102\/1076998615606099","volume":"406","author":"E Tipton","year":"2015","unstructured":"Tipton E, Pustejovsky JE (2015) Small-sample adjustments for tests of moderators and model fit using robust variance estimation in meta-regression. J Educ Behav Stat 406:604\u2013634. https:\/\/doi.org\/10.3102\/1076998615606099","journal-title":"J Educ Behav Stat"},{"key":"1530_CR31","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1002\/jrsm.1164","volume":"71","author":"AA Veroniki","year":"2016","unstructured":"Veroniki AA, Jackson D, Viechtbauer W, Bender R, Bowden J, Knapp G, Salanti G (2016) Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res Synth Methods 71:55\u201379. https:\/\/doi.org\/10.1002\/jrsm.1164","journal-title":"Res Synth Methods"},{"key":"1530_CR32","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1002\/jrsm.1562","volume":"136","author":"W Viechtbauer","year":"2022","unstructured":"Viechtbauer W, L\u00f3pez-L\u00f3pez JA (2022) Location-scale models for meta-analysis. Res Synth Methods 136:697\u2013715. https:\/\/doi.org\/10.1002\/jrsm.1562","journal-title":"Res Synth Methods"},{"key":"1530_CR33","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1037\/met0000023","volume":"20","author":"W Viechtbauer","year":"2015","unstructured":"Viechtbauer W, L\u00f3pez-L\u00f3pez J, Sanchez-Meca J, Mar\u00edn-Mart\u00ednez F (2015) A comparison of procedures to test for moderators in mixed-effects meta-regression models. Psychol Methods 20:360","journal-title":"Psychol Methods"},{"key":"1530_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/bmsp.12242","volume":"751","author":"T Welz","year":"2022","unstructured":"Welz T, Doebler P, Pauly M (2022) Fisher transformation based confidence intervals of correlations in fixed-and random-effects meta-analysis. Br J Math Stat Psychol 751:1\u201322","journal-title":"Br J Math Stat Psychol"},{"key":"1530_CR35","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1002\/jrsm.1388","volume":"113","author":"T Welz","year":"2020","unstructured":"Welz T, Pauly M (2020) A simulation study to compare robust tests for linear mixed-effects meta-regression. Res Synth Methods 113:331\u2013342. https:\/\/doi.org\/10.1002\/jrsm.1388","journal-title":"Res Synth Methods"},{"key":"1530_CR36","doi-asserted-by":"publisher","first-page":"107631","DOI":"10.1016\/j.csda.2022.107631","volume":"179","author":"T Welz","year":"2023","unstructured":"Welz T, Viechtbauer W, Pauly M (2023) Cluster-robust estimators for multivariate mixed-effects meta-regression. Comput Stat & Data Anal 179:107631","journal-title":"Comput Stat & Data Anal"},{"key":"1530_CR37","doi-asserted-by":"publisher","first-page":"817","DOI":"10.2307\/1912934","volume":"484","author":"H White","year":"1980","unstructured":"White H (1980) A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 484:817\u2013838","journal-title":"Econometrica"},{"key":"1530_CR38","doi-asserted-by":"publisher","first-page":"951","DOI":"10.1177\/1536867X1501500403","volume":"154","author":"IR White","year":"2015","unstructured":"White IR (2015) Network meta-analysis. Stata J 154:951\u2013985","journal-title":"Stata J"},{"key":"1530_CR39","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmva.2020.104594","volume":"177","author":"G Zimmermann","year":"2020","unstructured":"Zimmermann G, Pauly M, Bathke AC (2020) Multivariate analysis of covariance with potentially singular covariance matrices and non-normal responses. J Multivar Anal 177:104594","journal-title":"J Multivar Anal"}],"container-title":["Computational Statistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-024-01530-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00180-024-01530-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-024-01530-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T14:13:00Z","timestamp":1722607980000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00180-024-01530-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,2]]},"references-count":39,"alternative-id":["1530"],"URL":"https:\/\/doi.org\/10.1007\/s00180-024-01530-0","relation":{},"ISSN":["0943-4062","1613-9658"],"issn-type":[{"type":"print","value":"0943-4062"},{"type":"electronic","value":"1613-9658"}],"subject":[],"published":{"date-parts":[[2024,8,2]]},"assertion":[{"value":"15 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 August 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have declared no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}