{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T09:29:45Z","timestamp":1789032585842,"version":"build-2803163510"},"reference-count":54,"publisher":"Informa UK Limited","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2013,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This methodological review draws attention to the challenges faced by intellectual and developmental disabilities researchers in the appropriate design and analysis of group comparison studies. We provide a brief overview of matching methodologies in the field, emphasizing group-matching designs used in behavioral research on cognition and language in neurodevelopmental disorders, including autism spectrum disorder, Fragile X syndrome, Down syndrome, and Williams syndrome. The limitations of relying on p values to establish group equivalence are discussed in the context of other existing methods: equivalence tests, propensity scores, and regression-based analyses. Our primary recommendation for advancing research on intellectual and developmental disabilities is the use of descriptive indices of adequate group matching: effect sizes (i.e., standardized mean differences) and variance ratios.<\/jats:p>","DOI":"10.1352\/1944-7558-118.1.3","type":"journal-article","created":{"date-parts":[[2013,1,9]],"date-time":"2013-01-09T19:43:28Z","timestamp":1357760608000},"page":"3-15","source":"Crossref","is-referenced-by-count":101,"title":["Establishing Equivalence: Methodological Progress in Group-matching Design and Analysis"],"prefix":"10.1080","volume":"118","author":[{"given":"Sara T.","family":"Kover","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy K.","family":"Atwood","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"301","reference":[{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Abbeduto1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1352\/1944-7558-115.1.1","article-title":"Editorial","volume":"115","author":"Abbeduto","year":"2010","journal-title":"American Journal on Intellectual and Developmental Disabilities"},{"key":"2020060217495594300_i1944-7558-118-1-3-American1","volume-title":"Publication manual of the American Psychological Association (6th ed.)","author":"American Psychological Association","year":"2010"},{"key":"2020060217495594300_i1944-7558-118-1-3-Atwood1","volume-title":"The impact of selection procedures for nonnormal covariates on the Type I error rate and power of ANCOVA","author":"Atwood","year":"2010"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Bakeman1","first-page":"127","article-title":"VII. The practical importance of findings","volume":"71","author":"Bakeman","year":"2006","journal-title":"Monographs of the Society for Research in Child Development"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Beeghly1","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1017\/S0954579406060366","article-title":"Translational research on early language development: Current challenges and future directions","volume":"18","author":"Beeghly","year":"2006","journal-title":"Development and Psychopathology"},{"issue":"5","key":"2020060217495594300_i1944-7558-118-1-3-Blackford1","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1352\/1934-9556-47.5.348","article-title":"Propensity scores: Method for matching on multiple variables in down syndrome research","volume":"47","author":"Blackford","year":"2009","journal-title":"Intellectual and Developmental Disabilities"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Breaugh1","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1177\/1094428106292895","article-title":"Controlling nuisance variables by using a matched-groups design","volume":"10","author":"Breaugh","year":"2007","journal-title":"Organizational Research Methods"},{"issue":"9","key":"2020060217495594300_i1944-7558-118-1-3-Brock1","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1080\/02699200701541433","article-title":"Do children with Williams syndrome really have good vocabulary knowledge? Methods for comparing cognitive and linguistic abilities in developmental disorders","volume":"21","author":"Brock","year":"2007","journal-title":"Clinical Linguistics and Phonetics"},{"issue":"9","key":"2020060217495594300_i1944-7558-118-1-3-Brown1","doi-asserted-by":"crossref","first-page":"1789","DOI":"10.1080\/17470210903536910","article-title":"Intact implicit learning in autism spectrum conditions","volume":"63","author":"Brown","year":"2010","journal-title":"Quarterly Journal of Experimental Psychology (Hove)"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Burack1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1023\/B:JADD.0000018275.59897.10","article-title":"Editorial preface","volume":"34","author":"Burack","year":"2004","journal-title":"Journal of Autism and Develompental Disorders"},{"issue":"2","key":"2020060217495594300_i1944-7558-118-1-3-Burack2","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1017\/S095457940200202X","article-title":"Benefits and pitfalls in the merging of disciplines: The example of developmental psychopathology and the study of persons with autism","volume":"14","author":"Burack","year":"2002","journal-title":"Development and Psychopathology"},{"issue":"2","key":"2020060217495594300_i1944-7558-118-1-3-Cicchetti1","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1007\/s10803-010-1035-6","article-title":"From Bayes through marginal utility to effect sizes: A guide to understanding the clinical and statistical significance of the results of autism research findings","volume":"41","author":"Cicchetti","year":"2011","journal-title":"Journal of Autism and Develompental Disorders"},{"key":"2020060217495594300_i1944-7558-118-1-3-Cohen1","volume-title":"Statistical power analysis for the behavioral sciences (2nd ed.)","author":"Cohen","year":"1988"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Dennis1","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1017\/S1355617709090481","article-title":"Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders","volume":"15","author":"Dennis","year":"2009","journal-title":"Journal of the International Neuropsychological Society"},{"issue":"4","key":"2020060217495594300_i1944-7558-118-1-3-Edgell1","doi-asserted-by":"crossref","first-page":"525","DOI":"10.3758\/BF03197252","article-title":"Commentary on \u201cAccepting the Null Hypothesis.\u201d","volume":"23","author":"Edgell","year":"1995","journal-title":"Memory and Cognition"},{"issue":"2","key":"2020060217495594300_i1944-7558-118-1-3-Eigsti1","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1016\/j.rasd.2010.09.001","article-title":"Language acquisition in autism spectrum disorders: A developmental review","volume":"5","author":"Eigsti","year":"2011","journal-title":"Research in Autism Spectrum Disorders"},{"issue":"6","key":"2020060217495594300_i1944-7558-118-1-3-Facon1","doi-asserted-by":"crossref","first-page":"2134","DOI":"10.1016\/j.ridd.2011.07.029","article-title":"Beyond matching on the mean in developmental disabilities research","volume":"32","author":"Facon","year":"2011","journal-title":"Research in Developmental Disabilities"},{"key":"2020060217495594300_i1944-7558-118-1-3-Fraser1","volume-title":"Propensity score analysis: Statistical methods and applications. (Advanced Quantitative Techniques in the Social Sciences Series.)","author":"Fraser","year":"2009"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Frick1","doi-asserted-by":"crossref","first-page":"132","DOI":"10.3758\/BF03210562","article-title":"Accepting the null hypothesis","volume":"23","author":"Frick","year":"1995","journal-title":"Memory and Cognition"},{"issue":"396","key":"2020060217495594300_i1944-7558-118-1-3-Holland1","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1080\/01621459.1986.10478354","article-title":"Statistics and causal inference","volume":"81","author":"Holland","year":"1986","journal-title":"Journal of the American Statistical Association"},{"key":"2020060217495594300_i1944-7558-118-1-3-Imai1","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1111\/j.1467-985X.2007.00527.x","article-title":"Misunderstandings between experimentalists and observationalists about causal inference","volume":"171","author":"Imai","year":"2008","journal-title":"Journal of the Royal Statistical Society Series a-Statistics in Society"},{"issue":"2","key":"2020060217495594300_i1944-7558-118-1-3-Jarrold1","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/S0010-9452(08)70478-7","article-title":"Long-term memory for verbal and visual information in Down syndrome and Williams syndrome: Performance on the doors and people test","volume":"43","author":"Jarrold","year":"2007","journal-title":"Cortex"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Jarrold2","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1023\/B:JADD.0000018078.82542.ab","article-title":"To match or not to match? Methodological issues in autism-related research","volume":"34","author":"Jarrold","year":"2004","journal-title":"Journal of Autism and Developmental Disorders"},{"issue":"7","key":"2020060217495594300_i1944-7558-118-1-3-KarmiloffSmith1","doi-asserted-by":"crossref","first-page":"1258","DOI":"10.1111\/j.1469-7610.2004.00322.x","article-title":"Exploring the Williams syndrome face-processing debate: The importance of building developmental trajectories","volume":"45","author":"Karmiloff-Smith","year":"2004","journal-title":"Journal of Child Psychology and Psychiatry"},{"key":"2020060217495594300_i1944-7558-118-1-3-Kover1","volume-title":"Receptive vocabulary in boys with autism spectrum disorder: Cross-sectional developmental trajectories","author":"Kover","year":"2012"},{"issue":"2","key":"2020060217495594300_i1944-7558-118-1-3-Marsh1","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1080\/00220979809601402","article-title":"Simulation study of nonequivalent group-matching and regression-discontinuity designs: Evaluations of gifted and talented programs","volume":"66","author":"Marsh","year":"1998","journal-title":"Journal of Experimental Education"},{"issue":"4","key":"2020060217495594300_i1944-7558-118-1-3-Mervis1","doi-asserted-by":"crossref","first-page":"967","DOI":"10.1044\/1092-4388(2008\/071)","article-title":"Vocabulary abilities of children with Williams syndrome: Strengths, weaknesses, and relation to visuospatial construction ability","volume":"51","author":"Mervis","year":"2008","journal-title":"Journal of Speech, Language, and Hearing Research"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Mervis2","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/B:JADD.0000018069.69562.b8","article-title":"Methodological issues in group-matching designs: \u03b1 levels for control variable comparisons and measurement characteristics of control and target variables","volume":"34","author":"Mervis","year":"2004","journal-title":"Journal of Autism and Developmental Disorders"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Mervis3","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1111\/1540-5834.00011","article-title":"Methodological issues in cross-syndrome comparisons: Matching procedures, sensitivity (Se) and specificity (Sp)","volume":"64","author":"Mervis","year":"1999","journal-title":"Monographs of the Society for Research in Child Development"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Miller1","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1037\/0021-843X.110.1.40","article-title":"Misunderstanding analysis of covariance","volume":"110","author":"Miller","year":"2001","journal-title":"Journal of Abnormal Psychology"},{"issue":"4","key":"2020060217495594300_i1944-7558-118-1-3-Newcombe1","doi-asserted-by":"crossref","first-page":"1050","DOI":"10.1111\/1467-8624.00588","article-title":"Some controls control too much","volume":"74","author":"Newcombe","year":"2003","journal-title":"Child Development"},{"issue":"10","key":"2020060217495594300_i1944-7558-118-1-3-Piaggio1","doi-asserted-by":"crossref","first-page":"1152","DOI":"10.1001\/jama.295.10.1152","article-title":"Reporting of noninferiority and equivalence randomized trials: An extension of the CONSORT statement","volume":"295","author":"Piaggio","year":"2006","journal-title":"Journal of the American Medical Association"},{"key":"2020060217495594300_i1944-7558-118-1-3-R1","volume-title":"R: A language and environment for statistical computing (Version 2.10.1) [Computer software]","author":"R Development Core Team","year":"2010"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Rogers1","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1037\/0033-2909.113.3.553","article-title":"Using significance tests to evaluate equivalence between two experimental groups","volume":"113","author":"Rogers","year":"1993","journal-title":"Psychological Bulletin"},{"issue":"408","key":"2020060217495594300_i1944-7558-118-1-3-Rosenbaum1","doi-asserted-by":"crossref","first-page":"1024","DOI":"10.1080\/01621459.1989.10478868","article-title":"Optimal matching for observational studies","volume":"84","author":"Rosenbaum","year":"1989","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Rosenbaum2","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1080\/00031305.1985.10479383","article-title":"Constructing a control-group using multivariate matched sampling methods that incorporate the propensity score","volume":"39","author":"Rosenbaum","year":"1985","journal-title":"American Statistician"},{"issue":"5","key":"2020060217495594300_i1944-7558-118-1-3-Rubin1","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1037\/h0037350","article-title":"Estimating causal effects of treatments in randomized and nonrandomized studies","volume":"66","author":"Rubin","year":"1974","journal-title":"Journal of Educational Psychology"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Rubin2","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1023\/A:1020363010465","article-title":"Using propensity scores to help design observational studies: application to the tobacco litigation","volume":"2","author":"Rubin","year":"2001","journal-title":"Health Services and Outcomes Research Methodology"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Schervish1","first-page":"203","article-title":"p values: What they are and what they are not","volume":"50","author":"Schervish","year":"1996","journal-title":"American Statistician"},{"issue":"6","key":"2020060217495594300_i1944-7558-118-1-3-Schuirmann1","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1007\/BF01068419","article-title":"A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability","volume":"15","author":"Schuirmann","year":"1987","journal-title":"Journal of Pharmacokinetics and Biopharmaceutics"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Serlin1","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1037\/0003-066X.40.1.73","article-title":"Rationality in psychological research: The good-enough principle","volume":"40","author":"Serlin","year":"1985","journal-title":"American Psychologist"},{"key":"2020060217495594300_i1944-7558-118-1-3-Serlin2","first-page":"199","article-title":"Rational appraisal of psychological research and the good-enough principle","author":"Serlin","year":"1993","journal-title":"A handbook for data analysis in the behavioral sciences: Methodological issues"},{"key":"2020060217495594300_i1944-7558-118-1-3-Shadish1","volume-title":"Experimental and quasi-experimental designs for generalized causal inference","author":"Shadish","year":"2002"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Shadish2","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1053\/j.nainr.2009.12.010","article-title":"A primer on propensity score analysis","volume":"10","author":"Shadish","year":"2010","journal-title":"Newborn and Infant Nursing Reviews"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Stegner1","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/0149-7189(96)00011-0","article-title":"Equivalence testing for use in psychosocial and services research: An introduction with examples","volume":"19","author":"Stegner","year":"1996","journal-title":"Evaluation and Program Planning"},{"key":"2020060217495594300_i1944-7558-118-1-3-Steiner1","article-title":"Matching and propensity scores","author":"Steiner","year":"2012","journal-title":"Oxford handbook of quantitative methods (ch. 13)"},{"issue":"3","key":"2020060217495594300_i1944-7558-118-1-3-Steiner2","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1037\/a0018719","article-title":"The importance of covariate selection in controlling for selection bias in observational studies","volume":"15","author":"Steiner","year":"2010","journal-title":"Psychological Methods"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Strauss1","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1037\/0021-843X.110.1.6","article-title":"Demonstrating specific cognitive deficits: A psychometric perspective","volume":"110","author":"Strauss","year":"2001","journal-title":"Journal of Abnormal Psychology"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Stuart1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1214\/09-STS313","article-title":"Matching methods for causal inference: A review and a look forward","volume":"25","author":"Stuart","year":"2010","journal-title":"Statistical Science"},{"issue":"2","key":"2020060217495594300_i1944-7558-118-1-3-Thomas1","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1044\/1092-4388(2009\/07-0144)","article-title":"Using developmental trajectories to understand developmental disorders","volume":"52","author":"Thomas","year":"2009","journal-title":"Journal of Speech, Language, and Hearing Research"},{"issue":"13","key":"2020060217495594300_i1944-7558-118-1-3-Towgood1","doi-asserted-by":"crossref","first-page":"2981","DOI":"10.1016\/j.neuropsychologia.2009.06.028","article-title":"Advantages of the multiple case series approach to the study of cognitive deficits in autism spectrum disorder","volume":"47","author":"Towgood","year":"2009","journal-title":"Neuropsychologia"},{"issue":"4","key":"2020060217495594300_i1944-7558-118-1-3-Tupper1","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1080\/01688638408401234","article-title":"Methodological considerations in the use of attribute variables in neuropsychological research","volume":"6","author":"Tupper","year":"1984","journal-title":"Journal of Clinical Neuropsychology"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Westlake1","doi-asserted-by":"crossref","first-page":"273","DOI":"10.2307\/2529949","article-title":"Statistical aspects of comparative bioavailability trials","volume":"35","author":"Westlake","year":"1979","journal-title":"Biometrics"},{"issue":"1","key":"2020060217495594300_i1944-7558-118-1-3-Zimmerman1","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1348\/000711004849222","article-title":"A note on preliminary tests of equality of variances","volume":"57","author":"Zimmerman","year":"2004","journal-title":"British Journal of Mathematical and Statistical Psychology"}],"container-title":["American Journal on Intellectual and Developmental Disabilities"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/meridian.allenpress.com\/ajidd\/article-pdf\/118\/1\/3\/2025083\/1944-7558-118_1_3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/meridian.allenpress.com\/ajidd\/article-pdf\/118\/1\/3\/2025083\/1944-7558-118_1_3.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T16:36:04Z","timestamp":1768322164000},"score":1,"resource":{"primary":{"URL":"https:\/\/meridian.allenpress.com\/ajidd\/article\/118\/1\/3\/344\/Establishing-Equivalence-Methodological-Progress"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,1,1]]},"references-count":54,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,1,1]]}},"URL":"https:\/\/doi.org\/10.1352\/1944-7558-118.1.3","relation":{},"ISSN":["1944-7558","1944-7515"],"issn-type":[{"value":"1944-7558","type":"electronic"},{"value":"1944-7515","type":"print"}],"subject":[],"published":{"date-parts":[[2013,1,1]]}}}