{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T07:55:57Z","timestamp":1790841357847,"version":"4.1.0"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2016,12,10]],"date-time":"2016-12-10T00:00:00Z","timestamp":1481328000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100001659","name":"German Research Foundation","doi-asserted-by":"publisher","award":["DFG-PA 2409\/3-1"],"award-info":[{"award-number":["DFG-PA 2409\/3-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,11,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>Existing tests for factorial designs in the non-parametric case are based on hypotheses formulated in terms of distribution functions. Typical null hypotheses, however, are formulated in terms of some parameters or effect measures, particularly in heteroscedastic settings. Here this idea is extended to non-parametric models by introducing a novel non-parametric analysis-of-variance type of statistic based on ranks or pseudoranks which is suitable for testing hypotheses formulated in meaningful non-parametric treatment effects in general factorial designs. This is achieved by a careful detailed study of the common distribution of rank-based estimators for the treatment effects. Since the statistic is asymptotically not a pivotal quantity we propose three different approximation techniques, discuss their theoretic properties and compare them in extensive simulations together with two additional Wald-type tests. An extension of the presented idea to general repeated measures designs is briefly outlined. The rank- and pseudorank-based procedures proposed maintain the preassigned type I error rate quite accurately, also in unbalanced and heteroscedastic models.<\/jats:p>","DOI":"10.1111\/rssb.12222","type":"journal-article","created":{"date-parts":[[2016,12,10]],"date-time":"2016-12-10T07:01:58Z","timestamp":1481353318000},"page":"1463-1485","source":"Crossref","is-referenced-by-count":96,"title":["Rank-Based Procedures in Factorial Designs: Hypotheses About Non-Parametric Treatment Effects"],"prefix":"10.1093","volume":"79","author":[{"given":"Edgar","family":"Brunner","sequence":"first","affiliation":[{"name":"University of G\u00f6ttingen , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frank","family":"Konietschke","sequence":"additional","affiliation":[{"name":"University of Texas , Dallas , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Markus","family":"Pauly","sequence":"additional","affiliation":[{"name":"University of Ulm , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Madan L.","family":"Puri","sequence":"additional","affiliation":[{"name":"Indiana University , Bloomington , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2016,12,10]]},"reference":[{"key":"2023022002192905000_rssb12222-cit-0001","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1002\/sim.2256","article-title":"Probabilistic index: an intuitive non-parametric approach to measuring the size of treatment effects","volume":"25","author":"Acion","year":"2006","journal-title":"Statist. Med."},{"key":"2023022002192905000_rssb12222-cit-0004","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1080\/01621459.1994.10476475","article-title":"Fully non-parametric hypotheses for factorial designs I: Multivariate repeated measures designs","volume":"89","author":"Akritas","year":"1994","journal-title":"J. Am. Statist. Ass."},{"key":"2023022002192905000_rssb12222-cit-0005","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1080\/01621459.1997.10473623","article-title":"Nonparametric hypotheses and rank statistics for unbalanced factorial designs","volume":"92","author":"Akritas","year":"1997","journal-title":"J. Am. Statist. Ass."},{"key":"2023022002192905000_rssb12222-cit-0006","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/S0378-3758(96)00177-2","article-title":"A unified approach to ranks tests in mixed models","volume":"61","author":"Akritas","year":"1997","journal-title":"J. Statist. Planng Inf."},{"key":"2023022002192905000_rssb12222-cit-0007","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/0022-2496(75)90001-2","article-title":"The area above the ordinal dominance graph and the area below the receiver operating characteristic graph","volume":"12","author":"Bamber","year":"1975","journal-title":"J. Math. Psychol."},{"key":"2023022002192905000_rssb12222-cit-0008","doi-asserted-by":"crossref","first-page":"61","DOI":"10.2307\/2532739","article-title":"A rank-based mixed model approach to multisite clinical trials","volume":"44","author":"Boos","year":"1992","journal-title":"Biometrics"},{"key":"2023022002192905000_rssb12222-cit-0009","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1214\/aoms\/1177728786","article-title":"Some theorems on quadratic forms applied in the study of analysis of variance problems, I: Effect of inequality of variance in the one-way classification","volume":"25","author":"Box","year":"1954","journal-title":"Ann. Math. Statist."},{"key":"2023022002192905000_rssb12222-cit-0010","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1111\/1467-842X.00244","article-title":"Kruskal-Wallis, multiple comparisons and Efron dice","volume":"44","author":"Brown","year":"2002","journal-title":"Aust. New Zeal. J. Statist."},{"key":"2023022002192905000_rssb12222-cit-0011","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1002\/sim.2345","article-title":"Using the ROC curve for gauging treatment effect in clinical trials","volume":"25","author":"Brumback","year":"2006","journal-title":"Statist. Med."},{"key":"2023022002192905000_rssb12222-cit-0012","doi-asserted-by":"crossref","first-page":"1494","DOI":"10.1080\/01621459.1997.10473671","article-title":"Box-type approximations in non-parametric factorial designs","volume":"92","author":"Brunner","year":"1997","journal-title":"J. Am. Statist. Ass."},{"key":"2023022002192905000_rssb12222-cit-0014","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1002\/1521-4036(200010)42:6<663::AID-BIMJ663>3.0.CO;2-7","article-title":"Nonparametric analysis of ordered categorical data in designs with longitudinal observations and small sample sizes","volume":"42","author":"Brunner","year":"2000","journal-title":"Biometr. J."},{"key":"2023022002192905000_rssb12222-cit-0015","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1002\/(SICI)1521-4036(200001)42:1<17::AID-BIMJ17>3.0.CO;2-U","article-title":"The nonparametric Behrens-Fisher problem: asymptotic theory and a small-sample approximation","volume":"42","author":"Brunner","year":"2000","journal-title":"Biometr. J."},{"key":"2023022002192905000_rssb12222-cit-0016","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-37184-4","volume-title":"Nichtparametrische Datenanalyse","author":"Brunner","year":"2013"},{"key":"2023022002192905000_rssb12222-cit-0017","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1006\/jmva.1999.1821","article-title":"Rank-score tests in factorial designs with repeated measures","volume":"70","author":"Brunner","year":"1999","journal-title":"J. Multiv. Anal."},{"key":"2023022002192905000_rssb12222-cit-0018","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s003620000039","article-title":"Nonparametric methods in factorial designs","volume":"42","author":"Brunner","year":"2001","journal-title":"Statist. Pap."},{"key":"2023022002192905000_rssb12222-cit-0019","first-page":"471","volume-title":"Handbook of Methods and Applications of Statistics in Clinical Trials","author":"Brunner","year":"2013"},{"key":"2023022002192905000_rssb12222-cit-0020","doi-asserted-by":"crossref","first-page":"2494","DOI":"10.1093\/bioinformatics\/btu313","article-title":"The unified Wilcoxon-Mann-Whitney test for analyzing RT-qPCR data in R","volume":"30","author":"De Neve","year":"2014","journal-title":"Bioinformatics"},{"key":"2023022002192905000_rssb12222-cit-0021","doi-asserted-by":"crossref","first-page":"1276","DOI":"10.1080\/01621459.2015.1016226","article-title":"A regression framework for rank tests based on the Probabilistic Index Model","volume":"110","author":"De Neve","year":"2015","journal-title":"J. Am. Statist. Ass."},{"key":"2023022002192905000_rssb12222-cit-0023","volume-title":"Robust permutation tests for correlation and regression coefficients","author":"DiCiccio","year":"2015"},{"key":"2023022002192905000_rssb12222-cit-0024","volume-title":"Nichtparametrische relative Effekte","author":"Domhof","year":"2001"},{"key":"2023022002192905000_rssb12222-cit-0025","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.csda.2013.12.004","article-title":"Wald-type rank tests: a GEE approach","volume":"74","author":"Fan","year":"2014","journal-title":"Computnl Statist. Data Anal."},{"key":"2023022002192905000_rssb12222-cit-0026","article-title":"On power and sample size of the ANOVA-type rank test","author":"Fan","year":"2015","journal-title":"Communs Statist. Simuln Computn"},{"key":"2023022002192905000_rssb12222-cit-0027","first-page":"1","article-title":"Mann-Whitney type tests for microarray experiments: the R package gMWT","volume":"65","author":"Fischer","year":"2015","journal-title":"J. Statist. Softwr."},{"key":"2023022002192905000_rssb12222-cit-0028","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1111\/sjos.12055","article-title":"Generalized Mann-Whitney type tests for microarray experiments","volume":"41","author":"Fischer","year":"2014","journal-title":"Scand. J. Statist."},{"key":"2023022002192905000_rssb12222-cit-0029","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1198\/016214505000000042","article-title":"A unified non-parametric approach for unbalanced factorial designs","volume":"100","author":"Gao","year":"2005","journal-title":"J. Am. Statist. Ass."},{"key":"2023022002192905000_rssb12222-cit-0030","doi-asserted-by":"crossref","first-page":"3674","DOI":"10.1016\/j.jspi.2007.11.019","article-title":"Nonparametric multiple comparison procedures for unbalanced two-way layouts","volume":"138","author":"Gao","year":"2008","journal-title":"J. Statist. Planng Inf."},{"key":"2023022002192905000_rssb12222-cit-0031","doi-asserted-by":"crossref","first-page":"2574","DOI":"10.1016\/j.jspi.2007.10.015","article-title":"Nonparametric multiple comparison procedures for unbalanced one-way factorial designs","volume":"138","author":"Gao","year":"2008","journal-title":"J. Statist. Planng Inf."},{"key":"2023022002192905000_rssb12222-cit-0032","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1038\/scientificamerican1270-110","article-title":"The paradox of the nontransitive dice and the elusive principle of indifference","volume":"223","author":"Gardner","year":"1970","journal-title":"Scient. Am."},{"key":"2023022002192905000_rssb12222-cit-0034","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1214\/aos\/1056562462","article-title":"How do bootstrap and permutation tests work?","volume":"31","author":"Janssen","year":"2003","journal-title":"Ann. Statist."},{"key":"2023022002192905000_rssb12222-cit-0035","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1191\/0962280205sm392oa","article-title":"Nonparametric methods for analysing the accuracy of diagnostic tests with multiple readers","volume":"14","author":"Kaufmann","year":"2005","journal-title":"Statist. Meth. Med. Res."},{"key":"2023022002192905000_rssb12222-cit-0036","doi-asserted-by":"crossref","first-page":"1707","DOI":"10.1002\/sim.5634","article-title":"Assessment of statistical significance and clinical relevance","volume":"32","author":"Kieser","year":"2013","journal-title":"Statist. Med."},{"key":"2023022002192905000_rssb12222-cit-0037","doi-asserted-by":"crossref","first-page":"1895","DOI":"10.1016\/j.csda.2010.02.019","article-title":"Testing and estimation of purely non-parametric effects in repeated measures designs","volume":"54","author":"Konietschke","year":"2010","journal-title":"Computnl Statist. Data Anal."},{"key":"2023022002192905000_rssb12222-cit-0038","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1214\/12-EJS691","article-title":"Rank-based multiple test procedures and simultaneous confidence intervals","volume":"6","author":"Konietschke","year":"2012","journal-title":"Electron. J. Statist."},{"key":"2023022002192905000_rssb12222-cit-00501","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1214\/aoms\/1177729332","article-title":"A nonparametric test for the several sample problem","volume":"23","author":"Kruskal","year":"1952","journal-title":"Ann. Math. Statist."},{"key":"2023022002192905000_rssb12222-cit-0039","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1080\/01621459.1952.10483441","article-title":"Use of ranks in one-criterion variance analysis","volume":"47","author":"Kruskal","year":"1952","journal-title":"J. Am. Statist. Ass."},{"key":"2023022002192905000_rssb12222-cit-0040","volume-title":"Nichtparametrische Modelle f\u00fcr faktorielle Diagnosestudien","author":"Lange","year":"2008"},{"key":"2023022002192905000_rssb12222-cit-0041","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1214\/aoms\/1177730491","article-title":"On a test of whether one of two random variables is stochastically larger than the other","volume":"18","author":"Mann","year":"1947","journal-title":"Ann. Math. Statist."},{"key":"2023022002192905000_rssb12222-cit-0042","volume-title":"Quadratic Forms in Random Variables","author":"Mathai","year":"1992"},{"key":"2023022002192905000_rssb12222-cit-0043","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1016\/S0167-7152(98)00185-0","article-title":"Linear rank score statistics when ties are present","volume":"41","author":"Munzel","year":"1999","journal-title":"Statist. Probab. Lett."},{"key":"2023022002192905000_rssb12222-cit-0044","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1111\/rssb.12073","article-title":"Asymptotic permutation tests in general factorial designs","volume":"77","author":"Pauly","year":"2015","journal-title":"J. R. Statist. Soc."},{"key":"2023022002192905000_rssb12222-cit-0045","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1080\/02331888.2015.1050022","article-title":"Analysis of high-dimensional one group repeated measures designs","volume":"49","author":"Pauly","year":"2015","journal-title":"Statistics"},{"key":"2023022002192905000_rssb12222-cit-0046","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1214\/aoms\/1177703733","article-title":"Asymptotic efficiency of a class of c-sample tests","volume":"35","author":"Puri","year":"1964","journal-title":"Ann. Math. Statist."},{"key":"2023022002192905000_rssb12222-cit-00502","volume-title":"R: a Language and Environment for Statistical Computing","author":"R Development Core Team","year":"2010"},{"key":"2023022002192905000_rssb12222-cit-0047","doi-asserted-by":"crossref","first-page":"2007","DOI":"10.1080\/03610928408828810","article-title":"A modification of the Kruskal-Wallis statistic for the generalized Behrens-Fisher problem","volume":"13","author":"Rust","year":"1984","journal-title":"Communs Statist. Theory Meth."},{"key":"2023022002192905000_rssb12222-cit-0048","first-page":"1","volume-title":"Statistique non Parametrique Asymptotique","author":"Ruymgaart","year":"1980"},{"key":"2023022002192905000_rssb12222-cit-00503","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1016\/j.jspi.2006.06.005","article-title":"Wilcoxon\u2013Mann\u2013Whitney test for stratified samples and Efron's paradox dice","volume":"137","author":"Thangavelu","year":"2007","journal-title":"J. Statist. Planng Inf."},{"key":"2023022002192905000_rssb12222-cit-0049","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1111\/j.1467-9868.2011.01020.x","article-title":"Probabilistic index models (with discussion)","volume":"74","author":"Thas","year":"2012","journal-title":"J. R. Statist. Soc."},{"key":"2023022002192905000_rssb12222-cit-00504","article-title":"Rank-based permutation approaches for nonparametric designs","author":"Umlauft","year":"2016","journal-title":"Br. J. Math. Statist. Psychol."},{"key":"2023022002192905000_rssb12222-cit-0050","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1080\/00949650802482386","article-title":"Analysis of unbalanced factorial designs with heteroscedastic data","volume":"80","author":"Vallejo","year":"2010","journal-title":"J. Statist. Computn Simuln"},{"key":"2023022002192905000_rssb12222-cit-0051","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1002\/sim.6386","article-title":"Increasing the power of the Mann-Whitney test in randomized experiments through flexible covariate adjustment","volume":"34","author":"Vermeulen","year":"2015","journal-title":"Statist. Med."},{"key":"2023022002192905000_rssb12222-cit-0052","doi-asserted-by":"crossref","first-page":"3831","DOI":"10.1002\/sim.6583","article-title":"Nonparametric meta-analysis for diagnostic accuracy studies","volume":"34","author":"Zapf","year":"2015","journal-title":"Statist. Med."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12222","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12222","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/79\/5\/1463\/49269167\/jrsssb_79_5_1463.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/79\/5\/1463\/49269167\/jrsssb_79_5_1463.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,19]],"date-time":"2023-02-19T21:20:46Z","timestamp":1676841646000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/79\/5\/1463\/7040980"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,12,10]]},"references-count":51,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2016,12,10]]},"published-print":{"date-parts":[[2017,11,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12222","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,11]]},"published":{"date-parts":[[2016,12,10]]}}}