{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,5]],"date-time":"2026-04-05T05:24:31Z","timestamp":1775366671051,"version":"3.50.1"},"reference-count":47,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,26]],"date-time":"2022-01-26T00:00:00Z","timestamp":1643155200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["KO 4680\/3-2"],"award-info":[{"award-number":["KO 4680\/3-2"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["PA 2409\/3-2"],"award-info":[{"award-number":["PA 2409\/3-2"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministerstwo Edukacji i Nauki; Ministry of Education and Science","award":["022\/RID\/2018\/19"],"award-info":[{"award-number":["022\/RID\/2018\/19"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Clustered data arise frequently in many practical applications whenever units are repeatedly observed under a certain condition. One typical example for clustered data are animal experiments, where several animals share the same cage and should not be assumed to be completely independent. Standard methods for the analysis of such data are Linear Mixed Models and Generalized Estimating Equations\u2014however, checking their assumptions is not easy, especially in scenarios with small sample sizes, highly skewed, count, and ordinal or binary data. In such situations, Wilcoxon\u2013Mann\u2013Whitney type effects are suitable alternatives to mean-based or other distributional approaches. Hence, no specific data distribution, symmetric or asymmetric, is required. Within this work, we will present different estimation techniques of such effects in clustered factorial designs and discuss quadratic- and multiple contrast type-testing procedures for hypotheses formulated in terms of Wilcoxon\u2013Mann\u2013Whitney effects. Additionally, the framework allows for the occurrence of missing data: estimation and testing hypotheses are based on all-available data instead of complete-cases. An extensive simulation study investigates the precision of the estimators and the behavior of the test procedures in terms of their type-I error control. One real world dataset exemplifies the applicability of the newly proposed procedures.<\/jats:p>","DOI":"10.3390\/sym14020244","type":"journal-article","created":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T04:49:51Z","timestamp":1643258991000},"page":"244","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Estimation and Testing of Wilcoxon\u2013Mann\u2013Whitney Effects in Factorial Clustered Data Designs"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6174-6346","authenticated-orcid":false,"given":"Kerstin","family":"Rubarth","sequence":"first","affiliation":[{"name":"Institute of Biometry and Clinical Epidemiology, Charit\u00e9\u2014Universit\u00e4tsmedizin Berlin, Corporate Member of Freie Universit\u00e4t Berlin and Humboldt-Universit\u00e4t zu Berlin, Charit\u00e9platz 1, 10117 Berlin, Germany"},{"name":"Berlin Institute of Health (BIH), Anna-Louisa-Karsch-Stra\u00dfe 2, 10178 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paavo","family":"Sattler","sequence":"additional","affiliation":[{"name":"Department of Statistics, TU Dortmund University, TU Dortmund, 44221 Dortmund, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanna Gwendolyn","family":"Zimmermann","sequence":"additional","affiliation":[{"name":"Experimental and Clinical Research Center, Charit\u00e9\u2014Universit\u00e4tsmedizin Berlin, Corporate Member of Freie Universit\u00e4t Berlin and Humboldt-Universit\u00e4t zu Berlin, Charit\u00e9platz 1, 10117 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5674-2076","authenticated-orcid":false,"given":"Frank","family":"Konietschke","sequence":"additional","affiliation":[{"name":"Institute of Biometry and Clinical Epidemiology, Charit\u00e9\u2014Universit\u00e4tsmedizin Berlin, Corporate Member of Freie Universit\u00e4t Berlin and Humboldt-Universit\u00e4t zu Berlin, Charit\u00e9platz 1, 10117 Berlin, Germany"},{"name":"Berlin Institute of Health (BIH), Anna-Louisa-Karsch-Stra\u00dfe 2, 10178 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4939","DOI":"10.1002\/sim.8343","article-title":"The nonparametric Behrens-Fisher problem with dependent replicates","volume":"38","author":"Roy","year":"2019","journal-title":"Stat. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1080\/10485250903469728","article-title":"Two sample tests for the nonparametric Behrens\u2013Fisher problem with clustered data","volume":"22","author":"Larocque","year":"2010","journal-title":"J. Nonparametric Stat."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1002\/bimj.201900310","article-title":"The nonparametric Behrens\u2013Fisher problem in partially complete clustered data","volume":"63","author":"Cui","year":"2021","journal-title":"Biom. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1002\/bimj.200510299","article-title":"A Nonparametric Procedure for the Two-Factor Mixed Model with Missing Data","volume":"49","author":"Gao","year":"2007","journal-title":"Biom. J."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Fitzmaurice, G., Laird, N., and Ware, J. (2012). Applied Longitudinal Analysis, John Wiley & Sons.","DOI":"10.1002\/9781119513469"},{"key":"ref_6","unstructured":"Johnson, R.A., and Wichern, D. (2007). Applied Multivariate Statistical Analysis, Pearson Education Limited."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1214\/aoms\/1177730491","article-title":"On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other","volume":"18","author":"Mann","year":"1947","journal-title":"Ann. Math. Stat."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1002\/(SICI)1521-4036(200001)42:1<17::AID-BIMJ17>3.0.CO;2-U","article-title":"The Nonparametric Behrens-Fisher Problem: Asymptotic Theory and a Small-Sample Approximation","volume":"42","author":"Brunner","year":"2000","journal-title":"Biom. J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1111\/j.1467-9868.2011.01020.x","article-title":"Probabilistic index models","volume":"74","author":"Thas","year":"2012","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1002\/sim.2256","article-title":"Probabilistic index: An intuitive non-parametric approach to measuring the size of treatment effects","volume":"25","author":"Acion","year":"2006","journal-title":"Stat. Med."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Brunner, E., Bathke, A.C., and Konietschke, F. (2018). Rank and Pseudo-Rank Procedures for Independent Observations in Factorial Designs, Springer.","DOI":"10.1007\/978-3-030-02914-2"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1177\/0049124102030003006","article-title":"A Nonparametric Approach to Matched Pairs with Missing Data","volume":"30","author":"Akritas","year":"2002","journal-title":"Sociol. Methods Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1093\/biostatistics\/kxx039","article-title":"Rank-based two-sample tests for paired data with missing values","volume":"19","author":"Fong","year":"2018","journal-title":"Biostatistics"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1177\/0049124102030003004","article-title":"Rank Procedures for Repeated Measures with Missing Values","volume":"30","author":"Domhof","year":"2002","journal-title":"Sociol. Methods Res."},{"key":"ref_15","unstructured":"Amro, L., Konietschke, F., and Pauly, M. (2021). Incompletely observed nonparametric factorial designs with repeated measurements: A wild bootstrap approach. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/S0378-3758(96)00177-2","article-title":"A unified approach to rank tests for mixed models","volume":"61","author":"Akritas","year":"1997","journal-title":"J. Stat. Plan. Inference"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1006\/jmva.1999.1821","article-title":"Rank-Score Tests in Factorial Designs with Repeated Measures","volume":"70","author":"Brunner","year":"1999","journal-title":"J. Multivar. Anal."},{"key":"ref_18","unstructured":"Brunner, E., Domhof, S., and Langer, F. (2002). Nonparametric Analysis of Longitudinal Data in Factorial Experiments, Wiley-Interscience."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"615790","DOI":"10.3389\/fneur.2021.615790","article-title":"Retinal Thickness Analysis in Progressive Multiple Sclerosis Patients Treated With Epigallocatechin Gallate: Optical Coherence Tomography Results From the SUPREMES Study","volume":"12","author":"Klumbies","year":"2021","journal-title":"Front. Neurol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1816","DOI":"10.1177\/1352458520970841","article-title":"Rising prevalence of multiple sclerosis worldwide: Insights from the Atlas of MS, third edition","volume":"26","author":"Walton","year":"2020","journal-title":"Mult. Scler. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1056\/NEJMra1401483","article-title":"Multiple Sclerosis","volume":"378","author":"Reich","year":"2018","journal-title":"N. Engl. J. Med."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1016\/S1474-4422(17)30278-8","article-title":"Retinal layer segmentation in multiple sclerosis: A systematic review and meta-analysis","volume":"16","author":"Petzold","year":"2017","journal-title":"Lancet Neurol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1080\/14737175.2019.1559051","article-title":"Optical coherence tomography in neuromyelitis optica spectrum disorders: Potential advantages for individualized monitoring of progression and therapy","volume":"19","author":"Oertel","year":"2019","journal-title":"Expert Rev. Neurother."},{"key":"ref_24","unstructured":"Ruymgaart, F. (2006). A Unified Approach to the Asymptotic Distribution Theory of Certain Midrank Statistics, Springer."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1463","DOI":"10.1111\/rssb.12222","article-title":"Rank-Based Procedures in Factorial Designs: Hypotheses about Nonparametric Treatment Effects","volume":"79","author":"Brunner","year":"2016","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1111\/insr.12418","article-title":"Ranks and Pseudo-ranks\u2014Surprising Results of Certain Rank Tests in Unbalanced Designs","volume":"89","author":"Brunner","year":"2020","journal-title":"Int. Stat. Rev."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"567","DOI":"10.2307\/2533958","article-title":"Nonparametric analysis of clustered ROC curve data","volume":"53","author":"Obuchowski","year":"1997","journal-title":"Biometrics"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3227","DOI":"10.1002\/sim.8918","article-title":"Confidence interval estimation for treatment effects in cluster randomization trials based on ranks","volume":"40","author":"Zou","year":"2021","journal-title":"Stat. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1093\/biomet\/88.4.1121","article-title":"Within-Cluster Resampling","volume":"88","author":"Hoffman","year":"2001","journal-title":"Biometrika"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1111\/1541-0420.00005","article-title":"Marginal Analyses of Clustered Data When Cluster Size Is Informative","volume":"59","author":"Williamson","year":"2003","journal-title":"Biometrics"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1177\/09622802211046389","article-title":"Ranking Procedures for Repeated Measures Designs with Missing Data: Estimation, Testing and Asymptotic Theory","volume":"31","author":"Rubarth","year":"2022","journal-title":"Stat. Methods Med. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1214\/12-EJS691","article-title":"Rank-based multiple test procedures and simultaneous confidence intervals","volume":"6","author":"Konietschke","year":"2012","journal-title":"Electron. J. Stat."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1895","DOI":"10.1016\/j.csda.2010.02.019","article-title":"Testing and estimation of purely nonparametric effects in repeated measures designs","volume":"54","author":"Konietschke","year":"2010","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1080\/01621459.1997.10473623","article-title":"Nonparametric Hypotheses and Rank Statistics for Unbalanced Factorial Designs","volume":"92","author":"Akritas","year":"1997","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1002\/1521-4036(200109)43:5<645::AID-BIMJ645>3.0.CO;2-F","article-title":"On the Numerical Availability of Multiple Comparison Procedures","volume":"43","author":"Bretz","year":"2001","journal-title":"Biom. J."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1016\/j.csda.2011.03.022","article-title":"Ranking procedures for matched pairs with missing data\u2014Asymptotic theory and a small sample approximation","volume":"56","author":"Konietschke","year":"2012","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2574","DOI":"10.1016\/j.jspi.2007.10.015","article-title":"Nonparametric multiple comparison procedures for unbalanced one-way factorial designs","volume":"138","author":"Gao","year":"2008","journal-title":"J. Stat. Plan. Inference"},{"key":"ref_38","unstructured":"R Core Team (2013). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.csda.2016.06.016","article-title":"A wild bootstrap approach for nonparametric repeated measurements","volume":"113","author":"Friedrich","year":"2017","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1214\/09-SS051","article-title":"Wilcoxon-Mann-Whitney or t-test? On assumptions for hypothesis tests and multiple interpretations of decision rules","volume":"4","author":"Fay","year":"2010","journal-title":"Stat. Surv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1487","DOI":"10.1002\/sim.3561","article-title":"The Wilcoxon\u2013Mann\u2013Whitney test under scrutiny","volume":"28","author":"Fagerland","year":"2009","journal-title":"Stat. Med."},{"key":"ref_42","first-page":"72","article-title":"Different Outcomes of the Wilcoxon-Mann-Whitney Test from Different Statistics Packages","volume":"54","author":"Bergmann","year":"2000","journal-title":"Am. Stat."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3991","DOI":"10.1002\/sim.7890","article-title":"Confidence intervals of the Mann-Whitney parameter that are compatible with the Wilcoxon-Mann-Whitney test: Confidence Intervals on the Mann-Whitney Parameter","volume":"37","author":"Fay","year":"2018","journal-title":"Stat. Med."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2923","DOI":"10.1002\/sim.7799","article-title":"Causal estimands and confidence intervals associated with Wilcoxon-Mann-Whitney tests in randomized experiments","volume":"37","author":"Fay","year":"2017","journal-title":"Stat. Med."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1080\/00031305.1992.10475881","article-title":"On Comparing Two Treatments","volume":"46","author":"Hand","year":"1992","journal-title":"Am. Stat."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"12","DOI":"10.18637\/jss.v050.i12","article-title":"nparLD: An R software package for the nonparametric analysis of longitudinal data in factorial experiments","volume":"50","author":"Noguchi","year":"2012","journal-title":"J. Stat. Softw."},{"key":"ref_47","unstructured":"Domhof, S. (2001). Nichtparametrische Relative Effekte. [Ph.D. Thesis, Nieders\u00e4chsische Staats-und Universit\u00e4tsbibliothek G\u00f6ttingen]."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/2\/244\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:08:26Z","timestamp":1760134106000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/2\/244"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,26]]},"references-count":47,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["sym14020244"],"URL":"https:\/\/doi.org\/10.3390\/sym14020244","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,26]]}}}