{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T12:10:13Z","timestamp":1781007013586,"version":"3.54.1"},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,8,29]],"date-time":"2024-08-29T00:00:00Z","timestamp":1724889600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,29]],"date-time":"2024-08-29T00:00:00Z","timestamp":1724889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012550","name":"Nemzeti Kutat\u00e1si, Fejleszt\u00e9si \u00e9s Innovaci\u00f3s Alap","doi-asserted-by":"publisher","award":["K 138945"],"award-info":[{"award-number":["K 138945"]}],"id":[{"id":"10.13039\/501100012550","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012550","name":"Nemzeti Kutat\u00e1si, Fejleszt\u00e9si \u00e9s Innovaci\u00f3s Alap","doi-asserted-by":"publisher","award":["K 134260"],"award-info":[{"award-number":["K 134260"]}],"id":[{"id":"10.13039\/501100012550","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012550","name":"Nemzeti Kutat\u00e1si, Fejleszt\u00e9si \u00e9s Innovaci\u00f3s Alap","doi-asserted-by":"publisher","award":["\u00daNKP (Bolyai+) 23-5"],"award-info":[{"award-number":["\u00daNKP (Bolyai+) 23-5"]}],"id":[{"id":"10.13039\/501100012550","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100018253","name":"Corvinus University of Budapest","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100018253","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cent Eur J Oper Res"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Although cross-validation (CV) is a standard technique in machine learning and data science, its efficacy remains largely unexplored in ranking environments. When evaluating the significance of differences, cross-validation is typically coupled with statistical testing, such as the Dietterich, Alpaydin, or Wilcoxon test. In this paper, we evaluate the power and false positive error rate of the Dietterich, Alpaydin, and Wilcoxon statistical tests combined with cross-validation each operating with folds ranging from 5 to 10, resulting in a total of 18 variants. Our testing setup utilizes a ranking framework, similar to the Sum of Ranking Differences (SRD) statistical procedure: we assume the existence of a reference ranking, and distances are measured in <jats:inline-formula>\n              <jats:alternatives>\n                <jats:tex-math>$$L_1$$<\/jats:tex-math>\n                <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:msub>\n                    <mml:mi>L<\/mml:mi>\n                    <mml:mn>1<\/mml:mn>\n                  <\/mml:msub>\n                <\/mml:math>\n              <\/jats:alternatives>\n            <\/jats:inline-formula>-norm. We test the methods under artificial scenarios as well as on real data borrowed from sports and chemistry. The choice of the optimal CV test method depends on preferences related to the minimization of errors in type I and II cases, the size of the input, and anticipated patterns in the data. Among the investigated input sizes, the Wilcoxon method with eight folds proved to be the most effective, although its performance in type I situations is subpar. While the Dietterich and Alpaydin methods excel in type I situations, they perform poorly in type II scenarios. The inadequate performances of these tests raises questions about their efficacy outside of ranking environments too.<\/jats:p>","DOI":"10.1007\/s10100-024-00932-1","type":"journal-article","created":{"date-parts":[[2024,8,29]],"date-time":"2024-08-29T13:02:43Z","timestamp":1724936563000},"page":"1503-1528","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Does cross-validation work in telling rankings apart?"],"prefix":"10.1007","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0068-8920","authenticated-orcid":false,"given":"Bal\u00e1zs R.","family":"Sziklai","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M\u00e1t\u00e9","family":"Baranyi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"K\u00e1roly","family":"H\u00e9berger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,8,29]]},"reference":[{"issue":"4","key":"932_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0284078","volume":"18","author":"J Abonyi","year":"2023","unstructured":"Abonyi J, Ipkovich A, D\u00f6rg\u0151 G et al (2023) Matrix factorization-based multi-objective ranaking-what makes a good university? Plos One 18(4):1\u201330. https:\/\/doi.org\/10.1371\/journal.pone.0284078","journal-title":"Plos One"},{"key":"932_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.105745","volume":"195","author":"R Alaiz-Rodr\u00edguez","year":"2020","unstructured":"Alaiz-Rodr\u00edguez R, Parnell AC (2020) An information theoretic approach to quantify the stability of feature selection and ranking algorithms. Knowl Based Syst 195:105745. https:\/\/doi.org\/10.1016\/j.knosys.2020.105745","journal-title":"Knowl Based Syst"},{"key":"932_CR3","doi-asserted-by":"publisher","first-page":"1885","DOI":"10.1162\/089976699300016007","volume":"11","author":"E Alpaydin","year":"1999","unstructured":"Alpaydin E (1999) Combined 5$$\\times$$2 cv F Test for comparing supervised classification learning algorithms. Neural Comput 11:1885\u20131892. https:\/\/doi.org\/10.1162\/089976699300016007","journal-title":"Neural Comput"},{"issue":"4","key":"932_CR4","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1016\/S0003-3472(76)80010-3","volume":"24","author":"GW Barlow","year":"1976","unstructured":"Barlow GW, Ballin PJ (1976) Predicting and assessing dominance from size and coloration in the polychromatic midas cichlid. Anim Behav 24(4):793\u2013813. https:\/\/doi.org\/10.1016\/S0003-3472(76)80010-3","journal-title":"Anim Behav"},{"issue":"2","key":"932_CR5","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1007\/BF00303169","volume":"6","author":"J Bartholdi","year":"1989","unstructured":"Bartholdi J, Tovey CA, Trick MA (1989) Voting schemes for which it can be difficult to tell who won the election. Soc Choice Welf 6(2):157\u2013165","journal-title":"Soc Choice Welf"},{"issue":"02","key":"932_CR6","doi-asserted-by":"publisher","first-page":"1360003","DOI":"10.1142\/S1793830913600033","volume":"05","author":"FJ Brandenburg","year":"2013","unstructured":"Brandenburg FJ, Glei\u00dfner A, Hofmeier A (2013) Comparing and aggregating partial orders with Kendall tau distances. Discret Math Algorithms Appl 05(02):1360003. https:\/\/doi.org\/10.1142\/S1793830913600033","journal-title":"Discret Math Algorithms Appl"},{"issue":"3","key":"932_CR7","doi-asserted-by":"publisher","first-page":"1003","DOI":"10.1016\/j.ejor.2021.10.005","volume":"299","author":"D Burka","year":"2022","unstructured":"Burka D, Puppe C, Szepesv\u00e1ry L et al (2022) Voting: a machine learning approach. Eur J Oper Res 299(3):1003\u20131017. https:\/\/doi.org\/10.1016\/j.ejor.2021.10.005","journal-title":"Eur J Oper Res"},{"key":"932_CR8","doi-asserted-by":"publisher","unstructured":"Conrad E, Misenar S, Feldman J (2017) Chapter 5\u2014Domain 5: Identity and access management (controlling access and managing identity). In: Conrad E, Misenar S, Feldman J (eds) Eleventh Hour CISSP\u00ae (Third Edition). Syngress, pp 117\u2013134, https:\/\/doi.org\/10.1016\/B978-0-12-811248-9.00005-X","DOI":"10.1016\/B978-0-12-811248-9.00005-X"},{"issue":"5","key":"932_CR9","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1007\/s11222-023-10266-8","volume":"33","author":"M Crispino","year":"2023","unstructured":"Crispino M, Mollica C, Astuti V et al (2023) Efficient and accurate inference for mixtures of mallows models with spearman distance. Stat Comput 33(5):98. https:\/\/doi.org\/10.1007\/s11222-023-10266-8","journal-title":"Stat Comput"},{"issue":"2","key":"932_CR10","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1111\/j.2517-6161.1977.tb01624.x","volume":"39","author":"P Diaconis","year":"1977","unstructured":"Diaconis P, Graham RL (1977) Spearman\u2019s footrule as a measure of disarray. J R Stat Soc Ser B (Methodological) 39(2):262\u2013268. https:\/\/doi.org\/10.1111\/j.2517-6161.1977.tb01624.x","journal-title":"J R Stat Soc Ser B (Methodological)"},{"issue":"7","key":"932_CR11","doi-asserted-by":"publisher","first-page":"1895","DOI":"10.1162\/089976698300017197","volume":"10","author":"TG Dietterich","year":"1998","unstructured":"Dietterich TG (1998) Approximate statistical tests for comparing supervised classification learning algorithms. Neural Comput 10(7):1895\u20131923. https:\/\/doi.org\/10.1162\/089976698300017197","journal-title":"Neural Comput"},{"issue":"4","key":"932_CR12","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1016\/j.cageo.2009.09.015","volume":"36","author":"O Falivene","year":"2010","unstructured":"Falivene O, Cabrera L, Tolosana-Delgado R et al (2010) Interpolation algorithm ranking using cross-validation and the role of smoothing effect. A coal zone example. Comput Geosci 36(4):512\u2013519. https:\/\/doi.org\/10.1016\/j.cageo.2009.09.015","journal-title":"Comput Geosci"},{"issue":"2","key":"932_CR13","doi-asserted-by":"publisher","first-page":"335","DOI":"10.14720\/aas.2016.107.2.07","volume":"107","author":"E Farshadfar","year":"2016","unstructured":"Farshadfar E, Amiri R (2016) In vitro application of integrated selection index for screening drought tolerant genotypes in common wheat. Acta Agric Slovenica 107(2):335. https:\/\/doi.org\/10.14720\/aas.2016.107.2.07","journal-title":"Acta Agric Slovenica"},{"key":"932_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/j.foodchem.2020.128617","volume":"344","author":"A Gere","year":"2021","unstructured":"Gere A, R\u00e1cz A, Bajusz D et al (2021) Multicriteria decision making for evergreen problems in food science by sum of ranking differences. Food Chem 344:128617. https:\/\/doi.org\/10.1016\/j.foodchem.2020.128617","journal-title":"Food Chem"},{"key":"932_CR15","doi-asserted-by":"publisher","DOI":"10.3390\/app12136303","author":"A Gere","year":"2022","unstructured":"Gere A, Szak\u00e1l D, H\u00e9berger K (2022) Multiobject optimization of national football league drafts: comparison of teams and experts. Appl Sci. https:\/\/doi.org\/10.3390\/app12136303","journal-title":"Appl Sci"},{"key":"932_CR16","doi-asserted-by":"publisher","DOI":"10.3390\/app13074556","author":"L Gyarmati","year":"2023","unstructured":"Gyarmati L, Orb\u00e1n-Mih\u00e1lyk\u00f3 E, Mih\u00e1lyk\u00f3 C et al (2023) Aggregated rankings of top leagues\u2019 football teams: application and comparison of different ranking methods. Appl Sci. https:\/\/doi.org\/10.3390\/app13074556","journal-title":"Appl Sci"},{"key":"932_CR17","series-title":"Springer series in statistics","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The elements of statistical learning: data mining, inference, and prediction","author":"T Hastie","year":"2009","unstructured":"Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning: data mining, inference, and prediction, 2nd edn. Springer series in statistics. Springer, New York","edition":"2"},{"issue":"1","key":"932_CR18","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.trac.2009.09.009","volume":"29","author":"K H\u00e9berger","year":"2010","unstructured":"H\u00e9berger K (2010) Sum of Ranking Differences compares methods or models fairly. TrAC Trends Anal Chem 29(1):101\u2013109. https:\/\/doi.org\/10.1016\/j.trac.2009.09.009","journal-title":"TrAC Trends Anal Chem"},{"issue":"4","key":"932_CR19","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1002\/cem.1320","volume":"25","author":"K H\u00e9berger","year":"2011","unstructured":"H\u00e9berger K, Koll\u00e1r-Hunek K (2011) Sum of Ranking Differences for method discrimination and its validation: comparison of ranks with random numbers. J Chemom 25(4):151\u2013158. https:\/\/doi.org\/10.1002\/cem.1320","journal-title":"J Chemom"},{"issue":"8\u201310","key":"932_CR20","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1002\/cem.748","volume":"16","author":"K H\u00e9berger","year":"2002","unstructured":"H\u00e9berger K, Rajk\u00f3 R (2002) Generalization of pair correlation method (PCM) for non-parametric variable selection. J Chemom 16(8\u201310):436\u2013443. https:\/\/doi.org\/10.1002\/cem.748","journal-title":"J Chemom"},{"issue":"10","key":"932_CR21","doi-asserted-by":"publisher","first-page":"1195","DOI":"10.1016\/j.artint.2008.03.002","volume":"172","author":"M Hild","year":"2008","unstructured":"Hild M, Spohn W (2008) The measurement of ranks and the laws of iterated contraction. Artif Intell 172(10):1195\u20131218. https:\/\/doi.org\/10.1016\/j.artint.2008.03.002","journal-title":"Artif Intell"},{"issue":"12","key":"932_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v071.i12","volume":"71","author":"E Irurozki","year":"2016","unstructured":"Irurozki E, Calvo B, Lozano JA (2016) PerMallows: an R package for mallows and generalized mallows models. J Stat Softw 71(12):1\u201330","journal-title":"J Stat Softw"},{"key":"932_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2020.107665","volume":"111","author":"J Jiang","year":"2021","unstructured":"Jiang J, Ma Q, Jiang X et al (2021) Ranking list preservation for feature matching. Pattern Recognit 111:107665. https:\/\/doi.org\/10.1016\/j.patcog.2020.107665","journal-title":"Pattern Recognit"},{"key":"932_CR24","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/j.chemolab.2013.06.007","volume":"127","author":"K Koll\u00e1r-Hunek","year":"2013","unstructured":"Koll\u00e1r-Hunek K, H\u00e9berger K (2013) Method and model comparison by sum of ranking differences in cases of repeated observations (ties). Chemom Intell Lab Syst 127:139\u2013146. https:\/\/doi.org\/10.1016\/j.chemolab.2013.06.007","journal-title":"Chemom Intell Lab Syst"},{"key":"932_CR25","doi-asserted-by":"publisher","unstructured":"Kumar R, Vassilvitskii S (2010) Generalized distances between rankings. In: Proceedings of the 19th international conference on World Wide Web. Association for computing machinery, New York, USA, pp 571-580, https:\/\/doi.org\/10.1145\/1772690.1772749","DOI":"10.1145\/1772690.1772749"},{"issue":"6","key":"932_CR26","doi-asserted-by":"publisher","first-page":"1672","DOI":"10.1016\/j.csda.2010.01.027","volume":"54","author":"PH Lee","year":"2010","unstructured":"Lee PH, Yu PLH (2010) Distance-based tree models for ranking data. Comput Stat Data Anal 54(6):1672\u20131682. https:\/\/doi.org\/10.1016\/j.csda.2010.01.027","journal-title":"Comput Stat Data Anal"},{"issue":"8","key":"932_CR27","doi-asserted-by":"publisher","first-page":"2486","DOI":"10.1016\/j.csda.2012.02.002","volume":"56","author":"PH Lee","year":"2012","unstructured":"Lee PH, Yu PLH (2012) Mixtures of weighted distance-based models for ranking data with applications in political studies. Comput Stat Data Anal 56(8):2486\u20132500. https:\/\/doi.org\/10.1016\/j.csda.2012.02.002","journal-title":"Comput Stat Data Anal"},{"issue":"5","key":"932_CR28","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1002\/wics.111","volume":"2","author":"S Lin","year":"2010","unstructured":"Lin S (2010) Rank aggregation methods. WIREs Comput Stat 2(5):555\u2013570. https:\/\/doi.org\/10.1002\/wics.111","journal-title":"WIREs Comput Stat"},{"issue":"3","key":"932_CR29","doi-asserted-by":"publisher","first-page":"255","DOI":"10.3102\/10769986027003255","volume":"27","author":"J Lockwood","year":"2002","unstructured":"Lockwood J, Louis TA, McCaffrey DF (2002) Uncertainty in rank estimation: implications for value-added modeling accountability systems. J Educ Behav Stat 27(3):255\u2013270. https:\/\/doi.org\/10.3102\/10769986027003255","journal-title":"J Educ Behav Stat"},{"issue":"1\/2","key":"932_CR30","doi-asserted-by":"publisher","first-page":"114","DOI":"10.2307\/2333244","volume":"44","author":"CL Mallows","year":"1957","unstructured":"Mallows CL (1957) Non-Null Ranking Models I. Biometrika 44(1\/2):114\u2013130","journal-title":"Biometrika"},{"issue":"21","key":"932_CR31","doi-asserted-by":"publisher","first-page":"3738","DOI":"10.1002\/sim.6224","volume":"33","author":"C Mollica","year":"2014","unstructured":"Mollica C, Tardella L (2014) Epitope profiling via mixture modeling of ranked data. Stat Med 33(21):3738\u20133758. https:\/\/doi.org\/10.1002\/sim.6224","journal-title":"Stat Med"},{"issue":"2","key":"932_CR32","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1007\/s11336-016-9530-0","volume":"82","author":"C Mollica","year":"2017","unstructured":"Mollica C, Tardella L (2017) Bayesian Plackett-Luce mixture models for partially ranked data. Psychometrika 82(2):442\u2013458. https:\/\/doi.org\/10.1007\/s11336-016-9530-0","journal-title":"Psychometrika"},{"key":"932_CR33","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.comtox.2017.07.002","volume":"3","author":"NHN Moorthy","year":"2017","unstructured":"Moorthy NHN, Kumar S, Poongavanam V (2017) Classification of carcinogenic and mutagenic properties using machine learning method. Comput Toxicol 3:33\u201343. https:\/\/doi.org\/10.1016\/j.comtox.2017.07.002","journal-title":"Comput Toxicol"},{"issue":"40","key":"932_CR34","first-page":"1","volume":"19","author":"S Negahban","year":"2018","unstructured":"Negahban S, Oh S, Thekumparampil KK et al (2018) Learning from comparisons and choices. J Mach Learn Res 19(40):1\u201395","journal-title":"J Mach Learn Res"},{"key":"932_CR35","doi-asserted-by":"publisher","DOI":"10.1007\/s10100-023-00839-3","author":"\u00c9 Orb\u00e1n-Mih\u00e1lyk\u00f3","year":"2023","unstructured":"Orb\u00e1n-Mih\u00e1lyk\u00f3 \u00c9, Mih\u00e1lyk\u00f3 C, Gyarmati L (2023) Evaluating the capacity of paired comparison methods to aggregate rankings of separate groups. Central Eur J Oper Res. https:\/\/doi.org\/10.1007\/s10100-023-00839-3","journal-title":"Central Eur J Oper Res"},{"issue":"9","key":"932_CR36","doi-asserted-by":"publisher","first-page":"2046","DOI":"10.1016\/j.foreco.2009.07.057","volume":"258","author":"D Palmer","year":"2009","unstructured":"Palmer D, H\u00f6ck B, Kimberley M et al (2009) Comparison of spatial prediction techniques for developing Pinus Radiata productivity surfaces across New Zealand. For Ecol Manag 258(9):2046\u20132055. https:\/\/doi.org\/10.1016\/j.foreco.2009.07.057","journal-title":"For Ecol Manag"},{"issue":"2","key":"932_CR37","first-page":"193","volume":"24","author":"RL Plackett","year":"1975","unstructured":"Plackett RL (1975) The analysis of permutations. J R Stat Soc Ser C (Appl Stat) 24(2):193\u2013202","journal-title":"J R Stat Soc Ser C (Appl Stat)"},{"issue":"5","key":"932_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v090.i05","volume":"90","author":"Z Qian","year":"2019","unstructured":"Qian Z, Yu PLH (2019) Weighted distance-based models for ranking data using the R package rankdist. J Stat Softw 90(5):1\u201331. https:\/\/doi.org\/10.18637\/jss.v090.i05","journal-title":"J Stat Softw"},{"issue":"3","key":"932_CR39","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1037\/h0057950","volume":"27","author":"AC Rosander","year":"1936","unstructured":"Rosander AC (1936) The standard error of a mean rank order. J Educ Psychol 27(3):193\u2013196. https:\/\/doi.org\/10.1037\/h0057950","journal-title":"J Educ Psychol"},{"key":"932_CR40","doi-asserted-by":"publisher","first-page":"8363","DOI":"10.1007\/s00216-013-7206-5","volume":"405","author":"B \u0160krbi\u0107","year":"2013","unstructured":"\u0160krbi\u0107 B, H\u00e9berger K, \u0110uri\u0161i\u0107 Mladenovi\u0107 N (2013) Comparison of multianalyte proficiency test results by Sum of Ranking Differences, principal component analysis, and hierarchical cluster analysis. Anal Bioanal Chem 405:8363\u20138375. https:\/\/doi.org\/10.1007\/s00216-013-7206-5","journal-title":"Anal Bioanal Chem"},{"issue":"1","key":"932_CR41","doi-asserted-by":"publisher","first-page":"324","DOI":"10.32614\/RJ-2020-026","volume":"12","author":"\u00d8 S\u00f8rensen","year":"2020","unstructured":"S\u00f8rensen \u00d8, Crispino M, Liu Q et al (2020) Bayesmallows: an R package for the Bayesian mallows model. R J 12(1):324\u2013342. https:\/\/doi.org\/10.32614\/RJ-2020-026","journal-title":"R J"},{"key":"932_CR42","doi-asserted-by":"publisher","unstructured":"Staudacher J, Sziklai BR, Olsson L et al (2023) rSRD: Sum of Ranking Differences statistical test. https:\/\/doi.org\/10.32614\/CRAN.package.rSRD, https:\/\/CRAN.R-project.org\/package=rSRD, R package version 0.1.7","DOI":"10.32614\/CRAN.package.rSRD"},{"key":"932_CR43","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/j.csda.2017.05.010","volume":"115","author":"V \u0160vendov\u00e1","year":"2017","unstructured":"\u0160vendov\u00e1 V, Schimek MG (2017) A novel method for estimating the common signals for consensus across multiple ranked lists. Comput Stat Data Anal 115:122\u2013135. https:\/\/doi.org\/10.1016\/j.csda.2017.05.010","journal-title":"Comput Stat Data Anal"},{"issue":"3","key":"932_CR44","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0229209","volume":"15","author":"BR Sziklai","year":"2020","unstructured":"Sziklai BR, H\u00e9berger K (2020) Apportionment and districting by Sum of Ranking Differences. Plos One 15(3):e0229209. https:\/\/doi.org\/10.1371\/journal.pone.0229209","journal-title":"Plos One"},{"key":"932_CR45","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2022.105821","author":"BR Sziklai","year":"2022","unstructured":"Sziklai BR, Bir\u00f3 P, Csat\u00f3 L (2022) The efficacy of tournament designs. Comput Oper Res. https:\/\/doi.org\/10.1016\/j.cor.2022.105821","journal-title":"Comput Oper Res"},{"key":"932_CR46","doi-asserted-by":"publisher","unstructured":"Tavanaei A, Gottumukkalay R, Maida AS et\u00a0al (2018) Unsupervised learning to rank aggregation using parameterized function optimization. In: 2018 International joint conference on neural networks (IJCNN). IEEE, Rio de Janeiro, pp 1\u20138, https:\/\/doi.org\/10.1109\/IJCNN.2018.8489160","DOI":"10.1109\/IJCNN.2018.8489160"},{"issue":"6","key":"932_CR47","doi-asserted-by":"publisher","first-page":"1102","DOI":"10.1109\/TFUZZ.2012.2196050","volume":"20","author":"AF Tehrani","year":"2012","unstructured":"Tehrani AF, Cheng Weiwei, Hullermeier E (2012) Preference learning using the Choquet integral: the case of multipartite ranking. IEEE Trans Fuzzy Syst 20(6):1102\u20131113. https:\/\/doi.org\/10.1109\/TFUZZ.2012.2196050","journal-title":"IEEE Trans Fuzzy Syst"},{"issue":"3","key":"932_CR48","doi-asserted-by":"publisher","first-page":"869","DOI":"10.2136\/sssaj2001.653869x","volume":"65","author":"J Triantafilis","year":"2001","unstructured":"Triantafilis J, Odeh I, McBratney A (2001) Five geostatistical models to predict soil salinity from electromagnetic induction data across irrigated cotton. Soil Sci Soc Am J 65(3):869\u2013878. https:\/\/doi.org\/10.2136\/sssaj2001.653869x","journal-title":"Soil Sci Soc Am J"},{"key":"932_CR49","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.aca.2011.10.065","volume":"712","author":"B Vajna","year":"2012","unstructured":"Vajna B, Farkas A, Pataki H et al (2012) Testing the performance of pure spectrum resolution from Raman hyperspectral images of differently manufactured pharmaceutical tablets. Anal Chim Acta 712:45\u201355. https:\/\/doi.org\/10.1016\/j.aca.2011.10.065","journal-title":"Anal Chim Acta"},{"issue":"1","key":"932_CR50","first-page":"5796","volume":"18","author":"V Vitelli","year":"2017","unstructured":"Vitelli V, S\u00f8rensen \u00d8, Crispino M et al (2017) Probabilistic preference learning with the Mallows rank model. J Mach Learn Res 18(1):5796\u20135844","journal-title":"J Mach Learn Res"},{"issue":"1","key":"932_CR51","first-page":"1135","volume":"15","author":"MN Volkovs","year":"2014","unstructured":"Volkovs MN, Zemel RS (2014) New learning methods for supervised and unsupervised preference aggregation. J Mach Learn Res 15(1):1135\u20131176","journal-title":"J Mach Learn Res"},{"key":"932_CR52","first-page":"2","volume":"36","author":"C West","year":"2018","unstructured":"West C (2018) Statistics for analysts who hate statistics, Part VII: sum of ranking differences (SRD)s. LCGC N Am 36:2\u20136","journal-title":"LCGC N Am"},{"issue":"6","key":"932_CR53","doi-asserted-by":"publisher","first-page":"80","DOI":"10.2307\/3001968","volume":"1","author":"F Wilcoxon","year":"1945","unstructured":"Wilcoxon F (1945) Individual comparisons by ranking methods. Biomet Bull 1(6):80. https:\/\/doi.org\/10.2307\/3001968","journal-title":"Biomet Bull"},{"key":"932_CR54","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.csda.2017.12.004","volume":"121","author":"H Xu","year":"2018","unstructured":"Xu H, Alvo M, Yu PLH (2018) Angle-based models for ranking data. Comput Stat Data Anal 121:113\u2013136. https:\/\/doi.org\/10.1016\/j.csda.2017.12.004","journal-title":"Comput Stat Data Anal"},{"issue":"6","key":"932_CR55","doi-asserted-by":"publisher","DOI":"10.1002\/wics.1483","volume":"11","author":"PLH Yu","year":"2019","unstructured":"Yu PLH, Gu J, Xu H (2019) Analysis of ranking data. WIREs Comput Stat 11(6):e1483. https:\/\/doi.org\/10.1002\/wics.1483","journal-title":"WIREs Comput Stat"},{"issue":"1","key":"932_CR56","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1108\/17465661011026176","volume":"5","author":"LA Zampetakis","year":"2010","unstructured":"Zampetakis LA, Moustakis VS (2010) Quantifying uncertainty in ranking problems with composite indicators: a Bayesian approach. J Modell Manag 5(1):63\u201380. https:\/\/doi.org\/10.1108\/17465661011026176","journal-title":"J Modell Manag"},{"key":"932_CR57","unstructured":"Zuk O, Ein-Dor L, Domany E (2007) Ranking under uncertainty. In: Parr R, van\u00a0der Gaag LC (eds) UAI 2007, Proceedings of the Twenty-Third Conference on Uncertainty in Artificial Intelligence, Vancouver, BC, Canada, July 19\u201322, 2007. AUAI Press, pp 466\u2013473"}],"container-title":["Central European Journal of Operations Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10100-024-00932-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10100-024-00932-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10100-024-00932-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T14:12:49Z","timestamp":1759155169000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10100-024-00932-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,29]]},"references-count":57,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["932"],"URL":"https:\/\/doi.org\/10.1007\/s10100-024-00932-1","relation":{},"ISSN":["1435-246X","1613-9178"],"issn-type":[{"value":"1435-246X","type":"print"},{"value":"1613-9178","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,29]]},"assertion":[{"value":"10 August 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 August 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}