{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T14:16:34Z","timestamp":1778163394926,"version":"3.51.4"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T00:00:00Z","timestamp":1581465600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T00:00:00Z","timestamp":1581465600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000200","name":"United States Agency for International Development","doi-asserted-by":"publisher","award":["AID-OAA-F-14-00035"],"award-info":[{"award-number":["AID-OAA-F-14-00035"]}],"id":[{"id":"10.13039\/100000200","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/N510129\/1"],"award-info":[{"award-number":["EP\/N510129\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/N510129\/1"],"award-info":[{"award-number":["EP\/N510129\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000200","name":"United States Agency for International Development","doi-asserted-by":"publisher","award":["AID-OAA-F-14-00035"],"award-info":[{"award-number":["AID-OAA-F-14-00035"]}],"id":[{"id":"10.13039\/100000200","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Stat"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents the R package<jats:bold>PlackettLuce<\/jats:bold>, which implements a generalization of the Plackett\u2013Luce model for rankings data. The generalization accommodates both ties (of arbitrary order) and partial rankings (complete rankings of subsets of items). By default, the implementation adds a set of pseudo-comparisons with a hypothetical item, ensuring that the underlying network of wins and losses between items is always strongly connected. In this way, the worth of each item always has a finite maximum likelihood estimate, with finite standard error. The use of pseudo-comparisons also has a regularization effect, shrinking the estimated parameters towards equal item worth. In addition to standard methods for model summary,<jats:bold>PlackettLuce<\/jats:bold>provides a method to compute quasi standard errors for the item parameters. This provides the basis for comparison intervals that do not change with the choice of identifiability constraint placed on the item parameters. Finally, the package provides a method for model-based partitioning using covariates whose values vary between rankings, enabling the identification of subgroups of judges or settings with different item worths. The features of the package are demonstrated through application to classic and novel data sets.<\/jats:p>","DOI":"10.1007\/s00180-020-00959-3","type":"journal-article","created":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T04:48:01Z","timestamp":1581482881000},"page":"1027-1057","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":57,"title":["Modelling rankings in R: the PlackettLuce package"],"prefix":"10.1007","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1256-3375","authenticated-orcid":false,"given":"Heather L.","family":"Turner","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7554-2558","authenticated-orcid":false,"given":"Jacob","family":"van Etten","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0302-2312","authenticated-orcid":false,"given":"David","family":"Firth","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1556-0302","authenticated-orcid":false,"given":"Ioannis","family":"Kosmidis","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,2,12]]},"reference":[{"key":"959_CR1","doi-asserted-by":"publisher","first-page":"199","DOI":"10.2307\/270983","volume":"24","author":"PD Allison","year":"1994","unstructured":"Allison PD, Christakis NA (1994) Logit models for sets of ranked items. Sociol Methodol 24:199. https:\/\/doi.org\/10.2307\/270983","journal-title":"Sociol Methodol"},{"issue":"4","key":"959_CR2","doi-asserted-by":"publisher","first-page":"495","DOI":"10.2307\/2348134","volume":"43","author":"SG Baker","year":"1994","unstructured":"Baker SG (1994) The multinomial-Poisson transformation. J R Stat Soc Ser D (Stat) 43(4):495\u2013504. https:\/\/doi.org\/10.2307\/2348134","journal-title":"J R Stat Soc Ser D (Stat)"},{"key":"959_CR3","unstructured":"Bennett J, Lanning S (2007) The Netflix prize. In: Proceedings of the KDD cup workshop 2007, ACM, pp 3\u20136"},{"key":"959_CR4","first-page":"324","volume":"39","author":"RA Bradley","year":"1952","unstructured":"Bradley RA, Terry ME (1952) Rank analysis of incomplete block designs I: the method of paired comparisons. Biometrika 39:324\u201345","journal-title":"Biometrika"},{"key":"959_CR5","doi-asserted-by":"crossref","unstructured":"Coppola A, Stewart B, Okazaki N (2014) lbfgs: limited-memory BFGS optimization. https:\/\/CRAN.R-project.org\/package=lbfgs, R package version 1.2.1","DOI":"10.32614\/CRAN.package.lbfgs"},{"key":"959_CR6","first-page":"1","volume":"1695","author":"G Csardi","year":"2006","unstructured":"Csardi G, Nepusz T (2006) The igraph software package for complex network research. InterJ Complex Syst 1695:1\u20139","journal-title":"InterJ Complex Syst"},{"issue":"329","key":"959_CR7","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1080\/01621459.1970.10481082","volume":"65","author":"RR Davidson","year":"1970","unstructured":"Davidson RR (1970) On extending the Bradley\u2013Terry model to accommodate ties in paired comparison experiments. J Am Stat Assoc 65(329):317\u2013328. https:\/\/doi.org\/10.1080\/01621459.1970.10481082","journal-title":"J Am Stat Assoc"},{"issue":"1","key":"959_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/j.0081-1750.2003.t01-1-00125.x","volume":"33","author":"D Firth","year":"2003","unstructured":"Firth D (2003) Overcoming the reference category problem in the presentation of statistical models. Sociol Methodol 33(1):1\u201318. https:\/\/doi.org\/10.1111\/j.0081-1750.2003.t01-1-00125.x","journal-title":"Sociol Methodol"},{"issue":"1","key":"959_CR9","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1093\/biomet\/91.1.65","volume":"91","author":"D Firth","year":"2004","unstructured":"Firth D, De Menezes RX (2004) Quasi-variances. Biometrika 91(1):65\u201380. https:\/\/doi.org\/10.1093\/biomet\/91.1.65","journal-title":"Biometrika"},{"key":"959_CR10","unstructured":"Firth D, Kosmidis I, Turner H (2019) Davidson\u2013Luce model for multi-item choice with ties. arXiv:1909.07123"},{"key":"959_CR11","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1214\/08-EJS349","volume":"3","author":"CJ Geyer","year":"2009","unstructured":"Geyer CJ (2009) Likelihood inference in exponential families and directions of recession. Electron J Stat 3:259\u2013289","journal-title":"Electron J Stat"},{"key":"959_CR12","unstructured":"Grimonprez Q, Jacques J (2016) Rankcluster: model-based clustering for multivariate partial ranking data. https:\/\/CRAN.R-project.org\/package=Rankcluster, R package version 0.94"},{"key":"959_CR13","unstructured":"Hankin RKS (2019) hyper2: the hyperdirichlet distribution, mark 2. https:\/\/CRAN.R-project.org\/package=hyper2, R package version 1.0-7"},{"issue":"10","key":"959_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v048.i10","volume":"48","author":"R Hatzinger","year":"2012","unstructured":"Hatzinger R, Dittrich R (2012) prefmod: an R package for modeling preferences based on paired comparisons, rankings, or ratings. J Stat Softw 48(10):1\u201331","journal-title":"J Stat Softw"},{"issue":"1","key":"959_CR15","doi-asserted-by":"publisher","first-page":"384","DOI":"10.1214\/aos\/1079120141","volume":"32","author":"DR Hunter","year":"2004","unstructured":"Hunter DR (2004) MM algorithms for generalized Bradley\u2013Terry models. Ann Stat 32(1):384\u2013406. https:\/\/doi.org\/10.1214\/aos\/1079120141","journal-title":"Ann Stat"},{"issue":"12","key":"959_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v071.i12","volume":"71","author":"E Irurozki","year":"2016","unstructured":"Irurozki E, Calvo B, Lozano JA (2016) PerMallows: an R package for Mallows and generalized Mallows models. J Stat Softw 71(12):1\u201330. https:\/\/doi.org\/10.18637\/jss.v071.i12","journal-title":"J Stat Softw"},{"key":"959_CR17","unstructured":"Lee PH, Yu PLH (2015) pmr: probability models for ranking data. https:\/\/CRAN.R-project.org\/package=pmr, R package version 1.2.5"},{"key":"959_CR18","volume-title":"Individual choice behavior: a theoretical analysis","author":"RD Luce","year":"1959","unstructured":"Luce RD (1959) Individual choice behavior: a theoretical analysis. Wiley, New York"},{"issue":"3","key":"959_CR19","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/0022-2496(77)90032-3","volume":"15","author":"RD Luce","year":"1977","unstructured":"Luce RD (1977) The choice axiom after twenty years. J Math Psychol 15(3):215\u2013233. https:\/\/doi.org\/10.1016\/0022-2496(77)90032-3","journal-title":"J Math Psychol"},{"issue":"1\u20132","key":"959_CR20","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1093\/biomet\/44.1-2.114","volume":"44","author":"CL Mallows","year":"1957","unstructured":"Mallows CL (1957) Non-null ranking models. I. Biometrika 44(1\u20132):114\u2013130. https:\/\/doi.org\/10.1093\/biomet\/44.1-2.114","journal-title":"Biometrika"},{"key":"959_CR21","unstructured":"Mattei N, Walsh T (2013) Preflib: a library of preference data. In: Proceedings of the 3rd international conference on algorithmic decision theory (ADT 2013), Lecture notes in artificial intelligence. Springer. http:\/\/preflib.org"},{"key":"959_CR22","unstructured":"Maystre L (2018) choix: inference algorithms for models based on Luce\u2019s choice axiom. https:\/\/pypi.python.org\/pypi\/choix, Python package version 0.3.2"},{"key":"959_CR23","unstructured":"Maystre L, Grossglauser M (2015) Fast and accurate inference of Plackett\u2013Luce models. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in neural information processing systems 28, Curran Associates, Inc., pp 172\u2013180. http:\/\/papers.nips.cc\/paper\/5681-fast-and-accurate-inference-of-plackettluce-models.pdf"},{"issue":"21","key":"959_CR24","doi-asserted-by":"publisher","first-page":"3738","DOI":"10.1002\/sim.6224","volume":"33","author":"C Mollica","year":"2014","unstructured":"Mollica C, Tardella L (2014) Epitope profiling via mixture modeling for ranked data. Stat Med 33(21):3738\u20133758. https:\/\/doi.org\/10.1002\/sim.6224","journal-title":"Stat Med"},{"issue":"2","key":"959_CR25","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1007\/s11336-016-9530-0","volume":"82","author":"C Mollica","year":"2017","unstructured":"Mollica C, Tardella L (2017) Bayesian Plackett\u2013Luce mixture models for partially ranked data. Psychometrika 82(2):442\u2013458. https:\/\/doi.org\/10.1007\/s11336-016-9530-0","journal-title":"Psychometrika"},{"key":"959_CR26","doi-asserted-by":"publisher","unstructured":"Mollica C, Tardella L (2020). PLMIX: An R package for modelling and clustering partially ranked data. J Stat Comput Simul. https:\/\/doi.org\/10.1080\/00949655.2020.1711909","DOI":"10.1080\/00949655.2020.1711909"},{"issue":"1","key":"959_CR27","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1007\/BF01385782","volume":"59","author":"Y Nievergelt","year":"1991","unstructured":"Nievergelt Y (1991) Aitken\u2019s and Steffensen\u2019s accelerations in several variables. Numerische Mathematik 59(1):295\u2013310","journal-title":"Numerische Mathematik"},{"issue":"2","key":"959_CR28","doi-asserted-by":"publisher","first-page":"193","DOI":"10.2307\/2346567","volume":"24","author":"RL Plackett","year":"1975","unstructured":"Plackett RL (1975) The analysis of permutations. Appl Stat 24(2):193\u2013202. https:\/\/doi.org\/10.2307\/2346567","journal-title":"Appl Stat"},{"issue":"5","key":"959_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v090.i05","volume":"90","author":"Z Qian","year":"2019","unstructured":"Qian Z, Yu PLH (2019) Weighted distance-based models for ranking data using the R package rankdist. J Stat Softw 90(5):1\u201331. https:\/\/doi.org\/10.18637\/jss.v090.i05","journal-title":"J Stat Softw"},{"issue":"4","key":"959_CR30","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1037\/a0016973","volume":"14","author":"C Strobl","year":"2009","unstructured":"Strobl C, Malley J, Tutz G (2009) An introduction to recursive partitioning: rationale, application, and characteristics of classification and regression trees, bagging, and random forests. Psychol Methods 14(4):323\u201348. https:\/\/doi.org\/10.1037\/a0016973","journal-title":"Psychol Methods"},{"issue":"2","key":"959_CR31","doi-asserted-by":"publisher","first-page":"135","DOI":"10.3102\/1076998609359791","volume":"36","author":"C Strobl","year":"2011","unstructured":"Strobl C, Wickelmaier F, Zeileis A (2011) Accounting for individual differences in Bradley-Terry models by means of recursive partitioning. J Educ Behav Stat 36(2):135\u2013153. https:\/\/doi.org\/10.3102\/1076998609359791","journal-title":"J Educ Behav Stat"},{"key":"959_CR32","doi-asserted-by":"publisher","DOI":"10.1177\/0962280217747309","author":"CS Tan","year":"2017","unstructured":"Tan CS, Stoer N, Chen Y, Andersson M, Ning Y, Wee HL, Khoo EYH, Tai ES, Kao SL, Reilly M (2017) A stratification approach using logit-based models for confounder adjustment in the study of continuous outcomes. Stat Methods Med Res. https:\/\/doi.org\/10.1177\/0962280217747309","journal-title":"Stat Methods Med Res"},{"key":"959_CR33","unstructured":"Turner H, Firth D (2018) Generalized nonlinear models in R: an overview of the gnm package. http:\/\/CRAN.R-project.org\/package=gnm, R package version 1.1-0"},{"key":"959_CR34","unstructured":"Turner H, Kosmidis I, Firth D (2019) PlackettLuce: Plackett\u2013Luce models for rankings. https:\/\/CRAN.R-project.org\/package=PlackettLuce, R package version 0.2-9"},{"key":"959_CR35","doi-asserted-by":"publisher","DOI":"10.1017\/S0014479716000739","author":"J Van Etten","year":"2016","unstructured":"Van Etten J, Beza E, Calderer L, van Duijvendijk K, Fadda C, Fantahun B, Kidane YG, van de Gevel J, Gupta A, Mengistu DK, Kiambi D, Mathur PN, Mercado L, Mittra S, Mollel MJ, Rosas JC, Steinke J, Suchini JG, Zimmerer KS (2016) First experiences with a novel farmer citizen science approach: crowdsourcing participatory variety selection through on-farm triadic comparisons of technologies (tricot). Exp Agric. https:\/\/doi.org\/10.1017\/S0014479716000739","journal-title":"Exp Agric"},{"issue":"158","key":"959_CR36","first-page":"1","volume":"18","author":"V Vitelli","year":"2018","unstructured":"Vitelli V, S\u00d8ystein S, Crispino M, Frigessi A, Arjas E (2018) Probabilistic preference learning with the Mallows rank model. J Mach Learn Res 18(158):1\u201349","journal-title":"J Mach Learn Res"},{"key":"959_CR37","doi-asserted-by":"crossref","unstructured":"Wang YS, Erosheva EA (2015) mixedMem: Tools for discrete multivariate mixed membership models. https:\/\/CRAN.R-project.org\/package=mixedMem, R package version 1.1.0","DOI":"10.32614\/CRAN.package.mixedMem"},{"issue":"1","key":"959_CR38","doi-asserted-by":"publisher","first-page":"29","DOI":"10.3758\/BF03195547","volume":"36","author":"F Wickelmaier","year":"2004","unstructured":"Wickelmaier F, Schmid C (2004) A Matlab function to estimate choice model parameters from paired-comparison data. Behav Res Methods Instrum Comput 36(1):29\u201340. https:\/\/doi.org\/10.3758\/BF03195547","journal-title":"Behav Res Methods Instrum Comput"},{"key":"959_CR39","unstructured":"Zeileis A, Strobl C, Wickelmaier F, Komboz B, Kopf J (2018) psychotree: Recursive partitioning based on psychometric models. https:\/\/CRAN.R-project.org\/package=psychotree, R package version 0.15-2"}],"container-title":["Computational Statistics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-020-00959-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s00180-020-00959-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-020-00959-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T13:15:56Z","timestamp":1722431756000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s00180-020-00959-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,12]]},"references-count":39,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["959"],"URL":"https:\/\/doi.org\/10.1007\/s00180-020-00959-3","relation":{},"ISSN":["0943-4062","1613-9658"],"issn-type":[{"value":"0943-4062","type":"print"},{"value":"1613-9658","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,12]]},"assertion":[{"value":"30 October 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}