{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T03:58:13Z","timestamp":1790913493221,"version":"4.1.0"},"reference-count":70,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T00:00:00Z","timestamp":1638230400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T00:00:00Z","timestamp":1638230400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002835","name":"Chalmers University of Technology","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002835","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Behav Res"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This article introduces the  R package (Bayesian Paired Comparison in Stan) and the statistical models implemented in the package. This package aims to facilitate the use of Bayesian models for paired comparison data in behavioral research. Bayesian analysis of paired comparison data allows parameter estimation even in conditions where the maximum likelihood does not exist, allows easy extension of paired comparison models, provides straightforward interpretation of the results with credible intervals, has better control of type I error, has more robust evidence towards the null hypothesis, allows propagation of uncertainties, includes prior information, and performs well when handling models with many parameters and latent variables. The  package provides a consistent interface for R users and several functions to evaluate the posterior distribution of all parameters to estimate the posterior distribution of any contest between items and to obtain the posterior distribution of the ranks. Three reanalyses of recent studies that used the frequentist Bradley\u2013Terry model are presented. These reanalyses are conducted with the Bayesian models of the  package, and all the code used to fit the models, generate the figures, and the tables are available in the online appendix.<\/jats:p>","DOI":"10.3758\/s13428-021-01714-2","type":"journal-article","created":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T20:27:14Z","timestamp":1638304034000},"page":"2025-2045","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Bayesian paired comparison with the bpcs package"],"prefix":"10.3758","volume":"54","author":[{"given":"David","family":"Issa Mattos","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2501-9926","authenticated-orcid":false,"given":"\u00c9rika","family":"Martins Silva Ramos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,11,30]]},"reference":[{"issue":"5","key":"1714_CR1","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1163\/1568539X-00003366","volume":"153","author":"J Abalos","year":"2016","unstructured":"Abalos, J., de Lanuza, G. P., Carazo, P., & Font, E. (2016). The role of male coloration in the outcome of staged contests in the European common wall lizard (Podarcis muralis). Behaviour, 153(5), 607\u2013631.","journal-title":"Behaviour"},{"key":"1714_CR2","doi-asserted-by":"crossref","unstructured":"Betancourt, M. (2017). A conceptual introduction to Hamiltonian Monte Carlo. arXiv:1701.02434.","DOI":"10.3150\/16-BEJ810"},{"issue":"1","key":"1714_CR3","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1037\/1082-989X.6.1.49","volume":"6","author":"U B\u00f6ckenholt","year":"2001","unstructured":"B\u00f6ckenholt, U. (2001). Hierarchical modeling of paired comparison data. Psychological Methods, 6(1), 49.","journal-title":"Psychological Methods"},{"issue":"3\/4","key":"1714_CR4","doi-asserted-by":"publisher","first-page":"324","DOI":"10.2307\/2334029","volume":"39","author":"RA Bradley","year":"1952","unstructured":"Bradley, R. A., & Terry, M. E. (1952). Rank analysis of incomplete block designs: I. The method of paired comparisons. Biometrika, 39(3\/4), 324\u2013345.","journal-title":"Biometrika"},{"issue":"1","key":"1714_CR5","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1007\/s11336-014-9434-9","volume":"81","author":"A Brown","year":"2016","unstructured":"Brown, A. (2016). Item response models for forced-choice questionnaires: a common framework. Psychometrika, 81(1), 135\u2013160.","journal-title":"Psychometrika"},{"issue":"3","key":"1714_CR6","doi-asserted-by":"publisher","first-page":"460","DOI":"10.1177\/0013164410375112","volume":"71","author":"A Brown","year":"2011","unstructured":"Brown, A., & Maydeu-Olivares, A. (2011). Item response modeling of forced-choice questionnaires. Educational and Psychological Measurement, 71(3), 460\u2013502.","journal-title":"Educational and Psychological Measurement"},{"key":"1714_CR7","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.anbehav.2016.04.026","volume":"118","author":"JM Bush","year":"2016","unstructured":"Bush, J. M., Quinn, M. M., Balreira, E. C., & Johnson, M. A. (2016). How do lizards determine dominance? Applying ranking algorithms to animal social behaviour. Animal Behaviour, 118, 65\u201374.","journal-title":"Animal Behaviour"},{"key":"1714_CR8","unstructured":"Butler, K., & Whelan, J.T. (2004). The existence of maximum likelihood estimates in the Bradley\u2013Terry model and its extensions. arXiv:math\/0412232."},{"issue":"1","key":"1714_CR9","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1080\/10618600.2012.638220","volume":"21","author":"F Caron","year":"2012","unstructured":"Caron, F., & Doucet, A. (2012). Efficient Bayesian inference for generalized Bradley\u2013Terry models. Journal of Computational and Graphical Statistics, 21(1), 174\u2013196.","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"1714_CR10","doi-asserted-by":"crossref","unstructured":"Carpenter, B., Gelman, A., Hoffman, M.D., Lee, D., Goodrich, B., Betancourt, M., & et al. (2017). Stan: A probabilistic programming language. Journal of Statistical Software, 76(1).","DOI":"10.18637\/jss.v076.i01"},{"key":"1714_CR11","doi-asserted-by":"crossref","unstructured":"Cattelan, M. (2012). Models for paired comparison data: a review with emphasis on dependent data. Statistical Science, 412\u2013433.","DOI":"10.1214\/12-STS396"},{"issue":"3","key":"1714_CR12","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1068\/p7031","volume":"41","author":"SH-L Chien","year":"2012","unstructured":"Chien, S. H. -L., Lin, Y. -L., Qian, W., Zhou, K., Lin, M. -K., & Hsu, H. -Y. (2012). With or without a hole: Young infants\u2019 sensitivity for topological versus geometric property. Perception, 41(3), 305\u2013318.","journal-title":"Perception"},{"issue":"2","key":"1714_CR13","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/0950-3293(95)00039-9","volume":"7","author":"H Coetzee","year":"1996","unstructured":"Coetzee, H., & Taylor, J. (1996). The use and adaptation of the paired-comparison method in the sensory evaluation of hamburger-type patties by illiterate\/semi-literate consumers. Food Quality and Preference, 7(2), 81\u201385.","journal-title":"Food Quality and Preference"},{"key":"1714_CR14","unstructured":"Corff, S.L., Lerasle, M., & Vernet, E. (2018). A Bayesian nonparametric approach for generalized Bradley\u2013Terry models in random environment. arXiv:1808.08104."},{"issue":"329","key":"1714_CR15","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1080\/01621459.1970.10481082","volume":"65","author":"RR Davidson","year":"1970","unstructured":"Davidson, R. R. (1970). On extending the Bradley\u2013Terry model to accommodate ties in paired comparison experiments. Journal of the American Statistical Association, 65(329), 317\u2013328.","journal-title":"Journal of the American Statistical Association"},{"key":"1714_CR16","doi-asserted-by":"crossref","unstructured":"Davidson, R. R., & Beaver, R. J. (1977). On extending the Bradley\u2013Terry model to incorporate within-pair order effects. Biometrics, 693\u2013702.","DOI":"10.2307\/2529467"},{"issue":"3","key":"1714_CR17","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1093\/biomet\/60.3.477","volume":"60","author":"RR Davidson","year":"1973","unstructured":"Davidson, R. R., & Solomon, D. L. (1973). A Bayesian approach to paired comparison experimentation. Biometrika, 60(3), 477\u2013487.","journal-title":"Biometrika"},{"issue":"4","key":"1714_CR18","first-page":"511","volume":"47","author":"R Dittrich","year":"1998","unstructured":"Dittrich, R., Hatzinger, R., & Katzenbeisser, W. (1998). Modelling the effect of subject-specific covariates in paired comparison studies with an application to university rankings. Journal of the Royal Statistical Society: Series C (Applied Statistics), 47(4), 511\u2013525.","journal-title":"Journal of the Royal Statistical Society: Series C (Applied Statistics)"},{"key":"1714_CR19","unstructured":"Fleischhaker, D. S. (2019). Modelling outcomes in Canadian professional football via generalized Bradley\u2013Terry models. Unpublished doctoral dissertation, The University of Regina (Canada)."},{"key":"1714_CR20","doi-asserted-by":"crossref","unstructured":"Ford, Jr, L. R. (1957). Solution of a ranking problem from binary comparisons. The American Mathematical Monthly, 64(8P2), 28\u201333.","DOI":"10.1080\/00029890.1957.11989117"},{"key":"1714_CR21","unstructured":"Gabry, J. (2018). Shinystan: Interactive visual and numerical diagnostics and posterior analysis for Bayesian models [Computer software manual]. https:\/\/CRAN.R-project.org\/package=shinystan (R package version 2.5.0)."},{"issue":"6","key":"1714_CR22","doi-asserted-by":"publisher","first-page":"997","DOI":"10.1007\/s11222-013-9416-2","volume":"24","author":"A Gelman","year":"2014","unstructured":"Gelman, A., Hwang, J., & Vehtari, A. (2014). Understanding predictive information criteria for Bayesian models. Statistics and Computing, 24(6), 997\u20131016.","journal-title":"Statistics and Computing"},{"issue":"4","key":"1714_CR23","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1214\/ss\/1177011136","volume":"7","author":"A Gelman","year":"1992","unstructured":"Gelman, A., & Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7(4), 457\u2013472.","journal-title":"Statistical Science"},{"issue":"1","key":"1714_CR24","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1002\/jtr.2316","volume":"22","author":"F Giambona","year":"2020","unstructured":"Giambona, F., & Grassini, L. (2020). Tourism attractiveness in Italy: Regional empirical evidence using a pairwise comparisons modelling approach. International Journal of Tourism Research, 22(1), 26\u201341.","journal-title":"International Journal of Tourism Research"},{"issue":"6","key":"1714_CR25","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1080\/02664760120059219","volume":"28","author":"ME Glickman","year":"2001","unstructured":"Glickman, M. E. (2001). Dynamic paired comparison models with stochastic variances. Journal of Applied Statistics, 28(6), 673\u2013689.","journal-title":"Journal of Applied Statistics"},{"key":"1714_CR26","doi-asserted-by":"publisher","first-page":"822","DOI":"10.3389\/fpsyg.2018.00822","volume":"9","author":"CM H\u00e4gerh\u00e4ll","year":"2018","unstructured":"H\u00e4gerh\u00e4ll, C. M., Ode Sang, \u00c5., Englund, J.-E., Ahlner, F., Rybka, K., Huber, J., & et al. (2018). Humans really prefer semi-open natural landscapes? A cross-cultural reappraisal. Frontiers in psychology, 9, 822.","journal-title":"Frontiers in psychology"},{"key":"1714_CR27","unstructured":"Handley, J.C. (2001). Comparative analysis of Bradley\u2013Terry and Thurstone\u2013Mosteller paired comparison models for image quality assessment. In Pics, (Vol. 1 pp. 108\u2013112)."},{"issue":"10","key":"1714_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v048.i10","volume":"48","author":"R Hatzinger","year":"2012","unstructured":"Hatzinger, R., & Dittrich, R. (2012). Prefmod: An R package for modeling preferences based on paired comparisons, rankings, or ratings. Journal of Statistical Software, 48(10), 1\u201331.","journal-title":"Journal of Statistical Software"},{"issue":"1","key":"1714_CR29","first-page":"1593","volume":"15","author":"MD Hoffman","year":"2014","unstructured":"Hoffman, M. D., & Gelman, A. (2014). The No-U-Turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo. Journal of Machine Learning Research, 15(1), 1593\u20131623.","journal-title":"Journal of Machine Learning Research"},{"issue":"8","key":"1714_CR30","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1177\/0146621615585851","volume":"39","author":"PM Hontangas","year":"2015","unstructured":"Hontangas, P. M., Torre, J., Ponsoda, V., Leenen, I., Morillo, D., & Abad, F. J. (2015). De la Comparing traditional and IRT scoring of forced-choice tests. Applied Psychological Measurement, 39 (8), 598\u2013612.","journal-title":"Applied Psychological Measurement"},{"issue":"2","key":"1714_CR31","doi-asserted-by":"publisher","first-page":"639","DOI":"10.3758\/s13428-018-1065-0","volume":"51","author":"LM Hopper","year":"2019","unstructured":"Hopper, L. M., Egelkamp, C. L., Fidino, M., & Ross, S. R. (2019). An assessment of touchscreens for testing primate food preferences and valuations. Behavior Research Methods, 51(2), 639\u2013650.","journal-title":"Behavior Research Methods"},{"key":"1714_CR32","doi-asserted-by":"crossref","unstructured":"Huskisson, S. M., Jacobson, S. L., Egelkamp, C. L., Ross, S. R., & Hopper, L. M. (2020). Using a touchscreen paradigm to evaluate food preferences and response to novel photographic stimuli of food in three primate species (Gorilla gorilla gorilla, Pan troglodytes, and Macaca fuscata). International Journal of Primatology, 1\u201319.","DOI":"10.1007\/s10764-020-00131-0"},{"key":"1714_CR33","doi-asserted-by":"publisher","first-page":"170","DOI":"10.3389\/fpsyg.2020.00170","volume":"11","author":"K Iwasa","year":"2020","unstructured":"Iwasa, K., Komatsu, T., Kitamura, A., & Sakamoto, Y. (2020). Visual perception of moisture is a pathogen detection mechanism of the behavioral immune system. Frontiers in Psychology, 11, 170.","journal-title":"Frontiers in Psychology"},{"issue":"3","key":"1714_CR34","doi-asserted-by":"publisher","first-page":"857","DOI":"10.3758\/s13428-012-0300-3","volume":"45","author":"TR Johnson","year":"2013","unstructured":"Johnson, T. R., & Kuhn, K. M. (2013). Bayesian Thurstonian models for ranking data using JAGS. Behavior Research Methods, 45(3), 857\u2013872.","journal-title":"Behavior Research Methods"},{"key":"1714_CR35","doi-asserted-by":"crossref","unstructured":"Kelter, R. (2020). Analysis of type I and II error rates of Bayesian and frequentist parametric and nonparametric two-sample hypothesis tests under preliminary assessment of normality. Computational Statistics, 1\u201326.","DOI":"10.1007\/s00180-020-01034-7"},{"key":"1714_CR36","doi-asserted-by":"publisher","first-page":"2309","DOI":"10.3389\/fpsyg.2019.02309","volume":"10","author":"RS Kreitchmann","year":"2019","unstructured":"Kreitchmann, R. S., Abad, F. J., Ponsoda, V., Nieto, M. D., & Morillo, D. (2019). Controlling for response biases in self-report scales: forced-choice vs. psychometric modeling of Likert items. Frontiers in Psychology, 10, 2309.","journal-title":"Frontiers in Psychology"},{"issue":"2","key":"1714_CR37","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1037\/a0029146","volume":"142","author":"JK Kruschke","year":"2013","unstructured":"Kruschke, J. K. (2013). Bayesian estimation supersedes the t-test. Journal of Experimental Psychology: General, 142(2), 573.","journal-title":"Journal of Experimental Psychology: General"},{"issue":"1","key":"1714_CR38","doi-asserted-by":"publisher","first-page":"155","DOI":"10.3758\/s13423-017-1272-1","volume":"25","author":"JK Kruschke","year":"2018","unstructured":"Kruschke, J. K., & Liddell, T. M. (2018). Bayesian data analysis for newcomers. Psychonomic Bulletin and Review, 25(1), 155\u2013177.","journal-title":"Psychonomic Bulletin and Review"},{"key":"1714_CR39","first-page":"568","volume":"28","author":"A Kucukelbir","year":"2015","unstructured":"Kucukelbir, A., Ranganath, R., Gelman, A., & Blei, D. (2015). Automatic variational inference in Stan. Advances in Neural Information Processing Systems, 28, 568\u2013576.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"1714_CR40","doi-asserted-by":"crossref","unstructured":"Leonard, T. (1977). An alternative Bayesian approach to the Bradley\u2013Terry model for paired comparisons. Biometrics, 121\u2013132.","DOI":"10.2307\/2529308"},{"issue":"5","key":"1714_CR41","doi-asserted-by":"publisher","first-page":"e12593","DOI":"10.1111\/joss.12593","volume":"35","author":"CR Luckett","year":"2020","unstructured":"Luckett, C. R., Burns, S. L., & Jenkinson, L. (2020). Estimates of relative acceptability from paired preference tests. Journal of Sensory Studies, 35(5), e12593.","journal-title":"Journal of Sensory Studies"},{"key":"1714_CR42","doi-asserted-by":"crossref","unstructured":"Marton, G., Pizzoli, S. F. M., Vergani, L., Mazzocco, K., Monzani, D., Bailo, L., & et al. (2020). Patients\u2019 health locus of control and preferences about the role that they want to play in the medical decision-making process. Psychology, Health and Medicine, 1\u20137.","DOI":"10.1080\/13548506.2020.1748211"},{"key":"1714_CR43","doi-asserted-by":"publisher","DOI":"10.1201\/9780429029608","volume-title":"Statistical rethinking: A Bayesian course with examples in R and Stan","author":"R McElreath","year":"2020","unstructured":"McElreath, R. (2020) Statistical rethinking: A Bayesian course with examples in R and Stan. Boca Raton: CRC Press."},{"issue":"7","key":"1714_CR44","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1007\/s00228-016-2047-8","volume":"72","author":"AD Meid","year":"2016","unstructured":"Meid, A. D., Quinzler, R., Groll, A., Wild, B., Saum, K. -U., Sch\u00f6ttker, B., & et al. (2016). Longitudinal evaluation of medication underuse in older outpatients and its association with quality of life. European Journal of Clinical Pharmacology, 72(7), 877\u2013885.","journal-title":"European Journal of Clinical Pharmacology"},{"issue":"6","key":"1714_CR45","doi-asserted-by":"publisher","first-page":"1454","DOI":"10.1093\/beheco\/arx108","volume":"28","author":"ET Miller","year":"2017","unstructured":"Miller, E. T., Bonter, D. N., Eldermire, C., Freeman, B. G., Greig, E. I., Harmon, L. J., & et al. (2017). Fighting over food unites the birds of North America in a continental dominance hierarchy. Behavioral Ecology, 28(6), 1454\u20131463.","journal-title":"Behavioral Ecology"},{"issue":"7","key":"1714_CR46","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1177\/0146621616662226","volume":"40","author":"D Morillo","year":"2016","unstructured":"Morillo, D., Leenen, I., Abad, F. J., Hontangas, P., De la Torre, J., & Ponsoda, V. (2016). A dominance variant under the multi-unidimensional pairwise-preference framework: Model formulation and Markov chain Monte Carlo estimation. Applied Psychological Measurement, 40(7), 500\u2013516.","journal-title":"Applied Psychological Measurement"},{"issue":"1","key":"1714_CR47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12711-019-0515-1","volume":"51","author":"M Nishio","year":"2019","unstructured":"Nishio, M., & Arakawa, A. (2019). Performance of Hamiltonian Monte Carlo and No-U-Turn Sampler for estimating genetic parameters and breeding values. Genetics Selection Evolution, 51(1), 1\u201312.","journal-title":"Genetics Selection Evolution"},{"issue":"8","key":"1714_CR48","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1002\/hec.775","volume":"12","author":"S Petrou","year":"2003","unstructured":"Petrou, S. (2003). Methodological issues raised by preference-based approaches to measuring the health status of children. Health Economics, 12(8), 697\u2013702.","journal-title":"Health Economics"},{"key":"1714_CR49","doi-asserted-by":"crossref","unstructured":"Phelan, G.C., & Whelan, J.T. (2017). Hierarchical Bayesian Bradley\u2013Terry for applications in major league baseball. arXiv:1712.05879.","DOI":"10.13164\/ma.2018.07"},{"issue":"9","key":"1714_CR50","doi-asserted-by":"publisher","first-page":"e04821","DOI":"10.1016\/j.heliyon.2020.e04821","volume":"6","author":"JN Pritikin","year":"2020","unstructured":"Pritikin, J. N. (2020). An exploratory factor model for ordinal paired comparison indicators. Heliyon, 6(9), e04821.","journal-title":"Heliyon"},{"issue":"3","key":"1714_CR51","doi-asserted-by":"publisher","first-page":"889","DOI":"10.2466\/09.02.PR0.116k29w3","volume":"116","author":"TP Ross","year":"2015","unstructured":"Ross, T. P., Ross, L. T., Short, S. D., & Cataldo, S. (2015). The multidimensional health locus of control scale: Psychometric properties and form equivalence. Psychological reports, 116(3), 889\u2013913.","journal-title":"Psychological reports"},{"key":"1714_CR52","unstructured":"Seymour, R.G., Sirl, D., Preston, S., Dryden, I.L., Ellis, M.J., Perrat, B., & etal. (2020). TheBayesianspatialBradley\u2013Terrymodel:urbandeprivationmodelinginTanzania.arXiv:2010.14128."},{"key":"1714_CR53","unstructured":"Shah, N., Balakrishnan, S., Bradley, J., Parekh, A., Ramchandran, K., & Wainwright, M. (2015). Estimationfrompairwisecomparisons:Sharpminimaxboundswithtopologydependence. In Artificialintelligenceandstatistics (pp. 856\u2013865)."},{"issue":"6","key":"1714_CR54","doi-asserted-by":"publisher","first-page":"e66127","DOI":"10.1371\/journal.pone.0066127","volume":"8","author":"A Solari","year":"2013","unstructured":"Solari, A., Giordano, A., Kasper, J., Drulovic, J., vanNunen, A., Vahter, L., & et al. (2013). Rolepreferencesofpeoplewithmultiplesclerosis:image-revised,computerizedself-administeredversionofthecontrolpreferencescale. PLoSOne, 8(6), e66127.","journal-title":"PLoSOne"},{"key":"1714_CR55","unstructured":"Sport (2020). Sport:anRpackageforonlinerankingmethods.https:\/\/github.com\/gogonzo\/sport,(Rpackageversion0.2.0."},{"issue":"1","key":"1714_CR56","first-page":"59","volume":"22","author":"A Springall","year":"1973","unstructured":"Springall, A. (1973). ResponsesurfacefittingusingageneralizationoftheBradley\u2013Terrypairedcomparisonmodel. JournaloftheRoyalStatisticalSociety:SeriesC(AppliedStatistics), 22(1), 59\u201368.","journal-title":"JournaloftheRoyalStatisticalSociety:SeriesC(AppliedStatistics)"},{"key":"1714_CR57","unstructured":"StanDevelopmentTeam (2016). Stanmodelinglanguageusersguideandreferencemanual.Technicalreport."},{"issue":"3","key":"1714_CR58","first-page":"397","volume":"60","author":"SE Stern","year":"2011","unstructured":"Stern, S.E. (2011). Moderatedpairedcomparisons:ageneralizedBradley\u2013Terrymodelforcontinuousdatausingadiscontinuouspenalizedlikelihoodfunction. JournaloftheRoyalStatisticalSociety:SeriesC(AppliedStatistics), 60(3), 397\u2013415.","journal-title":"JournaloftheRoyalStatisticalSociety:SeriesC(AppliedStatistics)"},{"issue":"4","key":"1714_CR59","first-page":"273","volume":"34","author":"LL Thurstone","year":"1927","unstructured":"Thurstone, L.L. (1927). Alawofcomparativejudgment. PsychologicalReview, 34(4), 273.","journal-title":"PsychologicalReview"},{"key":"1714_CR60","unstructured":"Tsukida, K., & Gupta, M.R (2011). Howtoanalyzepairedcomparisondata(Tech.Rep.).WashingtonUnivSeattleDeptOfElectricalEngineering."},{"key":"1714_CR61","doi-asserted-by":"crossref","unstructured":"Turner, H., & Firth, D. (2012). Bradley\u2013TerrymodelsinR:theBradleyTerry2package.JournalofStatisticalSoftware,48(9).","DOI":"10.18637\/jss.v048.i09"},{"key":"1714_CR62","unstructured":"Turner, H., & Firth, D. (2020). GeneralizednonlinearmodelsinR:Anoverviewofthegnmpackage[Computersoftwaremanual].https:\/\/cran.r-project.org\/package=gnm,(Rpackageversion 1.1-1)."},{"key":"1714_CR63","unstructured":"Turner, H.L., vanEtten, J., Firth, D., & Kosmidis, I. (2020). ModellingrankingsinR:thePlackettLucepackage.ComputationalStatistics,1\u201331."},{"issue":"1","key":"1714_CR64","first-page":"1","volume":"1","author":"A Vehtari","year":"2021","unstructured":"Vehtari, A., Gelman, A., Simpson, D., Carpenter, B., & B\u00fcrkner, P.-C. (2021). Rank-normalization,folding,andlocalization:AnimprovedRforassessingconvergenceofMCMC. BayesianAnalysis, 1(1), 1\u201328.","journal-title":"BayesianAnalysis"},{"issue":"8","key":"1714_CR65","first-page":"600","volume":"41","author":"W-C Wang","year":"2017","unstructured":"Wang, W.-C., Qiu, X.-L., Chen, C.-W., Ro, S., & Jin, K.-Y. (2017). Itemresponsetheorymodelsforipsativetestswithmultidimensionalpairwisecomparisonitems. AppliedPsychologicalMeasurement, 41(8), 600\u2013613.","journal-title":"AppliedPsychologicalMeasurement"},{"key":"1714_CR66","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24277-4","volume-title":"ggplot2:Elegantgraphicsfordataanalysis","author":"H Wickham","year":"2016","unstructured":"Wickham, H. (2016) ggplot2:Elegantgraphicsfordataanalysis. NewYork: Springer. https:\/\/ggplot2.tidyverse.org."},{"key":"1714_CR67","doi-asserted-by":"crossref","unstructured":"Yao, Y., Vehtari, A., Simpson, D., & Gelman, A (2017). UsingstackingtoaverageBayesianpredictivedistributions.BayesianAnalysis.","DOI":"10.1214\/17-BA1091"},{"issue":"3","key":"1714_CR68","first-page":"1179","volume":"51","author":"H Zhang","year":"2019","unstructured":"Zhang, H., Houpt, J.W., & Harel, A. (2019). Establishingreferencescalesforscenenaturalnessandopenness. BehaviorResearchMethods, 51(3), 1179\u20131186.","journal-title":"BehaviorResearchMethods"},{"key":"1714_CR69","unstructured":"Zhu, H. (2020). kableExtra:ConstructComplexTablewith\u2018kable\u2019andPipeSyntax[Computersoftwaremanual].https:\/\/CRAN.R-project.org\/package=kableExtra(Rpackage version1.2.1)."},{"issue":"4","key":"1714_CR70","first-page":"646","volume":"26","author":"S Zitzmann","year":"2019","unstructured":"Zitzmann, S., & Hecht, M. (2019). GoingbeyondconvergenceinBayesianestimation:Whyprecisionmatterstooandhowtoassessit. StructuralEquationModeling:AMultidisciplinaryJournal, 26(4), 646\u2013661.","journal-title":"StructuralEquationModeling:AMultidisciplinaryJournal"}],"container-title":["Behavior Research Methods"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-021-01714-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.3758\/s13428-021-01714-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-021-01714-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T14:13:49Z","timestamp":1676038429000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.3758\/s13428-021-01714-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,30]]},"references-count":70,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["1714"],"URL":"https:\/\/doi.org\/10.3758\/s13428-021-01714-2","relation":{},"ISSN":["1554-3528"],"issn-type":[{"value":"1554-3528","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,30]]},"assertion":[{"value":"16 September 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 November 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}