{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T08:00:17Z","timestamp":1776931217027,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":65,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,13]]},"DOI":"10.1145\/3772318.3790821","type":"proceedings-article","created":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T04:12:36Z","timestamp":1776053556000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Better Assumptions, Stronger Conclusions: The Case for Ordinal Regression in HCI"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3376-7879","authenticated-orcid":false,"given":"Brandon","family":"Victor Syiem","sequence":"first","affiliation":[{"name":"School of Computer Science, The University of Sydney, Sydney, New South Wales, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4414-2249","authenticated-orcid":false,"given":"Eduardo","family":"Velloso","sequence":"additional","affiliation":[{"name":"School of Computer Science, The University of Sydney, Sydney, New South Wales, Australia"}]}],"member":"320","published-online":{"date-parts":[[2026,4,13]]},"reference":[{"key":"e_1_3_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04898-2_161"},{"key":"e_1_3_3_3_3_2","doi-asserted-by":"publisher","unstructured":"M Aguena C Avestruz C Combet S Fu R Herbonnet A\u00a0I Malz M Penna-Lima M Ricci S\u00a0D\u00a0P Vitenti L Baumont H Fan M Fong M Ho M Kirby C Payerne D Boutigny B Lee B Liu T McClintock H Miyatake C Sif\u00f3n A von\u00a0der\u00a0Linden H Wu M Yoon and The LSST Dark Energy\u00a0Science Collaboration. 2021. CLMM: a LSST-DESC cluster weak lensing mass modeling library for cosmology. Monthly Notices of the Royal Astronomical Society 508 4 (10 2021) 6092\u20136110. 10.1093\/mnras\/stab2764 arXiv:https:\/\/academic.oup.com\/mnras\/article-pdf\/508\/4\/6092\/41074412\/stab2764.pdf","DOI":"10.1093\/mnras\/stab2764"},{"key":"e_1_3_3_3_4_2","doi-asserted-by":"crossref","unstructured":"Ebrahim Babaei Tilman Dingler Benjamin Tag and Eduardo Velloso. 2025. Should we use the NASA-TLX in HCI? A review of theoretical and methodological issues around Mental Workload Measurement. International Journal of Human-Computer Studies (2025) 103515.","DOI":"10.1016\/j.ijhcs.2025.103515"},{"key":"e_1_3_3_3_5_2","doi-asserted-by":"crossref","unstructured":"Vance\u00a0W Berger and YanYan Zhou. 2014. Kolmogorov\u2013smirnov test: Overview. Wiley statsref: Statistics reference online (2014).","DOI":"10.1002\/9781118445112.stat06558"},{"key":"e_1_3_3_3_6_2","doi-asserted-by":"crossref","unstructured":"Kenneth\u00a0A Bollen. 2002. Latent variables in psychology and the social sciences. Annual review of psychology 53 1 (2002) 605\u2013634.","DOI":"10.1146\/annurev.psych.53.100901.135239"},{"key":"e_1_3_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642712"},{"key":"e_1_3_3_3_8_2","doi-asserted-by":"crossref","unstructured":"Rollin Brant. 1990. Assessing proportionality in the proportional odds model for ordinal logistic regression. Biometrics (1990) 1171\u20131178.","DOI":"10.2307\/2532457"},{"key":"e_1_3_3_3_9_2","unstructured":"John Brooke et\u00a0al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189 194 (1996) 4\u20137."},{"key":"e_1_3_3_3_10_2","volume-title":"newtest: command to compute new test @ONLINE","author":"Bruin J.","year":"2011","unstructured":"J. Bruin. 2011. newtest: command to compute new test @ONLINE. https:\/\/stats.oarc.ucla.edu\/other\/mult-pkg\/faq\/ologit\/"},{"key":"e_1_3_3_3_11_2","doi-asserted-by":"crossref","unstructured":"Paul-Christian B\u00fcrkner. 2017. brms: An R package for Bayesian multilevel models using Stan. Journal of statistical software 80 (2017) 1\u201328.","DOI":"10.18637\/jss.v080.i01"},{"key":"e_1_3_3_3_12_2","doi-asserted-by":"crossref","unstructured":"Paul-Christian B\u00fcrkner and Matti Vuorre. 2019. Ordinal regression models in psychology: A tutorial. Advances in Methods and Practices in Psychological Science 2 1 (2019) 77\u2013101.","DOI":"10.1177\/2515245918823199"},{"key":"e_1_3_3_3_13_2","doi-asserted-by":"crossref","unstructured":"Michael Calver and Douglas Fletcher. 2020. When ANOVA isn\u2019t ideal: Analyzing ordinal data from practical work in biology. The American Biology Teacher 82 5 (2020) 289\u2013294.","DOI":"10.1525\/abt.2020.82.5.289"},{"key":"e_1_3_3_3_14_2","doi-asserted-by":"crossref","unstructured":"James Carifio and Rocco Perla. 2008. Resolving the 50-year debate around using and misusing Likert scales. 1150\u20131152\u00a0pages.","DOI":"10.1111\/j.1365-2923.2008.03172.x"},{"key":"e_1_3_3_3_15_2","doi-asserted-by":"crossref","unstructured":"James Carifio and Rocco\u00a0J Perla. 2007. Ten common misunderstandings misconceptions persistent myths and urban legends about Likert scales and Likert response formats and their antidotes. Journal of social sciences 3 3 (2007) 106\u2013116.","DOI":"10.3844\/jssp.2007.106.116"},{"key":"e_1_3_3_3_16_2","doi-asserted-by":"crossref","unstructured":"Mingyang Chen Peng Chen Xu Gao and Chao Yang. 2020. Examining injury severity in truck-involved collisions using a cumulative link mixed model. Journal of Transport & Health 19 (2020) 100942.","DOI":"10.1016\/j.jth.2020.100942"},{"key":"e_1_3_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642936"},{"key":"e_1_3_3_3_18_2","unstructured":"Rune Haubo\u00a0B Christensen. 2018. Cumulative link models for ordinal regression with the R package ordinal. Submitted in J. Stat. Software 35 (2018) 1\u201346."},{"key":"e_1_3_3_3_19_2","volume-title":"ordinal\u2014Regression Models for Ordinal Data","author":"Christensen Rune H.\u00a0B.","year":"2023","unstructured":"Rune H.\u00a0B. Christensen. 2023. ordinal\u2014Regression Models for Ordinal Data. https:\/\/CRAN.R-project.org\/package=ordinal R package version 2023.12-4.1."},{"key":"e_1_3_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.2172\/6057803"},{"key":"e_1_3_3_3_21_2","volume-title":"Practical nonparametric statistics","author":"Conover William\u00a0Jay","year":"1999","unstructured":"William\u00a0Jay Conover. 1999. Practical nonparametric statistics. john wiley & sons."},{"key":"e_1_3_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511802843"},{"key":"e_1_3_3_3_23_2","doi-asserted-by":"crossref","unstructured":"Alexis Dinno. 2015. Nonparametric pairwise multiple comparisons in independent groups using Dunn\u2019s test. The Stata Journal 15 1 (2015) 292\u2013300.","DOI":"10.1177\/1536867X1501500117"},{"key":"e_1_3_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300295"},{"key":"e_1_3_3_3_25_2","doi-asserted-by":"crossref","unstructured":"Olive\u00a0Jean Dunn. 1964. Multiple comparisons using rank sums. Technometrics 6 3 (1964) 241\u2013252.","DOI":"10.1080\/00401706.1964.10490181"},{"key":"e_1_3_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474784"},{"key":"e_1_3_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642550"},{"key":"e_1_3_3_3_28_2","doi-asserted-by":"crossref","unstructured":"Benjamin French and Matthew\u00a0S Shotwell. 2022. Regression models for ordinal outcomes. Jama 328 8 (2022) 772\u2013773.","DOI":"10.1001\/jama.2022.12104"},{"key":"e_1_3_3_3_29_2","doi-asserted-by":"crossref","unstructured":"Milton Friedman. 1937. The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the american statistical association 32 200 (1937) 675\u2013701.","DOI":"10.1080\/01621459.1937.10503522"},{"key":"e_1_3_3_3_30_2","doi-asserted-by":"crossref","unstructured":"Filippo Gambarota and Gianmarco Alto\u00e8. 2024. Ordinal regression models made easy: A tutorial on parameter interpretation data simulation and power analysis. International Journal of Psychology 59 6 (2024) 1263\u20131292.","DOI":"10.1002\/ijop.13243"},{"key":"e_1_3_3_3_31_2","doi-asserted-by":"crossref","unstructured":"Paul\u00a0A Games and John\u00a0F Howell. 1976. Pairwise multiple comparison procedures with unequal n\u2019s and\/or variances: a Monte Carlo study. Journal of Educational Statistics 1 2 (1976) 113\u2013125.","DOI":"10.3102\/10769986001002113"},{"key":"e_1_3_3_3_32_2","doi-asserted-by":"publisher","unstructured":"Jason Geller Matti Vuorre Chelsea Parlett and Robert Kubinec. 2025. A Beta Way: A Tutorial For Using Beta Regression in Psychological Research. 10.31234\/osf.io\/d6v5t_v2","DOI":"10.31234\/osf.io\/d6v5t_v2"},{"key":"e_1_3_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511845062"},{"key":"e_1_3_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"e_1_3_3_3_35_2","unstructured":"Andrew\u00a0F Hayes. 2012. PROCESS: A versatile computational tool for observed variable mediation moderation and conditional process modeling."},{"key":"e_1_3_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3714197"},{"key":"e_1_3_3_3_37_2","doi-asserted-by":"crossref","unstructured":"Susan Jamieson. 2004. Likert scales: How to (ab) use them?Medical education 38 12 (2004) 1217\u20131218.","DOI":"10.1111\/j.1365-2929.2004.02012.x"},{"key":"e_1_3_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753686"},{"key":"e_1_3_3_3_39_2","volume-title":"Econometrics Academy","author":"Katchova Ani","year":"2020","unstructured":"Ani Katchova. 2020. Econometrics Academy. https:\/\/sites.google.com\/site\/econometricsacademy\/econometrics-models\/ordered-probit-and-logit-models?authuser=0"},{"key":"e_1_3_3_3_40_2","doi-asserted-by":"crossref","unstructured":"Diana\u00a0Eugenie Kornbrot. 1990. The rank difference test: A new and meaningful alternative to the Wilcoxon signed ranks test for ordinal data. Brit. J. Math. Statist. Psych. 43 2 (1990) 241\u2013264.","DOI":"10.1111\/j.2044-8317.1990.tb00939.x"},{"key":"e_1_3_3_3_41_2","doi-asserted-by":"crossref","unstructured":"William\u00a0H Kruskal and W\u00a0Allen Wallis. 1952. Use of ranks in one-criterion variance analysis. Journal of the American statistical Association 47 260 (1952) 583\u2013621.","DOI":"10.1080\/01621459.1952.10483441"},{"key":"e_1_3_3_3_42_2","unstructured":"Solomon Kurz. [n. d.]. Causal Inference with Ordinal Regresssion. https:\/\/solomonkurz.netlify.app\/blog\/2023-05-21-causal-inference-with-ordinal-regression\/. Accessed: 2025-08-28."},{"key":"e_1_3_3_3_43_2","volume-title":"emmeans: Estimated Marginal Means, aka Least-Squares Means","author":"Lenth Russell\u00a0V.","year":"2025","unstructured":"Russell\u00a0V. Lenth. 2025. emmeans: Estimated Marginal Means, aka Least-Squares Means. https:\/\/CRAN.R-project.org\/package=emmeans R package version 1.10.7."},{"key":"e_1_3_3_3_44_2","doi-asserted-by":"crossref","unstructured":"Torrin\u00a0M Liddell and John\u00a0K Kruschke. 2018. Analyzing ordinal data with metric models: What could possibly go wrong?Journal of Experimental Social Psychology 79 (2018) 328\u2013348.","DOI":"10.1016\/j.jesp.2018.08.009"},{"key":"e_1_3_3_3_45_2","unstructured":"Rensis Likert. 1932. A technique for the measurement of attitudes.Archives of psychology (1932)."},{"key":"e_1_3_3_3_46_2","doi-asserted-by":"crossref","unstructured":"Helen\u00a0M Marcus-Roberts and Fred\u00a0S Roberts. 1987. Meaningless statistics. Journal of Educational Statistics 12 4 (1987) 383\u2013394.","DOI":"10.3102\/10769986012004383"},{"key":"e_1_3_3_3_47_2","doi-asserted-by":"crossref","unstructured":"Peter McCullagh. 1980. Regression models for ordinal data. Journal of the Royal Statistical Society: Series B (Methodological) 42 2 (1980) 109\u2013127.","DOI":"10.1111\/j.2517-6161.1980.tb01109.x"},{"key":"e_1_3_3_3_48_2","doi-asserted-by":"crossref","unstructured":"David Moher Alessandro Liberati Jennifer Tetzlaff Douglas\u00a0G Altman and PRISMA Group*. 2009. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine 151 4 (2009) 264\u2013269.","DOI":"10.7326\/0003-4819-151-4-200908180-00135"},{"key":"e_1_3_3_3_49_2","volume-title":"Distribution-free multiple comparisons.","author":"Nemenyi Peter\u00a0Bjorn","year":"1963","unstructured":"Peter\u00a0Bjorn Nemenyi. 1963. Distribution-free multiple comparisons.Princeton University."},{"key":"e_1_3_3_3_50_2","doi-asserted-by":"crossref","unstructured":"Geoff Norman. 2010. Likert scales levels of measurement and the \u201claws\u201d of statistics. Advances in health sciences education 15 (2010) 625\u2013632.","DOI":"10.1007\/s10459-010-9222-y"},{"key":"e_1_3_3_3_51_2","doi-asserted-by":"crossref","unstructured":"Thomas\u00a0E Nygren. 1991. Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Human factors 33 1 (1991) 17\u201333.","DOI":"10.1177\/001872089103300102"},{"key":"e_1_3_3_3_52_2","volume-title":"repolr: Repeated Measures Proportional Odds Logistic Regression","author":"Parsons Nick","year":"2016","unstructured":"Nick Parsons. 2016. repolr: Repeated Measures Proportional Odds Logistic Regression. https:\/\/CRAN.R-project.org\/package=repolr R package version 3.4."},{"key":"e_1_3_3_3_53_2","doi-asserted-by":"crossref","unstructured":"Karl Pearson. 1900. X. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. The London Edinburgh and Dublin Philosophical Magazine and Journal of Science 50 302 (1900) 157\u2013175.","DOI":"10.1080\/14786440009463897"},{"key":"e_1_3_3_3_54_2","doi-asserted-by":"crossref","unstructured":"Bercedis Peterson and Frank\u00a0E Harrell\u00a0Jr. 1990. Partial proportional odds models for ordinal response variables. Journal of the Royal Statistical Society: Series C (Applied Statistics) 39 2 (1990) 205\u2013217.","DOI":"10.2307\/2347760"},{"key":"e_1_3_3_3_55_2","volume-title":"PMCMRplus: Calculate Pairwise Multiple Comparisons of Mean Rank Sums Extended","author":"Pohlert Thorsten","year":"2024","unstructured":"Thorsten Pohlert. 2024. PMCMRplus: Calculate Pairwise Multiple Comparisons of Mean Rank Sums Extended. https:\/\/CRAN.R-project.org\/package=PMCMRplus R package version 1.9.12."},{"key":"e_1_3_3_3_56_2","doi-asserted-by":"crossref","unstructured":"Mariah Schrum Muyleng Ghuy Erin Hedlund-Botti Manisha Natarajan Michael Johnson and Matthew Gombolay. 2023. Concerning trends in likert scale usage in human-robot interaction: Towards improving best practices. ACM Transactions on Human-Robot Interaction 12 3 (2023) 1\u201332.","DOI":"10.1145\/3572784"},{"key":"e_1_3_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-92bf1922-011"},{"key":"e_1_3_3_3_58_2","unstructured":"Mital\u00a0C Shingala and Arti Rajyaguru. 2015. Comparison of post hoc tests for unequal variance. International Journal of New Technologies in Science and Engineering 2 5 (2015) 22\u201333."},{"key":"e_1_3_3_3_59_2","doi-asserted-by":"crossref","unstructured":"Sidney Siegel. 1957. Nonparametric statistics. The American Statistician 11 3 (1957) 13\u201319.","DOI":"10.1080\/00031305.1957.10501091"},{"key":"e_1_3_3_3_60_2","unstructured":"Miguel\u00a0Alejandro Silan. 2025. When can we treat Likert type data as interval? (2025)."},{"key":"e_1_3_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14521"},{"key":"e_1_3_3_3_62_2","doi-asserted-by":"crossref","unstructured":"Kai Virtanen Heikki Mansikka Helmiina Kontio and Don Harris. 2022. Weight watchers: NASA-TLX weights revisited. TheoreTical issues in ergonomics science 23 6 (2022) 725\u2013748.","DOI":"10.1080\/1463922X.2021.2000667"},{"key":"e_1_3_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642919"},{"key":"e_1_3_3_3_64_2","doi-asserted-by":"crossref","unstructured":"Frank Wilcoxon. 1945. Individual comparisons by ranking methods. Biometrics bulletin 1 6 (1945) 80\u201383.","DOI":"10.2307\/3001968"},{"key":"e_1_3_3_3_65_2","doi-asserted-by":"crossref","unstructured":"Andre Williams. 2025. Cumulative Link Ordinal Outcome Neural Networks: An Evaluation of Current Methodology. Journal of Data Analysis and Information Processing 13 2 (2025) 182\u2013198.","DOI":"10.4236\/jdaip.2025.132011"},{"key":"e_1_3_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978963"}],"event":{"name":"CHI 2026: CHI Conference on Human Factors in Computing Systems","location":"Barcelona Spain","acronym":"CHI '26","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3772318.3790821","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T10:22:52Z","timestamp":1776421372000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3772318.3790821"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,13]]},"references-count":65,"alternative-id":["10.1145\/3772318.3790821","10.1145\/3772318"],"URL":"https:\/\/doi.org\/10.1145\/3772318.3790821","relation":{},"subject":[],"published":{"date-parts":[[2026,4,13]]},"assertion":[{"value":"2026-04-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}