{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:15:54Z","timestamp":1750220154879,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T00:00:00Z","timestamp":1657670400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/S021892\/1"],"award-info":[{"award-number":["EP\/S021892\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,13]]},"DOI":"10.1145\/3551708.3556204","type":"proceedings-article","created":{"date-parts":[[2022,11,18]],"date-time":"2022-11-18T22:04:26Z","timestamp":1668809066000},"page":"272-278","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Using Elo Rating as a Metric for Comparative Judgement in Educational Assessment"],"prefix":"10.1145","author":[{"given":"Andy","family":"Gray","sequence":"first","affiliation":[{"name":"Department of Computer Science, Swansea University, UK"}]},{"given":"Alma A.M","family":"Rahat","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Swansea University, UK"}]},{"given":"Tom","family":"Crick","sequence":"additional","affiliation":[{"name":"Faculty of Humanities & Social Sciences & Department of Computer Science, Swansea University, UK"}]},{"given":"Stephen","family":"Lindsay","sequence":"additional","affiliation":[{"name":"School of Computer Science, Glasgow University, UK"}]},{"given":"Darren","family":"Wallace","sequence":"additional","affiliation":[{"name":"CDSM, UK"}]}],"member":"320","published-online":{"date-parts":[[2022,11,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8317.1973.tb00520.x"},{"key":"e_1_3_2_1_2_1","volume-title":"Is comparative judgement just a quick form of multiple marking","author":"Benton Tom","year":"2018","unstructured":"Tom Benton and T Gallagher . 2018. Is comparative judgement just a quick form of multiple marking . Research Matters : A Cambridge Assessment Publication ( 26) ( 2018 ), 22\u201328. Tom Benton and T Gallagher. 2018. Is comparative judgement just a quick form of multiple marking. Research Matters: A Cambridge Assessment Publication (26) (2018), 22\u201328."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40753-016-0024-3"},{"key":"e_1_3_2_1_4_1","volume-title":"Paired comparison methods. Techniques for monitoring the comparability of examination standards 246","author":"Bramley T","year":"2007","unstructured":"T Bramley . 2007. Paired comparison methods. Techniques for monitoring the comparability of examination standards 246 ( 2007 ), 294. T Bramley. 2007. Paired comparison methods. Techniques for monitoring the comparability of examination standards 246 (2007), 294."},{"key":"e_1_3_2_1_5_1","volume-title":"Investigating the reliability of adaptive comparative judgment","author":"Bramley Tom","year":"2015","unstructured":"Tom Bramley . 2015. Investigating the reliability of adaptive comparative judgment . Cambridge Assessment , Cambridge 36 ( 2015 ). Tom Bramley. 2015. Investigating the reliability of adaptive comparative judgment. Cambridge Assessment, Cambridge 36 (2015)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2021.04.056"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1093\/itnow\/bwab005"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3416465.3416472"},{"volume-title":"Becoming a teacher: Issues in secondary education","author":"Dillon Justin","key":"e_1_3_2_1_9_1","unstructured":"Justin Dillon and Meg Maguire . 2011. Becoming a teacher: Issues in secondary education . McGraw-Hill Education (UK) . Justin Dillon and Meg Maguire. 2011. Becoming a teacher: Issues in secondary education. McGraw-Hill Education (UK)."},{"key":"e_1_3_2_1_10_1","volume-title":"New York).","author":"Elo Arpad","year":"1978","unstructured":"Arpad Elo . 1978. The rating of chess players, past and present (Arco , New York). ( 1978 ). Arpad Elo. 1978. The rating of chess players, past and present (Arco, New York). (1978)."},{"key":"e_1_3_2_1_11_1","unstructured":"R Michael Furr. 2021. Psychometrics: an introduction. SAGE publications.  R Michael Furr. 2021. Psychometrics: an introduction. SAGE publications."},{"volume-title":"Psychophysics: the fundamentals","author":"Gescheider George A","key":"e_1_3_2_1_12_1","unstructured":"George A Gescheider . 2013. Psychophysics: the fundamentals . Psychology Press . George A Gescheider. 2013. Psychophysics: the fundamentals. Psychology Press."},{"volume-title":"Multiple comparisons: theory and methods","author":"Hsu Jason","key":"e_1_3_2_1_13_1","unstructured":"Jason Hsu . 1996. Multiple comparisons: theory and methods . CRC Press . Jason Hsu. 1996. Multiple comparisons: theory and methods. CRC Press."},{"key":"e_1_3_2_1_14_1","volume-title":"MM algorithms for generalized Bradley-Terry models. The annals of statistics 32, 1","author":"Hunter David R","year":"2004","unstructured":"David R Hunter . 2004. MM algorithms for generalized Bradley-Terry models. The annals of statistics 32, 1 ( 2004 ), 384\u2013406. David R Hunter. 2004. MM algorithms for generalized Bradley-Terry models. The annals of statistics 32, 1 (2004), 384\u2013406."},{"key":"e_1_3_2_1_15_1","volume-title":"\u2018No More Marking\u2019: An online tool for comparative judgement. ISSN 1756-509X","author":"Kolen MJ","year":"2016","unstructured":"MJ Kolen and RL Brennan . 2016. \u2018No More Marking\u2019: An online tool for comparative judgement. ISSN 1756-509X ( 2016 ), 12. MJ Kolen and RL Brennan. 2016. \u2018No More Marking\u2019: An online tool for comparative judgement. ISSN 1756-509X (2016), 12."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40841-020-00163-3"},{"key":"e_1_3_2_1_17_1","volume-title":"Retrieved","author":"National Education Union.","year":"2021","unstructured":"National Education Union. 2021 . workload and working time . Retrieved May 27, 2022 from https:\/\/neu.org.uk\/advice\/workload-and-working-time#:\u223c:text=All%20teachers%20who%20teach%20pupils,time%20of%2020%20per%20cent. National Education Union. 2021. workload and working time. Retrieved May 27, 2022 from https:\/\/neu.org.uk\/advice\/workload-and-working-time#:\u223c:text=All%20teachers%20who%20teach%20pupils,time%20of%2020%20per%20cent."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2016.03.017"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10798-011-9189-x"},{"key":"e_1_3_2_1_20_1","volume-title":"Retrieved","author":"Research","year":"2018","unstructured":"Research ED. 2018 . Comparative judgement: the next big revolution in assessment ? Retrieved May 27, 2022 from https:\/\/researched.org.uk\/2018\/07\/06\/comparative-judgement-the-next-big-revolution-in-assessment-2\/ Research ED. 2018. Comparative judgement: the next big revolution in assessment? Retrieved May 27, 2022 from https:\/\/researched.org.uk\/2018\/07\/06\/comparative-judgement-the-next-big-revolution-in-assessment-2\/"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3502870.3506565"},{"key":"e_1_3_2_1_22_1","volume-title":"VA, USA","author":"Sullivan Connor","year":"2016","unstructured":"Connor Sullivan and Christopher Cronin . 2016. Improving elo rankings for sports experimenting on the english premier league. Virginia Tech CSx824\/ECEx424 technical report , VA, USA ( 2016 ). Connor Sullivan and Christopher Cronin. 2016. Improving elo rankings for sports experimenting on the english premier league. Virginia Tech CSx824\/ECEx424 technical report, VA, USA (2016)."},{"key":"e_1_3_2_1_23_1","volume-title":"A law of comparative judgment. Psychological review 34, 4","author":"Thurstone Louis L","year":"1927","unstructured":"Louis L Thurstone . 1927. A law of comparative judgment. Psychological review 34, 4 ( 1927 ), 273. Louis L Thurstone. 1927. A law of comparative judgment. Psychological review 34, 4 (1927), 273."},{"key":"e_1_3_2_1_24_1","volume-title":"Psychophysical analysis. The American journal of psychology 38, 3","author":"Thurstone Louis L","year":"1927","unstructured":"Louis L Thurstone . 1927. Psychophysical analysis. The American journal of psychology 38, 3 ( 1927 ), 368\u2013389. Louis L Thurstone. 1927. Psychophysical analysis. The American journal of psychology 38, 3 (1927), 368\u2013389."},{"key":"e_1_3_2_1_26_1","volume-title":"Retrieved","author":"Government UK","year":"2021","unstructured":"UK Government . 2021 . Reducing school workload . Retrieved May 27, 2022 from https:\/\/www.gov.uk\/government\/collections\/reducing-school-workload UK Government. 2021. Reducing school workload. Retrieved May 27, 2022 from https:\/\/www.gov.uk\/government\/collections\/reducing-school-workload"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10734-020-00561-y"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/01425692.2021.1937058"},{"key":"e_1_3_2_1_29_1","volume-title":"Retrieved","author":"Weale Sally","year":"2021","unstructured":"Sally Weale . 2021 . NEU Teacher Survey . Retrieved May 27, 2022 from https:\/\/www.theguardian.com\/uk-news\/2021\/apr\/08\/one-in-three-uk-teachers-plan-to-quit-says-national-education-union-survey Sally Weale. 2021. NEU Teacher Survey. Retrieved May 27, 2022 from https:\/\/www.theguardian.com\/uk-news\/2021\/apr\/08\/one-in-three-uk-teachers-plan-to-quit-says-national-education-union-survey"},{"volume-title":"Secondary education: The key concepts","author":"Wellington Jerry","key":"e_1_3_2_1_30_1","unstructured":"Jerry Wellington . 2007. Secondary education: The key concepts . Routledge . Jerry Wellington. 2007. Secondary education: The key concepts. Routledge."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1080\/0969594X.2019.1700212"}],"event":{"name":"ICEMT 2022: 2022 6th International Conference on Education and Multimedia Technology","acronym":"ICEMT 2022","location":"Guangzhou China"},"container-title":["Proceedings of the 6th International Conference on Education and Multimedia Technology"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3551708.3556204","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3551708.3556204","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:16Z","timestamp":1750186816000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3551708.3556204"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,13]]},"references-count":30,"alternative-id":["10.1145\/3551708.3556204","10.1145\/3551708"],"URL":"https:\/\/doi.org\/10.1145\/3551708.3556204","relation":{},"subject":[],"published":{"date-parts":[[2022,7,13]]},"assertion":[{"value":"2022-11-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}