{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,14]],"date-time":"2026-09-14T11:07:44Z","timestamp":1789384064316,"version":"build-2803163510"},"reference-count":48,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,14]],"date-time":"2026-09-14T00:00:00Z","timestamp":1789344000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sports"],"abstract":"<jats:p>Background: Reliable judging is essential to the fairness of elite boxing, yet inter-judge reliability under the current World Boxing 10-Point Must Scoring System remains largely unexplored. This study aimed to evaluate inter-judge reliability across rounds and weight categories at the 2025 World Boxing Championships. Methods: A retrospective observational analysis included 94 men\u2019s bouts in the 60 kg (n = 42), 75 kg (n = 23), and 90+ kg (n = 29) categories. Judge-level round scores were analysed using linear mixed-effects variance-component models, with bout-round target and judge identity specified as random effects. Reliability was estimated for individual judge ratings (Rsingle) and an aggregate measurement based on five judge ratings (Rpanel(5)). Pairwise differences across rounds and weight categories were evaluated using bout-level bootstrap procedures with Holm adjustment for multiple testing. Results: Across all bouts, Rsingle was 0.617 (95% CI: 0.521\u20130.693) in Round 1, 0.634 (95% CI: 0.539\u20130.709) in Round 2, and 0.687 (95% CI: 0.597\u20130.754) in Round 3. The corresponding Rpanel(5) estimates were consistently higher at 0.889 (95% CI: 0.845\u20130.919), 0.897 (95% CI: 0.854\u20130.924), and 0.916 (95% CI: 0.881\u20130.939), respectively. No statistically significant differences in reliability were detected across rounds or between weight categories after Holm adjustment. Overall, 98.2% of judge-round scores were 10:9 and 68.9% of bouts decided by judges\u2019 scores ended in unanimous 5:0 decisions. Conclusions: Reliability was consistently higher when five judge ratings were aggregated than when individual judge ratings were considered. No statistically significant evidence of systematic differences in reliability across rounds or between the examined weight categories was detected.<\/jats:p>","DOI":"10.3390\/sports14090403","type":"journal-article","created":{"date-parts":[[2026,9,14]],"date-time":"2026-09-14T10:19:41Z","timestamp":1789381181000},"page":"403","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Consistency of Judging Under the World Boxing 10-Point Must Scoring System: Single-Judge and Five-Judge Aggregate Reliability Across the 60 kg, 75 kg, and 90+ kg Categories at the 2025 World Boxing Championships"],"prefix":"10.3390","volume":"14","author":[{"given":"Ga\u0161per","family":"Munda","sequence":"first","affiliation":[{"name":"Faculty of Sport, University of Ljubljana, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5302-7192","authenticated-orcid":false,"given":"Goran","family":"Kuva\u010di\u0107","sequence":"additional","affiliation":[{"name":"Faculty of Kinesiology, University of Split, 21000 Split, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6105-4647","authenticated-orcid":false,"given":"Sara","family":"Besal","sequence":"additional","affiliation":[{"name":"Faculty of Sport, University of Ljubljana, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Damir","family":"Karpljuk","sequence":"additional","affiliation":[{"name":"Faculty of Sport, University of Ljubljana, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3318-2472","authenticated-orcid":false,"given":"Marco","family":"Batista","sequence":"additional","affiliation":[{"name":"Sport Physical Activity and Health Research & Innovation Center (SPRINT), Polytechnic University of Castelo Branco (UPCB), 6000-084 Castelo Branco, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7956-7488","authenticated-orcid":false,"given":"\u0141ukasz","family":"Rydzik","sequence":"additional","affiliation":[{"name":"Department of Sport Theory and Motor Skills, Institute of Sports Sciences, University of Physical Culture in Krak\u00f3w, 31-571 Krakow, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7668-2365","authenticated-orcid":false,"given":"Jo\u017eef","family":"\u0160imenko","sequence":"additional","affiliation":[{"name":"Faculty of Sport, University of Ljubljana, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1177\/15270025251348186","article-title":"They Were Robbed! Scoring by the Middlemost to Attenuate Biased Judging in Boxing","volume":"26","author":"Baumann","year":"2025","journal-title":"J. Sports Econom."},{"key":"ref_2","first-page":"51","article-title":"The Ethics of Knowing the Score: Recommendations for Improving Boxing\u2019s 10-Point Must System","volume":"2","author":"Gray","year":"2019","journal-title":"J. Ethical Urban Living"},{"key":"ref_3","unstructured":"McLaren, R.H. (2022). Independent Investigation of the International Boxing Association (AIBA), McLaren Global Sport Solutions."},{"key":"ref_4","unstructured":"IOC (2026, August 12). IOC Grants Provisional Recognition to World Boxing. Available online: https:\/\/www.olympics.com\/ioc\/news\/ioc-grants-provisional-recognition-to-world-boxing."},{"key":"ref_5","unstructured":"World Boxing (2026, August 12). World Boxing Announces Initial Certification Process for All Technical Officials\u2014World Boxing. Available online: https:\/\/worldboxing.org\/world-boxing-announces-initial-certification-process-for-all-technical-officials\/."},{"key":"ref_6","unstructured":"World Boxing (2024). Summary of Proposed Changes to the World Boxing Competition Rules, World Boxing."},{"key":"ref_7","unstructured":"World Boxing (2024). World Boxing Competition Rules, World Boxing."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1136\/bjsports-2017-097667","article-title":"Comparison of Amateur Boxing before and after the 2013 Rules Change and the Impact on Boxers\u2019 Safety","volume":"52","author":"Davis","year":"2018","journal-title":"Br. J. Sports Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1080\/24748668.2023.2207370","article-title":"The Temporal Structure of Male\u2019s Olympic Boxing Matches in Flyweight, Middleweight and Super Heavyweight Categories: A Pilot Study","volume":"23","year":"2023","journal-title":"Int. J. Perform. Anal. Sport"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Guti\u00e9rrez-Santiago, A., Morquillas-Riob\u00f3, M., Reguera-L\u00f3pez-de-la-Osa, X., Silva-Pinto, A.J., Argibay-Gonz\u00e1lez, J.C., and Prieto-Lage, I. (2024). Temporal Structure of Bouts in Men\u2019s Olympic Boxing: Featherweight, Lightweight, Welterweight, Light Heavyweight, and Heavyweight Categories. Appl. Sci., 14.","DOI":"10.3390\/app142210683"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dunn, E.C., Humberstone, C.E., Iredale, K.F., Martin, D.T., and Blazevich, A.J. (2017). Human Behaviours Associated with Dominance in Elite Amateur Boxing Bouts: A Comparison of Winners and Losers under the Ten Point Must System. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0188675"},{"key":"ref_12","first-page":"3","article-title":"An Examination of Judging Consistency in a Combat Sport","volume":"6","author":"Myers","year":"2010","journal-title":"J. Quant. Anal. Sports"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sato, N. (2025). Reliability of Judging in Olympic Breaking at the 2024 Paris Games. Front. Psychol., 16.","DOI":"10.3389\/fpsyg.2025.1593158"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Braeunig, P.A. (2025). Interrater Reliability of Olympic Winter Sports Judges\u2014A Comparative Analysis. Ger. J. Exerc. Sport Res.","DOI":"10.1007\/s12662-025-01067-4"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1080\/17461391.2010.551416","article-title":"Reliability and Validity of Judging in Women\u2019s Artistic Gymnastics at University Games 2009","volume":"12","author":"Pajek","year":"2012","journal-title":"Eur. J. Sport Sci."},{"key":"ref_16","first-page":"1","article-title":"Inter-Judge Variability in Scoring at the World Baton Twirling Championships","volume":"12","author":"Natsuda","year":"2026","journal-title":"J. Sports Anal."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"69","DOI":"10.52165\/sgj.10.1.69-79","article-title":"Inter-Rater Reliability and Validity of Scoring Men\u2019s Individual Trampoline Routines at European Championships 2014","volume":"10","author":"Peixoto","year":"2018","journal-title":"Sci. Gymnast. J."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Premel\u010d, J., Vu\u010dkovi\u0107, G., James, N., and Lesko\u0161ek, B. (2019). Reliability of Judging in DanceSport. Front. Psychol., 10.","DOI":"10.3389\/fpsyg.2019.01001"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1123\/ijspp.6.3.344","article-title":"The Activity Profile in International Taekwondo Competition Is Modulated by Weight Category","volume":"6","author":"Bridge","year":"2011","journal-title":"Int. J. Sports Physiol. Perform."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1519\/JSC.0000000000001597","article-title":"Sex and Weight Category Differences in Time-Motion Analysis of Elite Judo Athletes: Implications for Assessment and Training","volume":"31","author":"Miarka","year":"2017","journal-title":"J. Strength Cond. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1177\/1747016120988767","article-title":"de Ethical Approval: None Sought. How Discourse Analysts Report Ethical Issues around Publicly Available Online Data","volume":"17","author":"Stommel","year":"2021","journal-title":"Res. Ethics"},{"key":"ref_22","first-page":"1","article-title":"The Ethics of Publicly Available Data Research: A Situated Ethics Framework for Reddit","volume":"9","author":"Gliniecka","year":"2023","journal-title":"Soc. Media Soc."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Dopico-Calvo, X., Mayo, X., Santos, L., Carballeira, E., \u0160imenko, J., Ceylan, B., Clavel, I., and Iglesias-Soler, E. (2023). When and How a Judo Contest Ends: Analysis of Scores, Penalties, Rounds and Temporal Units in 2018, 2019 and 2021 World Championships. Appl. Sci., 13.","DOI":"10.3390\/app13042395"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1037\/met0000391","article-title":"Interrater Reliability for Multilevel Data: A Generalizability Theory Approach","volume":"27","author":"Jorgensen","year":"2022","journal-title":"Psychol. Methods"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1111\/j.1745-3992.1995.tb00882.x","article-title":"Generalizability of Performance Assessments","volume":"14","author":"Brennan","year":"1995","journal-title":"Educ. Meas. Issues Pract."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.jsp.2013.11.008","article-title":"Generalizability Theory: A Practical Guide to Study Design, Implementation, and Interpretation","volume":"52","author":"Briesch","year":"2014","journal-title":"J. Sch. Psychol."},{"key":"ref_27","first-page":"1241","article-title":"Using Generalizability Theory to Examine Scoring Reliability and Variability of Judging Panels in Skating Competitions","volume":"7","author":"Huang","year":"2011","journal-title":"J. Quant. Anal. Sports"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"337","DOI":"10.24985\/kjss.2017.28.2.337","article-title":"Analysis of Reliability and Error Sources of Judges\u2019 Rating in Rhythmic Gymnastics","volume":"28","author":"Lee","year":"2017","journal-title":"Korean J. Sport Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"756","DOI":"10.24985\/kjss.2016.27.4.756","article-title":"Analysis of Judges\u2019 Judging in Figure Skating","volume":"27","author":"Lee","year":"2016","journal-title":"Korean J. Sport Sci."},{"key":"ref_30","first-page":"395","article-title":"Analysis of Error Source in Subjective Evaluation Results on Taekwondo Poomsae: Application of Generalizability Theory","volume":"27","author":"Cho","year":"2016","journal-title":"J. Korean Data Inf. Sci. Soc."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"48","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting Linear Mixed-Effects Models Using Lme4","volume":"67","author":"Bates","year":"2015","journal-title":"J. Stat. Softw."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Vanbelle, S. (2025). From Tetrachoric to Kappa: How to Assess Reliability on Binary Scales. Br. J. Math. Stat. Psychol., 1\u201320.","DOI":"10.1111\/bmsp.70021"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"368","DOI":"10.4085\/1062-6050-49.2.22","article-title":"A Generalizability Theory Study of Athletic Taping Using the Technical Skill Assessment Instrument","volume":"49","author":"Lafave","year":"2014","journal-title":"J. Athl. Train."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Huebner, A., Lever, J.R., Clark, T.W., Suchomel, T.J., Metoyer, C.J., Hauenstein, J.D., and Wagle, J.P. (2025). Novel Use of Generalizability Theory to Optimize Countermovement Jump Data Collection. Sports, 13.","DOI":"10.3390\/sports13030085"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Davison, A.C., and Hinkley, D.V. (1997). Bootstrap Methods and Their Application, Cambridge University Press.","DOI":"10.1017\/CBO9780511802843"},{"key":"ref_36","first-page":"65","article-title":"A Simple Sequentially Rejective Multiple Test Procedure","volume":"6","author":"Holm","year":"1979","journal-title":"Scand. J. Stat."},{"key":"ref_37","unstructured":"Wickham, H., Fran\u00e7ois, R., Henry, L., M\u00fcller, K., and Vaughan, D. (2026, September 01). Dplyr: A Grammar of Data Manipulation. Available online: https:\/\/dplyr.tidyverse.org\/."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Hoelbling, D., Salmhofer, A., Gencoglu, C., Baranyi, R., Pinter, K., \u00d6zbay, S., Ulupinar, S., Ozkara, A.B., and Grechenig, T. (2023). JudgED: Comparison between Kickboxing Referee Performance at a Novel Serious Game for Judging Improvement and at World Championships. Appl. Sci., 13.","DOI":"10.3390\/app13179549"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"101926","DOI":"10.1016\/j.psychsport.2021.101926","article-title":"Inter-Individual Differences in Sport Refereeing: A Review of Theory and Practice","volume":"55","author":"Avugos","year":"2021","journal-title":"Psychol. Sport Exerc."},{"key":"ref_40","first-page":"149","article-title":"Physical Load and Referees\u2019 Decision-Making in Sports Games: A Scoping Review","volume":"19","author":"Schorer","year":"2020","journal-title":"J. Sports Sci. Med."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1132","DOI":"10.1519\/JSC.0000000000001643","article-title":"Performance Aspects and Physiological Responses in Male Amateur Boxing Competitions: A Brief Review","volume":"31","author":"Slimani","year":"2017","journal-title":"J. Strength Cond. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1123\/ijspp.2013-0474","article-title":"The Activity Profile of Elite Male Amateur Boxing","volume":"10","author":"Davis","year":"2015","journal-title":"Int. J. Sports Physiol. Perform."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s42978-022-00179-9","article-title":"Differences in Judo Attack Systems Between Weight Categories","volume":"5","author":"Kashiwagura","year":"2023","journal-title":"J. Sci. Sport Exerc."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1515\/jqas-2019-0113","article-title":"Judging the Judges: Evaluating the Accuracy and National Bias of International Gymnastics Judges","volume":"17","author":"Heiniger","year":"2021","journal-title":"J. Quant. Anal. Sports"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1080\/02640410400021583","article-title":"Do Judges Enhance Home Advantage in European Championship Boxing?","volume":"23","author":"Balmer","year":"2005","journal-title":"J. Sports Sci."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Qu, R., and Girard, O. (2025). Faster, More Accurate? A Feasibility Study on Replacing Human Judges with Artificial Intelligence in Video Review for the Paris Olympics Taekwondo Competition. Front. Sports Act. Living, 7.","DOI":"10.3389\/fspor.2025.1632326"},{"key":"ref_47","unstructured":"duBoef, M., Romeas, T., Charbonneau, M., and Svejstrup, A. (2026, January 6\u20137). Interpretable Prediction and Large-Scale Analysis of Judging in Professional Boxing. Proceedings of the MIT Sloan Sports Analytics Conference, Boston, MA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Karaman, S., Keskinoglu, M., and \u0160imenko, J. (2025). Understanding Sleep Health in Judo Referees: The Influence of Demographic and Athletic Factors. Appl. Sci., 15.","DOI":"10.3390\/app15137452"}],"container-title":["Sports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4663\/14\/9\/403\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,14]],"date-time":"2026-09-14T10:41:44Z","timestamp":1789382504000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4663\/14\/9\/403"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,14]]},"references-count":48,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["sports14090403"],"URL":"https:\/\/doi.org\/10.3390\/sports14090403","relation":{},"ISSN":["2075-4663"],"issn-type":[{"value":"2075-4663","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,14]]}}}