{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T16:25:32Z","timestamp":1753892732023,"version":"3.41.2"},"reference-count":22,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,5,1]],"date-time":"2024-05-01T00:00:00Z","timestamp":1714521600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>In sports competitions, judge scoring data serve as an objective measure of an athlete\u2019s performance level. However, research has indicated the unreliability of objective measurements. Controversy often arises regarding the quality of judge scoring data, undermining fairness and justice in sports competitions.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>This paper proposes a method utilizing the Kendall covariance coefficient and the Kendall correlation coefficient for the thorough evaluation of judging data quality in diving events. The analysis is structured around four key elements: overall competition, individual divers, specific rounds, and distinct diving techniques. Each element is analyzed across three dimensions: the collective data quality from the judging panel, interjudge data quality comparisons, and the alignment of individual judges\u2019 scores with the final tallied scores.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Two case studies serve to illustrate the application of this method. The Kendall covariance coefficient is employed to assess the data quality from the judges as a unified entity, whereas the Kendall correlation coefficient is utilized to evaluate the data quality from individual judges. Results show that the data quality of the judge group\u2019s scoring is high, while the data quality of the judge group\u2019s scoring for the 6th diver, the 5th round, Dive No. 5152B, Judge 5 and 6 in the Competition 1, and the 1st diver, the 3rd round, Dive No. 6245D, Judge 4 in the Competition 2 is inconsistent with the others.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>This approach uncovers disparities in data quality attributed to the judges\u2019 panel across each diver, each round, and the various diving maneuvers. However, the Kendall correlation coefficient may not be suitable for evaluating data quality when both the data differences and the sample size are small.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fpsyg.2024.1338405","type":"journal-article","created":{"date-parts":[[2024,5,1]],"date-time":"2024-05-01T05:00:55Z","timestamp":1714539655000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Multifactor and multidimensional data quality analysis of judge scoring in diving competition"],"prefix":"10.3389","volume":"15","author":[{"given":"Weijun","family":"Cai","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rong","family":"Xiang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,5,1]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1017\/jwe.2022.41","article-title":"Judging reliability at wine and water competitions","volume":"17","author":"Berg","year":"2022","journal-title":"J. Wine Econ."},{"key":"ref2","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1017\/jwe.2017.21","article-title":"Disentangling wine judges' consensus, idiosyncratic, and random expressions of quality or preference","volume":"12","author":"Bodington","year":"2017","journal-title":"J. Wine Econ."},{"key":"ref3","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1037\/\/1040-3590.6.4.284","article-title":"Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology","volume":"6","author":"Cicchetti","year":"1994","journal-title":"Psychol. Assess."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"80","DOI":"10.13546\/j.cnki.tjyjc.2016.22.022","article-title":"Application of variance analysis in diving performance management","volume":"466","author":"Dai","year":"2016","journal-title":"Statisti. Decis."},{"volume-title":"Measurement System Analysis: Theory, Method, and Applications","year":"2006","author":"Dong","key":"ref5"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"1419","DOI":"10.13860\/j.cnki.sltj.1987.02.005","article-title":"Analysis of the level of singers and referees in singing competitions","volume":"2","author":"Gao","year":"1987","journal-title":"Appl. Statist. Manag."},{"year":"2021","author":"Guo","key":"ref7"},{"key":"ref8","first-page":"68","article-title":"Research on non-parameter evaluation in subjective judge\u2019s quality","volume":"1","author":"He","year":"2005","journal-title":"J. Jilin Institut. Phys. Educ."},{"volume-title":"Statistics","year":"2018","author":"Jia","key":"ref9"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1515\/hukin-2017-0099","article-title":"Judging in rhythmic gymnastics at different levels of performance","volume":"60","author":"Leandro","year":"2017","journal-title":"J. Hum. Kinet."},{"key":"ref11","first-page":"31","article-title":"Evaluating judge performance in sport","volume":"5","author":"Looney","year":"2004","journal-title":"J. Appl. Meas."},{"key":"ref12","doi-asserted-by":"publisher","first-page":"950","DOI":"10.1080\/13218719.2020.1751334","article-title":"Judging experts: Australian magistrates' evaluations of expert opinion quality","volume":"27","author":"Martire","year":"2020","journal-title":"Psychiatry Psychol. Law"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"173","DOI":"10.2478\/hukin-2013-0038","article-title":"Is the quality of judging in women artistic gymnastics equivalent at major competitions of different levels?","volume":"37","author":"Pajek","year":"2013","journal-title":"J. Hum. Kinet."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1093\/biomet\/49.1-2.185","article-title":"Tests for rank correlation coefficients","volume":"49","author":"Pearson","year":"1962","journal-title":"Biometrika"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1590\/1517-869220182403170572","article-title":"Reliability of judge's evaluation of the synchronized swimming technical elements by video","volume":"24","author":"Ponciano","year":"2018","journal-title":"Rev. Bras. Med. Esporte"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"1001","DOI":"10.3389\/fpsyg.2019.01001","article-title":"Reliability of judging in dance sport","volume":"10","author":"Premel\u010d","year":"2019","journal-title":"Front. Psychol."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"934158","DOI":"10.3389\/fpsyg.2022.934158","article-title":"Improving reliability and validity in hip-hop dance assessment: judging standards that elevate the sport and competition","volume":"13","author":"Sato","year":"2022","journal-title":"Front. Psychol."},{"key":"ref18","doi-asserted-by":"publisher","first-page":"e245861","DOI":"10.1371\/journal.pone.0245861","article-title":"Judges' evaluation reliability changes between identifiable and anonymous performance of hip-hop dance movements","volume":"16","author":"Sato","year":"2021","journal-title":"PLoS One"},{"key":"ref19","first-page":"83","article-title":"A mathematical model for evaluating the level of referees in sports competitions and its application","volume":"4","author":"Wang","year":"1997","journal-title":"Shandong Sports Sci. Technol."},{"year":"","key":"ref20"},{"year":"","key":"ref21"},{"year":"2024","key":"ref9001"}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2024.1338405\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,1]],"date-time":"2024-05-01T05:01:04Z","timestamp":1714539664000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2024.1338405\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,1]]},"references-count":22,"alternative-id":["10.3389\/fpsyg.2024.1338405"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2024.1338405","relation":{},"ISSN":["1664-1078"],"issn-type":[{"type":"electronic","value":"1664-1078"}],"subject":[],"published":{"date-parts":[[2024,5,1]]},"article-number":"1338405"}}