{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T16:34:15Z","timestamp":1753893255037,"version":"3.41.2"},"reference-count":48,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T00:00:00Z","timestamp":1734307200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Sports Act. Living"],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Officials are essential in terms of player safety and injury prevention, especially in contact team sports such as ice hockey, where numerous fast pace and high force contacts occur. If against the rules, these collisions can result in penalties. However, there is limited literature on the inter-rater reliability of the officials\u2019 decisions. Hence, the purpose was to investigate the theoretical reliability agreement between professional ice hockey officials in the Swedish Hockey League (SHL).<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>Fifty video clips with different match situations were shown to 33 professional ice hockey officials in the SHL. Each situation was shown three times and the officials had 20 s between each video clip to answer which offence and penalty they would judge. The answers were anonymously collected using an online questionnaire. Fleiss\u2019 kappa was used to assess the reliability agreement between the referees, for each situation.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The Fleiss\u2019 kappa values for all officials were 0.63 and 0.35 for offences and penalties, respectively. Referees and linesmen had similar kappa values for offences (0.64 vs. 0.64), as well as for penalties (0.38 vs. 0.35).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The results show that the suggested methodology can be used to identify situations where officials agree and disagree. In ice hockey, poor agreement regarding penalties can depend on the chosen offence as the rulebook limits the availability of penalties, based on the chosen offence. This can create issues, as there are situations where different offences are equally correct but will result in different penalties.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fspor.2024.1425040","type":"journal-article","created":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T06:20:07Z","timestamp":1734330007000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Reliability agreement in foul and penalty judgements between officials in the Swedish hockey league"],"prefix":"10.3389","volume":"6","author":[{"given":"Glenn","family":"Bj\u00f6rklund","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olivia","family":"Procter","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mikael","family":"Swar\u00e9n","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,12,16]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1080\/1750984X.2020.1783696","article-title":"The referee\u2019s challenge: a threshold process model for decision making in sport games","volume":"14","author":"Raab","year":"2021","journal-title":"Int Rev Sport Exerc Psychol"},{"article-title":"The psychology of officiating","year":"2006","author":"Mascarenhas","key":"B2"},{"key":"B3","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1080\/14660970.2015.1133414","article-title":"Referees and the media: a difficult relationship but an unavoidable necessity","volume":"19","author":"Webb","year":"2018","journal-title":"Soccer & Society"},{"key":"B4","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1080\/02701367.2020.1756198","article-title":"An analysis of literature on sport officiating research","volume":"92","author":"Hancock","year":"2021","journal-title":"Res Q Exerc Sport"},{"key":"B5","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1080\/02640410902729733","article-title":"Officiating bias: the effect of foul differential on foul calls in NCAA basketball","volume":"27","author":"Anderson","year":"2009","journal-title":"J Sports Sci"},{"key":"B6","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1080\/02640410601038576","article-title":"Referee bias contributes to home advantage in English premiership football","volume":"25","author":"Boyko","year":"2007","journal-title":"J Sports Sci"},{"key":"B7","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1111\/j.1467-985X.2006.00451.x","article-title":"Are football referees really biased and inconsistent?: evidence on the incidence of disciplinary sanction in the English premier league","volume":"170","author":"Dawson","year":"2007","journal-title":"J R Stat Soc Ser A Stat Soc"},{"key":"B8","doi-asserted-by":"publisher","first-page":"e0256568","DOI":"10.1371\/journal.pone.0256568","article-title":"The absence of fans removes the home advantage associated with penalties called by national hockey league referees","volume":"16","author":"Gu\u00e9rette","year":"2021","journal-title":"PLoS One"},{"key":"B9","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1515\/jqas-2019-0113","article-title":"Judging the judges: evaluating the accuracy and national bias of international gymnastics judges","volume":"17","author":"Heiniger","year":"2021","journal-title":"J Quant Anal Sports"},{"key":"B10","doi-asserted-by":"publisher","first-page":"739570","DOI":"10.3389\/fspor.2021.739570","article-title":"The issue of unconscious bias in referee decisions in the national rugby league","volume":"3","author":"O'Brien","year":"2021","journal-title":"Front Sports Act Living"},{"key":"B11","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1628\/jite-2020-0040","article-title":"The impact of age on nationality bias and cultural proximity bias: evidence from ski-jumping","volume":"176","author":"Scholten","year":"2020","journal-title":"J Instit Theor Econ"},{"key":"B12","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1080\/02701367.2017.1412392","article-title":"Gaze behavior of gymnastics judges: where do experienced judges and gymnasts look while judging?","volume":"89","author":"Pizzera","year":"2018","journal-title":"Res Q Exerc Sport"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1936","DOI":"10.1080\/02640414.2021.1908734","article-title":"Howzat! expert umpires use a gaze anchor to overcome the processing demands of leg before wicket decisions","volume":"39","author":"Ramachandran","year":"2021","journal-title":"J Sports Sci"},{"key":"B14","doi-asserted-by":"publisher","first-page":"572891","DOI":"10.3389\/fspor.2020.572891","article-title":"Gaze behavior of referees in sport\u2014a review","volume":"2","author":"Ziv","year":"2020","journal-title":"Front Sports Act Living"},{"key":"B15","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1080\/15534510.2016.1259656","article-title":"Influence of competition level on referees\u2019 decision-making in handball","volume":"11","author":"Souchon","year":"2016","journal-title":"Soc Influ"},{"key":"B16","doi-asserted-by":"publisher","first-page":"19","DOI":"10.3389\/fspor.2020.00019","article-title":"Referee bias in professional football: favoritism toward successful teams in potential penalty situations","volume":"2","author":"Erikstad","year":"2020","journal-title":"Front Sports Act Living"},{"key":"B17","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1080\/026404102321011751","article-title":"The impact of a team\u2019s aggressive reputation on the decisions of association football referees","volume":"20","author":"Jones","year":"2002","journal-title":"J Sports Sci"},{"key":"B18","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1080\/02640410310001641502","article-title":"Physical and perceptual-cognitive demands of top-class refereeing in association football","volume":"22","author":"Helsen","year":"2004","journal-title":"J Sports Sci"},{"key":"B19","doi-asserted-by":"publisher","first-page":"3367","DOI":"10.1519\/JSC.0000000000001002","article-title":"Physiological and movement demands of rugby league referees: influence on penalty accuracy","volume":"29","author":"Emmonds","year":"2015","journal-title":"J Strength Cond Res"},{"key":"B20","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1080\/10413200.2020.1831651","article-title":"Sport arbitration as an emergent process in a complex system: decision-making variability is a marker of expertise in national-level football referees","volume":"34","author":"Russell","year":"2022","journal-title":"J Appl Sport Psychol"},{"key":"B21","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.psychsport.2017.04.003","article-title":"Decision-making of English netball superleague umpires: contextual and dispositional influences","volume":"31","author":"Burnett","year":"2017","journal-title":"Psychol Sport Exerc"},{"key":"B22","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1123\/tsp.19.2.131","article-title":"Training accurate and coherent decision making in rugby union referees","volume":"19","author":"Mascarenhas","year":"2005","journal-title":"Sport Psychol"},{"key":"B23","doi-asserted-by":"publisher","first-page":"102347","DOI":"10.1016\/j.psychsport.2022.102347","article-title":"A new Bayesian procedure for the estimation of the referees\u2019 decision thresholds and agreement. The case of professional handball refereeing","volume":"65","author":"Bruno","year":"2023","journal-title":"Psychol Sport Exerc"},{"key":"B24","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1177\/0363546503261249","article-title":"An assessment of football referees\u2019 decisions in incidents leading to player injuries","volume":"32","author":"Fuller","year":"2004","journal-title":"Am J Sports Med"},{"volume-title":"Decision-making in ice Hockey Referees: Officiating Style and Accurate Detection of Penalties","year":"2017","author":"Werger","key":"B25"},{"key":"B26","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1136\/bjsm.30.3.251","article-title":"Concussion among Swedish elite ice hockey players","volume":"30","author":"Tegner","year":"1996","journal-title":"Br J Sports Med"},{"key":"B27","doi-asserted-by":"publisher","first-page":"208","DOI":"10.2139\/ssrn.2259798","article-title":"Biased impartiality among national hockey league referees","volume":"8","author":"Lopez","year":"2013","journal-title":"Int J Sport Finance"},{"key":"B28","doi-asserted-by":"publisher","first-page":"e69122","DOI":"10.1371\/journal.pone.0069122","article-title":"Bodychecking rules and concussion in elite hockey","volume":"8","author":"Donaldson","year":"2013","journal-title":"PLoS One"},{"key":"B29","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1097\/JSM.0b013e3182342b69","article-title":"Violence in Canadian amateur hockey: the experience of referees in Ontario","volume":"22","author":"Ackery","year":"2012","journal-title":"Clin J Sport Med"},{"key":"B30","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1136\/bjsm.25.2.87","article-title":"Ice hockey injuries: incidence, nature and causes","volume":"25","author":"Tegner","year":"1991","journal-title":"Br J Sports Med"},{"key":"B31","first-page":"149","article-title":"Physical load and referees\u2019 decision-making in sports games: a scoping review","volume":"19","author":"Blo\u00df","year":"2020","journal-title":"J Sports Sci Med"},{"key":"B32","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1080\/1612197X.2013.837091","article-title":"\u201cI like that you can hit a guy and not really get in trouble\u201d: young ice hockey players\u2019 experiences with body checking","volume":"12","author":"Fraser-Thomas","year":"2014","journal-title":"Int J Sport Exerc Psychol"},{"key":"B33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2202\/1559-0410.1178","article-title":"An examination of judging consistency in a combat sport","volume":"6","author":"Myers","year":"2010","journal-title":"J Quant Anal Sports"},{"article-title":"The Home Advantage in Elite-Level Ice Hockey","year":"2009","author":"Goldman","key":"B34"},{"key":"B35","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1260\/1747-9541.8.3.505","article-title":"Association of certification level and assertiveness with accuracy of calls among ice hockey referees","volume":"8","author":"Wilson","year":"2013","journal-title":"Int J Sports Sci Coach"},{"article-title":"Referee analytics: an analysis of penalty rates by national hockey league officials","year":"2012","author":"Schuckersab","key":"B36"},{"key":"B37","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1002\/sam.11320","article-title":"Biased penalty calls in the national hockey league","volume":"9","author":"Beaudoin","year":"2016","journal-title":"Statistical Analysis and Data Mining: the ASA Data Science Journal"},{"volume-title":"The Effects of Various Feedback Modes During Video Practice to Enhance the Decision Making of Beginning ice Hockey Referees","year":"2006","author":"Tsai","key":"B38"},{"key":"B39","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1097\/JSM.0000000000001133","article-title":"Can referees assess head contact penalties correctly in Canadian youth ice hockey? A video analysis study","volume":"33","author":"Williamson","year":"2023","journal-title":"Clin J Sport Med"},{"year":"2024","key":"B40","article-title":"Stats.swehockey.se Official Statistics. Swedish Ice Hockey Federation"},{"key":"B41","doi-asserted-by":"publisher","first-page":"101926","DOI":"10.1016\/j.psychsport.2021.101926","article-title":"Inter-individual differences in sport refereeing: a review of theory and practice","volume":"55","author":"Avugos","year":"2021","journal-title":"Psychol Sport Exerc"},{"key":"B42","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychol Bull"},{"key":"B43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.70252\/HMZN3851","article-title":"New author guidelines in statistical reporting: embracing an era beyond p<.05","volume":"13","author":"Johnson","year":"2020","journal-title":"Int J Exerc Sci"},{"key":"B44","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"B45","unstructured":"The Jamovi project\n          \n          \n          2020"},{"year":"2021","key":"B46","article-title":"Rule Book 2021-2022"},{"key":"B47","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1080\/02701367.2023.2184459","article-title":"Referee abuse, intention to quit, and well-being","volume":"95","author":"Downward","year":"2024","journal-title":"Res Q Exerc Sport"},{"key":"B48","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1080\/13606710500146175","article-title":"Contextual factors associated with poor sport spectator behaviour","volume":"10","author":"Nicholson","year":"2005","journal-title":"Manag Leisure"}],"container-title":["Frontiers in Sports and Active Living"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fspor.2024.1425040\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T06:20:11Z","timestamp":1734330011000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fspor.2024.1425040\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,16]]},"references-count":48,"alternative-id":["10.3389\/fspor.2024.1425040"],"URL":"https:\/\/doi.org\/10.3389\/fspor.2024.1425040","relation":{},"ISSN":["2624-9367"],"issn-type":[{"type":"electronic","value":"2624-9367"}],"subject":[],"published":{"date-parts":[[2024,12,16]]},"article-number":"1425040"}}