{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T10:23:10Z","timestamp":1762251790643},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Adv Data Anal Classif"],"published-print":{"date-parts":[[2012,4]]},"DOI":"10.1007\/s11634-011-0094-7","type":"journal-article","created":{"date-parts":[[2011,9,28]],"date-time":"2011-09-28T11:04:53Z","timestamp":1317207893000},"page":"67-79","source":"Crossref","is-referenced-by-count":25,"title":["Cohen\u2019s linearly weighted kappa is a weighted average"],"prefix":"10.1007","volume":"6","author":[{"given":"Matthijs J.","family":"Warrens","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2011,9,29]]},"reference":[{"key":"94_CR1","volume-title":"Handbook of mathematical functions (with formulas, graphs and mathematical tables)","author":"M Abramowitz","year":"1970","unstructured":"Abramowitz M, Stegun IA (1970) Handbook of mathematical functions (with formulas, graphs and mathematical tables). Dover Publications, New York"},{"key":"94_CR2","volume-title":"Categorical data analysis","author":"A Agresti","year":"1990","unstructured":"Agresti A (1990) Categorical data analysis. Wiley, New York"},{"key":"94_CR3","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1177\/0013164488484007","volume":"48","author":"KJ Berry","year":"1988","unstructured":"Berry KJ, Mielke PW (1988) A generalization of Cohen\u2019s kappa agreement measure to interval measurement and multiple raters. Educ Psychol Meas 48: 921\u2013933","journal-title":"Educ Psychol Meas"},{"key":"94_CR4","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1177\/001316448104100307","volume":"41","author":"RL Brennan","year":"1981","unstructured":"Brennan RL, Prediger DJ (1981) Coefficient kappa: Some uses, misuses, and alternatives. Educ Psychol Meas 41: 687\u2013699","journal-title":"Educ Psychol Meas"},{"key":"94_CR5","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1097\/00001648-199603000-00016","volume":"7","author":"H Brenner","year":"1996","unstructured":"Brenner H, Kliebsch U (1996) Dependence of weighted kappa coefficients on the number of categories. Epidemiology 7: 199\u2013202","journal-title":"Epidemiology"},{"key":"94_CR6","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1080\/00029238.1971.11080840","volume":"11","author":"D Cicchetti","year":"1971","unstructured":"Cicchetti D, Allison T (1971) A new procedure for assessing reliability of scoring EEG sleep recordings. Am J EEG Technol 11: 101\u2013109","journal-title":"Am J EEG Technol"},{"key":"94_CR7","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1177\/001316446002000134","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20: 213\u2013220","journal-title":"Educ Psychol Meas"},{"key":"94_CR8","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1037\/h0026256","volume":"70","author":"J Cohen","year":"1968","unstructured":"Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70: 213\u2013220","journal-title":"Psychol Bull"},{"key":"94_CR9","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1037\/0033-2909.88.2.322","volume":"88","author":"AJ Conger","year":"1980","unstructured":"Conger AJ (1980) Integration and generalization of kappas for multiple raters. Psychol Bull 88: 322\u2013328","journal-title":"Psychol Bull"},{"key":"94_CR10","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1177\/001316447303300309","volume":"33","author":"JL Fleiss","year":"1973","unstructured":"Fleiss JL, Cohen J (1973) The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas 33: 613\u2013619","journal-title":"Educ Psychol Meas"},{"key":"94_CR11","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1097\/00006254-196806000-00023","volume":"23","author":"NS Holmquist","year":"1968","unstructured":"Holmquist NS, McMahon CA, Williams EO (1968) Variability in classification of carcinoma in situ of the uterine cervix. Obstet Gynecol Surv 23: 580\u2013585","journal-title":"Obstet Gynecol Surv"},{"key":"94_CR12","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1207\/S15328031US0203_03","volume":"2","author":"LM Hsu","year":"2003","unstructured":"Hsu LM, Field R (2003) Interrater agreement measures: Comments on kappan, Cohen\u2019s kappa, Scott\u2019s \u03c0 and Aickin\u2019s \u03b1. Underst Stat 2: 205\u2013219","journal-title":"Underst Stat"},{"key":"94_CR13","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1111\/j.1471-6712.2005.00368.x","volume":"19","author":"U Jakobsson","year":"2005","unstructured":"Jakobsson U, Westergren A (2005) Statistical methods for assessing agreement for ordinal data. Scand J Caring Sci 19: 427\u2013431","journal-title":"Scand J Caring Sci"},{"key":"94_CR14","doi-asserted-by":"crossref","first-page":"2109","DOI":"10.1002\/sim.1180","volume":"21","author":"HC Kraemer","year":"2004","unstructured":"Kraemer HC, Periyakoil VS, Noda A (2004) Tutorial in biostatistics: Kappa coefficients in medical research. Stat Med 21: 2109\u20132129","journal-title":"Stat Med"},{"key":"94_CR15","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1148\/radiol.2282011860","volume":"288","author":"HL Kundel","year":"2003","unstructured":"Kundel HL, Polansky M (2003) Measurement of observer agreement. Radiology 288: 303\u2013308","journal-title":"Radiology"},{"key":"94_CR16","doi-asserted-by":"crossref","first-page":"363","DOI":"10.2307\/2529786","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG (1977) An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 33: 363\u2013374","journal-title":"Biometrics"},{"key":"94_CR17","doi-asserted-by":"crossref","first-page":"655","DOI":"10.2466\/PR0.101.6.655-660","volume":"101","author":"PW Mielke","year":"2007","unstructured":"Mielke PW, Berry KJ, Johnston JE (2007) The exact variance of weighted kappa with multiple raters. Psychol Rep 101: 655\u2013660","journal-title":"Psychol Rep"},{"key":"94_CR18","doi-asserted-by":"crossref","first-page":"606","DOI":"10.2466\/pr0.102.2.606-613","volume":"102","author":"PW Mielke","year":"2008","unstructured":"Mielke PW, Berry KJ, Johnston JE (2008) Resampling probability values for weighted kappa with multiple raters. Psychol Rep 102: 606\u2013613","journal-title":"Psychol Rep"},{"key":"94_CR19","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1191\/096228000701555262","volume":"9","author":"JC Nelson","year":"2000","unstructured":"Nelson JC, Pepe MS (2000) Statistical description of interrater variability in ordinal ratings. Stat Methods Med Res 9: 475\u2013496","journal-title":"Stat Methods Med Res"},{"key":"94_CR20","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1007\/BF02294066","volume":"51","author":"HJA Schouten","year":"1986","unstructured":"Schouten HJA (1986) Nominal scale agreement among observers. Psychometrika 51: 453\u2013466","journal-title":"Psychometrika"},{"key":"94_CR21","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1177\/0013164403260197","volume":"64","author":"C Schuster","year":"2004","unstructured":"Schuster C (2004) A note on the interpretation of weighted kappa and its relations to other rater agreement statistics for metric scales. Educ Psychol Meas 64: 243\u2013253","journal-title":"Educ Psychol Meas"},{"key":"94_CR22","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1007\/s11336-009-9116-1","volume":"74","author":"S Vanbelle","year":"2009","unstructured":"Vanbelle S, Albert A (2009a) Agreement between two independent groups of raters. Psychometrika 74: 477\u2013491","journal-title":"Psychometrika"},{"key":"94_CR23","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1111\/j.1467-9574.2008.00412.x","volume":"63","author":"S Vanbelle","year":"2009","unstructured":"Vanbelle S, Albert A (2009b) Agreement between an isolated rater and a group of raters. Stat Neerlandica 63: 82\u2013100","journal-title":"Stat Neerlandica"},{"key":"94_CR24","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.stamet.2008.06.001","volume":"6","author":"S Vanbelle","year":"2009","unstructured":"Vanbelle S, Albert A (2009c) A note on the linearly weighted kappa coefficient for ordinal scales. Stat Methodol 6: 157\u2013163","journal-title":"Stat Methodol"},{"key":"94_CR25","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s00357-008-9023-7","volume":"25","author":"MJ Warrens","year":"2008","unstructured":"Warrens MJ (2008a) On the equivalence of Cohen\u2019s kappa and the Hubert-Arabie adjusted Rand index. J Classif 25: 177\u2013183","journal-title":"J Classif"},{"key":"94_CR26","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/s11336-008-9059-y","volume":"73","author":"MJ Warrens","year":"2008","unstructured":"Warrens MJ (2008b) On similarity coefficients for 2\u00a0\u00d7 2 tables and correction for chance. Psychometrika 73: 487\u2013502","journal-title":"Psychometrika"},{"key":"94_CR27","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1007\/s11336-009-9138-8","volume":"75","author":"MJ Warrens","year":"2010","unstructured":"Warrens MJ (2010a) Inequalities between kappa and kappa-like statistics for k\u00a0\u00d7 k tables. Psychometrika 75: 176\u2013185","journal-title":"Psychometrika"},{"key":"94_CR28","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1007\/s00357-010-9060-x","volume":"27","author":"MJ Warrens","year":"2010","unstructured":"Warrens MJ (2010b) A formal proof of a paradox associated with Cohen\u2019s kappa. J Classif 27: 322\u2013332","journal-title":"J Classif"},{"key":"94_CR29","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/s11634-010-0073-4","volume":"4","author":"MJ Warrens","year":"2010","unstructured":"Warrens MJ (2010c) Inequalities between multi-rater kappas. Adv Data Anal Classif 4: 271\u2013286","journal-title":"Adv Data Anal Classif"},{"key":"94_CR30","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1007\/s11336-010-9155-7","volume":"75","author":"MJ Warrens","year":"2010","unstructured":"Warrens MJ (2010d) A Kraemer-type rescaling that transforms the odds ratio into the weighted kappa coefficient. Psychometrika 75: 328\u2013330","journal-title":"Psychometrika"},{"key":"94_CR31","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1016\/j.stamet.2010.05.003","volume":"7","author":"MJ Warrens","year":"2010","unstructured":"Warrens MJ (2010e) Cohen\u2019s kappa can always be increased and decreased by combining categories. Stat Methodol 7: 673\u2013677","journal-title":"Stat Methodol"},{"key":"94_CR32","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.stamet.2010.09.004","volume":"8","author":"MJ Warrens","year":"2011","unstructured":"Warrens MJ (2011a) Weighted kappa is higher than Cohen\u2019s kappa for tridiagonal agreement tables. Stat Methodol 8: 268\u2013272","journal-title":"Stat Methodol"},{"key":"94_CR33","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1007\/s11336-011-9210-z","volume":"76","author":"MJ Warrens","year":"2011","unstructured":"Warrens MJ (2011b) Cohen\u2019s linearly weighted kappa is a weighted average of 2\u00a0\u00d7 2 kappas. Psychometrika 76: 471\u2013486","journal-title":"Psychometrika"},{"key":"94_CR34","doi-asserted-by":"crossref","unstructured":"Warrens MJ (2011c) Cohen\u2019s quadratically weighted kappa is higher than linearly weighted kappa for tridiagonal agreement tables. Stat Methodol (in press)","DOI":"10.1016\/j.stamet.2010.09.004"},{"key":"94_CR35","doi-asserted-by":"crossref","unstructured":"Warrens MJ (2011d) Cohen\u2019s kappa is weighted average. Stat Methodol (in press)","DOI":"10.1016\/j.stamet.2011.06.002"},{"key":"94_CR36","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1037\/0033-2909.103.3.374","volume":"103","author":"R Zwick","year":"1988","unstructured":"Zwick R (1988) Another look at interrater agreement. Psychol Bull 103: 374\u2013378","journal-title":"Psychol Bull"}],"container-title":["Advances in Data Analysis and Classification"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.springerlink.com\/index\/pdf\/10.1007\/s11634-011-0094-7","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,16]],"date-time":"2019-06-16T13:28:24Z","timestamp":1560691704000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11634-011-0094-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,9,29]]},"references-count":36,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,4]]}},"alternative-id":["94"],"URL":"https:\/\/doi.org\/10.1007\/s11634-011-0094-7","relation":{},"ISSN":["1862-5347","1862-5355"],"issn-type":[{"value":"1862-5347","type":"print"},{"value":"1862-5355","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,9,29]]}}}