{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,3,14]],"date-time":"2024-03-14T00:53:25Z","timestamp":1710377605213},"reference-count":15,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T00:00:00Z","timestamp":1710288000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T00:00:00Z","timestamp":1710288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Fundamental Research Funds in Heilongjiang Provincial Universities","award":["145209121"],"award-info":[{"award-number":["145209121"]}]},{"name":"Heilongjiang Province Leading Talent Echelon Reserve Leader Funding Project","award":["Not available"],"award-info":[{"award-number":["Not available"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Nephrol"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The evaluation of inter-rater reliability (IRR) is integral to research designs involving the assessment of observational ratings by two raters. However, existing literature is often heterogeneous in reporting statistical procedures and the evaluation of IRR, although such information can impact subsequent hypothesis testing analyses.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>This paper evaluates a recent publication by Chen et al., featured in <jats:italic>BMC Nephrology<\/jats:italic>, aiming to introduce an alternative statistical approach to assessing IRR and discuss its statistical properties. The study underscores the crucial need for selecting appropriate Kappa statistics, emphasizing the accurate computation, interpretation, and reporting of commonly used IRR statistics between two raters.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The Cohen\u2019s Kappa statistic is typically used for two raters dealing with two categories or for unordered categorical variables having three or more categories. On the other hand, when assessing the concordance between two raters for ordered categorical variables with three or more categories, the commonly employed measure is the weighted Kappa.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Chen and colleagues might have underestimated the agreement between AU5800 and UN2000. Although the statistical approach adopted in Chen et al.\u2019s research did not alter their findings, it is important to underscore the importance of researchers being discerning in their choice of statistical techniques to address their specific research inquiries.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12882-024-03540-y","type":"journal-article","created":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T18:01:27Z","timestamp":1710352887000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluating inter-rater reliability in the context of \u201cSysmex UN2000 detection of protein\/creatinine ratio and of renal tubular epithelial cells can be used for screening lupus nephritis\u201d: a statistical examination"],"prefix":"10.1186","volume":"25","author":[{"given":"Ming","family":"Li","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qian","family":"Gao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tianfei","family":"Yu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,3,13]]},"reference":[{"issue":"1","key":"3540_CR1","doi-asserted-by":"publisher","first-page":"23","DOI":"10.20982\/tqmp.08.1.p023","volume":"8","author":"KA Hallgren","year":"2012","unstructured":"Hallgren KA. Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol. 2012;8(1):23.","journal-title":"Tutor Quant Methods Psychol"},{"issue":"3","key":"3540_CR2","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1007\/s11222-022-10105-2","volume":"32","author":"J Hughes","year":"2022","unstructured":"Hughes J. Sklar\u2019s omega: a gaussian copula-based framework for assessing agreement. Stat Comput. 2022;32(3):46.","journal-title":"Stat Comput"},{"issue":"1","key":"3540_CR3","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1186\/s12882-022-02953-x","volume":"23","author":"Y Chen","year":"2022","unstructured":"Chen Y, Zhao Y, Zhang Z, Cheng X, Lin J, Li J, et al. Sysmex UN2000 detection of protein\/creatinine ratio and of renal tubular epithelial cells can be used for screening lupus nephritis. BMC Nephrol. 2022;23(1):328.","journal-title":"BMC Nephrol"},{"issue":"1","key":"3540_CR4","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37\u201346.","journal-title":"Educ Psychol Meas"},{"issue":"1","key":"3540_CR5","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1186\/s12882-023-03306-y","volume":"24","author":"P Gao","year":"2023","unstructured":"Gao P, He W, Jin Y, Zhou C, Zhang P, Wang W, Hu J, Liu J. Acute kidney injury after infant cardiac surgery: a comparison of pRIFLE, KDIGO, and pROCK definitions. BMC Nephrol. 2023;24(1):251.","journal-title":"BMC Nephrol"},{"issue":"1","key":"3540_CR6","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1186\/s12882-023-03232-z","volume":"24","author":"C Liu","year":"2023","unstructured":"Liu C, He Y, Venn AJ, Jose MD, Tian J. Childhood modifiable risk factors and later life chronic kidney disease: a systematic review. BMC Nephrol. 2023;24(1):184.","journal-title":"BMC Nephrol"},{"issue":"1","key":"3540_CR7","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1186\/s12882-023-03126-0","volume":"24","author":"BM Anderson","year":"2023","unstructured":"Anderson BM, Qasim M, Correa G, Evison F, Gallier S, Ferro CJ, et al. A clinical frailty scale obtained from MDT discussion performs poorly in assessing frailty in haemodialysis recipients. BMC Nephrol. 2023;24(1):80.","journal-title":"BMC Nephrol"},{"issue":"1","key":"3540_CR8","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1186\/s12882-022-02978-2","volume":"23","author":"J Stojanowski","year":"2022","unstructured":"Stojanowski J, Konieczny A, Rydzy\u0144ska K, Kasenberg I, Miko\u0142ajczak A, Go\u0142\u0119biowski T, et al. Artificial neural network - an effective tool for predicting the lupus nephritis outcome. BMC Nephrol. 2022;23(1):381.","journal-title":"BMC Nephrol"},{"issue":"1","key":"3540_CR9","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1186\/s12882-021-02399-7","volume":"22","author":"D Keane","year":"2021","unstructured":"Keane D, Glyde M, Dasgupta I, Gardiner C, Lindley E, Mitra S, et al. Patient perspectives of target weight management and ultrafiltration in haemodialysis: a multi-center survey. BMC Nephrol. 2021;22(1):188.","journal-title":"BMC Nephrol"},{"issue":"1","key":"3540_CR10","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1186\/s12882-022-02763-1","volume":"23","author":"N Alsalemi","year":"2022","unstructured":"Alsalemi N, Sadowski CA, Elftouh N, Louis M, Kilpatrick K, Houle SKD, et al. The effect of renin-angiotensin-aldosterone system inhibitors on continuous and binary kidney outcomes in subgroups of patients with diabetes: a meta-analysis of randomized clinical trials. BMC Nephrol. 2022;23(1):161.","journal-title":"BMC Nephrol"},{"issue":"3","key":"3540_CR11","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1080\/00029238.1971.11080840","volume":"11","author":"DV Cicchetti","year":"1971","unstructured":"Cicchetti DV, Allison T. A New Procedure for assessing reliability of Scoring EEG Sleep recordings. Am J EEG Technol. 1971;11(3):101\u201310.","journal-title":"Am J EEG Technol"},{"issue":"3","key":"3540_CR12","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1177\/001316447303300309","volume":"33","author":"JL Fleiss","year":"1973","unstructured":"Fleiss JL, Cohen J. The equivalence of weighted Kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33(3):613\u20139.","journal-title":"Educ Psychol Meas"},{"issue":"2","key":"3540_CR13","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1007\/s11336-014-9439-4","volume":"81","author":"S Vanbelle","year":"2016","unstructured":"Vanbelle S. A new interpretation of the weighted kappa coefficients. Psychometrika. 2016;81(2):399\u2013410.","journal-title":"Psychometrika"},{"issue":"1","key":"3540_CR14","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1097\/MRR.0000000000000516","volume":"45","author":"KB Bayram","year":"2022","unstructured":"Bayram KB, \u015eeng\u00fcl \u0130, A\u015fkin A, Tosun A. Inter-rater reliability of the Australian spasticity Assessment Scale in Poststroke spasticity. Int J Rehabil Res. 2022;45(1):86\u201392.","journal-title":"Int J Rehabil Res"},{"issue":"3","key":"3540_CR15","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh ML. Interrater reliability: the Kappa statistic. Biochemia Med (Zagreb). 2012;22(3):276\u201382.","journal-title":"Biochemia Med (Zagreb)"}],"container-title":["BMC Nephrology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12882-024-03540-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12882-024-03540-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12882-024-03540-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T18:02:32Z","timestamp":1710352952000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcnephrol.biomedcentral.com\/articles\/10.1186\/s12882-024-03540-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,13]]},"references-count":15,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["3540"],"URL":"https:\/\/doi.org\/10.1186\/s12882-024-03540-y","relation":{},"ISSN":["1471-2369"],"issn-type":[{"value":"1471-2369","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,13]]},"assertion":[{"value":"22 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"94"}}