{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T20:58:26Z","timestamp":1790888306561,"version":"4.1.0"},"reference-count":24,"publisher":"Universidad Nacional de C\u00f3rdoba","issue":"3","license":[{"start":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T00:00:00Z","timestamp":1790640000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Rev Fac Cien Med Univ Nac Cordoba"],"abstract":"<jats:p>Introducci\u00f3n: En muchas oportunidades, se requiere establecer el grado de acuerdo entre dos o m\u00e1s observadores, ya sea como un fin en s\u00ed mismo o como paso intermedio en una investigaci\u00f3n. En este tipo de estudios, la elecci\u00f3n del dise\u00f1o adecuado es crucial, ya que influye en la aplicabilidad y generalizaci\u00f3n de los m\u00e9todos. Objetivos: En este art\u00edculo presentaremos -a prop\u00f3sito de un caso real de un trabajo que todav\u00eda est\u00e1 en curso- la metodolog\u00eda para estimar el grado de acuerdo entre dos o m\u00e1s observadores respecto de una variable categ\u00f3rica. Materiales y m\u00e9todos: Para la definici\u00f3n de los coeficientes utilizados se realiz\u00f3 una b\u00fasqueda bibliogr\u00e1fica en Pubmed y en Google Scholar. Resultados: Se propone el uso del kappa de Fleiss ponderado y el AC2 de Gwet como m\u00e9tricas de acuerdo para este problema. El AC2 es un coeficiente nuevo que permite superar algunas de las limitaciones relacionadas con el kappa, en particular las paradojas descritas por Feinstein y Cichetti. Conclusi\u00f3n: En este art\u00edculo presentamos el dise\u00f1o de un estudio para evaluar el grado de acuerdo interobservador y describimos en forma detallada la metodolog\u00eda, incluyendo las caracter\u00edsticas de las jueces, de los sujetos y las categor\u00edas a evaluar, la elecci\u00f3n del coeficiente de acuerdo y su interpretaci\u00f3n y el c\u00e1lculo de los intervalos de confianza.<\/jats:p>","DOI":"10.31053\/1853.0605.v83.n3.50187","type":"journal-article","created":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T20:21:25Z","timestamp":1790886085000},"page":"e50187","source":"Crossref","is-referenced-by-count":0,"title":["C\u00f3mo dise\u00f1ar un estudio de confiabilidad interobservador para variables categ\u00f3ricas","How to design an interobserver reliability study for categorical variables","Como elaborar um estudo de confiabilidade interobservador para vari\u00e1veis categ\u00f3ricas"],"prefix":"10.31053","volume":"83","author":[{"given":"Ana Beatriz","family":"Rusconi Lagarrigue","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5218-5241","authenticated-orcid":false,"given":"Sebasti\u00e1n Andr\u00e9s","family":"Sguiglia Sch\u00fctz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victoria","family":"Guarnieri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8557-1926","authenticated-orcid":false,"given":"Eliana Ludmila","family":"Frutos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pedro","family":"Mirsky","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julieta","family":"Caridi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martina","family":"Micheletti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manuela","family":"Velloso Colombres","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8323-9233","authenticated-orcid":false,"given":"Mar\u00eda Florencia","family":"Bertarini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-3033-6773","authenticated-orcid":false,"given":"Noelia","family":"Capellato","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mar\u00eda Virginia","family":"Campoy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4481-8563","authenticated-orcid":false,"given":"Mar\u00eda Eugenia","family":"P\u00e9rez Corti\u00f1as","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1103-0905","authenticated-orcid":false,"given":"Anah\u00ed Lorena","family":"Belatti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6315-7916","authenticated-orcid":false,"given":"Luis Daniel","family":"Mazzuoccolo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2748-0801","authenticated-orcid":false,"given":"M\u00f3nica Beatriz","family":"Senillosa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5606-8210","authenticated-orcid":false,"given":"Gast\u00f3n","family":"Perman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5246-0709","authenticated-orcid":false,"given":"Sergio Adri\u00e1n","family":"Terrasa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1403-7069","authenticated-orcid":false,"given":"Mar\u00eda Lourdes","family":"Posadas Mart\u00ednez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6648-1984","authenticated-orcid":false,"given":"Sonia Elizabeth","family":"Ben\u00edtez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"12333","published-online":{"date-parts":[[2026,9,29]]},"reference":[{"key":"ref0","doi-asserted-by":"publisher","unstructured":"1. Anvari A, Halpern EF, Samir AE. Statistics 101 for Radiologists. Radiographics. 2015 Oct;35(6):1789-801. doi: 10.1148\/rg.2015150112.","DOI":"10.1148\/rg.2015150112"},{"key":"ref1","unstructured":"2. Gwet KL. Handbook of Inter-Rater Reliability. The Definitive Guide to Measuring the Extent of Agreement Among Raters. Volume 1: Analysis of Categorical Ratings. 5\u00b0 ed. AgreeStat Analytics; 2021."},{"key":"ref2","unstructured":"3. Norman GR, Streiner SL. Biostatistics: The Bare Essentials. 4\u00b0 ed: EEUU: PMPH; 2014."},{"key":"ref3","doi-asserted-by":"publisher","unstructured":"4. Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005 Mar;85(3):257-68.","DOI":"10.1093\/ptj\/85.3.257"},{"issue":"1","key":"ref4","doi-asserted-by":"publisher","first-page":"23","DOI":"10.20982\/tqmp.08.1.p023","article-title":"Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial","volume":"8","author":"Hallgren","year":"2012","unstructured":"5. Hallgren KA. Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. Tutor Quant Methods Psychol. 2012;8(1):23-34.","journal-title":"Tutor Quant Methods Psychol"},{"key":"ref5","doi-asserted-by":"publisher","unstructured":"6. Edsberg LE, Black JM, Goldberg M, McNichol L, Moore L, Sieggreen M. Revised National Pressure Ulcer Advisory Panel Pressure Injury Staging System: Revised Pressure Injury Staging System. J Wound Ostomy Continence Nurs. 2016 Nov\/Dec;43(6):585-597. doi: 10.1097\/WON.0000000000000281.","DOI":"10.1097\/WON.0000000000000281"},{"key":"ref6","doi-asserted-by":"publisher","unstructured":"7. Cardoso JR, Pereira LM, Iversen MD, Ramos AL. What is gold standard and what is ground truth? Dental Press J Orthod. 2014 Sep-Oct;19(5):27-30. doi: 10.1590\/2176-9451.19.5.027-030.ebo.","DOI":"10.1590\/2176-9451.19.5.027-030.ebo"},{"key":"ref7","doi-asserted-by":"publisher","unstructured":"8. Yang F, Zamzmi G, Angara S, Rajaraman S, Aquilina A, Xue Z, Jaeger S, Papagiannakis E, Antani SK. Assessing Inter-Annotator Agreement for Medical Image Segmentation. IEEE Access. 2023;11:21300-21312. doi: 10.1109\/access.2023.3249759.","DOI":"10.1109\/ACCESS.2023.3249759"},{"key":"ref8","unstructured":"9. Zhong X, Nagase T, Huang L, Kaitani T, Iizaka S, Yamamoto Y, Kanazawa T, Sanada H. Reliability and validity of the Chinese version of DESIGN-R, an assessment instrument for pressure ulcers . Ostomy Wound Manage. 2013 Feb;59(2):36-43."},{"key":"ref9","doi-asserted-by":"publisher","unstructured":"10. Norman GR, Rosenthal D, Brooks LR, Allen SW, Muzzin LJ. The development of expertise in dermatology. Arch Dermatol. 1989 Aug;125(8):1063-8.","DOI":"10.1001\/archderm.1989.01670200039005"},{"key":"ref10","unstructured":"11. Sekachev B, Manovich N, Zhiltsov M, Zhavoronkov A, Kalinin D, Hoff B, TOsmanov, Kruchinin D, Zankevic A, Sidnev D, Markelov M, Johannes222, Chenuet M, a-andre, telenachos, Melnikov A, Kim J, Ilouz L, Glazov N, Priya4607, Tehrani R, Jeong S, Skubriev V, Yonekura S, truong V, zliang712, lizhming, Truong T. opencv\/cvat. Versi\u00f3n 1.1.0 [software]. 2020. doi: 10.5281\/zenodo.4009388."},{"key":"ref11","doi-asserted-by":"publisher","unstructured":"12. Cohen JA. Coefficient of Agreement for Nominal Scales. Educ Psychol Meas. 1960; 20(1):37-46. doi: 10.1177\/001316446002000104.","DOI":"10.1177\/001316446002000104"},{"key":"ref12","doi-asserted-by":"publisher","unstructured":"13. Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull. 1971;76(5):378-82. doi: 10.1037\/h0031619.","DOI":"10.1037\/h0031619"},{"key":"ref13","doi-asserted-by":"publisher","unstructured":"14. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159-74.","DOI":"10.2307\/2529310"},{"key":"ref14","doi-asserted-by":"publisher","unstructured":"15. Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543-9. doi: 10.1016\/0895-4356(90)90158-l.","DOI":"10.1016\/0895-4356(90)90158-L"},{"key":"ref15","doi-asserted-by":"publisher","unstructured":"16. Gwet KL. Computing inter-rater reliability and its variance in the presence of high agreement. Br J Math Stat Psychol. 2008 May;61(Pt 1):29-48. doi: 10.1348\/000711006X126600.","DOI":"10.1348\/000711006X126600"},{"key":"ref16","doi-asserted-by":"publisher","unstructured":"17. Shankar V, Bangdiwala SI. Observer agreement paradoxes in 2x2 tables: comparison of agreement measures. BMC Med Res Methodol. 2014 Aug 28;14:100. doi: 10.1186\/1471-2288-14-100.","DOI":"10.1186\/1471-2288-14-100"},{"key":"ref17","doi-asserted-by":"publisher","unstructured":"18. Vach W, Gerke O. Gwet's AC1 is not a substitute for Cohen's kappa - A comparison of basic properties. MethodsX. 2023 May 10;10:102212. doi: 10.1016\/j.mex.2023.102212.","DOI":"10.1016\/j.mex.2023.102212"},{"key":"ref18","doi-asserted-by":"publisher","unstructured":"19. Chmura Kraemer H, Periyakoil VS, Noda A. Kappa coefficients in medical research. Stat Med. 2002 Jul 30;21(14):2109-29. doi: 10.1002\/sim.1180.","DOI":"10.1002\/sim.1180"},{"key":"ref19","doi-asserted-by":"publisher","unstructured":"20. Li M, Gao Q, Yu T. Kappa statistic considerations in evaluating inter-rater reliability between two raters: which, when and context matters. BMC Cancer. 2023 Aug 25;23(1):799. doi: 10.1186\/s12885-023-11325-z.","DOI":"10.1186\/s12885-023-11325-z"},{"key":"ref20","unstructured":"21. Gwet KL. irrCAC: Computing Chance-Corrected Agreement Coefficients (CAC). Version 1.0 [software]. 2019. Disponible en: https:\/\/cran.r-project.org\/web\/packages\/irrCAC\/index.html"},{"key":"ref21","doi-asserted-by":"publisher","unstructured":"22. Gwet KL. Large-Sample Variance of Fleiss Generalized Kappa. Educ Psychol Meas. 2021 Aug;81(4):781-790. doi: 10.1177\/0013164420973080.","DOI":"10.1177\/0013164420973080"},{"key":"ref22","doi-asserted-by":"publisher","unstructured":"23. Mkungudza J, Twabi HS, Manda SOM. Development of a diagnostic predictive model for determining child stunting in Malawi: a comparative analysis of variable selection approaches. BMC Med Res Methodol. 2024 Aug 8;24(1):175. doi: 10.1186\/s12874-024-02283-6.","DOI":"10.1186\/s12874-024-02283-6"},{"key":"ref23","unstructured":"1"}],"container-title":["Revista de la Facultad de Ciencias M\u00e9dicas de C\u00f3rdoba"],"original-title":[],"link":[{"URL":"https:\/\/revistas.unc.edu.ar\/index.php\/med\/article\/download\/50187\/56005","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/revistas.unc.edu.ar\/index.php\/med\/article\/download\/50187\/56014","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/revistas.unc.edu.ar\/index.php\/med\/article\/download\/50187\/56005","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T20:22:40Z","timestamp":1790886160000},"score":1,"resource":{"primary":{"URL":"https:\/\/revistas.unc.edu.ar\/index.php\/med\/article\/view\/50187"}},"subtitle":["revisi\u00f3n de la literatura","a literature review","uma revis\u00e3o da literatura"],"short-title":[],"issued":{"date-parts":[[2026,9,29]]},"references-count":24,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,8,4]]}},"URL":"https:\/\/doi.org\/10.31053\/1853.0605.v83.n3.50187","relation":{},"ISSN":["1853-0605","0014-6722"],"issn-type":[{"value":"1853-0605","type":"electronic"},{"value":"0014-6722","type":"print"}],"subject":[],"published":{"date-parts":[[2026,9,29]]}}}