{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T00:18:25Z","timestamp":1787876305691,"version":"build-2784847793"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T00:00:00Z","timestamp":1646179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychiatry"],"abstract":"<jats:sec><jats:title>Background and Objectives<\/jats:title><jats:p>The use of \u201coperational criteria\u201d is a solution for low reliability, contrasting with a prototypical classification that is used in clinics. We aim to measure the reliability of prototypical and ICD-10 diagnoses.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>This is a retrospective study, with a convenience sample of subjects treated in a university clinic. Residents reviewed their diagnosis using ICD-10 criteria, and Cohen's kappa statistic was performed on operational and prototype diagnoses.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Three out of 30 residents participated, reviewing 146 subjects under their care. Diagnoses were grouped in eight classes: organic (diagnoses from F00 to F09), substance disorders (F10\u2013F19), schizophrenia spectrum disorders (F20\u2013F29), bipolar affective disorder (F30, F31, F34.0, F38.1), depression (F32, F33), anxiety-related disorders (F40\u2013F49), personality disorders (F60\u2013F69), and neurodevelopmental disorders (F70\u2013F99). Overall, agreement was high [<jats:italic>K<\/jats:italic> = 0.77, 95% confidence interval (CI) = 0.69\u20130.85], with a lower agreement related to personality disorders (<jats:italic>K<\/jats:italic> = 0.58, 95% CI = 0.38\u20130.76) and higher with schizophrenia spectrum disorders (<jats:italic>K<\/jats:italic> = 0.91, 95% CI = 0.82\u20130.99).<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Use of ICD-10 criteria did not significantly increase the number of diagnoses. It changed few diagnoses, implying that operational criteria were irrelevant to clinical opinion. This suggests that reliability among interviewers is more related to information gathering than diagnostic definitions. Also, it suggests an incorporation of diagnostic criteria according to training, which then became part of the clinician's prototypes. Residents should be trained in the use of diagnostic categories, but presence\/absence checking is not needed to achieve operational compatible diagnoses.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fpsyt.2022.793743","type":"journal-article","created":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T05:05:32Z","timestamp":1646197532000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Intra-rater Kappa Accuracy of Prototype and ICD-10 Operational Criteria-Based Diagnoses for Mental Disorders: A Brief Report of a Cross-Sectional Study in an Outpatient Setting"],"prefix":"10.3389","volume":"13","author":[{"given":"Helio G.","family":"Rocha Neto","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tomas Boldrini","family":"Sinem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luisa Mendez","family":"Koiller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amanda Machado","family":"Pereira","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bianca Marques","family":"de Souza Gomes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos Linhares","family":"Veloso Filho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria T.","family":"Cavalcanti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diogo","family":"Telles-Correia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,3,2]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1037\/h0058417","article-title":"The reliability of psychiatric diagnoses","volume":"44","author":"Ash","year":"1949","journal-title":"J Abnorm Soc Psychol."},{"key":"B2","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1001\/archpsyc.1971.01750140027006","article-title":"Diagnostic criteria of American and British psychiatrists","volume":"25","author":"Kendell","year":"1971","journal-title":"Arch Gen Psychiatry."},{"key":"B3","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1001\/archpsyc.1977.01770140026002","article-title":"Reliability of psychiatric diagnosis: II. The test\/retest reliability of diagnostic classification","volume":"34","author":"Helzer","year":"1977","journal-title":"Arch Gen Psychiatry."},{"key":"B4","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1001\/archpsyc.1992.01820080032005","article-title":"The structured clinical interview for DSM-III-R (SCID): I: history, rationale, and description","volume":"49","author":"Spitzer","year":"1992","journal-title":"Arch Gen Psychiatry."},{"key":"B5","first-page":"26","article-title":"Do psychiatrists use structured interviews in real clinical settings?","volume":"5","author":"Aboraya","year":"2008","journal-title":"Psychiatry."},{"key":"B6","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1080\/09540260701563429","article-title":"Classification for clinical practice: How to make ICD and DSM better able to serve clinicians","volume":"19","author":"First","year":"2007","journal-title":"Int Rev Psychiatry."},{"key":"B7","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1097\/NMD.0000000000000300","article-title":"Assessment of clinical information: comparison of the validity of a structured clinical interview (the SCID) and the clinical diagnostic interview","volume":"203","author":"Drill","year":"2015","journal-title":"J Nerv Mental Dis."},{"key":"B8","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1097\/NMD.0000000000000765","article-title":"Agreement among clinician, patient, and independent interviewer ratings of adaptive functioning","volume":"206","author":"Nakash","year":"2018","journal-title":"J Nerv Mental Dis."},{"key":"B9","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.wpsyc.2012.01.004","article-title":"Prototype diagnosis of psychiatric syndromes","volume":"11","author":"Westen","year":"2012","journal-title":"World Psychiatry."},{"key":"B10","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1002\/j.2051-5545.2011.tb00019.x","article-title":"Psychiatric diagnosis: pros and cons of prototypes vs. operational criteria","volume":"10","author":"MAJ","year":"2011","journal-title":"World Psychiatry."},{"key":"B11","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1016\/j.wpsyc.2012.01.026","article-title":"Prototype diagnosis of psychiatric syndromes and the ICD-11","volume":"11","author":"Ayuso-Mateos","year":"2012","journal-title":"World Psychiatry."},{"key":"B12","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1159\/000096388","article-title":"Validation of the SWAP-200 for diagnosing psychostructural organizationin personality disorders","volume":"40","author":"Loeffler-Stastka","year":"2007","journal-title":"Psychopathology."},{"key":"B13","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1521\/pedi.2000.14.2.109","article-title":"A prototype matching approach to diagnosing personality disorders: toward DSM-V","volume":"14","author":"Westen","year":"2000","journal-title":"J Pers Disord."},{"key":"B14","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1002\/wps.20239","article-title":"Differential diagnosis and current polythetic classification","volume":"14","author":"Parnas","year":"2015","journal-title":"World Psychiatry."},{"key":"B15","first-page":"374","article-title":"An empirically based prototype diagnostic system for DSM-V and ICD-11","volume-title":"Contemporary directions in psychopathology: Scientific foundations of the DSM-V and ICD-11.","author":"Ortigo","year":"2010"},{"key":"B16","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1007\/s00406-012-0293-z","article-title":"Standardized diagnostic interviews, criteria, and algorithms for mental disorders: garbage in, garbage out","volume":"262","author":"Linden","year":"2012","journal-title":"Eur Arch Psychiatry Clin Neurosci."},{"key":"B17","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1186\/1472-6947-8-50","article-title":"Underutilization of information and knowledge in everyday medical practice: evaluation of a computer-based solution","volume":"8","author":"Zakim","year":"2008","journal-title":"BMC Med Inform Decis Mak."},{"key":"B18","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1097\/ACM.0b013e31820824cd","article-title":"Checklists to reduce diagnostic errors","volume":"86","author":"Ely","year":"2011","journal-title":"Acad Med."},{"key":"B19","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1590\/0047-2085000000208","article-title":"Clinical stability, diagnosis and catchment area: the patients of a university-based psychiatric outpatient clinic","volume":"67","author":"Oliveira IC","year":"2018","journal-title":"J Bras Psiquiatr."},{"key":"B20","unstructured":"RESOLU\u00c7\u00c3O CNRM N\u00b0 02 \/2006, de 17 de maio de 2006.2006"},{"key":"B21","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1017\/CBO9781107588714.012","article-title":"Mental illness with intellectual disabilities and autism spectrum disorders","volume-title":"Psychiatric and Behavioral Disorders in Intellectual and Developmental Disabilities.","author":"Bakken","year":"2016"},{"key":"B22","unstructured":"CarstensenB\n            PlummerM\n            LaaraE\n            HillsM\n          A Package for Statistical Analysis in Epidemiology: R Package Version 2.44.2021"},{"key":"B23","unstructured":"Quantify Interrater Agreement With Kappa."},{"key":"B24","author":"Fox","year":"2020","journal-title":"Rcmdr: R Commander"},{"key":"B25","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ Psychol Meas."},{"key":"B26","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: the kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochemia Medica."},{"key":"B27","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/j.cct.2017.08.006","article-title":"Recruitment methods for survey research: findings from the Mid-South Clinical Data Research Network","volume":"62","author":"Heerman","year":"2017","journal-title":"Contemp Clin Trials."},{"key":"B28","unstructured":"Demografia No Brasil M\u00e9dica."},{"key":"B29","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1353\/ppp.0.0123","article-title":"Clinicians' folk taxonomies of mental disorders","volume":"14","author":"Flanagan","year":"2008","journal-title":"Philos Psychiatry Psychol."},{"key":"B30","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1002\/jclp.22145","article-title":"Categories that should be removed from mental disorders classifications: perspectives and rationales of clinicians from eight countries","volume":"71","author":"Robles","year":"2015","journal-title":"J Clin Psychol."},{"key":"B31","first-page":"13","article-title":"Medical decision making","volume-title":"Diagnosis: Interpreting the Shadows.","author":"Cosby","year":""},{"key":"B32","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1192\/bjp.bp.106.024026","article-title":"Diagnostic stability of psychiatric disorders in clinical practice","volume":"190","author":"Baca-Garcia","year":"2007","journal-title":"Br J Psychiatry."},{"key":"B33","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1176\/appi.ajp.160.1.4","article-title":"Distinguishing between the validity and utility of psychiatric diagnoses","volume":"160","author":"Kendell","year":"2003","journal-title":"Am J Psychiatry."},{"key":"B34","doi-asserted-by":"publisher","first-page":"462","DOI":"10.3758\/BF03197480","article-title":"Natural categories: well defined or fuzzy sets?","volume":"6","author":"McCloskey","year":"1978","journal-title":"Mem Cogn."},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1111\/jep.13592.","article-title":"How to define today a medical disorder? Biological and psychosocial disadvantages as the paramount criteria","author":"Telles Correia","year":"2021","journal-title":"J Eval Clin Pract."},{"key":"B36","doi-asserted-by":"crossref","DOI":"10.1037\/e448242006-001","article-title":"Diagnostic failure: A cognitive and affective approach","volume-title":"Advances in Patient Safety: From Research to Implementation (Volume 2: Concepts and Methodology).","author":"Croskerry","year":"2005"},{"key":"B37","doi-asserted-by":"publisher","first-page":"e12267","DOI":"10.2427\/12267","article-title":"Guidelines of the minimum sample size requirements for Cohen's Kappa","volume":"14","author":"Bujang","year":"2017","journal-title":"Epidemiol Biostat Public Health."},{"key":"B38","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1176\/appi.ajp.2012.12070998","article-title":"DSM-5 field trials in the United States and Canada, part I: study design, sampling strategy, implementation, and analytic approaches","volume":"170","author":"Clarke","year":"2013","journal-title":"Am J Psychiatry."}],"container-title":["Frontiers in Psychiatry"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2022.793743\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T05:05:42Z","timestamp":1646197542000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2022.793743\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,2]]},"references-count":38,"alternative-id":["10.3389\/fpsyt.2022.793743"],"URL":"https:\/\/doi.org\/10.3389\/fpsyt.2022.793743","relation":{},"ISSN":["1664-0640"],"issn-type":[{"value":"1664-0640","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,2]]},"article-number":"793743"}}