{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,14]],"date-time":"2026-11-14T19:15:11Z","timestamp":1794683711307,"version":"4.9.1"},"reference-count":52,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2018,5,24]],"date-time":"2018-05-24T00:00:00Z","timestamp":1527120000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["World Psychiatry"],"published-print":{"date-parts":[[2018,6]]},"abstract":"<jats:p>Reliable, clinically useful, and globally applicable diagnostic classification of mental disorders is an essential foundation for global mental health. The World Health Organization (WHO) is nearing completion of the 11th revision of the International Classification of Diseases and Related Health Problems (ICD\u201011). The present study assessed inter\u2010diagnostician reliability of mental disorders accounting for the greatest proportion of global disease burden and the highest levels of service utilization \u2013 schizophrenia and other primary psychotic disorders, mood disorders, anxiety and fear\u2010related disorders, and disorders specifically associated with stress \u2013 among adult patients presenting for treatment at 28 participating centers in 13 countries. A concurrent joint\u2010rater design was used, focusing specifically on whether two clinicians, relying on the same clinical information, agreed on the diagnosis when separately applying the ICD\u201011 diagnostic guidelines. A total of 1,806 patients were assessed by 339 clinicians in the local language. Intraclass kappa coefficients for diagnoses weighted by site and study prevalence ranged from 0.45 (dysthymic disorder) to 0.88 (social anxiety disorder) and would be considered moderate to almost perfect for all diagnoses. Overall, the reliability of the ICD\u201011 diagnostic guidelines was superior to that previously reported for equivalent ICD\u201010 guidelines. These data provide support for the suitability of the ICD\u201011 diagnostic guidelines for implementation at a global level. The findings will inform further revision of the ICD\u201011 diagnostic guidelines prior to their publication and the development of programs to support professional training and implementation of the ICD\u201011 by WHO member states.<\/jats:p>","DOI":"10.1002\/wps.20524","type":"journal-article","created":{"date-parts":[[2018,5,31]],"date-time":"2018-05-31T23:56:07Z","timestamp":1527810967000},"page":"174-186","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":116,"title":["The ICD\u201011 developmental field study of reliability of diagnoses of high\u2010burden mental disorders: results among adult patients in mental health settings of 13 countries"],"prefix":"10.1002","volume":"17","author":[{"given":"Geoffrey M.","family":"Reed","sequence":"first","affiliation":[{"name":"Department of Psychiatry Columbia University College of Physicians and Surgeons New York NY USA"},{"name":"National Institute of Psychiatry Ram\u00f3n de la Fuente Mu\u00f1iz Mexico City Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pratap","family":"Sharan","sequence":"additional","affiliation":[{"name":"Department of Psychiatry All India Institute of Medical Sciences New Delhi India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tahilia J.","family":"Rebello","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Columbia University College of Physicians and Surgeons New York NY USA"},{"name":"New York State Psychiatric Institute New York NY USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jared W.","family":"Keeley","sequence":"additional","affiliation":[{"name":"Department of Psychology Virginia Commonwealth University Richmond VA USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mar\u00eda","family":"Elena Medina\u2010Mora","sequence":"additional","affiliation":[{"name":"National Institute of Psychiatry Ram\u00f3n de la Fuente Mu\u00f1iz Mexico City Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oye","family":"Gureje","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Ibadan  Nigeria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jos\u00e9","family":"Luis Ayuso\u2010Mateos","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Universidad Autonoma de Madrid, IIS\u2010P and Instituto de Salud Carlos III, Centro de Investigaci\u00f3n Biom\u00e9dica en Red de Salud Mental (CIBERSAM) Madrid Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shigenobu","family":"Kanba","sequence":"additional","affiliation":[{"name":"Department of Neuropsychiatry Kyushu University Fukuoka City Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brigitte","family":"Khoury","sequence":"additional","affiliation":[{"name":"Department of Psychiatry American University of Beirut Medical Center Beirut Lebanon"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cary S.","family":"Kogan","sequence":"additional","affiliation":[{"name":"School of Psychology University of Ottawa Ottawa Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valery N.","family":"Krasnov","sequence":"additional","affiliation":[{"name":"Moscow Research Institute of Psychiatry, National Medical Research Centre for Psychiatry and Narcology Moscow Russian Federation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mario","family":"Maj","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Campania \u201cL. Vanvitelli\u201d Naples Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jair","family":"de Jesus Mari","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Universidade Federal de S\u00e3o Paulo S\u00e3o Paulo Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dan J.","family":"Stein","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Cape Town and South African Medical Research Council Unit on Risk and Resilience in Mental Disorders Cape Town South Africa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min","family":"Zhao","sequence":"additional","affiliation":[{"name":"Shanghai Mental Health Center and Department of Psychiatry Shanghai Jiao Tong University School of Medicine Shanghai People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tsuyoshi","family":"Akiyama","sequence":"additional","affiliation":[{"name":"NTT Medical Center Tokyo Tokyo Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Howard F.","family":"Andrews","sequence":"additional","affiliation":[{"name":"New York State Psychiatric Institute New York NY USA"},{"name":"Departments of Biostatistics and Psychiatry Columbia University College of Physicians and Surgeons New York NY USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elson","family":"Asevedo","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Universidade Federal de S\u00e3o Paulo S\u00e3o Paulo Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Majda","family":"Cheour","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Tunis Al Manar University and Al Razi Hospital Tunis Tunisia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tecelli","family":"Dom\u00ednguez\u2010Mart\u00ednez","sequence":"additional","affiliation":[{"name":"National Institute of Psychiatry Ram\u00f3n de la Fuente Mu\u00f1iz Mexico City Mexico"},{"name":"C\u00e1tedras CONACYT, National Council for Science and Technology Mexico City Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph","family":"El\u2010Khoury","sequence":"additional","affiliation":[{"name":"Department of Psychiatry American University of Beirut Medical Center Beirut Lebanon"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"Fiorillo","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Campania \u201cL. Vanvitelli\u201d Naples Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jean","family":"Grenier","sequence":"additional","affiliation":[{"name":"Institut du Savoir Montfort \u2010 H\u00f4pital Montfort &amp; Universit\u00e9 d'Ottawa Ottawa Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nitin","family":"Gupta","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Government Medical College and Hospital Chandigarh India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lola","family":"Kola","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Ibadan  Nigeria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maya","family":"Kulygina","sequence":"additional","affiliation":[{"name":"Moscow Research Institute of Psychiatry, National Medical Research Centre for Psychiatry and Narcology Moscow Russian Federation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Itziar","family":"Leal\u2010Leturia","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Universidad Autonoma de Madrid, IIS\u2010P and Instituto de Salud Carlos III, Centro de Investigaci\u00f3n Biom\u00e9dica en Red de Salud Mental (CIBERSAM) Madrid Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mario","family":"Luciano","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Campania \u201cL. Vanvitelli\u201d Naples Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bulumko","family":"Lusu","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Cape Town and South African Medical Research Council Unit on Risk and Resilience in Mental Disorders Cape Town South Africa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J.","family":"Nicolas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"I.","family":"Mart\u00ednez\u2010L\u00f3pez","sequence":"additional","affiliation":[{"name":"National Institute of Psychiatry Ram\u00f3n de la Fuente Mu\u00f1iz Mexico City Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chihiro","family":"Matsumoto","sequence":"additional","affiliation":[{"name":"Japanese Society of Psychiatry and Neurology Tokyo Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucky","family":"Umukoro Onofa","sequence":"additional","affiliation":[{"name":"Federal Neuropsychiatric Hospital Aro Abeokuta Nigeria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sabrina","family":"Paterniti","sequence":"additional","affiliation":[{"name":"Institute of Mental Health Research, Royal Ottawa Mental Health Centre, and Department of Psychiatry, University of Ottawa  Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shivani","family":"Purnima","sequence":"additional","affiliation":[{"name":"Department of Psychiatry All India Institute of Medical Sciences New Delhi India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rebeca","family":"Robles","sequence":"additional","affiliation":[{"name":"National Institute of Psychiatry Ram\u00f3n de la Fuente Mu\u00f1iz Mexico City Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manoj K.","family":"Sahu","sequence":"additional","affiliation":[{"name":"Pt. Jawahar Lal Nehru Memorial Medical College Raipur Chhattisgarh India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Goodman","family":"Sibeko","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Cape Town and South African Medical Research Council Unit on Risk and Resilience in Mental Disorders Cape Town South Africa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Na","family":"Zhong","sequence":"additional","affiliation":[{"name":"Shanghai Mental Health Center and Department of Psychiatry Shanghai Jiao Tong University School of Medicine Shanghai People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael B.","family":"First","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Columbia University College of Physicians and Surgeons New York NY USA"},{"name":"New York State Psychiatric Institute New York NY USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wolfgang","family":"Gaebel","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Psychotherapy, Medical Faculty Heinrich\u2010Heine University D\u00fcsseldorf Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne M.","family":"Lovell","sequence":"additional","affiliation":[{"name":"Institut National de la Sant\u00e9 et de la Recherche M\u00e9dicale U988 Paris France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Toshimasa","family":"Maruta","sequence":"additional","affiliation":[{"name":"Health Management Center, Seitoku University Matsudo City Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael C.","family":"Roberts","sequence":"additional","affiliation":[{"name":"Office of Graduate Studies and Clinical Child Psychology Program University of Kansas Lawrence KS USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathleen M.","family":"Pike","sequence":"additional","affiliation":[{"name":"Department of Psychiatry Columbia University College of Physicians and Surgeons New York NY USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2018,5,24]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2051-5545.2011.tb00022.x"},{"key":"e_1_2_7_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.22031"},{"key":"e_1_2_7_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/schbul\/sbs104"},{"issue":"1","key":"e_1_2_7_5_1","article-title":"The ICD\u201011 classification of mood and anxiety disorders: background and options","volume":"11","author":"Maj M","year":"2012","journal-title":"World Psychiatry"},{"key":"e_1_2_7_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/wps.20057"},{"key":"e_1_2_7_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2015.10.061"},{"key":"e_1_2_7_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/da.22530"},{"key":"e_1_2_7_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(14)61995-4"},{"key":"e_1_2_7_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijchp.2015.09.002"},{"key":"e_1_2_7_11_1","volume-title":"The ICD\u201010 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines","author":"World Health Organization","year":"1992"},{"key":"e_1_2_7_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijchp.2014.12.001"},{"key":"e_1_2_7_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0039972"},{"key":"e_1_2_7_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/wps.20189"},{"key":"e_1_2_7_15_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0021701"},{"key":"e_1_2_7_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/wps.20322"},{"key":"e_1_2_7_17_1","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.1993.01820140037004"},{"key":"e_1_2_7_18_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0016607"},{"key":"e_1_2_7_19_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-clinpsy-032813-153639"},{"key":"e_1_2_7_20_1","first-page":"601","article-title":"Classification of mental disorders","volume":"21","author":"Stengel E.","year":"1959","journal-title":"Bull World Health Organ"},{"key":"e_1_2_7_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-349-03753-7_1"},{"key":"e_1_2_7_22_1","volume-title":"Glossary of mental disorders and guide to their classification","author":"World Health Organization","year":"1974"},{"key":"e_1_2_7_23_1","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.119.4.351"},{"key":"e_1_2_7_24_1","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.1962.01720030044006"},{"key":"e_1_2_7_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.schres.2012.03.026"},{"key":"e_1_2_7_26_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2012.12070999"},{"key":"e_1_2_7_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/abn0000069"},{"key":"e_1_2_7_28_1","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.151.8.1163"},{"key":"e_1_2_7_29_1","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.144.3.351"},{"key":"e_1_2_7_30_1","doi-asserted-by":"publisher","DOI":"10.1002\/mpr.1382"},{"key":"e_1_2_7_31_1","first-page":"41","article-title":"The reliability of psychiatric diagnosis revisited: the clinician's guide to improve the reliability of psychiatric diagnosis","volume":"3","author":"Aboraya A","year":"2006","journal-title":"Psychiatry"},{"key":"e_1_2_7_32_1","first-page":"24","article-title":"Counterpoint \u2013 there isn't enough evidence available to speculate on the reliability of diagnoses in clinical settings","volume":"4","author":"First MB.","year":"2007","journal-title":"Psychiatry"},{"key":"e_1_2_7_33_1","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.136.6.815"},{"key":"e_1_2_7_34_1","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.152.10.1427"},{"key":"e_1_2_7_35_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2012.12070998"},{"key":"e_1_2_7_36_1","doi-asserted-by":"publisher","DOI":"10.15288\/jsad.2009.70.475"},{"key":"e_1_2_7_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2215-0366(16)00048-1"},{"key":"e_1_2_7_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(13)61611-6"},{"key":"e_1_2_7_39_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_7_40_1","doi-asserted-by":"publisher","DOI":"10.3109\/00048679509075901"},{"key":"e_1_2_7_41_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpp.693"},{"key":"e_1_2_7_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpain.2015.10.014"},{"key":"e_1_2_7_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2009.03.001"},{"issue":"1","key":"e_1_2_7_44_1","first-page":"89","article-title":"Agoraphobia and panic disorder: options for ICD\u201011","volume":"11","author":"Stein DJ.","year":"2012","journal-title":"World Psychiatry"},{"issue":"1","key":"e_1_2_7_45_1","first-page":"94","article-title":"Specific and social phobias in ICD\u201011","volume":"11","author":"Emmelkamp PMG.","year":"2012","journal-title":"World Psychiatry"},{"key":"e_1_2_7_46_1","doi-asserted-by":"publisher","DOI":"10.1097\/NMD.0b013e31816a4952"},{"key":"e_1_2_7_47_1","doi-asserted-by":"publisher","DOI":"10.1111\/bdi.12340"},{"key":"e_1_2_7_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eurpsy.2010.03.010"},{"key":"e_1_2_7_49_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291710000206"},{"key":"e_1_2_7_50_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1024732727414"},{"key":"e_1_2_7_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2017.09.001"},{"key":"e_1_2_7_52_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-clinpsy-032813-153739"},{"key":"e_1_2_7_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2215-0366(15)00183-2"}],"container-title":["World Psychiatry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fwps.20524","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/wps.20524","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,23]],"date-time":"2023-09-23T19:32:01Z","timestamp":1695497521000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/wps.20524"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,24]]},"references-count":52,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,6]]}},"alternative-id":["10.1002\/wps.20524"],"URL":"https:\/\/doi.org\/10.1002\/wps.20524","archive":["Portico"],"relation":{},"ISSN":["1723-8617","2051-5545"],"issn-type":[{"value":"1723-8617","type":"print"},{"value":"2051-5545","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,5,24]]},"assertion":[{"value":"2018-05-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}