{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,17]],"date-time":"2026-01-17T16:54:20Z","timestamp":1768668860225,"version":"3.49.0"},"reference-count":32,"publisher":"Public Library of Science (PLoS)","issue":"8","license":[{"start":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T00:00:00Z","timestamp":1629331200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Innovation Fund Health Insurers","award":["2832"],"award-info":[{"award-number":["2832"]}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:sec id=\"sec001\">\n<jats:title>Background<\/jats:title>\n<jats:p>Early identification of patients with an anxiety disorder, obsessive-compulsive disorder (OCD), or post-traumatic stress disorder (PTSD) in need of highly specialized care could facilitate the selection of the optimal initial treatment in these patients. This paper describes the development and psychometric evaluation of the Decision Tool Anxiety Disorders, OCD and PTSD (DTAOP), which aims to aid clinicians in the early identification of patients with an anxiety disorder, OCD, or PTSD in need of highly specialized mental healthcare.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec002\">\n<jats:title>Methods<\/jats:title>\n<jats:p>A systematic literature review and a concept mapping procedure were carried out to inform the development of the DTAOP. To evaluate the psychometric properties of the DTAOP, a cross-sectional study in 454 patients with a DSM-IV-TR anxiety disorder was carried out. Feasibility was evaluated by the completion time and the content clarity of the DTAOP. Inter-rater reliability was assessed in a subsample of 87 patients. Spearman\u2019s rank correlation coefficients between the DTAOP and EuroQol five-dimensional questionnaire (EQ-5D-5L) scores were computed to examine the convergent validity. Criterion validity was assessed against independent clinical judgments made by clinicians.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec003\">\n<jats:title>Results<\/jats:title>\n<jats:p>The average time required to complete the eight-item DTAOP was 4.6 min and the total DTAOP was evaluated as clear in the majority (93%) of the evaluations. Krippendorff\u2019s alpha estimates ranged from 0.427 to 0.839. Based on the qualitative feedback, item wording and instructions were improved. As hypothesized, the DTAOP correlated negatively with EQ-5D-5L scores. The area under the curve was 0.826 and the cut-off score of \u22654 optimized sensitivity (70%) and specificity (71%).<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec004\">\n<jats:title>Conclusions<\/jats:title>\n<jats:p>The DTAOP demonstrated excellent feasibility and good validity, but weak inter-rater reliability. Based on the qualitative feedback and reliability estimates, revisions and refinements of the wording and instructions were made, resulting in the final version of the DTAOP.<\/jats:p>\n<\/jats:sec>","DOI":"10.1371\/journal.pone.0256384","type":"journal-article","created":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T18:12:15Z","timestamp":1629396735000},"page":"e0256384","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":3,"title":["Development and psychometric evaluation of the Decision Tool Anxiety Disorders, OCD and PTSD (DTAOP): Facilitating the early detection of patients in need of highly specialized care"],"prefix":"10.1371","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8592-3581","authenticated-orcid":true,"given":"Fr\u00e9d\u00e9rique C. W.","family":"van Krugten","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Meriam","family":"Kaddouri","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maartje","family":"Goorden","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anton J. L. M.","family":"van Balkom","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ed W.","family":"Berretty","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dani\u00eblle C.","family":"Cath","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gert-Jan","family":"Hendriks","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5537-112X","authenticated-orcid":true,"given":"Suzy J. M. A.","family":"Matthijssen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Henny A. D.","family":"Visser","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Irene M.","family":"van Vliet","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Werner B. F.","family":"Brouwer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leona","family":"Hakkaart-van Roijen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2021,8,19]]},"reference":[{"issue":"1","key":"pone.0256384.ref001","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1037\/0882-7974.22.1.8","article-title":"Evidence-based psychological treatments for late-life anxiety","volume":"22","author":"CR Ayers","year":"2007","journal-title":"Psychol Aging"},{"issue":"11","key":"pone.0256384.ref002","first-page":"37","article-title":"Psychotherapy for generalized anxiety disorder","volume":"62","author":"TD Borkovec","year":"2001","journal-title":"J Clin Psychiatry"},{"issue":"19","key":"pone.0256384.ref003","doi-asserted-by":"crossref","first-page":"1921","DOI":"10.1001\/jama.2010.608","article-title":"Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial","volume":"303","author":"P Roy-Byrne","year":"2010","journal-title":"JAMA"},{"issue":"4","key":"pone.0256384.ref004","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1037\/0022-006X.68.4.549","article-title":"Recommendations for a cost-offset model of psychotherapy allocation using generalized anxiety disorder as an example","volume":"68","author":"MG Newman","year":"2000","journal-title":"J Consult Clin Psychol"},{"key":"pone.0256384.ref005","article-title":"Organization of services for mental health","author":"World Health Organization","year":"2003","journal-title":"Organization of services for mental health"},{"issue":"2","key":"pone.0256384.ref006","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1177\/070674370004500209","article-title":"Tertiary mental health services: I. Key concepts","volume":"45","author":"D Wasylenki","year":"2000","journal-title":"Can J Psychiatry"},{"issue":"2","key":"pone.0256384.ref007","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1177\/070674370004500210","article-title":"Tertiary mental health services: II. Subpopulations and best practices for service delivery","volume":"45","author":"J Cochrane","year":"2000","journal-title":"Can J Psychiatry"},{"issue":"5","key":"pone.0256384.ref008","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1017\/S1461145710001434","article-title":"Evidence-based pharmacological treatment of generalized anxiety disorder","volume":"14","author":"DS Baldwin","year":"2011","journal-title":"International Journal of Neuropsychopharmacology"},{"issue":"3","key":"pone.0256384.ref009","doi-asserted-by":"crossref","first-page":"233","DOI":"10.4088\/JCP.12m07657","article-title":"Five-year course of obsessive-compulsive disorder: predictors of remission and relapse","volume":"74","author":"JL Eisen","year":"2013","journal-title":"J Clin Psychiatry"},{"issue":"5","key":"pone.0256384.ref010","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1016\/j.janxdis.2012.02.010","article-title":"Non-adherence and non-response in the treatment of anxiety disorders","volume":"26","author":"S Taylor","year":"2012","journal-title":"J Anxiety Disord"},{"issue":"1","key":"pone.0256384.ref011","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12888-020-02753-3","article-title":"A systematic review of validated screening tools for anxiety disorders and PTSD in low to middle income countries","volume":"20","author":"AY Mughal","year":"2020","journal-title":"BMC psychiatry"},{"issue":"4","key":"pone.0256384.ref012","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1037\/0022-006X.68.4.547","article-title":"Introduction to the special section on stepped care models in psychotherapy","volume":"68","author":"DA Haaga","year":"2000","journal-title":"J Consult Clin Psychol"},{"issue":"2","key":"pone.0256384.ref013","doi-asserted-by":"crossref","first-page":"e0171659","DOI":"10.1371\/journal.pone.0171659","article-title":"Indicators of patients with major depressive disorder in need of highly specialized care: A systematic review","volume":"12","author":"FC van Krugten","year":"2017","journal-title":"PLoS One"},{"issue":"4","key":"pone.0256384.ref014","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1002\/da.22741","article-title":"Indicators to facilitate the early identification of patients with major depressive disorder in need of highly specialized care: A concept mapping study","volume":"35","author":"F van Krugten","year":"2018","journal-title":"Depress Anxiety"},{"issue":"10","key":"pone.0256384.ref015","first-page":"e1","article-title":"The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration","volume":"62","author":"A Liberati","year":"2009","journal-title":"BMJ"},{"key":"pone.0256384.ref016","volume-title":"142nd APHA Annual Meeting and Exposition (November 15-November 19, 2014)","year":"2014"},{"issue":"1","key":"pone.0256384.ref017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0149-7189(89)90016-5","article-title":"An introduction to concept mapping for planning and evaluation","volume":"12","author":"WM Trochim","year":"1989","journal-title":"Eval Program Plann"},{"key":"pone.0256384.ref018","article-title":"The reliability of concept mapping","year":"1993","journal-title":"annual conference of the American Evaluation Association"},{"key":"pone.0256384.ref019","doi-asserted-by":"crossref","DOI":"10.1176\/appi.books.9780890423349","author":"American Psychiatric Association","year":"2000","journal-title":"Diagnostic and statistical manual of mental disorders DSM-IV-TR fourth edition (text revision)"},{"key":"pone.0256384.ref020","doi-asserted-by":"crossref","DOI":"10.1176\/appi.books.9780890425596","volume-title":"Diagnostic and statistical manual of mental disorders (DSM-5\u00ae)","author":"American Psychiatric Association","year":"2013"},{"issue":"20","key":"pone.0256384.ref021","first-page":"22","article-title":"The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10","volume":"59","author":"DV Sheehan","year":"1998","journal-title":"J Clin Psychiatry"},{"issue":"6","key":"pone.0256384.ref022","first-page":"393","article-title":"Het Mini Internationaal Neuropsychiatrisch Interview (MINI): Een kort gestructureerd diagnostisch psychiatrisch interview voor DSM-IV-en ICD-10-stoomissen","volume":"49","author":"I Van Vliet","year":"2007","journal-title":"Tijdschrift voor Psychiatrie"},{"issue":"10","key":"pone.0256384.ref023","doi-asserted-by":"crossref","first-page":"1727","DOI":"10.1007\/s11136-011-9903-x","article-title":"Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L)","volume":"20","author":"M Herdman","year":"2011","journal-title":"Quality of life research"},{"issue":"4","key":"pone.0256384.ref024","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/j.jval.2016.01.003","article-title":"Dutch Tariff for the Five-Level Version of EQ-5D","volume":"19","author":"MM Versteegh","year":"2016","journal-title":"Value in Health"},{"issue":"1","key":"pone.0256384.ref025","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1080\/19312450709336664","article-title":"Answering the call for a standard reliability measure for coding data","volume":"1","author":"AF Hayes","year":"2007","journal-title":"Communication methods and measures"},{"key":"pone.0256384.ref026","volume-title":"Content analysis: An introduction to its methodology","author":"K Krippendorff","year":"2012"},{"key":"pone.0256384.ref027","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"J Cohen","year":"1988","edition":"2"},{"issue":"3","key":"pone.0256384.ref028","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1097\/01.nmd.0000154836.22687.13","article-title":"Quality of life and anxiety disorders: a population study","volume":"193","author":"V Cramer","year":"2005","journal-title":"J Nerv Ment Dis"},{"issue":"1","key":"pone.0256384.ref029","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1002\/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3","article-title":"Index for rating diagnostic tests","volume":"3","author":"WJ Youden","year":"1950","journal-title":"Cancer"},{"issue":"4","key":"pone.0256384.ref030","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1111\/j.1468-2958.2002.tb00826.x","article-title":"Content analysis in mass communication: Assessment and reporting of intercoder reliability","volume":"28","author":"M Lombard","year":"2002","journal-title":"Human communication research"},{"issue":"6","key":"pone.0256384.ref031","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1017\/S0012162299000870","article-title":"Reliability and responsiveness of the Barry\u2013Albright dystonia scale.","volume":"41","author":"MJ Barry","year":"1999","journal-title":"Developmental Medicine & Child Neurology"},{"issue":"3","key":"pone.0256384.ref032","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1037\/pas0000086","article-title":"Does a web-based feedback training program result in improved reliability in clinicians\u2019 ratings of the Global Assessment of Functioning (GAF) Scale?","volume":"27","author":"J St\u00f8re-Valen","year":"2015","journal-title":"Psychol Assess"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0256384","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T18:12:57Z","timestamp":1629396777000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0256384"}},"subtitle":[],"editor":[{"given":"Stephan","family":"Doering","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,8,19]]},"references-count":32,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8,19]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0256384","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,19]]}}}