{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T00:30:17Z","timestamp":1791419417060,"version":"4.3.3"},"reference-count":80,"publisher":"Cambridge University Press (CUP)","issue":"14","license":[{"start":{"date-parts":[[2023,1,5]],"date-time":"2023-01-05T00:00:00Z","timestamp":1672876800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Psychol. Med."],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec id=\"S0033291722003798_sec_a1\"><jats:title>Background<\/jats:title><jats:p>In difficult-to-treat depression (DTD) the outcome metrics historically used to evaluate treatment effectiveness may be suboptimal. Metrics based on remission status and on single end-point (SEP) assessment may be problematic given infrequent symptom remission, temporal instability, and poor durability of benefit in DTD.<\/jats:p><\/jats:sec><jats:sec id=\"S0033291722003798_sec_a2\" sec-type=\"methods\"><jats:title>Methods<\/jats:title><jats:p>Self-report and clinician assessment of depression symptom severity were regularly obtained over a 2-year period in a chronic and highly treatment-resistant registry sample (<jats:italic>N<\/jats:italic> = 406) receiving treatment as usual, with or without vagus nerve stimulation. Twenty alternative metrics for characterizing symptomatic improvement were evaluated, contrasting SEP metrics with integrative (INT) metrics that aggregated information over time. Metrics were compared in effect size and discriminating power when contrasting groups that did (<jats:italic>N<\/jats:italic> = 153) and did not (<jats:italic>N<\/jats:italic> = 253) achieve a threshold level of improvement in end-point quality-of-life (QoL) scores, and in their association with continuous QoL scores.<\/jats:p><\/jats:sec><jats:sec id=\"S0033291722003798_sec_a3\" sec-type=\"results\"><jats:title>Results<\/jats:title><jats:p>Metrics based on remission status had smaller effect size and poorer discrimination of the binary QoL outcome and weaker associations with the continuous end-point QoL scores than metrics based on partial response or response. The metrics with the strongest performance characteristics were the SEP measure of percentage change in symptom severity and the INT metric quantifying the proportion of the observation period in partial response or better. Both metrics contributed independent variance when predicting end-point QoL scores.<\/jats:p><\/jats:sec><jats:sec id=\"S0033291722003798_sec_a4\" sec-type=\"conclusions\"><jats:title>Conclusions<\/jats:title><jats:p>Revision is needed in the metrics used to quantify symptomatic change in DTD with consideration of INT time-based measures as primary or secondary outcomes. Metrics based on remission status may not be useful.<\/jats:p><\/jats:sec>","DOI":"10.1017\/s0033291722003798","type":"journal-article","created":{"date-parts":[[2023,1,5]],"date-time":"2023-01-05T09:07:29Z","timestamp":1672909649000},"page":"6511-6523","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":12,"title":["Alternative metrics for characterizing longer-term clinical outcomes in difficult-to-treat depression: I. Association with change in quality of life"],"prefix":"10.1017","volume":"53","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1107-4553","authenticated-orcid":false,"given":"Harold A.","family":"Sackeim","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1908-9474","authenticated-orcid":false,"given":"A. John","family":"Rush","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7114-8673","authenticated-orcid":false,"given":"Teresa","family":"Greco","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mei","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Badejo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5871-0687","authenticated-orcid":false,"given":"Mark T.","family":"Bunker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1333-4045","authenticated-orcid":false,"given":"Scott T.","family":"Aaronson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3918-5519","authenticated-orcid":false,"given":"Charles R.","family":"Conway","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5331-487X","authenticated-orcid":false,"given":"Koen","family":"Demyttenaere","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4130-5914","authenticated-orcid":false,"given":"Allan H.","family":"Young","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9966-1834","authenticated-orcid":false,"given":"R. Hamish","family":"McAllister-Williams","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"56","published-online":{"date-parts":[[2023,1,5]]},"reference":[{"key":"S0033291722003798_ref26","doi-asserted-by":"publisher","DOI":"10.4088\/JCP.9078tx1c"},{"key":"S0033291722003798_ref53","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.88.5.879"},{"key":"S0033291722003798_ref62","doi-asserted-by":"publisher","DOI":"10.1016\/S0006-3223(03)00088-X"},{"key":"S0033291722003798_ref6","doi-asserted-by":"publisher","DOI":"10.1093\/ijnp\/pyy079"},{"key":"S0033291722003798_ref35","doi-asserted-by":"publisher","DOI":"10.1038\/s41398-019-0460-3"},{"key":"S0033291722003798_ref24","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.1991.01810330075011"},{"key":"S0033291722003798_ref1","doi-asserted-by":"publisher","DOI":"10.1097\/YCT.0000000000000724"},{"key":"S0033291722003798_ref10","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ps.201800094"},{"key":"S0033291722003798_ref78","doi-asserted-by":"publisher","DOI":"10.1097\/YIC.0b013e32832d6bf4"},{"key":"S0033291722003798_ref61","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291721004943"},{"key":"S0033291722003798_ref54","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1176\/ajp.143.1.18","article-title":"Continuation drug therapy for major depressive episodes: How long should it be maintained?","volume":"143","author":"Prien","year":"1986","journal-title":"American Journal of Psychiatry"},{"key":"S0033291722003798_ref57","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.1972.01750240058009"},{"key":"S0033291722003798_ref40","doi-asserted-by":"publisher","DOI":"10.1002\/wps.20299"},{"key":"S0033291722003798_ref67","doi-asserted-by":"publisher","DOI":"10.1017\/S1461145706007425"},{"key":"S0033291722003798_ref12","volume-title":"Applied multiple regression\/correlation analysis for the behavioral sciences","author":"Cohen","year":"2003"},{"key":"S0033291722003798_ref79","doi-asserted-by":"publisher","DOI":"10.1097\/YIC.0b013e3283427cd7"},{"key":"S0033291722003798_ref15","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.164.11.1197"},{"key":"S0033291722003798_ref46","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.160.10.1830"},{"key":"S0033291722003798_ref48","doi-asserted-by":"publisher","DOI":"10.1007\/s11136-012-0302-8"},{"key":"S0033291722003798_ref16","first-page":"CD011612","article-title":"Ketamine and other glutamate receptor modulators for depression in adults with unipolar major depressive disorder","volume":"9","author":"Dean","year":"2021","journal-title":"Cochrane Database of Systematic Reviews"},{"key":"S0033291722003798_ref29","first-page":"627","article-title":"Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation","volume":"4","author":"Hajian-Tilaki","year":"2013","journal-title":"Caspian Journal of Internal Medicine"},{"key":"S0033291722003798_ref7","doi-asserted-by":"publisher","DOI":"10.1097\/YIC.0000000000000116"},{"key":"S0033291722003798_ref9","doi-asserted-by":"publisher","DOI":"10.1016\/j.euroneuro.2006.04.008"},{"key":"S0033291722003798_ref36","doi-asserted-by":"publisher","DOI":"10.2147\/NDT.S196665"},{"key":"S0033291722003798_ref34","volume-title":"Diagnosis and drug treatment of psychiatric disorders: Adults and children","author":"Klein","year":"1980"},{"key":"S0033291722003798_ref64","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.2006.163.11.1905"},{"key":"S0033291722003798_ref68","doi-asserted-by":"publisher","DOI":"10.1001\/archgenpsychiatry.2009.75"},{"key":"S0033291722003798_ref73","doi-asserted-by":"publisher","DOI":"10.1177\/0149206316687295"},{"key":"S0033291722003798_ref66","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2019.03.021"},{"key":"S0033291722003798_ref21","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ps.53.3.288"},{"key":"S0033291722003798_ref76","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1995.03520250075037"},{"key":"S0033291722003798_ref60","doi-asserted-by":"publisher","DOI":"10.1038\/sj.npp.1301131"},{"key":"S0033291722003798_ref11","volume-title":"Statistical power analysis for the behavioral sciences","author":"Cohen","year":"1988"},{"key":"S0033291722003798_ref56","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.1991.01810330020003"},{"key":"S0033291722003798_ref25","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-017-1385-0"},{"key":"S0033291722003798_ref65","first-page":"10","article-title":"The definition and meaning of treatment-resistant depression","volume":"62","author":"Sackeim","year":"2001","journal-title":"Journal of Clinical Psychiatry"},{"key":"S0033291722003798_ref38","doi-asserted-by":"publisher","DOI":"10.1111\/j.1600-0447.2008.01308.x"},{"key":"S0033291722003798_ref47","doi-asserted-by":"publisher","DOI":"10.1097\/00001648-199109000-00014"},{"key":"S0033291722003798_ref33","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-019-2222-4"},{"key":"S0033291722003798_ref22","doi-asserted-by":"publisher","DOI":"10.1002\/bimj.200410135"},{"key":"S0033291722003798_ref59","doi-asserted-by":"publisher","DOI":"10.1002\/mpr.79"},{"key":"S0033291722003798_ref19","first-page":"29","article-title":"A randomized, double-blind, placebo-controlled study of quetiapine in the treatment of bipolar I and II depression: Improvements in quality of life","volume":"22","author":"Endicott","year":"2007","journal-title":"International Clinical Psychopharmacology"},{"key":"S0033291722003798_ref3","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-018-1964-8"},{"key":"S0033291722003798_ref4","doi-asserted-by":"publisher","DOI":"10.1016\/j.mehy.2013.06.010"},{"key":"S0033291722003798_ref72","doi-asserted-by":"publisher","DOI":"10.1016\/bs.apha.2020.05.002"},{"key":"S0033291722003798_ref30","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0327(01)00451-7"},{"key":"S0033291722003798_ref45","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.134.4.382"},{"key":"S0033291722003798_ref5","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.bp.114.158543"},{"key":"S0033291722003798_ref41","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2020.02.023"},{"key":"S0033291722003798_ref17","doi-asserted-by":"publisher","DOI":"10.1097\/YIC.0b013e328303ac5f"},{"key":"S0033291722003798_ref52","doi-asserted-by":"publisher","DOI":"10.1034\/j.1600-0447.106.s415.3.x"},{"key":"S0033291722003798_ref42","volume-title":"A primer of signal detection theory","author":"McNicol","year":"2004"},{"key":"S0033291722003798_ref13","first-page":"52","article-title":"Chronic vagus nerve stimulation significantly improves quality of life in treatment-resistant major depression","volume":"79","author":"Conway","year":"2018","journal-title":"Journal of Clinical Psychiatry"},{"key":"S0033291722003798_ref70","first-page":"22","article-title":"The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10","volume":"59","author":"Sheehan","year":"1998","journal-title":"Journal of Clinical Psychiatry"},{"key":"S0033291722003798_ref75","first-page":"1081","volume-title":"Psychopharmacology: The fourth generation of progress","author":"Thase","year":"1995"},{"key":"S0033291722003798_ref77","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2005.08.004"},{"key":"S0033291722003798_ref80","doi-asserted-by":"publisher","DOI":"10.4088\/JCP.v65n0204"},{"key":"S0033291722003798_ref39","doi-asserted-by":"publisher","DOI":"10.1097\/JCP.0000000000000229"},{"key":"S0033291722003798_ref32","doi-asserted-by":"publisher","DOI":"10.1016\/0197-2456(89)90005-6"},{"key":"S0033291722003798_ref51","doi-asserted-by":"publisher","DOI":"10.1093\/bmb\/57.1.145"},{"key":"S0033291722003798_ref50","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsych.2007.01.018"},{"key":"S0033291722003798_ref55","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.1983.01790220086014"},{"key":"S0033291722003798_ref8","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2013.01.019"},{"key":"S0033291722003798_ref63","doi-asserted-by":"publisher","DOI":"10.1016\/S0006-3223(02)01866-8"},{"key":"S0033291722003798_ref2","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2017.16010034"},{"key":"S0033291722003798_ref31","doi-asserted-by":"publisher","DOI":"10.1080\/16506073.2017.1304445"},{"key":"S0033291722003798_ref23","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2015-010944"},{"key":"S0033291722003798_ref37","doi-asserted-by":"publisher","DOI":"10.1177\/1363459311403945"},{"key":"S0033291722003798_ref69","doi-asserted-by":"publisher","DOI":"10.1037\/1040-3590.5.3.350"},{"key":"S0033291722003798_ref44","doi-asserted-by":"publisher","DOI":"10.1080\/15622970801981606"},{"key":"S0033291722003798_ref43","doi-asserted-by":"publisher","DOI":"10.4081\/hpr.2013.932"},{"key":"S0033291722003798_ref58","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.162.6.1171"},{"key":"S0033291722003798_ref28","volume-title":"ECDEU assessment manual for psychopharmacology","author":"Guy","year":"1976"},{"key":"S0033291722003798_ref18","first-page":"321","article-title":"Quality of Life Enjoyment and Satisfaction Questionnaire: A new measure","volume":"29","author":"Endicott","year":"1993","journal-title":"Psychopharmacology Bulletin"},{"key":"S0033291722003798_ref27","author":"Green","year":"1966","journal-title":"Signal detection theory and psychophysics"},{"key":"S0033291722003798_ref20","doi-asserted-by":"publisher","DOI":"10.1161\/01.CIR.0000128373.90851.7B"},{"key":"S0033291722003798_ref49","doi-asserted-by":"publisher","DOI":"10.2214\/ajr.184.2.01840364"},{"key":"S0033291722003798_ref74","doi-asserted-by":"publisher","DOI":"10.3758\/BF03207704"},{"key":"S0033291722003798_ref14","doi-asserted-by":"publisher","DOI":"10.1016\/j.cct.2020.106066"},{"key":"S0033291722003798_ref71","doi-asserted-by":"publisher","DOI":"10.1038\/s41398-020-00897-0"}],"container-title":["Psychological Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0033291722003798","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,26]],"date-time":"2023-10-26T07:56:56Z","timestamp":1698307016000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0033291722003798\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,5]]},"references-count":80,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["S0033291722003798"],"URL":"https:\/\/doi.org\/10.1017\/s0033291722003798","relation":{},"ISSN":["0033-2917","1469-8978"],"issn-type":[{"value":"0033-2917","type":"print"},{"value":"1469-8978","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,5]]},"assertion":[{"value":"Copyright \u00a9 The Author(s), 2023. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http:\/\/creativecommons.org\/licenses\/by\/4.0\/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}