{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T04:46:02Z","timestamp":1794026762506,"version":"4.8.0"},"reference-count":65,"publisher":"Cambridge University Press (CUP)","issue":"16","license":[{"start":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T00:00:00Z","timestamp":1633996800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"funder":[{"DOI":"10.13039\/100007670","name":"Dalhousie Medical Research Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007670","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001804","name":"Canada Research Chairs","doi-asserted-by":"publisher","award":["231397"],"award-info":[{"award-number":["231397"]}],"id":[{"id":"10.13039\/501100001804","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Psychol. Med."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec id=\"S0033291721003871_sec_a1\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Multiple treatments are effective for major depressive disorder (MDD), but the outcomes of each treatment vary broadly among individuals. Accurate prediction of outcomes is needed to help select a treatment that is likely to work for a given person. We aim to examine the performance of machine learning methods in delivering replicable predictions of treatment outcomes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"S0033291721003871_sec_a2\" sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Of 7732 non-duplicate records identified through literature search, we retained 59 eligible reports and extracted data on sample, treatment, predictors, machine learning method, and treatment outcome prediction. A minimum sample size of 100 and an adequate validation method were used to identify adequate-quality studies. The effects of study features on prediction accuracy were tested with mixed-effects models. Fifty-four of the studies provided accuracy estimates or other estimates that allowed calculation of balanced accuracy of predicting outcomes of treatment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"S0033291721003871_sec_a3\" sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Eight adequate-quality studies reported a mean accuracy of 0.63 [95% confidence interval (CI) 0.56\u20130.71], which was significantly lower than a mean accuracy of 0.75 (95% CI 0.72\u20130.78) in the other 46 studies. Among the adequate-quality studies, accuracies were higher when predicting treatment resistance (0.69) and lower when predicting remission (0.60) or response (0.56). The choice of machine learning method, feature selection, and the ratio of features to individuals were not associated with reported accuracy.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"S0033291721003871_sec_a4\" sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The negative relationship between study quality and prediction accuracy, combined with a lack of independent replication, invites caution when evaluating the potential of machine learning applications for personalizing the treatment of depression.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1017\/s0033291721003871","type":"journal-article","created":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T18:20:43Z","timestamp":1634062843000},"page":"2742-2751","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":152,"title":["Machine learning in the prediction of depression treatment outcomes: a systematic review and meta-analysis"],"prefix":"10.1017","volume":"51","author":[{"given":"Mehri","family":"Sajjadian","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raymond W.","family":"Lam","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roumen","family":"Milev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susan","family":"Rotzinger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benicio N.","family":"Frey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claudio N.","family":"Soares","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sagar V.","family":"Parikh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jane A.","family":"Foster","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gustavo","family":"Turecki","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel J.","family":"M\u00fcller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen C.","family":"Strother","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Faranak","family":"Farzan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sidney H.","family":"Kennedy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2998-0546","authenticated-orcid":false,"given":"Rudolf","family":"Uher","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"56","published-online":{"date-parts":[[2021,10,12]]},"reference":[{"key":"S0033291721003871_ref63","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2019-034568"},{"key":"S0033291721003871_ref9","doi-asserted-by":"publisher","DOI":"10.1016\/j.euroneuro.2018.11.1102"},{"key":"S0033291721003871_ref41","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0197268"},{"key":"S0033291721003871_ref2","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.1482"},{"key":"S0033291721003871_ref30","doi-asserted-by":"publisher","DOI":"10.1177\/0706743716659417"},{"key":"S0033291721003871_ref47","doi-asserted-by":"publisher","DOI":"10.1002\/wps.20345"},{"key":"S0033291721003871_ref65","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2007.06101757"},{"key":"S0033291721003871_ref1","doi-asserted-by":"publisher","DOI":"10.2147\/PPA.S29716"},{"key":"S0033291721003871_ref6","doi-asserted-by":"publisher","DOI":"10.1038\/srep10312"},{"key":"S0033291721003871_ref38","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2013.143"},{"key":"S0033291721003871_ref46","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsych.2012.12.007"},{"key":"S0033291721003871_ref61","unstructured":"World Health Organization, . (2021). Depression. Retrieved from https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/depression."},{"key":"S0033291721003871_ref55","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.163.1.28"},{"key":"S0033291721003871_ref3","doi-asserted-by":"publisher","DOI":"10.1038\/533452a"},{"key":"S0033291721003871_ref36","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2017.12.009"},{"key":"S0033291721003871_ref40","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1000097"},{"key":"S0033291721003871_ref18","doi-asserted-by":"publisher","DOI":"10.1167\/tvst.9.2.7"},{"key":"S0033291721003871_ref57","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291711001905"},{"key":"S0033291721003871_ref4","doi-asserted-by":"publisher","DOI":"10.1038\/s41386-018-0122-9"},{"key":"S0033291721003871_ref10","first-page":"2079","article-title":"On over-fitting in model selection and subsequent selection bias in performance evaluation","volume":"11","author":"Cawley","year":"2010","journal-title":"Journal of Machine Learning Research"},{"key":"S0033291721003871_ref22","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2014.226"},{"key":"S0033291721003871_ref51","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2020-100251"},{"key":"S0033291721003871_ref42","doi-asserted-by":"publisher","DOI":"10.1093\/ijnp\/pyx081"},{"key":"S0033291721003871_ref60","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.l6927"},{"key":"S0033291721003871_ref17","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2014.333"},{"key":"S0033291721003871_ref45","doi-asserted-by":"publisher","DOI":"10.1002\/gps.4262"},{"key":"S0033291721003871_ref16","doi-asserted-by":"publisher","DOI":"10.1037\/ccp0000476"},{"key":"S0033291721003871_ref64","first-page":"9","article-title":"Missing data imputation: Focusing on single imputation","volume":"4","author":"Zhang","year":"2016","journal-title":"Annals of Translational Medicine"},{"key":"S0033291721003871_ref49","doi-asserted-by":"publisher","DOI":"10.1147\/rd.441.0206"},{"key":"S0033291721003871_ref28","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2020.01.118"},{"key":"S0033291721003871_ref7","first-page":"1","article-title":"From predictive methods to missing data imputation: An optimization approach","volume":"18","author":"Bertsimas","year":"2018","journal-title":"Journal of Machine Learning Research"},{"key":"S0033291721003871_ref50","first-page":"1","article-title":"A comparison of six methods for missing data imputation","volume":"6","author":"Schmitt","year":"2015","journal-title":"Journal of Biometrics and Biostatistics"},{"key":"S0033291721003871_ref11","doi-asserted-by":"publisher","DOI":"10.1002\/da.22705"},{"key":"S0033291721003871_ref53","doi-asserted-by":"publisher","DOI":"10.1177\/070674371005500303"},{"key":"S0033291721003871_ref12","doi-asserted-by":"publisher","DOI":"10.1016\/S2215-0366(15)00471-X"},{"key":"S0033291721003871_ref15","doi-asserted-by":"publisher","DOI":"10.4088\/JCP.v63n1102"},{"key":"S0033291721003871_ref26","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"S0033291721003871_ref8","doi-asserted-by":"publisher","DOI":"10.1038\/s41386-021-00981-z"},{"key":"S0033291721003871_ref21","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2017.07.003"},{"key":"S0033291721003871_ref58","doi-asserted-by":"publisher","DOI":"10.2217\/pgs.11.161"},{"key":"S0033291721003871_ref62","doi-asserted-by":"publisher","DOI":"10.1038\/s41588-018-0090-3"},{"key":"S0033291721003871_ref27","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2018.00768"},{"key":"S0033291721003871_ref32","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-6849-3"},{"key":"S0033291721003871_ref29","doi-asserted-by":"publisher","DOI":"10.4088\/JCP.15m10381"},{"key":"S0033291721003871_ref25","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291716001367"},{"key":"S0033291721003871_ref37","doi-asserted-by":"publisher","DOI":"10.18553\/jmcp.2007.13.s6-a.8"},{"key":"S0033291721003871_ref59","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0224365"},{"key":"S0033291721003871_ref43","doi-asserted-by":"publisher","DOI":"10.1177\/0706743716659418"},{"key":"S0033291721003871_ref56","article-title":"Symptom dimension of interest-activity indicates need for aripiprazole augmentation of escitalopram in major depressive disorder: A CAN-BIND-1 report","volume":"81","author":"Uher","year":"2020","journal-title":"Journal of Clinical Psychiatry"},{"key":"S0033291721003871_ref48","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.2006.163.11.1905"},{"key":"S0033291721003871_ref31","doi-asserted-by":"publisher","DOI":"10.1097\/YCO.0000000000000377"},{"key":"S0033291721003871_ref35","doi-asserted-by":"publisher","DOI":"10.1177\/2167702618815466"},{"key":"S0033291721003871_ref52","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2010.09111680"},{"key":"S0033291721003871_ref5","doi-asserted-by":"publisher","DOI":"10.1016\/j.aca.2012.11.007"},{"key":"S0033291721003871_ref39","doi-asserted-by":"publisher","DOI":"10.1177\/0706743716660033"},{"key":"S0033291721003871_ref23","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon","year":"2003","journal-title":"Journal of Machine Learning Research"},{"key":"S0033291721003871_ref13","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(17)32802-7"},{"key":"S0033291721003871_ref19","doi-asserted-by":"publisher","DOI":"10.4088\/JCP.8017br3c"},{"key":"S0033291721003871_ref14","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/aww326"},{"key":"S0033291721003871_ref54","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.104324"},{"key":"S0033291721003871_ref20","doi-asserted-by":"publisher","DOI":"10.1080\/14737175.2017.1307737"},{"key":"S0033291721003871_ref34","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2018.00290"},{"key":"S0033291721003871_ref33","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2018.08.073"},{"key":"S0033291721003871_ref24","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-23584-z"},{"key":"S0033291721003871_ref44","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2017171920"}],"container-title":["Psychological Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0033291721003871","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T08:46:59Z","timestamp":1645778819000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0033291721003871\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,12]]},"references-count":65,"journal-issue":{"issue":"16","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["S0033291721003871"],"URL":"https:\/\/doi.org\/10.1017\/s0033291721003871","relation":{},"ISSN":["0033-2917","1469-8978"],"issn-type":[{"value":"0033-2917","type":"print"},{"value":"1469-8978","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,12]]},"assertion":[{"value":"Copyright \u00a9 The Author(s), 2021. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}}]}}