{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T13:33:32Z","timestamp":1780407212413,"version":"3.54.1"},"reference-count":67,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,2,11]],"date-time":"2021-02-11T00:00:00Z","timestamp":1613001600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,11]],"date-time":"2021-02-11T00:00:00Z","timestamp":1613001600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Weill Cornell Medicine Children\u2019s Health Council Investigator Fund"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Meta-analyses have shown that digital mental health apps can be efficacious in reducing symptoms of depression and anxiety. However, real-world usage of apps is typically not sustained over time, and no studies systematically examine which features increase sustained engagement with apps or the relationship between engagement features and clinical efficacy. We conducted a systematic search of the literature to identify empirical studies that (1) investigate standalone apps for depression and\/or anxiety in symptomatic participants and (2) report at least one measure of engagement. Features intended to increase engagement were categorized using the persuasive system design (PSD) framework and principles of behavioral economics. Twenty-five studies with 4159 participants were included in the analysis. PSD features were commonly used, whereas behavioral economics techniques were not. Smartphone apps were efficacious in treating symptoms of anxiety and depression in randomized controlled trials, with overall small-to-medium effects (<jats:italic>g<\/jats:italic>\u2009=\u20090.2888, SE\u2009=\u20090.0999, z(15)\u2009=\u20092.89, <jats:italic>p<\/jats:italic>\u2009=\u20090.0119, Q(df\u2009=\u200914) = 41.93, <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.0001, <jats:italic>I<\/jats:italic><jats:sup>2<\/jats:sup>\u2009=\u200966.6%), and apps that employed a greater number of engagement features as compared to the control condition had larger effect sizes (\u03b2\u2009=\u20090.0450, SE\u2009=\u20090.0164, t(15)\u2009=\u20092.7344, <jats:italic>p<\/jats:italic>\u2009=\u20090.0161). We observed an unexpected negative association between PSD features and engagement, as measured by completion rate (\u03b2\u2009=\u2009\u22120.0293, SE\u2009=\u20090.0121, t(17)\u2009=\u200902.4142, <jats:italic>p<\/jats:italic>\u2009=\u20090.0281). Overall, PSD features show promise for augmenting app efficacy, though engagement, as reflected in study completion, may not be the primary factor driving this association. The results suggest that expanding the use of PSD features in mental health apps may increase clinical benefits and that other techniques, such as those informed by behavioral economics, are employed infrequently.<\/jats:p>","DOI":"10.1038\/s41746-021-00386-8","type":"journal-article","created":{"date-parts":[[2021,2,11]],"date-time":"2021-02-11T11:03:58Z","timestamp":1613041438000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":163,"title":["Smartphone apps for depression and anxiety: a systematic review and meta-analysis of techniques to increase engagement"],"prefix":"10.1038","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2780-0409","authenticated-orcid":false,"given":"Ashley","family":"Wu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5554-8186","authenticated-orcid":false,"given":"Matthew A.","family":"Scult","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily D.","family":"Barnes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6940-3391","authenticated-orcid":false,"given":"Jessica A.","family":"Betancourt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2502-5549","authenticated-orcid":false,"given":"Avital","family":"Falk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1854-9969","authenticated-orcid":false,"given":"Faith M.","family":"Gunning","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,2,11]]},"reference":[{"key":"386_CR1","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1001\/jamapsychiatry.2017.0262","volume":"74","author":"J Torous","year":"2017","unstructured":"Torous, J. & Roberts, L. W. Needed innovation in digital health and smartphone applications for mental health: transparency and trust. JAMA Psychiatry 74, 437\u2013438 (2017).","journal-title":"JAMA Psychiatry"},{"key":"386_CR2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-019-0188-8","volume":"2","author":"KK Weisel","year":"2019","unstructured":"Weisel, K. K. et al. Standalone smartphone apps for mental health-a systematic review and meta-analysis. npj Digital Med. 2, 118 (2019).","journal-title":"npj Digital Med."},{"key":"386_CR3","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.jad.2017.04.046","volume":"218","author":"J Firth","year":"2017","unstructured":"Firth, J. et al. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J. Affect. Disord. 218, 15\u201322 (2017).","journal-title":"J. Affect. Disord."},{"key":"386_CR4","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1002\/wps.20472","volume":"16","author":"J Firth","year":"2017","unstructured":"Firth, J. et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry 16, 287\u2013298 (2017).","journal-title":"World Psychiatry"},{"key":"386_CR5","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1002\/wps.20673","volume":"18","author":"J Linardon","year":"2019","unstructured":"Linardon, J., Cuijpers, P., Carlbring, P., Messer, M. & Fuller-Tyszkiewicz, M. The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry 18, 325\u2013336 (2019).","journal-title":"World Psychiatry"},{"key":"386_CR6","doi-asserted-by":"publisher","DOI":"10.2196\/14567","volume":"21","author":"A Baumel","year":"2019","unstructured":"Baumel, A., Muench, F., Edan, S. & Kane, J. M. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J. Med. Internet Res. 21, e14567 (2019).","journal-title":"J. Med. Internet Res."},{"key":"386_CR7","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2104","volume":"14","author":"SM Kelders","year":"2012","unstructured":"Kelders, S. M., Kok, R. N., Ossebaard, H. C. & Van Gemert-Pijnen, J. E. W. C. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J. Med. Internet Res. 14, e152 (2012).","journal-title":"J. Med. Internet Res."},{"key":"386_CR8","doi-asserted-by":"publisher","first-page":"485","DOI":"10.17705\/1CAIS.02428","volume":"24","author":"H Oinas-Kukkonen","year":"2009","unstructured":"Oinas-Kukkonen, H. & Harjumaa, M. Persuasive systems design: key issues, process model, and system features. CAIS 24, 485\u2013500 (2009).","journal-title":"CAIS"},{"key":"386_CR9","doi-asserted-by":"publisher","first-page":"1449","DOI":"10.1257\/000282803322655392","volume":"93","author":"D Kahneman","year":"2003","unstructured":"Kahneman, D. Maps of bounded rationality: psychology for behavioral economics. Am. Econ. Rev. 93, 1449\u20131475 (2003).","journal-title":"Am. Econ. Rev."},{"key":"386_CR10","doi-asserted-by":"publisher","first-page":"600","DOI":"10.7326\/L16-0280","volume":"165","author":"MS Patel","year":"2016","unstructured":"Patel, M. S., Asch, D. A. & Volpp, K. G. Framing financial incentives to increase physical activity among overweight and obese adults. Ann. Intern. Med. 165, 600 (2016).","journal-title":"Ann. Intern. Med."},{"key":"386_CR11","doi-asserted-by":"publisher","first-page":"2563","DOI":"10.1287\/mnsc.2014.1901","volume":"60","author":"H Dai","year":"2014","unstructured":"Dai, H., Milkman, K. L. & Riis, J. The fresh start effect: temporal landmarks motivate aspirational behavior. Manag. Sci. 60, 2563\u20132582 (2014).","journal-title":"Manag. Sci."},{"key":"386_CR12","doi-asserted-by":"publisher","first-page":"2065","DOI":"10.1001\/jama.2014.3485","volume":"311","author":"T Rogers","year":"2014","unstructured":"Rogers, T., Milkman, K. L. & Volpp, K. G. Commitment devices: using initiatives to change behavior. JAMA 311, 2065\u20132066 (2014).","journal-title":"JAMA"},{"key":"386_CR13","doi-asserted-by":"publisher","first-page":"1568","DOI":"10.1177\/0890117118758932","volume":"32","author":"MS Patel","year":"2018","unstructured":"Patel, M. S. et al. A randomized, controlled trial of lottery-based financial incentives to increase physical activity among overweight and obese adults. Am. J. Health Promot 32, 1568\u20131575 (2018).","journal-title":"Am. J. Health Promot"},{"key":"386_CR14","doi-asserted-by":"publisher","unstructured":"Huotari, K. & Hamari, J. Defining gamification: a service marketing perspective. in Proceeding of the 16th International Academic MindTrek Conference on - MindTrek \u201912 17 (ACM Press, 2012). https:\/\/doi.org\/10.1145\/2393132.2393137.","DOI":"10.1145\/2393132.2393137"},{"key":"386_CR15","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.9923","volume":"20","author":"SM Kelders","year":"2018","unstructured":"Kelders, S. M., Sommers-Spijkerman, M. & Goldberg, J. Investigating the direct impact of a gamified versus nongamified well-being intervention: an exploratory experiment. J. Med. Internet Res. 20, e247 (2018).","journal-title":"J. Med. Internet Res."},{"key":"386_CR16","doi-asserted-by":"publisher","DOI":"10.2196\/13717","volume":"6","author":"VWS Cheng","year":"2019","unstructured":"Cheng, V. W. S., Davenport, T., Johnson, D., Vella, K. & Hickie, I. B. Gamification in apps and technologies for improving mental health and well-being: systematic review. JMIR Ment. Health 6, e13717 (2019).","journal-title":"JMIR Ment. Health"},{"key":"386_CR17","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1177\/0890117118790394","volume":"33","author":"V Cotton","year":"2019","unstructured":"Cotton, V. & Patel, M. S. Gamification use and design in popular health and fitness mobile applications. Am. J. Health Promot 33, 448\u2013451 (2019).","journal-title":"Am. J. Health Promot"},{"key":"386_CR18","doi-asserted-by":"publisher","DOI":"10.2196\/games.8902","volume":"6","author":"G Pramana","year":"2018","unstructured":"Pramana, G. et al. Using mobile health gamification to facilitate cognitive behavioral therapy skills practice in child anxiety treatment: open clinical trial. JMIR Serious Games 6, e9 (2018).","journal-title":"JMIR Serious Games"},{"key":"386_CR19","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1016\/j.jad.2019.11.167","volume":"263","author":"J Torous","year":"2020","unstructured":"Torous, J., Lipschitz, J., Ng, M. & Firth, J. Dropout rates in clinical trials of smartphone apps for depressive symptoms: a systematic review and meta-analysis. J. Affect. Disord. 263, 413\u2013419 (2020).","journal-title":"J. Affect. Disord."},{"key":"386_CR20","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1136\/bmjinnov-2015-000098","volume":"2","author":"JA Anguera","year":"2016","unstructured":"Anguera, J. A., Jordan, J. T., Castaneda, D., Gazzaley, A. & Are\u00e1n, P. A. Conducting a fully mobile and randomised clinical trial for depression: access, engagement and expense. BMJ Innov. 2, 14\u201321 (2016).","journal-title":"BMJ Innov."},{"key":"386_CR21","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1111\/ap.12383","volume":"54","author":"D Bakker","year":"2019","unstructured":"Bakker, D. & Rickard, N. Engagement with a cognitive behavioural therapy mobile phone app predicts changes in mental health and wellbeing: MoodMission. Aust. Psychol. 54, 245\u2013260 (2019).","journal-title":"Aust. Psychol."},{"key":"386_CR22","doi-asserted-by":"publisher","DOI":"10.2196\/mental.6348","volume":"3","author":"D Ben-Zeev","year":"2016","unstructured":"Ben-Zeev, D. et al. mHealth for schizophrenia: patient engagement with a mobile phone intervention following hospital discharge. JMIR Ment. Health 3, e34 (2016).","journal-title":"JMIR Ment. Health"},{"key":"386_CR23","unstructured":"Bustillos, D. The effects of using pacifica on depressed patients. https:\/\/search.proquest.com\/docview\/2172401714?pq-origsite=primo (2018)."},{"key":"386_CR24","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1080\/00207411.2018.1553486","volume":"47","author":"S Caplan","year":"2018","unstructured":"Caplan, S., Sosa Lovera, A. & Reyna Liberato, P. A feasibility study of a mental health mobile app in the Dominican Republic: the untold story. Int. J. Ment. Health 47, 311\u2013345 (2018).","journal-title":"Int. J. Ment. Health"},{"key":"386_CR25","doi-asserted-by":"publisher","first-page":"103187","DOI":"10.1016\/j.jbi.2019.103187","volume":"94","author":"AT Chen","year":"2019","unstructured":"Chen, A. T., Wu, S., Tomasino, K. N., Lattie, E. G. & Mohr, D. C. A multi-faceted approach to characterizing user behavior and experience in a digital mental health intervention. J. Biomed. Inform. 94, 103187 (2019).","journal-title":"J. Biomed. Inform."},{"key":"386_CR26","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1016\/j.beth.2018.12.003","volume":"50","author":"J Dahne","year":"2019","unstructured":"Dahne, J. et al. Pilot randomized trial of a self-help behavioral activation mobile app for utilization in primary care. Behav. Ther. 50, 817\u2013827 (2019).","journal-title":"Behav. Ther."},{"key":"386_CR27","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1016\/j.jad.2019.03.009","volume":"250","author":"J Dahne","year":"2019","unstructured":"Dahne, J. et al. Pilot randomized controlled trial of a Spanish-language Behavioral Activation mobile app (\u00a1Apt\u00edvate!) for the treatment of depressive symptoms among united states Latinx adults with limited English proficiency. J. Affect. Disord. 250, 210\u2013217 (2019).","journal-title":"J. Affect. Disord."},{"key":"386_CR28","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1007\/s10608-014-9606-z","volume":"38","author":"PM Enock","year":"2014","unstructured":"Enock, P. M., Hofmann, S. G. & McNally, R. J. Attention bias modification training via smartphone to reduce social anxiety: a randomized, controlled multi-session experiment. Cogn. Ther. Res. 38, 200\u2013216 (2014).","journal-title":"Cogn. Ther. Res."},{"key":"386_CR29","doi-asserted-by":"publisher","first-page":"710","DOI":"10.1089\/tmj.2017.0214","volume":"24","author":"J-W Hur","year":"2018","unstructured":"Hur, J.-W., Kim, B., Park, D. & Choi, S.-W. A scenario-based cognitive behavioral therapy mobile app to reduce dysfunctional beliefs in individuals with depression: a randomized controlled trial. Telemed. J. E Health 24, 710\u2013716 (2018).","journal-title":"Telemed. J. E Health"},{"key":"386_CR30","doi-asserted-by":"publisher","DOI":"10.2196\/12106","volume":"6","author":"B Inkster","year":"2018","unstructured":"Inkster, B., Sarda, S. & Subramanian, V. An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: real-world data evaluation mixed-methods study. JMIR Mhealth Uhealth 6, e12106 (2018).","journal-title":"JMIR Mhealth Uhealth"},{"key":"386_CR31","doi-asserted-by":"publisher","first-page":"753","DOI":"10.1016\/j.psychres.2018.08.113","volume":"269","author":"T L\u00fcdtke","year":"2018","unstructured":"L\u00fcdtke, T., Pult, L. K., Schr\u00f6der, J., Moritz, S. & B\u00fccker, L. A randomized controlled trial on a smartphone self-help application (Be Good to Yourself) to reduce depressive symptoms. Psychiatry Res 269, 753\u2013762 (2018).","journal-title":"Psychiatry Res"},{"key":"386_CR32","doi-asserted-by":"publisher","unstructured":"Lukas, C. A., Eskofier, B. & Berking, M. A gamified smartphone-based intervention for depression: results from a randomized controlled pilot trial. Preprint https:\/\/doi.org\/10.2196\/preprints.16643 (2019).","DOI":"10.2196\/preprints.16643"},{"key":"386_CR33","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2013-003440","volume":"4","author":"KH Ly","year":"2014","unstructured":"Ly, K. H. et al. Behavioural activation versus mindfulness-based guided self-help treatment administered through a smartphone application: a randomised controlled trial. BMJ Open 4, e003440 (2014).","journal-title":"BMJ Open"},{"key":"386_CR34","doi-asserted-by":"publisher","first-page":"36","DOI":"10.3390\/bs8040036","volume":"8","author":"S Mehrotra","year":"2018","unstructured":"Mehrotra, S., Sudhir, P., Rao, G., Thirthalli, J. & Srikanth, T. K. Development and pilot testing of an internet-based self-help intervention for depression for indian users. Behav. Sci. 8, 36 (2018).","journal-title":"Behav. Sci."},{"key":"386_CR35","doi-asserted-by":"publisher","DOI":"10.2196\/12556","volume":"21","author":"C Moberg","year":"2019","unstructured":"Moberg, C., Niles, A. & Beermann, D. Guided self-help works: randomized waitlist controlled trial of pacifica, a mobile app integrating cognitive behavioral therapy and mindfulness for stress, anxiety, and depression. J. Med. Internet Res. 21, e12556 (2019).","journal-title":"J. Med. Internet Res."},{"key":"386_CR36","doi-asserted-by":"publisher","DOI":"10.2196\/13609","volume":"21","author":"DC Mohr","year":"2019","unstructured":"Mohr, D. C. et al. Comparison of the effects of coaching and receipt of app recommendations on depression, anxiety, and engagement in the intellicare platform: factorial randomized controlled trial. J. Med. Internet Res. 21, e13609 (2019).","journal-title":"J. Med. Internet Res."},{"key":"386_CR37","unstructured":"Norton, V. P. The CALM project: teaching mindfulness meditation in primary care using computer-based application (ProQuest, 2017)."},{"key":"386_CR38","doi-asserted-by":"publisher","DOI":"10.2196\/10130","volume":"20","author":"A Pratap","year":"2018","unstructured":"Pratap, A. et al. Using mobile apps to assess and treat depression in hispanic and latino populations: fully remote randomized clinical trial. J. Med. Internet Res. 20, e10130 (2018).","journal-title":"J. Med. Internet Res."},{"key":"386_CR39","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1089\/g4h.2014.0046","volume":"4","author":"AM Roepke","year":"2015","unstructured":"Roepke, A. M. et al. Randomized controlled trial of superbetter, a smartphone-based\/internet-based self-help tool to reduce depressive symptoms. Games Health J. 4, 235\u2013246 (2015).","journal-title":"Games Health J."},{"key":"386_CR40","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1037\/ser0000261","volume":"16","author":"C Stiles-Shields","year":"2019","unstructured":"Stiles-Shields, C., Montague, E., Kwasny, M. J. & Mohr, D. C. Behavioral and cognitive intervention strategies delivered via coached apps for depression: pilot trial. Psychol. Serv. 16, 233\u2013238 (2019).","journal-title":"Psychol. Serv."},{"key":"386_CR41","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1037\/ccp0000301","volume":"86","author":"T Stolz","year":"2018","unstructured":"Stolz, T. et al. A mobile app for social anxiety disorder: a three-arm randomized controlled trial comparing mobile and PC-based guided self-help interventions. J. Consult. Clin. Psychol. 86, 493\u2013504 (2018).","journal-title":"J. Consult. Clin. Psychol."},{"key":"386_CR42","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.5960","volume":"4","author":"F Wahle","year":"2016","unstructured":"Wahle, F., Kowatsch, T., Fleisch, E., Rufer, M. & Weidt, S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR Mhealth Uhealth 4, e111 (2016).","journal-title":"JMIR Mhealth Uhealth"},{"key":"386_CR43","doi-asserted-by":"publisher","DOI":"10.1186\/1471-244X-13-49","volume":"13","author":"S Watts","year":"2013","unstructured":"Watts, S. et al. CBT for depression: a pilot RCT comparing mobile phone vs. computer. BMC Psychiatry 13, 49 (2013).","journal-title":"BMC Psychiatry"},{"key":"386_CR44","doi-asserted-by":"publisher","first-page":"604","DOI":"10.3389\/fpsyt.2019.00604","volume":"10","author":"MH Lim","year":"2019","unstructured":"Lim, M. H. et al. A pilot digital intervention targeting loneliness in youth mental health. Front. Psychiatry 10, 604 (2019).","journal-title":"Front. Psychiatry"},{"key":"386_CR45","unstructured":"Aromataris, E. & Munn, Z. Joanna Briggs Institute reviewer\u2019s manual. The Joanna Briggs Institute https:\/\/reviewersmanual.joannabriggs.org (2017)."},{"key":"386_CR46","doi-asserted-by":"publisher","first-page":"l4898","DOI":"10.1136\/bmj.l4898","volume":"366","author":"JAC Sterne","year":"2019","unstructured":"Sterne, J. A. C. et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 366, l4898 (2019).","journal-title":"BMJ"},{"key":"386_CR47","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1136\/eb-2018-102891","volume":"21","author":"J Torous","year":"2018","unstructured":"Torous, J., Nicholas, J., Larsen, M. E., Firth, J. & Christensen, H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid. Based Ment. Health 21, 116\u2013119 (2018).","journal-title":"Evid. Based Ment. Health"},{"key":"386_CR48","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/j.invent.2014.08.003","volume":"1","author":"H Baumeister","year":"2014","unstructured":"Baumeister, H., Reichler, L., Munzinger, M. & Lin, J. The impact of guidance on Internet-based mental health interventions \u2014 a systematic review. Internet Interv. 1, 205\u2013215 (2014).","journal-title":"Internet Interv."},{"key":"386_CR49","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1093\/tbm\/ibx037","volume":"8","author":"A Baumel","year":"2018","unstructured":"Baumel, A. & Yom-Tov, E. Predicting user adherence to behavioral eHealth interventions in the real world: examining which aspects of intervention design matter most. Transl. Behav. Med. 8, 793\u2013798 (2018).","journal-title":"Transl. Behav. Med."},{"key":"386_CR50","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2019.2075","author":"AK Graham","year":"2019","unstructured":"Graham, A. K., Lattie, E. G. & Mohr, D. C. Experimental therapeutics for digital mental health. JAMA Psychiatry https:\/\/doi.org\/10.1001\/jamapsychiatry.2019.2075 (2019).","journal-title":"JAMA Psychiatry"},{"key":"386_CR51","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1257\/000282803321946985","volume":"93","author":"D Kahneman","year":"2003","unstructured":"Kahneman, D. A psychological perspective on economics. Am. Econ. Rev. 93, 162\u2013168 (2003).","journal-title":"Am. Econ. Rev."},{"key":"386_CR52","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-019-7407-8","volume":"19","author":"I Vlaev","year":"2019","unstructured":"Vlaev, I., King, D., Darzi, A. & Dolan, P. Changing health behaviors using financial incentives: a review from behavioral economics. BMC Public Health 19, 1059 (2019).","journal-title":"BMC Public Health"},{"key":"386_CR53","doi-asserted-by":"publisher","DOI":"10.2196\/12121","volume":"8","author":"RS Beidas","year":"2019","unstructured":"Beidas, R. S. et al. Transforming mental health delivery through behavioral economics and implementation science: protocol for three exploratory projects. JMIR Res Protoc. 8, e12121 (2019).","journal-title":"JMIR Res Protoc."},{"key":"386_CR54","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-018-1736-5","volume":"18","author":"J Wang","year":"2018","unstructured":"Wang, J., Mann, F., Lloyd-Evans, B., Ma, R. & Johnson, S. Associations between loneliness and perceived social support and outcomes of mental health problems: a systematic review. BMC Psychiatry 18, 156 (2018).","journal-title":"BMC Psychiatry"},{"key":"386_CR55","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1772","volume":"13","author":"L Donkin","year":"2011","unstructured":"Donkin, L. et al. A systematic review of the impact of adherence on the effectiveness of e-therapies. J. Med. Internet Res. 13, e52 (2011).","journal-title":"J. Med. Internet Res."},{"key":"386_CR56","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.10918","volume":"3","author":"J Torous","year":"2020","unstructured":"Torous, J., Michalak, E. E. & O\u2019Brien, H. L. Digital health and engagement-looking behind the measures and methods. JAMA Netw. Open 3, e2010918 (2020).","journal-title":"JAMA Netw. Open"},{"key":"386_CR57","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1056\/NEJMsa0806819","volume":"360","author":"KG Volpp","year":"2009","unstructured":"Volpp, K. G. et al. A randomized, controlled trial of financial incentives for smoking cessation. N. Engl. J. Med. 360, 699\u2013709 (2009).","journal-title":"N. Engl. J. Med."},{"key":"386_CR58","doi-asserted-by":"publisher","unstructured":"Patel, M. S. et al. Effectiveness of behaviorally designed gamification interventions with social incentives for increasing physical activity among overweight and obese adults across the united states: the STEP UP randomized clinical trial. JAMA Intern. Med. 1\u20139, https:\/\/doi.org\/10.1001\/jamainternmed.2019.3505 (2019).","DOI":"10.1001\/jamainternmed.2019.3505"},{"key":"386_CR59","doi-asserted-by":"publisher","first-page":"1176","DOI":"10.1001\/jamapediatrics.2017.3233","volume":"171","author":"CA Wong","year":"2017","unstructured":"Wong, C. A. et al. Effect of financial incentives on glucose monitoring adherence and glycemic control among adolescents and young adults with type 1 diabetes: a randomized clinical trial. JAMA Pediatr. 171, 1176\u20131183 (2017).","journal-title":"JAMA Pediatr."},{"key":"386_CR60","doi-asserted-by":"publisher","first-page":"b2535","DOI":"10.1136\/bmj.b2535","volume":"339","author":"D Moher","year":"2009","unstructured":"Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339, b2535 (2009).","journal-title":"BMJ"},{"key":"386_CR61","doi-asserted-by":"publisher","DOI":"10.2196\/15321","volume":"7","author":"C Qu","year":"2020","unstructured":"Qu, C., Sas, C., Daud\u00e9n Roquet, C. & Doherty, G. Functionality of top-rated mobile apps for depression: systematic search and evaluation. JMIR Ment. Health 7, e15321 (2020).","journal-title":"JMIR Ment. Health"},{"key":"386_CR62","doi-asserted-by":"publisher","first-page":"1038","DOI":"10.1089\/tmj.2015.0002","volume":"21","author":"S Chan","year":"2015","unstructured":"Chan, S., Torous, J., Hinton, L. & Yellowlees, P. Towards a framework for evaluating mobile mental health apps. Telemed. J. E Health 21, 1038\u20131041 (2015).","journal-title":"Telemed. J. E Health"},{"key":"386_CR63","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1136\/bmj.327.7414.557","volume":"327","author":"JPT Higgins","year":"2003","unstructured":"Higgins, J. P. T., Thompson, S. G., Deeks, J. J. & Altman, D. G. Measuring inconsistency in meta-analyses. BMJ 327, 557\u2013560 (2003).","journal-title":"BMJ"},{"key":"386_CR64","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1111\/j.0006-341X.2000.00455.x","volume":"56","author":"S Duval","year":"2000","unstructured":"Duval, S. & Tweedie, R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 56, 455\u2013463 (2000).","journal-title":"Biometrics"},{"key":"386_CR65","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v036.i03","volume":"36","author":"W Viechtbauer","year":"2010","unstructured":"Viechtbauer, W. Conducting meta-analyses in R with the metafor package. J Stat Softw 36, 1\u201348 (2010).","journal-title":"J Stat Softw"},{"key":"386_CR66","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.2551803","author":"M Harrer","year":"2019","unstructured":"Harrer, M., Cuijpers, P., Furukawa, T. & Ebert, D. Doing meta-analysis in R: a hands-on guide. Zenodo https:\/\/doi.org\/10.5281\/zenodo.2551803 (2019).","journal-title":"Zenodo"},{"key":"386_CR67","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1136\/ebmental-2019-300117","volume":"22","author":"S Balduzzi","year":"2019","unstructured":"Balduzzi, S., R\u00fccker, G. & Schwarzer, G. How to perform a meta-analysis with R: a practical tutorial. Evid. Based Ment. Health 22, 153\u2013160 (2019).","journal-title":"Evid. Based Ment. Health"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00386-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00386-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00386-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,29]],"date-time":"2023-01-29T01:15:36Z","timestamp":1674954936000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00386-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,11]]},"references-count":67,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["386"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00386-8","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,11]]},"assertion":[{"value":"5 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 December 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 February 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests. The Weill Cornell Department of Psychiatry has developed an app for the treatment of anxiety in youth. The app is not commercially available.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"20"}}