{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T19:43:56Z","timestamp":1777059836941,"version":"3.51.4"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,3,22]],"date-time":"2019-03-22T00:00:00Z","timestamp":1553212800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,3,22]],"date-time":"2019-03-22T00:00:00Z","timestamp":1553212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Despite the emergence of curated app libraries for mental health apps, personal searches by consumers remain a common method for discovering apps. App store descriptions therefore represent a key channel to inform consumer choice. This study examined the claims invoked through these app store descriptions, the extent to which scientific language is used to support such claims, and the corresponding evidence in the literature. Google Play and iTunes were searched for apps related to depression, self-harm, substance use, anxiety, and schizophrenia. The descriptions of the top-ranking, consumer-focused apps were coded to identify claims of acceptability and effectiveness, and forms of supporting statement. For apps which invoked ostensibly scientific principles, a literature search was conducted to assess their credibility. Seventy-three apps were coded, and the majority (64%) claimed effectiveness at diagnosing a mental health condition, or improving symptoms, mood or self-management. Scientific language was most frequently used to support these effectiveness claims (44%), although this included techniques not validated by literature searches (8\/24\u2009=\u200933%). Two apps described low-quality, primary evidence to support the use of the app. Only one app included a citation to published literature. A minority of apps (14%) described design or development involving lived experience, and none referenced certification or accreditation processes such as app libraries. Scientific language was the most frequently invoked form of support for use of mental health apps; however, high-quality evidence is not commonly described. Improved knowledge translation strategies may improve the adoption of other strategies, such as certification or lived experience co-design.<\/jats:p>","DOI":"10.1038\/s41746-019-0093-1","type":"journal-article","created":{"date-parts":[[2019,3,22]],"date-time":"2019-03-22T11:02:47Z","timestamp":1553252567000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":306,"title":["Using science to sell apps: Evaluation of mental health app store quality claims"],"prefix":"10.1038","volume":"2","author":[{"given":"Mark Erik","family":"Larsen","sequence":"first","affiliation":[]},{"given":"Kit","family":"Huckvale","sequence":"additional","affiliation":[]},{"given":"Jennifer","family":"Nicholas","sequence":"additional","affiliation":[]},{"given":"John","family":"Torous","sequence":"additional","affiliation":[]},{"given":"Louise","family":"Birrell","sequence":"additional","affiliation":[]},{"given":"Emily","family":"Li","sequence":"additional","affiliation":[]},{"given":"Bill","family":"Reda","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,3,22]]},"reference":[{"key":"93_CR1","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1002\/wps.20472","volume":"16","author":"J Firth","year":"2017","unstructured":"Firth, J. et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry 16, 287\u2013298 (2017).","journal-title":"World Psychiatry"},{"key":"93_CR2","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.jad.2017.04.046","volume":"218","author":"J Firth","year":"2017","unstructured":"Firth, J. et al. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J. Affect Disord. 218, 15\u201322 (2017).","journal-title":"J. Affect Disord."},{"key":"93_CR3","doi-asserted-by":"publisher","DOI":"10.1186\/1741-7015-10-144","volume":"10","author":"K Huckvale","year":"2012","unstructured":"Huckvale, K., Car, M., Morrison, C. & Car, J. Apps for asthma self-management: a systematic assessment of content and tools. BMC Med. 10, 144 (2012).","journal-title":"BMC Med."},{"key":"93_CR4","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-015-0303-x","volume":"13","author":"K Huckvale","year":"2015","unstructured":"Huckvale, K., Morrison, C., Ouyang, J., Ghaghda, A. & Car, J. The evolution of mobile apps for asthma: an updated systematic assessment of content and tools. BMC Med. 13, 58 (2015).","journal-title":"BMC Med."},{"key":"93_CR5","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0152285","volume":"11","author":"ME Larsen","year":"2016","unstructured":"Larsen, M. E., Nicholas, J. & Christensen, H. A systematic assessment of smartphone tools for suicide prevention. PLoS ONE 11, e0152285 (2016).","journal-title":"PLoS ONE"},{"key":"93_CR6","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.4581","volume":"17","author":"J Nicholas","year":"2015","unstructured":"Nicholas, J., Larsen, M. E., Proudfoot, J. & Christensen, H. Mobile apps for bipolar disorder: a systematic review of features and content quality. J. Med. Internet Res. 17, e198 (2015).","journal-title":"J. Med. Internet Res."},{"key":"93_CR7","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1111\/1753-6405.12688","volume":"41","author":"L Thornton","year":"2017","unstructured":"Thornton, L. et al. Free smoking cessation mobile apps available in Australia: a quality review and content analysis. Aust. N. Z. J. Public Health 41, 625\u2013630 (2017).","journal-title":"Aust. N. Z. J. Public Health"},{"key":"93_CR8","unstructured":"U.S. Food and Drug Administration. Digital Health Software Precertification (Pre-Cert) Program https:\/\/www.fda.gov\/MedicalDevices\/DigitalHealth\/UCM567265 (2018)."},{"key":"93_CR9","unstructured":"NHS. NHS Apps Library https:\/\/apps.beta.nhs.uk\/ (2018)."},{"key":"93_CR10","unstructured":"PsyberGuide. PsyberGuide https:\/\/psyberguide.org\/ (2018)."},{"key":"93_CR11","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1176\/appi.ps.201700423","volume":"69","author":"JB Torous","year":"2018","unstructured":"Torous, J. B. et al. A hierarchical framework for evaluation and informed decision making regarding smartphone apps for clinical care. Psychiatr. Serv. 69, 498\u2013500 (2018).","journal-title":"Psychiatr. Serv."},{"key":"93_CR12","doi-asserted-by":"publisher","DOI":"10.2196\/10141","volume":"20","author":"SM Schueller","year":"2018","unstructured":"Schueller, S. M., Neary, M., O\u2019Loughlin, K. & Adkins, E. C. Discovery of and interest in health apps among those with mental health needs: survey and focus group study. J. Med. Internet Res. 20, e10141 (2018).","journal-title":"J. Med. Internet Res."},{"key":"93_CR13","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.6020","volume":"4","author":"ME Larsen","year":"2016","unstructured":"Larsen, M. E., Nicholas, J. & Christensen, H. Quantifying app store dynamics: longitudinal tracking of mental health apps. JMIR Mhealth Uhealth 4, e96 (2016).","journal-title":"JMIR Mhealth Uhealth"},{"key":"93_CR14","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.cpr.2005.07.003","volume":"26","author":"AC Butler","year":"2006","unstructured":"Butler, A. C., Chapman, J. E., Forman, E. M. & Beck, A. T. The empirical status of cognitive-behavioral therapy: a review of meta-analyses. Clin. Psychol. Rev. 26, 17\u201331 (2006).","journal-title":"Clin. Psychol. Rev."},{"key":"93_CR15","doi-asserted-by":"publisher","unstructured":"Hawton, K. et al. Psychosocial interventions for self-harm in adults. Cochrane Data base Syst Rev, CD012189, https:\/\/doi.org\/10.1002\/14651858.CD012189 (2016).","DOI":"10.1002\/14651858.CD012189"},{"key":"93_CR16","doi-asserted-by":"publisher","first-page":"1596","DOI":"10.1007\/s11606-007-0333-y","volume":"22","author":"S Gilbody","year":"2007","unstructured":"Gilbody, S., Richards, D., Brealey, S. & Hewitt, C. Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): a diagnostic meta-analysis. J. Gen. Intern. Med. 22, 1596\u20131602 (2007).","journal-title":"J. Gen. Intern. Med."},{"key":"93_CR17","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.genhosppsych.2015.11.005","volume":"39","author":"F Plummer","year":"2016","unstructured":"Plummer, F., Manea, L., Trepel, D. & McMillan, D. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen. Hosp. Psychiatry 39, 24\u201331 (2016).","journal-title":"Gen. Hosp. Psychiatry"},{"key":"93_CR18","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.1111\/adb.12414","volume":"22","author":"K Charlet","year":"2017","unstructured":"Charlet, K. & Heinz, A. Harm reduction-a systematic review on effects of alcohol reduction on physical and mental symptoms. Addict. Biol. 22, 1119\u20131159 (2017).","journal-title":"Addict. Biol."},{"key":"93_CR19","first-page":"1053","volume":"34","author":"K Robertson","year":"2005","unstructured":"Robertson, K. Active listening: more than just paying attention. Aust. Fam. Physician 34, 1053\u20131055 (2005).","journal-title":"Aust. Fam. Physician"},{"key":"93_CR20","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0154248","volume":"11","author":"A Huguet","year":"2016","unstructured":"Huguet, A. et al. A systematic review of cognitive behavioral therapy and behavioral activation apps for depression. PLoS ONE 11, e0154248 (2016).","journal-title":"PLoS ONE"},{"key":"93_CR21","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2016-013518","volume":"7","author":"J Tighe","year":"2017","unstructured":"Tighe, J. et al. Ibobbly mobile health intervention for suicide prevention in Australian Indigenous youth: a pilot randomised controlled trial. BMJ Open 7, e013518 (2017).","journal-title":"BMJ Open"},{"key":"93_CR22","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.7725","volume":"19","author":"DC Mohr","year":"2017","unstructured":"Mohr, D. C., Lyon, A. R., Lattie, E. G., Reddy, M. & Schueller, S. M. Accelerating digital mental health research from early design and creation to successful implementation and sustainment. J. Med. Internet Res. 19, e153 (2017).","journal-title":"J. Med. Internet Res."},{"key":"93_CR23","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1136\/eb-2018-102891","volume":"21","author":"J Torous","year":"2018","unstructured":"Torous, J., Nicholas, J., Larsen, M. E., Firth, J. & Christensen, H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid. Based Ment. Health 21, 116\u2013119 (2018).","journal-title":"Evid. Based Ment. Health"},{"key":"93_CR24","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.7273","volume":"19","author":"J Nicholas","year":"2017","unstructured":"Nicholas, J., Fogarty, A. S., Boydell, K. & Christensen, H. The reviews are in: a qualitative content analysis of consumer perspectives on apps for bipolar disorder. J. Med. Internet Res. 19, e105 (2017).","journal-title":"J. Med. Internet Res."},{"key":"93_CR25","doi-asserted-by":"publisher","first-page":"2310","DOI":"10.1377\/hlthaff.2016.0578","volume":"35","author":"K Singh","year":"2016","unstructured":"Singh, K. et al. Many mobile health apps target high-need, high-cost populations, but gaps remain. Health Aff. (Millwood) 35, 2310\u20132318 (2016).","journal-title":"Health Aff. (Millwood)"},{"key":"93_CR26","unstructured":"OCEBM Levels of Evidence Working Group. The Oxford Levels of Evidence 2 https:\/\/www.cebm.net\/index.aspx?o=5653 (2016)."},{"key":"93_CR27","unstructured":"NHS Digital. Digital Assessment Questionnaire v2.1 (16 August 2018) https:\/\/developer.nhs.uk\/digital-tools\/daq\/ (2018)."},{"key":"93_CR28","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/S2215-0366(15)00505-2","volume":"3","author":"D Vigo","year":"2016","unstructured":"Vigo, D., Thornicroft, G. & Atun, R. Estimating the true global burden of mental illness. Lancet Psychiatry 3, 171\u2013178 (2016).","journal-title":"Lancet Psychiatry"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0093-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0093-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0093-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,17]],"date-time":"2022-12-17T18:28:33Z","timestamp":1671301713000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0093-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,22]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["93"],"URL":"https:\/\/doi.org\/10.1038\/s41746-019-0093-1","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,22]]},"assertion":[{"value":"15 October 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 February 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 March 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"18"}}