{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T05:48:38Z","timestamp":1790747318436,"version":"4.1.0"},"reference-count":30,"publisher":"BMJ","issue":"4","funder":[{"name":"ORCHA Healthcare Limited"}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["Evid Based Mental Health"],"accepted":{"date-parts":[[2017,9,13]]},"published-print":{"date-parts":[[2017,11]]},"abstract":"<jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Mobile health offers many opportunities; however, the \u2018side-effects\u2019 of health apps are often unclear. With no guarantee health apps first do no harm, their role as a viable, safe and effective therapeutic option is limited.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To assess the quality of apps for chronic insomnia disorder, available on the Android Google Play Store, and determine whether a novel approach to app assessment could identify high-quality and low-risk health apps in the absence of indicators such as National Health Service (NHS) approval.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>The Organisation for the Review of Care and Health Applications- 24 Question Assessment (ORCHA-24), 24 app assessment criteria concerning data privacy, clinical efficacy and user experience, answered on a \u2018yes\u2019 or \u2018no\u2019 and evidence-driven basis, was applied to assess 18 insomnia apps identified via the Android Google Play Store, in addition to the NHS-approved iOS app Sleepio.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Findings<\/jats:title>\n                  <jats:p>63.2% of apps (12\/19) provided a privacy policy, with seven (36.8%) stating no user data would be shared without explicit consent. 10.5% (2\/19) stated they had been shown to be of benefit to those with insomnia, with cognitive behavioural therapy apps outperforming hypnosis and meditation apps (p=0.046). Both the number of app downloads (p=0.29) and user-review scores (p=0.23) were unrelated to ORCHA-24 scores. The NHS-approved app Sleepio, consistently outperformed non-accredited apps across all domains of the ORCHA-24.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Apps for chronic insomnia disorder exhibit substantial variation in adherence to published data privacy, user experience and clinical efficacy standards, which are not clearly correlated with app downloads or user-review scores.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Clinical implications<\/jats:title>\n                  <jats:p>In absence of formal app accreditation, the ORCHA-24 could feasibly be used to highlight the risk\u2013benefit profiles of health apps prior to downloading.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1136\/eb-2017-102751","type":"journal-article","created":{"date-parts":[[2017,9,25]],"date-time":"2017-09-25T20:40:27Z","timestamp":1506372027000},"page":"e20-e20","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":45,"title":["Effective? Engaging? Secure? Applying the ORCHA-24 framework to evaluate apps for chronic insomnia disorder"],"prefix":"10.1136","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6843-6447","authenticated-orcid":false,"given":"Simon","family":"Leigh","sequence":"first","affiliation":[{"name":"Lifecode Solutions, Liverpool, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Ouyang","sequence":"additional","affiliation":[{"name":"Innovation Hub, Alder Hey Children\u2019s Hospital, Liverpool, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chris","family":"Mimnagh","sequence":"additional","affiliation":[{"name":"Wingate Medical Centre, Liverpool, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2017,9,25]]},"reference":[{"key":"2025082623421902000_20.4.e20.1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.06.003"},{"key":"2025082623421902000_20.4.e20.2","unstructured":"Price Waterhouse Coopers (PWC): socio-economic impact of mHealth: an assessment report for the European Union. 2013 https:\/\/www.gsma.com\/iot\/wp-content\/uploads\/2013\/06\/Socio-economic_impact-of-mHealth_EU_14062013V2.pdf (accessed 9 Mar 2017)."},{"key":"2025082623421902000_20.4.e20.3","unstructured":"World Health Organisation World Health Report. Mental disorders affect one in four people. http:\/\/www.who.int\/whr\/2001\/media_centre\/press_release\/en\/ (accessed 18 Apr 2017)."},{"key":"2025082623421902000_20.4.e20.4","doi-asserted-by":"publisher","DOI":"10.1136\/eb-2015-102203"},{"key":"2025082623421902000_20.4.e20.5","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-015-0444-y"},{"key":"2025082623421902000_20.4.e20.6","unstructured":"Charter of fundamental rights of the European union (2000\/c 364\/01). article 8. http:\/\/www.europarl.europa.eu\/charter\/pdf\/text_en.pdf (accessed 7 apr 2017)."},{"key":"2025082623421902000_20.4.e20.7","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-015-0314-7"},{"key":"2025082623421902000_20.4.e20.8","doi-asserted-by":"publisher","DOI":"10.1001\/jamadermatol.2013.2382"},{"key":"2025082623421902000_20.4.e20.9","doi-asserted-by":"crossref","DOI":"10.2196\/mhealth.3422","article-title":"Mobile app rating scale: a new tool for assessing the quality of health mobile apps","volume":"3","author":"Stoyanov","year":"2015","journal-title":"JMIR Mhealth Uhealth"},{"key":"2025082623421902000_20.4.e20.10","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1089\/tmj.2012.0073","article-title":"Conceptual framework for development of comprehensive e-health evaluation tool","volume":"19","author":"Khoja","year":"2013","journal-title":"Telemed J E Health"},{"key":"2025082623421902000_20.4.e20.11","unstructured":"PAS 277:2015 health and wellness apps. Quality criteria across the life cycle. Code of practice. http:\/\/shop.bsigroup.com\/forms\/PASs\/PAS-2772015\/ (accessed 4 Feb 2017)."},{"key":"2025082623421902000_20.4.e20.12","unstructured":"App Quality Alliance. Baseline testing criteria for android applications. updated with v1.6,30 Nov 2014. http:\/\/www.appqualityalliance.org\/AQuA-test-criteria-for-android-apps (accessed 5 Feb 2017)."},{"key":"2025082623421902000_20.4.e20.13","unstructured":"The data protection act 1998. http:\/\/www.legislation.gov.uk\/ukpga\/1998\/29\/contents (accessed 4 Jun 2017)."},{"key":"2025082623421902000_20.4.e20.14","unstructured":"The European Data Protection Directive (95\/46\/EC). http:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=celex:31995L0046 (accessed 5 May 2017)."},{"key":"2025082623421902000_20.4.e20.15","unstructured":"Information Commissioner\u2019s Office. Guidance on data security breach management. version 2.1. the data protection act. (2012). https:\/\/ico.org.uk\/media\/for-organisations\/documents\/1562\/guidance_on_data_security_breach_management.pdf (accessed 6 Apr 2017)."},{"key":"2025082623421902000_20.4.e20.16","unstructured":"GSMA: Mobile and Privacy. Privacy design guidelines for mobile application development 2012. https:\/\/www.gsma.com\/publicpolicy\/wp-content\/uploads\/2012\/03\/gsmaprivacydesignguidelinesformobileapplicationdevelopmentv1.pdf (accessed 18 May 2017)."},{"key":"2025082623421902000_20.4.e20.17","unstructured":"App Quality Alliance. Accessibility testing criteria for windows applications\u00a0version 1.0\u00a0October 2015. http:\/\/www.appqualityalliance.org\/Accessibility_Testing_Criteria (accessed 7 Feb 2017)."},{"key":"2025082623421902000_20.4.e20.18","unstructured":"W3C. Accessibility requirements for people with low vision editor\u2019s draft 06 Jun 2016, clause 3.3.1. https:\/\/www.w3.org\/TR\/low-vision-needs\/ (accessed 5 Apr 2017)."},{"key":"2025082623421902000_20.4.e20.19","unstructured":"NHS. Online Mental Health Services: Sleepio. http:\/\/www.nhs.uk\/Conditions\/online-mental-health-services\/Pages\/sleepio.aspx (accessed 21 May 2017)."},{"key":"2025082623421902000_20.4.e20.20","unstructured":"Misrepresentation act 1967. http:\/\/www.legislation.gov.uk\/ukpga\/1967\/7\/section\/3 (accessed 18 Apr 2017)."},{"key":"2025082623421902000_20.4.e20.21","doi-asserted-by":"publisher","DOI":"10.1136\/eb-2016-102384"},{"key":"2025082623421902000_20.4.e20.22","doi-asserted-by":"crossref","unstructured":"Zimmeck S , Wang Z , Zou L , et al . Automated analysis of privacy requirements for mobile apps. 2016 http:\/\/shomir.net\/pdf\/publications\/plt_2016s.pdf (accessed 23 Apr 2017).","DOI":"10.14722\/ndss.2017.23034"},{"key":"2025082623421902000_20.4.e20.23","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2015.19426"},{"key":"2025082623421902000_20.4.e20.24","unstructured":"EU Commission. EU charter of fundamental rights (2009). http:\/\/ec.europa.eu\/justice\/fundamental-rights\/charter\/index_en.htm (accessed 11 Feb 2017)."},{"key":"2025082623421902000_20.4.e20.25","unstructured":"Olmstead K , Atkinson M . Pew Research Center: Internet & Technology. Apps permissions in the google play store. 2015 http:\/\/www.pewinternet.org\/2015\/11\/10\/apps-permissions-in-the-google-play-store\/ (accessed 28 May 2017)."},{"key":"2025082623421902000_20.4.e20.26","unstructured":"Khalid H . On the link between mobile app quality and user reviews.\u00a0M.Sc Thesis. 2014 https:\/\/qspace.library.queensu.ca\/bitstream\/handle\/1974\/12596\/Khalid_Hammad_201410_MSC.pdf;jsessionid=25F5D563137E7802DBF77A2F0AB3F84E?sequence=1 (accessed 28 May 2017)."},{"key":"2025082623421902000_20.4.e20.27","unstructured":"Apps Information for Developers about the Apps Library (Beta). NHS digital assessment questions \u2013 Beta. frequently asked questions. https:\/\/developer.nhs.uk\/digital-tools\/frequently-asked-questions\/ (accessed 8 Sep 2017)."},{"key":"2025082623421902000_20.4.e20.28","unstructured":"NHS apps. https:\/\/apps.beta.nhs.uk (accessed 2 May 2017)."},{"key":"2025082623421902000_20.4.e20.29","unstructured":"IMS institute for health informatics. Medicines use and spending in the US\u2014a review of 2015 and outlook to 2020. http:\/\/www.imshealth.com\/en\/ thought-leadership\/ims-institute (accessed 2 Apr 2016)."},{"key":"2025082623421902000_20.4.e20.30","unstructured":"AQuA. Best practice guidelines for producing high quality mobile applications version 2.3. http:\/\/www.appqualityalliance.org\/AQuA-best-practice-guidelines (accessed 5 May 2017)."}],"container-title":["Evidence Based Mental Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/eb-2017-102751","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,27]],"date-time":"2025-08-27T06:42:31Z","timestamp":1756276951000},"score":1,"resource":{"primary":{"URL":"https:\/\/mentalhealth.bmj.com\/lookup\/doi\/10.1136\/eb-2017-102751"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,25]]},"references-count":30,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,10,23]]},"published-print":{"date-parts":[[2017,11]]}},"alternative-id":["10.1136\/eb-2017-102751"],"URL":"https:\/\/doi.org\/10.1136\/eb-2017-102751","relation":{},"ISSN":["1362-0347","1468-960X"],"issn-type":[{"value":"1362-0347","type":"print"},{"value":"1468-960X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,25]]}}}