{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,26]],"date-time":"2026-07-26T18:19:10Z","timestamp":1785089950539,"version":"3.55.0"},"reference-count":106,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2021,3,31]],"date-time":"2021-03-31T00:00:00Z","timestamp":1617148800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100020646","name":"Medibank Better Health Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100020646","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,6,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The study sought to review the different assessment items that have been used within existing health app evaluation frameworks aimed at individual, clinician, or organizational users, and to analyze the scoring and evaluation methods used in these frameworks.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We searched multiple bibliographic databases and conducted backward searches of reference lists, using search terms that were synonyms of \u201chealth apps,\u201d \u201cevaluation,\u201d and \u201cframeworks.\u201d The review covered publications from 2011 to April 2020. Studies on health app evaluation frameworks and studies that elaborated on the scaling and scoring mechanisms applied in such frameworks were included.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Ten common domains were identified across general health app evaluation frameworks. A list of 430 assessment criteria was compiled across 97 identified studies. The most frequently used scaling mechanism was a 5-point Likert scale. Most studies have adopted summary statistics to generate the total scoring of each app, and the most popular approach taken was the calculation of mean or average scores. Other frameworks did not use any scaling or scoring mechanism and adopted criteria-based, pictorial, or descriptive approaches, or \u201cthreshold\u201d filter.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>There is wide variance in the approaches to evaluating health apps within published frameworks, and this variance leads to ongoing uncertainty in how to evaluate health apps.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>A new evaluation framework is needed that can integrate the full range of evaluative criteria within one structure, and provide summative guidance on health app rating, to support individual app users, clinicians, and health organizations in choosing or recommending the best health app.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab041","type":"journal-article","created":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T12:18:12Z","timestamp":1614773892000},"page":"1318-1329","source":"Crossref","is-referenced-by-count":66,"title":["Scoping review: Development and assessment of evaluation frameworks of mobile health apps for recommendations to consumers"],"prefix":"10.1093","volume":"28","author":[{"given":"Martin","family":"Hensher","sequence":"first","affiliation":[{"name":"Institute for Health Transformation, Faculty of Health, Deakin University, Geelong, Victoria, Australia"},{"name":"Deakin Health Economics, School of Health and Social Development, Faculty of Health, Deakin University, Burwood, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Cooper","sequence":"additional","affiliation":[{"name":"Institute for Health Transformation, Faculty of Health, Deakin University, Geelong, Victoria, Australia"},{"name":"Deakin Health Economics, School of Health and Social Development, Faculty of Health, Deakin University, Burwood, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sithara Wanni Arachchige","family":"Dona","sequence":"additional","affiliation":[{"name":"Institute for Health Transformation, Faculty of Health, Deakin University, Geelong, Victoria, Australia"},{"name":"Deakin Health Economics, School of Health and Social Development, Faculty of Health, Deakin University, Burwood, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5660-9198","authenticated-orcid":false,"given":"Mary Rose","family":"Angeles","sequence":"additional","affiliation":[{"name":"Institute for Health Transformation, Faculty of Health, Deakin University, Geelong, Victoria, Australia"},{"name":"Deakin Health Economics, School of Health and Social Development, Faculty of Health, Deakin University, Burwood, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dieu","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Institute for Health Transformation, Faculty of Health, Deakin University, Geelong, Victoria, Australia"},{"name":"Deakin Health Economics, School of Health and Social Development, Faculty of Health, Deakin University, Burwood, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Natalie","family":"Heynsbergh","sequence":"additional","affiliation":[{"name":"Institute for Health Transformation, Faculty of Health, Deakin University, Geelong, Victoria, Australia"},{"name":"School of Nursing and Midwifery, Faculty of Health, Deakin University, Geelong, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary Lou","family":"Chatterton","sequence":"additional","affiliation":[{"name":"Institute for Health Transformation, Faculty of Health, Deakin University, Geelong, Victoria, Australia"},{"name":"Deakin Health Economics, School of Health and Social Development, Faculty of Health, Deakin University, Burwood, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Peeters","sequence":"additional","affiliation":[{"name":"Institute for Health Transformation, Faculty of Health, Deakin University, Geelong, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,3,31]]},"reference":[{"issue":"5","key":"2021070722001323900_ocab041-B1","first-page":"1699","article-title":"The regulatory arms race: mobile-health applications and agency posturing","volume":"93","author":"Schulke","year":"2013","journal-title":"Boston Univ Law Rev"},{"issue":"9","key":"2021070722001323900_ocab041-B2","doi-asserted-by":"crossref","first-page":"e11400","DOI":"10.2196\/11400","article-title":"Exploration of users' perspectives and needs and design of a type 1 diabetes management mobile app: mixed-methods study","volume":"6","author":"Zhang","year":"2018","journal-title":"JMIR Mhealth Uhealth"},{"issue":"2","key":"2021070722001323900_ocab041-B3","doi-asserted-by":"crossref","first-page":"e52","DOI":"10.1016\/S2589-7500(19)30013-5","article-title":"Deriving a practical framework for the evaluation of health apps","volume":"1","author":"Henson","year":"2019","journal-title":"Lancet Digit Health"},{"issue":"1","key":"2021070722001323900_ocab041-B4","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1002\/wps.20592","article-title":"Towards a consensus around standards for smartphone apps and digital mental health","volume":"18","author":"Torous","year":"2019","journal-title":"World Psychiatry"},{"issue":"1","key":"2021070722001323900_ocab041-B5","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1186\/s12916-018-1211-7","article-title":"How can clinicians, specialty societies and others evaluate and improve the quality of apps for patient use?","volume":"16","author":"Wyatt","year":"2018","journal-title":"BMC Med"},{"issue":"8","key":"2021070722001323900_ocab041-B6","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1097\/NMD.0000000000000864","article-title":"The emerging imperative for a consensus approach toward the rating and clinical recommendation of mental health apps","volume":"206","author":"Torous","year":"2018","journal-title":"J Nerv Ment Dis"},{"key":"2021070722001323900_ocab041-B7","year":"2020"},{"issue":"5","key":"2021070722001323900_ocab041-B8","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1001\/jamainternmed.2016.0326","article-title":"The challenges of mobile health regulation","volume":"176","author":"Schoenfeld","year":"2016","journal-title":"JAMA Intern Med"},{"key":"2021070722001323900_ocab041-B9","doi-asserted-by":"crossref","DOI":"10.1080\/17483107.2019.1701103","article-title":"Mobile health app usability and quality rating scales: a systematic review","author":"Azad-Khaneghah","year":"2020","journal-title":"Disabil Rehabil Assistive Technol"},{"issue":"3","key":"2021070722001323900_ocab041-B10","doi-asserted-by":"crossref","first-page":"e13057","DOI":"10.2196\/13057","article-title":"Standards for mobile health-related apps: systematic review and development of a guide","volume":"8","author":"Llorens-Vernet","year":"2020","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2021070722001323900_ocab041-B11","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1177\/1357633X16673538","article-title":"Evaluating mobile phone applications for health behaviour change: a systematic review","volume":"24","author":"McKay","year":"2018","journal-title":"J Telemed Telecare"},{"issue":"5","key":"2021070722001323900_ocab041-B12","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1017\/S026646231800051X","article-title":"Suitability of current evaluation frameworks for use in the health technology assessment of mobile medical applications: a systematic review","volume":"34","author":"Moshi","year":"2018","journal-title":"Int J Technol Assess Health Care"},{"issue":"8","key":"2021070722001323900_ocab041-B13","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1093\/jamia\/ocy050","article-title":"Criteria for assessing the quality of mHealth apps: a systematic review","volume":"25","author":"Nouri","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2021070722001323900_ocab041-B14","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1186\/s12874-018-0611-x","article-title":"Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach","volume":"18","author":"Munn","year":"2018","journal-title":"BMC Med Res Methodol"},{"key":"2021070722001323900_ocab041-B15"},{"key":"2021070722001323900_ocab041-B16","author":"Peters","year":"2020"},{"issue":"4","key":"2021070722001323900_ocab041-B17","first-page":"254","article-title":"Developing a theoretical framework for evaluating the quality of mhealth apps for adolescent users: a systematic review","volume":"24","author":"Jeminiwa","year":"2019","journal-title":"J Pediatr Pharmacol Ther"},{"key":"2021070722001323900_ocab041-B18","first-page":"1210","article-title":"A review and comparative analysis of security risks and safety measures of mobile health apps","volume":"19","author":"Scott","year":"2015","journal-title":"Aust J Inform Syst"},{"issue":"1","key":"2021070722001323900_ocab041-B19","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1186\/s13643-016-0384-4","article-title":"Rayyan-a web and mobile app for systematic reviews","volume":"5","author":"Ouzzani","year":"2016","journal-title":"Syst Rev"},{"issue":"11","key":"2021070722001323900_ocab041-B20","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1007\/s10916-015-0303-6","article-title":"Experiences and results of applying tools for assessing the quality of a mHealth App named heartkeeper","volume":"39","author":"Mart\u00ednez-P\u00e9rez","year":"2015","journal-title":"J Med Syst"},{"issue":"2","key":"2021070722001323900_ocab041-B21","doi-asserted-by":"crossref","first-page":"99","DOI":"10.3109\/03630269.2014.880716","article-title":"Patients welcome the sickle cell disease mobile application to record Symptoms via Technology (SMART)","volume":"38","author":"Shah","year":"2014","journal-title":"Hemoglobin"},{"issue":"2","key":"2021070722001323900_ocab041-B22","doi-asserted-by":"crossref","first-page":"e0229546","DOI":"10.1371\/journal.pone.0229546","article-title":"Consumer preference to utilise a mobile health app: a stated preference experiment","volume":"15","author":"Lim","year":"2020","journal-title":"PLoS One"},{"key":"2021070722001323900_ocab041-B23","first-page":"62","article-title":"Going digital: a narrative overview of the effects, quality and utility of mobile apps in chronic disease self-management","volume-title":"Aust Health Rev","author":"Scott","year":"2020"},{"issue":"1","key":"2021070722001323900_ocab041-B24","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1186\/1741-7015-10-144","article-title":"Apps for asthma self-management: a systematic assessment of content and tools","volume":"10","author":"Huckvale","year":"2012","journal-title":"BMC Med"},{"issue":"4","key":"2021070722001323900_ocab041-B25","doi-asserted-by":"crossref","first-page":"e20","DOI":"10.1136\/eb-2017-102751","article-title":"Effective? Engaging? Secure? Applying the orcha-24 framework to evaluate apps for chronic insomnia disorder","volume":"20","author":"Leigh","year":"2017","journal-title":"Evid Based Mental Health"},{"issue":"3","key":"2021070722001323900_ocab041-B26","first-page":"275","article-title":"Evaluation of mobile Apps for health promotion of pregnant women with preeclampsia","volume":"32","author":"De Sousa Gomes","year":"2019","journal-title":"Acta Paulista Enfermagem"},{"issue":"2","key":"2021070722001323900_ocab041-B27","doi-asserted-by":"crossref","first-page":"e25","DOI":"10.2196\/mhealth.2902","article-title":"A persuasive and social mHealth application for physical activity: a usability and feasibility study","volume":"2","author":"Al Ayubi","year":"2014","journal-title":"JMIR Mhealth Uhealth"},{"issue":"2","key":"2021070722001323900_ocab041-B28","doi-asserted-by":"crossref","first-page":"e16","DOI":"10.2196\/humanfactors.9765","article-title":"Relationship between evidence requirements, user expectations, and actual experiences: usability evaluation of the Twazon Arabic weight loss app","volume":"5","author":"Alnasser","year":"2018","journal-title":"JMIR Hum Factors"},{"issue":"4","key":"2021070722001323900_ocab041-B29","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1007\/s13142-016-0402-z","article-title":"Exploring the theoretical pathways through which asthma app features can promote adolescent self-management","volume":"6","author":"Carpenter","year":"2016","journal-title":"Transl Behav Med"},{"issue":"2","key":"2021070722001323900_ocab041-B30","doi-asserted-by":"crossref","first-page":"117","DOI":"10.4258\/hir.2014.20.2.117","article-title":"Development of smartphone educational application for patients with coronary artery disease","volume":"20","author":"Cho","year":"2014","journal-title":"Healthc Inform Res"},{"issue":"4","key":"2021070722001323900_ocab041-B31","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1258\/jtt.2012.111002","article-title":"An evaluation of diabetes self-management applications for Android smartphones","volume":"18","author":"Demidowich","year":"2012","journal-title":"J Telemed Telecare"},{"issue":"1","key":"2021070722001323900_ocab041-B32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3145846","article-title":"A review and assessment framework for mobile-based emergency intervention apps","volume":"51","author":"Gaziel-Yablowitz","year":"2018","journal-title":"ACM Comput Surv"},{"issue":"3","key":"2021070722001323900_ocab041-B33","doi-asserted-by":"crossref","first-page":"e67","DOI":"10.2196\/jmir.6976","article-title":"Assessing the quality of mobile exercise apps based on the American College of Sports Medicine Guidelines: a reliable and valid scoring instrument","volume":"19","author":"Guo","year":"2017","journal-title":"J Med Internet Res"},{"key":"2021070722001323900_ocab041-B34","year":"2020"},{"issue":"1","key":"2021070722001323900_ocab041-B35","doi-asserted-by":"crossref","first-page":"12","DOI":"10.7205\/MILMED-D-13-00271","article-title":"Preliminary evaluation of PTSD coach, a smartphone app for post-traumatic stress symptoms","volume":"179","author":"Kuhn","year":"2014","journal-title":"Mil Med"},{"key":"2021070722001323900_ocab041-B36","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.2147\/PPA.S207031","article-title":"Does \u201chospital loyalty\u201d matter? Factors related to the intention of using a mobile app","volume":"13","author":"Lin","year":"2019","journal-title":"Patient Prefer Adherence"},{"issue":"3","key":"2021070722001323900_ocab041-B37","doi-asserted-by":"crossref","first-page":"e82","DOI":"10.2196\/mhealth.4328","article-title":"Review and evaluation of mindfulness-based iPhone apps","volume":"3","author":"Mani","year":"2015","journal-title":"JMIR Mhealth Uhealth"},{"issue":"5","key":"2021070722001323900_ocab041-B38","doi-asserted-by":"crossref","first-page":"9976","DOI":"10.1007\/s10916-013-9976-x","article-title":"Development and evaluation of tools for measuring the quality of experience (QoE) in mHealth applications","volume":"37","author":"Mart\u00ednez-P\u00e9rez","year":"2013","journal-title":"J Med Syst"},{"issue":"3","key":"2021070722001323900_ocab041-B39","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1177\/1460458216642504","article-title":"Usability evaluation of the digital anger thermometer app","volume":"23","author":"Mattson","year":"2017","journal-title":"Health Inform J"},{"issue":"2","key":"2021070722001323900_ocab041-B40","doi-asserted-by":"crossref","first-page":"e196","DOI":"10.1016\/j.wombi.2020.02.006","article-title":"Developing and testing a mobile application for breastfeeding support: the Milky Way application","volume":"34","author":"Meedya","year":"2021","journal-title":"Women Birth"},{"issue":"4","key":"2021070722001323900_ocab041-B41","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1037\/ser0000100","article-title":"The DBT Coach mobile application as an adjunct to treatment for suicidal and self-injuring individuals with borderline personality disorder: a preliminary evaluation and challenges to client utilization","volume":"13","author":"Rizvi","year":"2016","journal-title":"Psychol Serv"},{"issue":"1","key":"2021070722001323900_ocab041-B42","doi-asserted-by":"crossref","first-page":"e5","DOI":"10.2196\/humanfactors.7133","article-title":"A self-regulation theory\u2013based asthma management mobile app for adolescents: a usability assessment","volume":"4","author":"Sage","year":"2017","journal-title":"JMIR Hum Factors"},{"issue":"9","key":"2021070722001323900_ocab041-B43","doi-asserted-by":"crossref","first-page":"e214","DOI":"10.2196\/jmir.2617","article-title":"Monitoring dietary intake and physical activity electronically: feasibility, usability, and ecological validity of a mobile-based ecological momentary assessment tool","volume":"15","author":"Spook","year":"2013","journal-title":"J Med Internet Res"},{"issue":"2","key":"2021070722001323900_ocab041-B44","doi-asserted-by":"crossref","first-page":"e72","DOI":"10.2196\/mhealth.5849","article-title":"Development and validation of the User Version of the Mobile Application Rating Scale (uMARS)","volume":"4","author":"Stoyanov","year":"2016","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2021070722001323900_ocab041-B45","doi-asserted-by":"crossref","first-page":"e27","DOI":"10.2196\/mhealth.3422","article-title":"Mobile app rating scale: a new tool for assessing the quality of health mobile apps","volume":"3","author":"Stoyanov","year":"2015","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2021070722001323900_ocab041-B46","doi-asserted-by":"crossref","first-page":"e27","DOI":"10.2196\/mhealth.8337","article-title":"A breastfeed-promoting mobile app intervention: usability and usefulness study","volume":"6","author":"Wang","year":"2018","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"2021070722001323900_ocab041-B47","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.amepre.2010.10.032","article-title":"iPhone apps for smoking cessation: a content analysis","volume":"40","author":"Abroms","year":"2011","journal-title":"Am J Prev Med"},{"issue":"4","key":"2021070722001323900_ocab041-B48","doi-asserted-by":"crossref","first-page":"e204","DOI":"10.2196\/resprot.6194","article-title":"App chronic disease checklist: protocol to evaluate mobile apps for chronic disease self-management","volume":"5","author":"Anderson","year":"2016","journal-title":"JMIR Res Protoc"},{"issue":"8","key":"2021070722001323900_ocab041-B49","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s10916-014-0081-6","article-title":"Mobile PHRs compliance with android and iOS usability guidelines","volume":"38","author":"Cruz Zapata","year":"2014","journal-title":"J Med Syst"},{"issue":"2","key":"2021070722001323900_ocab041-B50","doi-asserted-by":"crossref","first-page":"e29","DOI":"10.2196\/mhealth.3262","article-title":"Exploring the usability of a mobile app for adolescent obesity management","volume":"2","author":"O'Malley","year":"2014","journal-title":"JMIR Mhealth Uhealth"},{"issue":"8","key":"2021070722001323900_ocab041-B51","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1089\/tmj.2013.0262","article-title":"High quantity but limited quality in healthcare applications intended for HIV-infected patients","volume":"20","author":"Robustillo Cort\u00e9s","year":"2014","journal-title":"Telemed J E Health"},{"issue":"1","key":"2021070722001323900_ocab041-B52","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1136\/ebmental-2018-300069","article-title":"Understanding the quality, effectiveness and attributes of top-rated smartphone health apps","volume":"22","author":"Wisniewski","year":"2019","journal-title":"Evid Based Ment Health"},{"issue":"10","key":"2021070722001323900_ocab041-B53","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1089\/tmj.2014.0151","article-title":"Development and evaluation of an evaluation tool for healthcare smartphone applications","volume":"21","author":"Jin","year":"2015","journal-title":"Telemed J E Health"},{"issue":"5","key":"2021070722001323900_ocab041-B54","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1007\/s12529-017-9643-6","article-title":"Self-management and shared decision-making in alcohol dependence via a mobile app: a pilot study","volume":"24","author":"Barrio","year":"2017","journal-title":"Int Behav Med"},{"issue":"1","key":"2021070722001323900_ocab041-B55","doi-asserted-by":"crossref","first-page":"e16","DOI":"10.2196\/mhealth.5167","article-title":"The PAediatric Risk Assessment (PARA) mobile app to reduce postdischarge child mortality: design, usability, and feasibility for health care workers in Uganda","volume":"4","author":"English","year":"2016","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2021070722001323900_ocab041-B56","doi-asserted-by":"crossref","first-page":"e3","DOI":"10.2196\/mental.5023","article-title":"Usability evaluation of a mobile monitoring system to assess symptoms after a traumatic injury: a mixed-methods study","volume":"3","author":"Price","year":"2016","journal-title":"JMIR Ment Health"},{"issue":"8","key":"2021070722001323900_ocab041-B57","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1007\/s10916-018-1002-x","article-title":"Evaluating the privacy policies of mobile personal health records for pregnancy monitoring","volume":"42","author":"Bachiri","year":"2018","journal-title":"J Med Syst"},{"issue":"7","key":"2021070722001323900_ocab041-B58","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1089\/sur.2019.155","article-title":"Identification of important features in mobile health applications for surgical site infection surveillance","volume":"20","author":"Chernetsky Tejedor","year":"2019","journal-title":"Surg Infect (Larchmt)"},{"issue":"3","key":"2021070722001323900_ocab041-B59","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1111\/jhn.12424","article-title":"An evaluation of diabetes targeted apps for Android smartphone in relation to behaviour change techniques","volume":"30","author":"Hoppe","year":"2017","journal-title":"J Hum Nutr Diet"},{"issue":"2","key":"2021070722001323900_ocab041-B60","doi-asserted-by":"crossref","first-page":"e25","DOI":"10.2196\/mhealth.5022","article-title":"Smartphone applications to support tuberculosis prevention and treatment: review and evaluation","volume":"4","author":"Iribarren","year":"2016","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2021070722001323900_ocab041-B61","doi-asserted-by":"crossref","first-page":"23","DOI":"10.4258\/hir.2014.20.1.23","article-title":"Analysis of the information quality of Korean obesity-management smartphone applications","volume":"20","author":"Jeon","year":"2014","journal-title":"Healthc Inform Res"},{"issue":"3","key":"2021070722001323900_ocab041-B62","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1016\/j.pec.2015.10.023","article-title":"Quality assessment of a sample of mobile app-based health behavior change interventions using a tool based on the National Institute of Health and Care Excellence behavior change guidance","volume":"99","author":"McMillan","year":"2016","journal-title":"Patient Educ Couns"},{"issue":"1","key":"2021070722001323900_ocab041-B63","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1186\/s12966-014-0097-9","article-title":"Apps to promote physical activity among adults: a review and content analysis","volume":"11","author":"Middelweerd","year":"2014","journal-title":"Int J Behav Nutr Phys Act"},{"issue":"3","key":"2021070722001323900_ocab041-B64","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1177\/2049463716638700","article-title":"A quality review of smartphone applications for the management of pain","volume":"10","author":"Portelli","year":"2016","journal-title":"Br J Pain"},{"key":"2021070722001323900_ocab041-B65","first-page":"2055207619886463","article-title":"Development of the mHealth App Trustworthiness checklist","volume":"5","author":"van Haasteren","year":"2019","journal-title":"Digit Health"},{"issue":"1","key":"2021070722001323900_ocab041-B66","doi-asserted-by":"crossref","first-page":"e31","DOI":"10.2196\/mhealth.3861","article-title":"Apps seeking theories: results of a study on the use of health behavior change theories in cancer survivorship mobile apps","volume":"3","author":"Vollmer Dahlke","year":"2015","journal-title":"JMIR Mhealth Uhealth"},{"key":"2021070722001323900_ocab041-B67","first-page":"1030","article-title":"Current status and quality assessment of cardiovascular diseases related smartphone apps in China","volume":"225","author":"Xiao","year":"2016","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"2021070722001323900_ocab041-B68","doi-asserted-by":"crossref","first-page":"e9","DOI":"10.2196\/cancer.8951","article-title":"Acceptability of a mobile phone app for measuring time use in breast cancer survivors (Life in a Day): mixed-methods study","volume":"4","author":"Ainsworth","year":"2018","journal-title":". JMIR Cancer"},{"issue":"12","key":"2021070722001323900_ocab041-B69","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1016\/j.sapharm.2018.01.006","article-title":"MedAd-AppQ: A quality assessment tool for medication adherence apps on iOS and android platforms","volume":"14","author":"Ali","year":"2018","journal-title":"Res Soc Admin Pharm"},{"issue":"4","key":"2021070722001323900_ocab041-B70","doi-asserted-by":"crossref","first-page":"e104","DOI":"10.2196\/jmir.2968","article-title":"Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older","volume":"16","author":"Arnhold","year":"2014","journal-title":"J Med Internet Res"},{"issue":"3","key":"2021070722001323900_ocab041-B71","doi-asserted-by":"crossref","first-page":"e82","DOI":"10.2196\/jmir.7270","article-title":"Enlight: a comprehensive quality and therapeutic potential evaluation tool for mobile and web-based ehealth interventions","volume":"19","author":"Baumel","year":"2017","journal-title":"J Med Internet Res"},{"issue":"1","key":"2021070722001323900_ocab041-B72","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1080\/02763869.2015.986794","article-title":"development and examination of a rubric for evaluating point-of-care medical applications for mobile devices","volume":"34","author":"Butcher","year":"2015","journal-title":"Med Ref Serv Q"},{"issue":"4","key":"2021070722001323900_ocab041-B73","doi-asserted-by":"crossref","first-page":"e104","DOI":"10.2196\/mhealth.4334","article-title":"The most popular smartphone apps for weight loss: a quality assessment","volume":"3","author":"Chen","year":"2015","journal-title":"JMIR Mhealth Uhealth"},{"issue":"6","key":"2021070722001323900_ocab041-B74","doi-asserted-by":"crossref","first-page":"1478","DOI":"10.1097\/AOG.0000000000000842","article-title":"Rating pregnancy wheel applications using the APPLICATIONS Scoring System","volume":"125","author":"Chyjek","year":"2015","journal-title":"Obstet Gynecol"},{"issue":"10","key":"2021070722001323900_ocab041-B75","doi-asserted-by":"crossref","first-page":"e163","DOI":"10.2196\/mhealth.7441","article-title":"A new tool for nutrition App Quality Evaluation (AQEL): development, validation, and reliability testing","volume":"5","author":"DiFilippo","year":"2017","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"2021070722001323900_ocab041-B76","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1089\/tmj.2017.0075","article-title":"Usability, acceptability, and impact of a pediatric Teledermatology Mobile Health Application","volume":"24","author":"Fiks","year":"2018","journal-title":"Telemed e-Health"},{"issue":"10","key":"2021070722001323900_ocab041-B77","first-page":"1124","article-title":"Quality assessment of medical apps that target medication-related problems","volume":"22","author":"Loy","year":"2016","journal-title":"J Manag Care Spec Pharm"},{"key":"2021070722001323900_ocab041-B78","year":"2020"},{"issue":"1","key":"2021070722001323900_ocab041-B79","doi-asserted-by":"crossref","first-page":"e15","DOI":"10.2196\/mhealth.5176","article-title":"Interrater reliability of mHealth app rating measures: analysis of top depression and smoking cessation apps","volume":"4","author":"Powell","year":"2016","journal-title":"JMIR Mhealth Uhealth"},{"issue":"6","key":"2021070722001323900_ocab041-B80","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1111\/pme.12327","article-title":"Assessing the quality and usability of smartphone apps for pain self-management","volume":"15","author":"Reynoldson","year":"2014","journal-title":"Pain Med"},{"issue":"1","key":"2021070722001323900_ocab041-B81","doi-asserted-by":"crossref","first-page":"e4","DOI":"10.2196\/mhealth.8851","article-title":"Health Information Technology Usability Evaluation Scale (Health-ITUES) for usability assessment of mobile health technology: validation study","volume":"6","author":"Schnall","year":"2018","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"2021070722001323900_ocab041-B82","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1089\/tmj.2016.0079","article-title":"An evaluation of mobile applications for reproductive endocrinology and infertility providers","volume":"23","author":"Shaia","year":"2017","journal-title":"Telemed J E Health"},{"issue":"3","key":"2021070722001323900_ocab041-B83","doi-asserted-by":"crossref","first-page":"e18","DOI":"10.2196\/ijmr.4323","article-title":"Infant feeding websites and apps: a systematic assessment of quality and content","volume":"4","author":"Taki","year":"2015","journal-title":"Interact J Med Res"},{"issue":"3","key":"2021070722001323900_ocab041-B84","doi-asserted-by":"crossref","first-page":"e27","DOI":"10.2196\/mhealth.5717","article-title":"Development and testing of a mobile phone app for self-monitoring of calcium intake in young women","volume":"5","author":"Tay","year":"2017","journal-title":"JMIR Mhealth Uhealth"},{"key":"2021070722001323900_ocab041-B85","doi-asserted-by":"crossref","first-page":"96","DOI":"10.3389\/fpsyt.2015.00096","article-title":"Quality of smartphone apps related to panic disorder","volume":"6","author":"Van Singer","year":"2015","journal-title":"Front Psychiatry"},{"key":"2021070722001323900_ocab041-B86","first-page":"205","article-title":"mHealth quality: a process to seal the qualified mobile health apps","volume":"228","author":"Yasini","year":"2016","journal-title":"Stud Health Technol Inform"},{"issue":"9","key":"2021070722001323900_ocab041-B87","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1016\/j.ijmedinf.2012.04.007","article-title":"Mobile personal health records: an evaluation of features and functionality","volume":"81","author":"Kharrazi","year":"2012","journal-title":"Int J Med Inform"},{"issue":"8","key":"2021070722001323900_ocab041-B88","doi-asserted-by":"crossref","first-page":"480","DOI":"10.3928\/01484834-20160715-12","article-title":"Evaluating health mobile apps: information literacy in undergraduate and graduate nursing courses","volume":"55","author":"McNiel","year":"2016","journal-title":"J Nurs Educ"},{"issue":"1","key":"2021070722001323900_ocab041-B89","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1038\/s41746-019-0111-3","article-title":"Digital health: a path to validation","volume":"2","author":"Mathews","year":"2019","journal-title":"NPJ Digit Med"},{"issue":"6","key":"2021070722001323900_ocab041-B90","doi-asserted-by":"crossref","first-page":"1080","DOI":"10.1016\/j.jbi.2013.08.001","article-title":"Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology","volume":"46","author":"Brown","year":"2013","journal-title":"J Biomed Inform"},{"key":"2021070722001323900_ocab041-B91","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.compbiomed.2016.02.005","article-title":"Advising patients on selecting trustful apps for diabetes self-care","volume":"71","author":"Basilico","year":"2016","journal-title":"Comput Biol Med"},{"issue":"5","key":"2021070722001323900_ocab041-B92","doi-asserted-by":"crossref","first-page":"e13895","DOI":"10.2196\/13895","article-title":"Exploring user needs and preferences for mobile apps for sleep disturbance: mixed methods study","volume":"6","author":"Aji","year":"2019","journal-title":"JMIR Ment Health"},{"key":"2021070722001323900_ocab041-B93","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.genhosppsych.2017.11.010","article-title":"Acceptability of mHealth augmentation of Collaborative Care: a mixed methods pilot study","volume":"51","author":"Bauer","year":"2018","journal-title":"Gen Hosp Psychiatry"},{"key":"2021070722001323900_ocab041-B94","author":"Chaudhry"},{"issue":"3","key":"2021070722001323900_ocab041-B95","doi-asserted-by":"crossref","first-page":"e72","DOI":"10.2196\/mhealth.6335","article-title":"Evaluating an mHealth app for health and well-being at work: mixed-method qualitative study","volume":"6","author":"De Korte","year":"2018","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"2021070722001323900_ocab041-B96","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1044\/2019_AJA-18-0135","article-title":"A comprehensive evaluation of tinnitus apps","volume":"28","author":"Deshpande","year":"2019","journal-title":"Am J Audiol"},{"issue":"11","key":"2021070722001323900_ocab041-B97","doi-asserted-by":"crossref","first-page":"e14645","DOI":"10.2196\/14645","article-title":"User engagement and attrition in an app-based physical activity intervention: secondary analysis of a randomized controlled trial","volume":"21","author":"Edney","year":"2019","journal-title":"J Med Internet Res"},{"key":"2021070722001323900_ocab041-B98","year":"2013"},{"key":"2021070722001323900_ocab041-B99","doi-asserted-by":"crossref","first-page":"7328274","DOI":"10.1155\/2018\/7328274","article-title":"Chinese Mobile Health APPs for hypertension management: a systematic evaluation of usefulness","volume":"2018","author":"Liang","year":"2018","journal-title":"J Healthc Eng"},{"issue":"1","key":"2021070722001323900_ocab041-B100","doi-asserted-by":"crossref","first-page":"e12160","DOI":"10.2196\/12160","article-title":"Usability challenges for health and wellness mobile apps: mixed-methods study among mHealth experts and consumers","volume":"7","author":"Liew","year":"2019","journal-title":"JMIR Mhealth Uhealth"},{"key":"2021070722001323900_ocab041-B101","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/978-3-030-17287-9_16","volume-title":"PERSUASIVE 2019: Persuasive Technology: Development of Persuasive and Behavior Change Support Systems","author":"Meedya","year":"2019"},{"issue":"5\u20136","key":"2021070722001323900_ocab041-B102","first-page":"253","article-title":"A design and evaluation framework for digital health interventions","volume":"61","author":"Tobias","year":"2019","journal-title":"it - Inform Technol"},{"issue":"3","key":"2021070722001323900_ocab041-B103","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1136\/eb-2018-102891","article-title":"Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements","volume":"21","author":"Torous","year":"2018","journal-title":"Evid Based Ment Health"},{"issue":"5","key":"2021070722001323900_ocab041-B104","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1176\/appi.ps.201700423","article-title":"A hierarchical framework for evaluation and informed decision making regarding smartphone apps for clinical care","volume":"69","author":"Torous","year":"2018","journal-title":"Psychiatr Serv"},{"key":"2021070722001323900_ocab041-B105","first-page":"1","author":"Dolnicar"},{"issue":"1","key":"2021070722001323900_ocab041-B106","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1177\/0049124113509605","article-title":"Choosing the number of categories in agree\u2013disagree scales","volume":"43","author":"Revilla","year":"2014","journal-title":"Soc Methods Res"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/6\/1318\/38615469\/ocab041.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/6\/1318\/38615469\/ocab041.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T00:12:59Z","timestamp":1625703179000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/6\/1318\/6205942"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,31]]},"references-count":106,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,3,31]]},"published-print":{"date-parts":[[2021,6,12]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab041","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,6,1]]},"published":{"date-parts":[[2021,3,31]]}}}