{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T12:36:27Z","timestamp":1774528587090,"version":"3.50.1"},"reference-count":63,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2018,5,16]],"date-time":"2018-05-16T00:00:00Z","timestamp":1526428800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/academic.oup.com\/journals\/pages\/about_us\/legal\/notices"}],"funder":[{"name":"Deputy of Education of Tehran University of Medical Sciences"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Review the existing studies including an assessment tool\/method to assess the quality of mHealth apps; extract their criteria; and provide a classification of the collected criteria.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>In accordance with the PRISMA statement, a literature search was conducted in MEDLINE, EMBase, ISI and Scopus for English language citations published from January 1, 2008 to December 22, 2016 for studies including tools or methods for quality assessment of mHealth apps. Two researchers screened the titles and abstracts of all retrieved citations against the inclusion and exclusion criteria. The full text of relevant papers was then individually examined by the same researchers. A senior researcher resolved eventual disagreements and confirmed the relevance of all included papers. The authors, date of publication, subject fields of target mHealth apps, development method, and assessment criteria were extracted from each paper. The extracted assessment criteria were then reviewed, compared, and classified by an expert panel of two medical informatics specialists and two health information management specialists.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Twenty-three papers were included in the review. Thirty-eight main classes of assessment criteria were identified. These were reorganized by expert panel into 7 main classes (Design, Information\/Content, Usability, Functionality, Ethical Issues, Security and Privacy, and User-perceived value) with 37 sub-classes of criteria.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>There is a wide heterogeneity in assessment criteria for mHealth apps. It is necessary to define the exact meanings and degree of distinctness of each criterion. This will help to improve the existing tools and may lead to achieve a better comprehensive mHealth app assessment tool.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocy050","type":"journal-article","created":{"date-parts":[[2018,4,17]],"date-time":"2018-04-17T11:10:17Z","timestamp":1523963417000},"page":"1089-1098","source":"Crossref","is-referenced-by-count":215,"title":["Criteria for assessing the quality of mHealth apps: a systematic review"],"prefix":"10.1093","volume":"25","author":[{"given":"Rasool","family":"Nouri","sequence":"first","affiliation":[{"name":"Health Information Management Department, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran"}]},{"given":"Sharareh","family":"R Niakan Kalhori","sequence":"additional","affiliation":[{"name":"Health Information Management Department, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran"}]},{"given":"Marjan","family":"Ghazisaeedi","sequence":"additional","affiliation":[{"name":"Health Information Management Department, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran"}]},{"given":"Guillaume","family":"Marchand","sequence":"additional","affiliation":[{"name":"Research and Development Department, DMD Sant\u00e9, Paris, France"}]},{"given":"Mobin","family":"Yasini","sequence":"additional","affiliation":[{"name":"Research and Development Department, DMD Sant\u00e9, Paris, France"}]}],"member":"286","published-online":{"date-parts":[[2018,5,16]]},"reference":[{"issue":"1","key":"2020110612223976400_ocy050-B1","doi-asserted-by":"crossref","first-page":"46.","DOI":"10.1186\/1741-7015-10-46","article-title":"The regulation of mobile health applications","volume":"10","author":"Barton","year":"2012","journal-title":"BMC Med"},{"issue":"3","key":"2020110612223976400_ocy050-B2","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1177\/2168479017725557","article-title":"Mobile health applications for pediatric care: review and comparison","volume":"52","author":"Morse","year":"2018","journal-title":"Ther Innov Regul Sci"},{"issue":"5","key":"2020110612223976400_ocy050-B3","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1177\/193229681200600525","article-title":"Mobile health applications to assist patients with diabetes: lessons learned and design implications","volume":"6","author":"\u00c5rsand","year":"2012","journal-title":"J Diabetes Sci Technol"},{"issue":"1","key":"2020110612223976400_ocy050-B4","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.wombi.2013.11.001","article-title":"An emerging model of maternity care: smartphone, midwife, doctor?","volume":"27","author":"Tripp","year":"2014","journal-title":"Women Birth"},{"issue":"3","key":"2020110612223976400_ocy050-B5","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.hjdsi.2016.08.004","article-title":"Patient portals and health apps: pitfalls, promises, and what one might learn from the other","volume":"5","author":"Baldwin","year":"2017","journal-title":"Healthc"},{"issue":"1","key":"2020110612223976400_ocy050-B6","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.jand.2013.10.016","article-title":"Nutrition apps: opportunities to guide patients and grow your career","volume":"114","author":"Boyce","year":"2014","journal-title":"J Acad Nutr Diet"},{"issue":"12","key":"2020110612223976400_ocy050-B7","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1093\/qjmed\/hct203","article-title":"Mobile phone health apps for diabetes management: current evidence and future developments","volume":"106","author":"Goyal","year":"2013","journal-title":"QJM"},{"issue":"1","key":"2020110612223976400_ocy050-B8","first-page":"11","article-title":"Developing a framework for evaluating the patient engagement, quality, and safety of mobile health applications","volume":"5","author":"Singh","year":"2016","journal-title":"Issue Brief (Commonw Fund)"},{"key":"2020110612223976400_ocy050-B9","volume-title":"Health Informatics: Practical Guide for Healthcare and Information Technology Professionals.","author":"Hoyt","year":"2014"},{"issue":"1","key":"2020110612223976400_ocy050-B10","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1177\/1460458213479598","article-title":"Analysis of mobile health applications for a broad spectrum of consumers: a user experience approach","volume":"20","author":"Garc\u00eda-G\u00f3mez","year":"2014","journal-title":"Health Informatics J"},{"key":"2020110612223976400_ocy050-B11","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.jbi.2015.06.003","article-title":"Mobile-health: a review of current state in 2015","volume":"56","author":"Silva","year":"2015","journal-title":"J Biomed Inform"},{"issue":"2","key":"2020110612223976400_ocy050-B12","doi-asserted-by":"crossref","first-page":"73","DOI":"10.4258\/hir.2016.22.2.73","article-title":"Utilization and content evaluation of mobile applications for pregnancy, birth, and child care","volume":"22","author":"Lee","year":"2016","journal-title":"Healthc Inform Res"},{"key":"2020110612223976400_ocy050-B13","first-page":"76","author":"Agu","year":"2013"},{"issue":"5","key":"2020110612223976400_ocy050-B14","first-page":"356","article-title":"Mobile devices and apps for health care professionals: uses and benefits","volume":"39","author":"Lee Ventola","year":"2014","journal-title":"P T"},{"issue":"4","key":"2020110612223976400_ocy050-B15","doi-asserted-by":"crossref","first-page":"304","DOI":"10.4258\/hir.2014.20.4.304","article-title":"Technology acceptance and adoption of innovative smartphone uses among hospital employees","volume":"20","author":"Moon","year":"2014","journal-title":"Healthc Inform Res"},{"issue":"5","key":"2020110612223976400_ocy050-B16","doi-asserted-by":"crossref","first-page":"e128.","DOI":"10.2196\/jmir.1994","article-title":"The smartphone in medicine: a review of current and potential use among physicians and students","volume":"14","author":"Ozdalga","year":"2012","journal-title":"J Med Internet Res"},{"issue":"7","key":"2020110612223976400_ocy050-B17","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1097\/CIN.0000000000000063","article-title":"Bringing technology to the bedside: using smartphones to improve interprofessional communication","volume":"32","author":"Whitlow","year":"2014","journal-title":"Comput Inform Nurs"},{"issue":"7","key":"2020110612223976400_ocy050-B18","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1002\/jhm.2037","article-title":"Educational impact of using smartphones for clinical communication on general medicine: more global, less local","volume":"8","author":"Wu","year":"2013","journal-title":"J Hosp Med"},{"key":"2020110612223976400_ocy050-B19","first-page":"175","article-title":"Toward a use case based classification of mobile health applications","volume":"210","author":"Yasini","year":"2015","journal-title":"Stud Health Technol Inform"},{"key":"2020110612223976400_ocy050-B20","author":"Research2guidance","year":"2017"},{"issue":"1","key":"2020110612223976400_ocy050-B21","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1186\/s12911-016-0323-2","article-title":"Development and validation of the Italian version of the Mobile Application Rating Scale and its generalisability to apps targeting primary prevention","volume":"16","author":"Domnich","year":"2016","journal-title":"BMC Med Inform Decis Mak"},{"key":"2020110612223976400_ocy050-B22","doi-asserted-by":"crossref","DOI":"10.1017\/9781316339275","volume-title":"Wellbeing, Recovery and Mental Health","author":"Slade","year":"2017"},{"key":"2020110612223976400_ocy050-B23","first-page":"225","article-title":"mHealth apps and their risks\u2014taking stock","volume":"226","author":"Albrecht","year":"2016","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"2020110612223976400_ocy050-B24","doi-asserted-by":"crossref","first-page":"58.","DOI":"10.1186\/s12916-015-0303-x","article-title":"The evolution of mobile apps for asthma: an updated systematic assessment of content and tools","volume":"13","author":"Huckvale","year":"2015","journal-title":"BMC Med"},{"issue":"4","key":"2020110612223976400_ocy050-B25","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1007\/s13142-014-0293-9","article-title":"Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations","volume":"4","author":"Boudreaux","year":"2014","journal-title":"Behav Med Pract Policy Res"},{"issue":"2","key":"2020110612223976400_ocy050-B26","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1089\/tmj.2014.0088","article-title":"A systematic review of quality assessment methods for smartphone health apps","volume":"21","author":"BinDhim","year":"2015","journal-title":"Telemed J E Health"},{"issue":"2","key":"2020110612223976400_ocy050-B27","first-page":"59","article-title":"Assessment metrics, challenges and strategies for mobile health apps","volume":"15","author":"Zhang","year":"2014","journal-title":"Issues Inform Syst"},{"issue":"4","key":"2020110612223976400_ocy050-B28","doi-asserted-by":"crossref","first-page":"e125.","DOI":"10.2196\/jmir.5604","article-title":"Who uses mobile phone health apps and does use matter? A secondary data analytics approach","volume":"19","author":"Carroll","year":"2017","journal-title":"J Med Internet Res"},{"issue":"4","key":"2020110612223976400_ocy050-B29","doi-asserted-by":"crossref","first-page":"264","DOI":"10.7326\/0003-4819-151-4-200908180-00135","article-title":"Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement","volume":"151","author":"Moher","year":"2009","journal-title":"Ann Intern Med"},{"issue":"10","key":"2020110612223976400_ocy050-B30","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1089\/tmj.2014.0151","article-title":"Development and evaluation of an evaluation tool for healthcare smartphone applications","volume":"21","author":"Jin","year":"2015","journal-title":"Telemed J E Health"},{"issue":"5","key":"2020110612223976400_ocy050-B31","doi-asserted-by":"crossref","first-page":"9976.","DOI":"10.1007\/s10916-013-9976-x","article-title":"Development and evaluation of tools for measuring the quality of experience (QoE) in mHealth applications","volume":"37","author":"Mart\u00ednez-P\u00e9rez","year":"2013","journal-title":"J Med Syst"},{"key":"2020110612223976400_ocy050-B32","article-title":"A review and comparative analysis of security risks and safety measures of mobile health apps","volume":"9","author":"Scott","year":"2015","journal-title":"Aust J Inform Syst"},{"issue":"1","key":"2020110612223976400_ocy050-B33","doi-asserted-by":"crossref","first-page":"e27.","DOI":"10.2196\/mhealth.3422","article-title":"Mobile app rating scale: a new tool for assessing the quality of health mobile apps","volume":"3","author":"Stoyanov","year":"2015","journal-title":"JMIR mHealth Uhealth"},{"issue":"4","key":"2020110612223976400_ocy050-B34","doi-asserted-by":"crossref","first-page":"e204.","DOI":"10.2196\/resprot.6194","article-title":"App chronic disease checklist: protocol to evaluate mobile apps for chronic disease self-management","volume":"5","author":"Anderson","year":"2016","journal-title":"JMIR Res Protoc"},{"issue":"1","key":"2020110612223976400_ocy050-B35","doi-asserted-by":"crossref","first-page":"e15.","DOI":"10.2196\/mhealth.5176","article-title":"Interrater reliability of mHealth app rating measures: analysis of top depression and smoking cessation apps","volume":"4","author":"Powell","year":"2016","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"2020110612223976400_ocy050-B36","doi-asserted-by":"crossref","first-page":"e18.","DOI":"10.2196\/ijmr.4323","article-title":"Infant feeding websites and apps: a systematic assessment of quality and content","volume":"4","author":"Taki","year":"2015","journal-title":"Interact J Med Res"},{"key":"2020110612223976400_ocy050-B37","article-title":"Quality of smartphone apps related to panic disorder","volume":"6: 96","author":"Van Singer","year":"2015","journal-title":"Front Psychiatry"},{"issue":"2","key":"2020110612223976400_ocy050-B38","doi-asserted-by":"crossref","first-page":"e72.","DOI":"10.2196\/mhealth.5849","article-title":"Development and validation of the user version of the mobile application rating scale (uMARS)","volume":"4","author":"Stoyanov","year":"2016","journal-title":"JMIR MHealth Uhealth"},{"issue":"2","key":"2020110612223976400_ocy050-B39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10916-014-0182-2","article-title":"Empirical studies on usability of mHealth apps: a systematic literature review","volume":"39","author":"Zapata","year":"2015","journal-title":"J Med Syst"},{"issue":"8","key":"2020110612223976400_ocy050-B40","doi-asserted-by":"crossref","first-page":"81.","DOI":"10.1007\/s10916-014-0081-6","article-title":"Mobile PHRs compliance with android and iOS usability guidelines","volume":"38","author":"Cruz Zapata","year":"2014","journal-title":"J Med Syst"},{"issue":"10","key":"2020110612223976400_ocy050-B41","first-page":"1124","article-title":"Quality assessment of medical apps that target medication-related problems","volume":"22","author":"Loy","year":"2016","journal-title":"J Manag Care Spec Pharm"},{"key":"2020110612223976400_ocy050-B42","first-page":"205","article-title":"mHealth quality: a process to seal the qualified mobile health apps","volume":"228","author":"Yasini","year":"2016","journal-title":"Stud Health Technol Inform"},{"issue":"6","key":"2020110612223976400_ocy050-B43","doi-asserted-by":"crossref","first-page":"1080","DOI":"10.1016\/j.jbi.2013.08.001","article-title":"Assessment of the Health IT usability evaluation model (Health-ITUEM) for evaluating mobile health (mHealth) technology","volume":"46","author":"Brown","year":"2013","journal-title":"J Biomed Inform"},{"issue":"1","key":"2020110612223976400_ocy050-B44","doi-asserted-by":"crossref","first-page":"23","DOI":"10.4258\/hir.2014.20.1.23","article-title":"Analysis of the information quality of Korean obesity-management smartphone applications","volume":"20","author":"Jeon","year":"2014","journal-title":"Healthc Inform Res"},{"issue":"8","key":"2020110612223976400_ocy050-B45","doi-asserted-by":"crossref","first-page":"480.","DOI":"10.3928\/01484834-20160715-12","article-title":"Evaluating health mobile apps: information literacy in undergraduate and graduate nursing courses","volume":"55","author":"McNiel","year":"2016","journal-title":"J Nurs Educ"},{"issue":"1","key":"2020110612223976400_ocy050-B46","doi-asserted-by":"crossref","first-page":"144.","DOI":"10.1186\/1741-7015-10-144","article-title":"Apps for asthma self-management: a systematic assessment of content and tools","volume":"10","author":"Huckvale","year":"2012","journal-title":"BMC Med"},{"key":"2020110612223976400_ocy050-B47","first-page":"1030","article-title":"Current status and quality assessment of cardiovascular diseases related smartphone apps in China","volume":"225","author":"Xiao","year":"2016","journal-title":"Stud Health Technol Inform"},{"key":"2020110612223976400_ocy050-B48","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.jbi.2016.02.002","article-title":"A user-centered model for designing consumer mobile health (mHealth) applications (apps)","volume":"60","author":"Schnall","year":"2016","journal-title":"J Biomed Inform"},{"issue":"11","key":"2020110612223976400_ocy050-B49","doi-asserted-by":"crossref","DOI":"10.1007\/s10916-015-0303-6","article-title":"Experiences and results of applying tools for assessing the quality of a mHealth app named Heartkeeper","volume":"39","author":"Martinez-Perez","year":"2015","journal-title":"J Med Syst"},{"issue":"2","key":"2020110612223976400_ocy050-B50","doi-asserted-by":"crossref","first-page":"e25.","DOI":"10.2196\/mhealth.5022","article-title":"Smartphone applications to support tuberculosis prevention and treatment: review and evaluation","volume":"4","author":"Iribarren","year":"2016","journal-title":"JMIR MHealth Uhealth"},{"issue":"4","key":"2020110612223976400_ocy050-B51","doi-asserted-by":"crossref","first-page":"e104.","DOI":"10.2196\/mhealth.4334","article-title":"The most popular smartphone apps for weight loss: a quality assessment","volume":"3","author":"Chen","year":"2015","journal-title":"JMIR MHealth Uhealth"},{"issue":"6","key":"2020110612223976400_ocy050-B52","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1111\/pme.12327","article-title":"Assessing the quality and usability of smartphone apps for pain self-management","volume":"15","author":"Reynoldson","year":"2014","journal-title":"Pain Med"},{"key":"2020110612223976400_ocy050-B53","first-page":"864","article-title":"Heuristic evaluation of eNote: an electronic notes system","volume":"2006","author":"Bright","year":"2006","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110612223976400_ocy050-B54","volume-title":"Health Information Technology Usability Evaluation: Methods, Models, and Measures","author":"Yen","year":"2010"},{"key":"2020110612223976400_ocy050-B55","first-page":"20","volume-title":"Int J Mob Hum Comput Interact","author":"Bertini","year":"2008"},{"issue":"3","key":"2020110612223976400_ocy050-B56","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1145\/77481.77486","article-title":"Improving a human-computer dialogue","volume":"33","author":"Molich","year":"1990","journal-title":"Commun ACM"},{"issue":"4","key":"2020110612223976400_ocy050-B57","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1093\/innovait\/inn034","article-title":"Pain control in palliative care","volume":"1","author":"Simon","year":"2008","journal-title":"InnovAiT"},{"key":"2020110612223976400_ocy050-B58","volume-title":"Patient Apps for Improved Healthcare: from Novelty to Mainstream","author":"Aitken","year":"2013"},{"issue":"3","key":"2020110612223976400_ocy050-B59","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1111\/j.1753-6405.2011.00707.x","article-title":"A scientific audit of smartphone applications for the management of obesity","volume":"35","author":"Gan","year":"2011","journal-title":"Aust N Z J Public Health"},{"issue":"6","key":"2020110612223976400_ocy050-B60","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1016\/j.amepre.2016.07.009","article-title":"Challenges in assessing mobile health app quality: a systematic review of prevalent and innovative methods","volume":"51","author":"Grundy","year":"2016","journal-title":"Am J Prev Med"},{"key":"2020110612223976400_ocy050-B61","author":"French National Authority for Health"},{"key":"2020110612223976400_ocy050-B62","author":"NHS Innovations South East"},{"key":"2020110612223976400_ocy050-B63","author":"European Commission"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/8\/1089\/34150933\/ocy050.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/8\/1089\/34150933\/ocy050.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T17:23:58Z","timestamp":1604683438000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/25\/8\/1089\/4996915"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,16]]},"references-count":63,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,5,16]]},"published-print":{"date-parts":[[2018,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocy050","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,8]]},"published":{"date-parts":[[2018,5,16]]}}}