{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T20:35:16Z","timestamp":1773693316231,"version":"3.50.1"},"reference-count":41,"publisher":"JMIR Publications Inc.","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"\n Background<\/jats:title>\n The usability of electronic health (eHealth) and mobile health apps is of paramount importance as it impacts the quality of care. Methodological quality assessment is a common practice in the field of health for different designs and types of studies. However, we were unable to find a scale to assess the methodological quality of studies on the usability of eHealth products or services.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to develop a scale to assess the methodological quality of studies assessing usability of mobile apps and to perform a preliminary analysis of of the scale\u2019s feasibility, reliability, and construct validity on studies assessing usability of mobile apps, measuring aspects of physical activity.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n A 3-round Delphi panel was used to generate a pool of items considered important when assessing the quality of studies on the usability of mobile apps. These items were used to write the scale and the guide to assist its use. The scale was then used to assess the quality of studies on usability of mobile apps for physical activity, and it assessed in terms of feasibility, interrater reliability, and construct validity.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n A total of 25 experts participated in the Delphi panel, and a 15-item scale was developed. This scale was shown to be feasible (time of application mean 13.10 [SD 2.59] min), reliable (intraclass correlation coefficient=0.81; 95% CI 0.55-0.93), and able to discriminate between low- and high-quality studies (high quality: mean 9.22 [SD 0.36]; low quality: mean 6.86 [SD 0.80]; P=.01).<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The scale that was developed can be used both to assess the methodological quality of usability studies and to inform its planning.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/14829","type":"journal-article","created":{"date-parts":[[2019,8,13]],"date-time":"2019-08-13T21:52:02Z","timestamp":1565733122000},"page":"e14829","source":"Crossref","is-referenced-by-count":21,"title":["A Scale to Assess the Methodological Quality of Studies Assessing Usability of Electronic Health Products and Services: Delphi Study Followed by Validity and Reliability Testing"],"prefix":"10.2196","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4386-5851","authenticated-orcid":false,"given":"Anabela G","family":"Silva","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9648-3120","authenticated-orcid":false,"given":"Patr\u00edcia","family":"Sim\u00f5es","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9741-6210","authenticated-orcid":false,"given":"Rita","family":"Santos","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3172-7400","authenticated-orcid":false,"given":"Alexandra","family":"Queir\u00f3s","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3801-7249","authenticated-orcid":false,"given":"Nelson P","family":"Rocha","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8415-9040","authenticated-orcid":false,"given":"M\u00e1rio","family":"Rodrigues","sequence":"additional","affiliation":[]}],"member":"1010","published-online":{"date-parts":[[2019,11,15]]},"reference":[{"key":"ref1","unstructured":"HigginsJPGreenSThe Cochrane Collaboration20112019-03-30The Cochrane CollaborationCochrane Handbook for Systematic Reviews of Interventions. http:\/\/handbook-5-1.cochrane.org\/"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.38414.515938.8F"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-3-25"},{"key":"ref4","first-page":"603","volume":"25","author":"Wells, G","year":"2011","journal-title":"Eur J Epidemiol"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.2522\/ptj.20070147"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2753.2011.01707.x"},{"key":"ref7","unstructured":"International Standards Organization20192019-07-20Ergonomics of human-system interaction \u2014 Part 210: Human-centered design for interactive systems. https:\/\/www.iso.org\/obp\/ui\/#iso:std:iso:9241:-210:ed-2:v1:en"},{"key":"ref8","author":"Martins, AI","year":"2014","journal-title":"Human Factors in Software Development and Design"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2014.930311"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2016.06.004"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2012-001458"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2003.11.002"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.28945\/199"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2010.09.012"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1186\/1745-6215-13-132"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-5-37"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.4741"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.2902"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1016\/j.jgo.2017.09.008"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.3390\/s17030611"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2016.7591428"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.4225"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.3305\/nutr hosp.v28in06.6784"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.5518"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2014.00012"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.4546"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2617"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.2196\/humanfactors.3787"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1089\/tmj.2011.0087"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0108842"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1950"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1016\/j.mhpa.2016.02.001"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1519\/15184.1"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1016\/0197-2456(95)00134-4"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1016\/j.pain.2005.06.018"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-014-0182-2"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1093\/intqhc\/mzg031"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.4338\/ACI-2016-10-R-0170"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.1136\/jnnp.2003.025833"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocw046"},{"key":"ref41","doi-asserted-by":"crossref","DOI":"10.1093\/med\/9780199685219.001.0001","author":"Streiner, DL","year":"2015","journal-title":"Health Measurement Scales: A Practical Guide to Their Development and Use. Fifth Edition"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2019,11,15]],"date-time":"2019-11-15T10:00:16Z","timestamp":1573812016000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.jmir.org\/2019\/11\/e14829\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,15]]},"references-count":41,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019]]}},"URL":"https:\/\/doi.org\/10.2196\/14829","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.14829","asserted-by":"object"}]},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,15]]}}}