{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,4]],"date-time":"2026-10-04T19:06:08Z","timestamp":1791140768877,"version":"4.1.0"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T00:00:00Z","timestamp":1643241600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T00:00:00Z","timestamp":1643241600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004621","name":"Kerman University of Medical Sciences","doi-asserted-by":"publisher","award":["400000266"],"award-info":[{"award-number":["400000266"]}],"id":[{"id":"10.13039\/501100004621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004621","name":"Kerman University of Medical Sciences","doi-asserted-by":"publisher","award":["400000266"],"award-info":[{"award-number":["400000266"]}],"id":[{"id":"10.13039\/501100004621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004621","name":"Kerman University of Medical Sciences","doi-asserted-by":"publisher","award":["400000266"],"award-info":[{"award-number":["400000266"]}],"id":[{"id":"10.13039\/501100004621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004621","name":"Kerman University of Medical Sciences","doi-asserted-by":"publisher","award":["400000266"],"award-info":[{"award-number":["400000266"]}],"id":[{"id":"10.13039\/501100004621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004621","name":"Kerman University of Medical Sciences","doi-asserted-by":"publisher","award":["400000266"],"award-info":[{"award-number":["400000266"]}],"id":[{"id":"10.13039\/501100004621","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Various questionnaires are used for evaluating satisfaction, usability, acceptance, and quality outcomes of mobile health (mHealth) services. Using the best one to meet the needs of an mHealth study is a challenge for researchers. Therefore, this study aimed to review and determine the frequently used questionnaires for evaluating the mentioned outcomes of mHealth services.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The PubMed database was searched for conducting this review in April 2021. Papers that used a referenced questionnaire to evaluate the satisfaction, usability, acceptance, or quality outcomes of mHealth were included. The first author\u2019s name, year of publication, evaluation outcome, and evaluation questionnaire were extracted from relevant papers. Data were analyzed using descriptive statistics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In total, 247 papers were included in the study. Questionnaires were used for usability (40%), quality (34.5%), acceptance (8.5%), and satisfaction (4%) outcomes, respectively. System usability scale (36.5%), mobile application rating scale (35.5%), post study system usability questionnaire (6%), user mobile application rating scale (5%), technology acceptance model (4.5%), computer system usability questionnaire (2.5%), net promoter score (2%), health information technology usability evaluation scale (2%), the usefulness, satisfaction, and ease of use (1.5%), client satisfaction questionnaire (1.5%), unified theory of acceptance and use of technology (1.5%), questionnaire for user interaction satisfaction (1%), user experience questionnaire (1%), and after-scenario questionnaire (1%) were the most used questionnaires, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Despite the existence of special questionnaires for evaluating several outcomes of mHealth, general questionnaires with fewer items and higher reliability have been used more frequently. Researchers should pay more attention to questionnaires with a goal-based design.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-022-01764-2","type":"journal-article","created":{"date-parts":[[2022,1,26]],"date-time":"2022-01-26T23:51:50Z","timestamp":1643241110000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":170,"title":["The most used questionnaires for evaluating satisfaction, usability, acceptance, and quality outcomes of mobile health"],"prefix":"10.1186","volume":"22","author":[{"given":"Sadrieh","family":"Hajesmaeel-Gohari","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Firoozeh","family":"Khordastan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Farhad","family":"Fatehi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hamidreza","family":"Samzadeh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kambiz","family":"Bahaadinbeigy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,1,27]]},"reference":[{"issue":"5s","key":"1764_CR1","first-page":"S106","volume":"9","author":"CK Kao","year":"2017","unstructured":"Kao CK, Liebovitz DM. Consumer mobile health apps: current state, barriers, and future directions. PM & R J Inj Funct Rehabil. 2017;9(5s):S106\u201315.","journal-title":"PM & R J Inj Funct Rehabil"},{"issue":"4","key":"1764_CR2","doi-asserted-by":"publisher","first-page":"253","DOI":"10.4258\/hir.2016.22.4.253","volume":"22","author":"Y-T Park","year":"2016","unstructured":"Park Y-T. Emerging new era of mobile health technologies. Healthc Inform Res. 2016;22(4):253\u20134.","journal-title":"Healthc Inform Res"},{"key":"1764_CR3","first-page":"183","volume-title":"Key advances in clinical informatics: Transforming health care through health information technology","author":"K Singh","year":"2018","unstructured":"Singh K, Landman AB. Mobile health. In: Sheikh A, Bates DW, Wright A, Cresswell K, editors. Key advances in clinical informatics: Transforming health care through health information technology. London: Academic Press; 2018. p. 183\u201396."},{"key":"1764_CR4","unstructured":"World Health Organization. mHealth: New horizons for health through mobile technologies. 2011. Available from: https:\/\/www.who.int\/goe\/publications\/goe_mhealth_web.pdf."},{"key":"1764_CR5","doi-asserted-by":"crossref","unstructured":"Mangkunegara C, Azzahro F, Handayani P. Analysis of factors affecting user's intention in using mobile health application: a case study of halodoc. 2018. p. 87\u201392","DOI":"10.1109\/ICACSIS.2018.8618174"},{"key":"1764_CR6","unstructured":"ISO9241-11. Ergonomics of human\u2013system interaction\u2014Part 11: usability: definitions and concepts 2018. Available from: https:\/\/www.iso.org\/obp\/ui\/#iso:std:iso:9241:-11:ed-2:v1:en."},{"key":"1764_CR7","doi-asserted-by":"publisher","first-page":"55563","DOI":"10.1109\/ACCESS.2020.2981892","volume":"8","author":"P Weichbroth","year":"2020","unstructured":"Weichbroth P. Usability of mobile applications: a systematic literature study. IEEE Access. 2020;8:55563\u201377.","journal-title":"IEEE Access"},{"key":"1764_CR8","unstructured":"Swaid S. Usability of mobile apps: an integrated approach. AHFE; July 17-212017."},{"issue":"3","key":"1764_CR9","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1287\/isre.8.3.240","volume":"8","author":"PB Seddon","year":"1997","unstructured":"Seddon PB. A respecification and extension of the DeLone and McLean model of IS success. Inf Syst Res. 1997;8(3):240\u201353.","journal-title":"Inf Syst Res"},{"key":"1764_CR10","unstructured":"Cambridge Dictionary-Cambridge University Press. Acceptance 2020 [Available from: https:\/\/dictionary.cambridge.org\/dictionary\/english\/acceptance."},{"issue":"7","key":"1764_CR11","doi-asserted-by":"publisher","first-page":"e17256","DOI":"10.2196\/17256","volume":"22","author":"C Nadal","year":"2020","unstructured":"Nadal C, Sas C, Doherty G. Technology acceptance in mobile health: scoping review of definitions, models, and measurement. J Med Internet Res. 2020;22(7):e17256.","journal-title":"J Med Internet Res"},{"issue":"1","key":"1764_CR12","doi-asserted-by":"publisher","first-page":"e27","DOI":"10.2196\/mhealth.3422","volume":"3","author":"SR Stoyanov","year":"2015","unstructured":"Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth uHealth. 2015;3(1):e27.","journal-title":"JMIR mHealth uHealth"},{"issue":"12","key":"1764_CR13","doi-asserted-by":"publisher","first-page":"e190-e","DOI":"10.2196\/mhealth.8758","volume":"5","author":"DE Jake-Schoffman","year":"2017","unstructured":"Jake-Schoffman DE, Silfee VJ, Waring ME, Boudreaux ED, Sadasivam RS, Mullen SP, et al. Methods for evaluating the content, usability, and efficacy of commercial mobile health apps. JMIR mHealth uHealth. 2017;5(12):e190-e.","journal-title":"JMIR mHealth uHealth"},{"key":"1764_CR14","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.ijmedinf.2019.03.018","volume":"126","author":"I Maramba","year":"2019","unstructured":"Maramba I, Chatterjee A, Newman C. Methods of usability testing in the development of eHealth applications: a scoping review. Int J Med Inform. 2019;126:95\u2013104.","journal-title":"Int J Med Inform"},{"issue":"3","key":"1764_CR15","doi-asserted-by":"publisher","first-page":"e93","DOI":"10.2196\/resprot.4348","volume":"5","author":"T Alanzi","year":"2016","unstructured":"Alanzi T, Istepanian R, Philip N. Design and usability evaluation of social mobile diabetes management system in the gulf region. JMIR Res Protoc. 2016;5(3):e93.","journal-title":"JMIR Res Protoc"},{"issue":"4","key":"1764_CR16","doi-asserted-by":"publisher","first-page":"e24271","DOI":"10.2196\/24271","volume":"9","author":"C Bakogiannis","year":"2021","unstructured":"Bakogiannis C, Tsarouchas A, Mouselimis D, Lazaridis C, Theofillogianakos EK, Billis A, et al. A patient-oriented app (ThessHF) to improve self-care quality in heart failure: from evidence-based design to pilot study. JMIR mHealth uHealth. 2021;9(4):e24271.","journal-title":"JMIR mHealth uHealth"},{"issue":"4","key":"1764_CR17","doi-asserted-by":"publisher","first-page":"e11500","DOI":"10.2196\/11500","volume":"7","author":"L Zhou","year":"2019","unstructured":"Zhou L, Bao J, Setiawan IMA, Saptono A, Parmanto B. The mHealth app usability questionnaire (MAUQ): development and validation study. JMIR mHealth uHealth. 2019;7(4):e11500.","journal-title":"JMIR mHealth uHealth"},{"issue":"7","key":"1764_CR18","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1080\/10447318.2018.1455307","volume":"34","author":"JR Lewis","year":"2018","unstructured":"Lewis JR. The system usability scale: past, present, and future. Int J Hum Comput Interact. 2018;34(7):577\u201390.","journal-title":"Int J Hum Comput Interact"},{"key":"1764_CR19","first-page":"189","volume":"189","author":"J Brooke","year":"1996","unstructured":"Brooke J. Sus: a \u201cquick and dirty\u2019usability. J Usability Eval Ind. 1996;189:189\u201394.","journal-title":"J Usability Eval Ind"},{"issue":"11","key":"1764_CR20","doi-asserted-by":"publisher","first-page":"e0241480","DOI":"10.1371\/journal.pone.0241480","volume":"15","author":"Y Terhorst","year":"2020","unstructured":"Terhorst Y, Philippi P, Sander LB, Schultchen D, Paganini S, Bardus M, et al. Validation of the mobile application rating scale (MARS). PLoS ONE. 2020;15(11):e0241480.","journal-title":"PLoS ONE"},{"key":"1764_CR21","doi-asserted-by":"crossref","unstructured":"Lewis JR, editor. Psychometric evaluation of the post-study system usability questionnaire: the PSSUQ. In: Proceedings of the human factors society annual meeting. Los Angeles: Sage Publications; 1992.","DOI":"10.1177\/154193129203601617"},{"issue":"2","key":"1764_CR22","doi-asserted-by":"publisher","first-page":"e72","DOI":"10.2196\/mhealth.5849","volume":"4","author":"SR Stoyanov","year":"2016","unstructured":"Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the mobile application rating scale (uMARS). JMIR mHealth uHealth. 2016;4(2):e72.","journal-title":"JMIR mHealth uHealth"},{"key":"1764_CR23","doi-asserted-by":"publisher","first-page":"319","DOI":"10.2307\/249008","volume":"13","author":"FD Davis","year":"1989","unstructured":"Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. J MIS Q. 1989;13:319\u201340.","journal-title":"J MIS Q"},{"issue":"1","key":"1764_CR24","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1080\/10447319509526110","volume":"7","author":"JR Lewis","year":"1995","unstructured":"Lewis JR. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Hum Comput Interact. 1995;7(1):57\u201378.","journal-title":"Int J Hum Comput Interact"},{"issue":"12","key":"1764_CR25","first-page":"46","volume":"81","author":"FF Reichheld","year":"2003","unstructured":"Reichheld FF. The one number you need to grow. Harv Bus Rev. 2003;81(12):46\u201354.","journal-title":"Harv Bus Rev"},{"key":"1764_CR26","unstructured":"Yen P-Y, Wantland D, Bakken S. Development of a customizable health it usability evaluation scale. In: AMIA annual symposium proceedings\/AMIA symposium, vol. 2010. 2010. p. 917\u201321."},{"key":"1764_CR27","first-page":"3","volume":"8","author":"A Lund","year":"2001","unstructured":"Lund A. Measuring usability with the use questionnaire. Usability and user experience newsletter of the STC usability SIG. Usability Interface. 2001;8:3\u20136.","journal-title":"Usability Interface"},{"key":"1764_CR28","doi-asserted-by":"crossref","unstructured":"Gao M, Kortum P, Oswald F, editors. Psychometric evaluation of the use (usefulness, satisfaction, and ease of use) questionnaire for reliability and validity. In: Proceedings of the human factors and ergonomics society annual meeting. Los Angeles: SAGE Publications; 2018","DOI":"10.1177\/1541931218621322"},{"issue":"3","key":"1764_CR29","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1016\/0149-7189(79)90094-6","volume":"2","author":"DL Larsen","year":"1979","unstructured":"Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client\/patient satisfaction: development of a general scale. Eval Program Plan. 1979;2(3):197\u2013207.","journal-title":"Eval Program Plan"},{"key":"1764_CR30","doi-asserted-by":"publisher","first-page":"425","DOI":"10.2307\/30036540","volume":"27","author":"V Venkatesh","year":"2003","unstructured":"Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Q. 2003;27:425\u201378.","journal-title":"MIS Q"},{"key":"1764_CR31","doi-asserted-by":"crossref","unstructured":"Chin JP, Diehl VA, Norman KL, editors. Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of the SIGCHI conference on human factors in computing systems; 1988.","DOI":"10.1145\/57167.57203"},{"key":"1764_CR32","volume-title":"Construction and evaluation of a user experience questionnaire. HCI and usability for education and work","year":"2008","unstructured":"Laugwitz B, Held T, Schrepp M, editors. Construction and evaluation of a user experience questionnaire. HCI and usability for education and work. Berlin: Springer; 2008."},{"key":"1764_CR33","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/122672.122692","volume":"23","author":"J Lewis","year":"1991","unstructured":"Lewis J. Psychometric evaluation of an after-scenario questionnaire for computer usability studies: the ASQ. SIGCHI Bull. 1991;23:78\u201381.","journal-title":"SIGCHI Bull"},{"key":"1764_CR34","volume-title":"D3.3: Game Experience Questionnaire","author":"K Poels","year":"2007","unstructured":"Poels K, de Kort YAW, IJsselsteijn WA. D3.3: Game Experience Questionnaire. Eindhoven: Technische Universiteit Eindhoven; 2007."},{"issue":"1","key":"1764_CR35","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1186\/s12911-021-01407-y","volume":"21","author":"S Hajesmaeel-Gohari","year":"2021","unstructured":"Hajesmaeel-Gohari S, Bahaadinbeigy K. The most used questionnaires for evaluating telemedicine services. BMC Med Inform Decis Mak. 2021;21(1):36.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1764_CR36","first-page":"64","volume":"263","author":"E Ammenwerth","year":"2019","unstructured":"Ammenwerth E. Technology acceptance models in health informatics: TAM and UTAUT. Stud Health Technol Inform. 2019;263:64\u201371.","journal-title":"Stud Health Technol Inform"},{"issue":"12","key":"1764_CR37","doi-asserted-by":"publisher","first-page":"2329","DOI":"10.1017\/S1368980018000678","volume":"21","author":"N De Cock","year":"2018","unstructured":"De Cock N, Van Lippevelde W, Vangeel J, Notebaert M, Beullens K, Eggermont S, et al. Feasibility and impact study of a reward-based mobile application to improve adolescents\u2019 snacking habits. Public Health Nutr. 2018;21(12):2329\u201344.","journal-title":"Public Health Nutr"},{"issue":"6","key":"1764_CR38","doi-asserted-by":"publisher","first-page":"e18781","DOI":"10.2196\/18781","volume":"8","author":"A Lawitschka","year":"2020","unstructured":"Lawitschka A, Buehrer S, Bauer D, Peters K, Silbernagl M, Zubarovskaya N, et al. A web-based mobile app (INTERACCT App) for adolescents undergoing cancer and hematopoietic stem cell transplantation aftercare to improve the quality of medical information for clinicians: observational study. JMIR mHealth uHealth. 2020;8(6):e18781.","journal-title":"JMIR mHealth uHealth"},{"issue":"5","key":"1764_CR39","doi-asserted-by":"publisher","first-page":"e15909","DOI":"10.2196\/15909","volume":"8","author":"J Melin","year":"2020","unstructured":"Melin J, Bonn SE, Pendrill L, Lagerros YT. A questionnaire for assessing user satisfaction with mobile health apps: development using rasch measurement theory. JMIR mHealth uHealth. 2020;8(5):e15909.","journal-title":"JMIR mHealth uHealth"},{"key":"1764_CR40","doi-asserted-by":"crossref","unstructured":"Ansaar MZ, Hussain J, Bang J, Lee S, Shin KY, Woo KY, editors. The mHealth applications usability evaluation review. In: 2020 International conference on information networking (ICOIN). IEEE; 2020.","DOI":"10.1109\/ICOIN48656.2020.9016509"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01764-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-022-01764-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01764-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,26]],"date-time":"2022-01-26T23:52:22Z","timestamp":1643241142000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-022-01764-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,27]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1764"],"URL":"https:\/\/doi.org\/10.1186\/s12911-022-01764-2","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,27]]},"assertion":[{"value":"3 August 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This research was approved by the Ethics Committee of Kerman University of Medical Sciences with the Ethical ID IR.KMU.REC.1400.197.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to publish"}},{"value":"The authors declare that there are no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"22"}}