{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T03:47:25Z","timestamp":1787024845647,"version":"build-2736575974"},"reference-count":37,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Virtual care is here to stay; however, there remains no comprehensive measurement framework to guide evaluation of its impacts, to inform policy decisions, and to support optimization of practice.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to conduct a scoping review of reviews to synthesize measures related to virtual care evaluation across clinical conditions and contexts to identify gaps in current evaluation measures and to inform the development of recommendations for future work.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Citations published from 2015 to 2023 were retrieved from MEDLINE, Cochrane Database of Systematic Reviews, Embase, Emcare, Scopus, CINAHL, and Web of Science using search terms grouped by key concepts (virtual care and evaluation or quality measurement). Measures were defined as any quantitative or qualitative evaluation of performance or impact of virtual care on processes, outcomes, or systems. Articles were excluded if they were not a literature review (eg, primary results, commentaries, letters, protocols), dealt exclusively with pediatric populations, were published in a language other than English, or were abstracts only. Measures from retained articles (1233) were thematically grouped against the Proctor Implementation Research Outcomes framework. The study was reported according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guideline extension for scoping reviews.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n There has been substantial growth in the virtual care literature, particularly since the start of the COVID-19 pandemic. The majority of articles (900\/1233, 73.0%) evaluated client outcomes, including satisfaction with virtual care, usability or functionality of platforms, or clinical outcomes. Relative to the other domains of the Proctor framework, implementation measures were poorly defined, and many of the measures were proxy rather than direct measures. Despite the potential impacts of virtual care on health equity, most studies examining health equity were purely qualitative. Measures of safety, privacy, and security of virtual care were sparse and poorly defined. Caregivers play an important role in facilitating virtual visits and providing informal technical support; however, few studies examined implementation or satisfaction with virtual care from the perspective of caregivers. Additionally, clinician experience and acceptance of virtual care have implications for availability and adoption; however, relative to patients, few articles examined this perspective.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Our study highlights gaps in current evaluations of virtual care. Work is needed to improve the quality and standardization of virtual care evaluation to ensure reproducibility, generalizability, and comparability of findings. Additionally, compliance with existing measure definitions and conventions should extend to virtual care. Finally, additional theoretical work is needed to standardize and conceptually frame future virtual care evaluations. Future studies should include both the caregiver and clinician as unique perspectives in evaluations and should embed systematic evaluations of the impact of social determinants of health on virtual care access, adoption, and perceptions of care.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/65312","type":"journal-article","created":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T17:45:07Z","timestamp":1761932707000},"page":"e65312-e65312","source":"Crossref","is-referenced-by-count":3,"title":["Virtual Care, What Are We Measuring and What Should We Measure? Scoping Review of Reviews"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6038-0701","authenticated-orcid":false,"given":"Melanie","family":"Powis","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1879-9917","authenticated-orcid":false,"given":"Anum","family":"Ali","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6255-9000","authenticated-orcid":false,"given":"Jackelyn","family":"Salmini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-3845-9691","authenticated-orcid":false,"given":"Saidah","family":"Hack","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8316-7759","authenticated-orcid":false,"given":"Rouhi","family":"Fazelzad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8302-4117","authenticated-orcid":false,"given":"Lisa","family":"Barbara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1880-6905","authenticated-orcid":false,"given":"Alejandro","family":"Berlin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3193-5872","authenticated-orcid":false,"given":"Matthew","family":"Cheung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2205-2683","authenticated-orcid":false,"given":"Mary","family":"DeVera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-9571-4717","authenticated-orcid":false,"given":"Annemarie","family":"Edwards","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5451-0845","authenticated-orcid":false,"given":"Helen","family":"McTaggart-Cowan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4532-6197","authenticated-orcid":false,"given":"Robert","family":"Olson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8243-8721","authenticated-orcid":false,"given":"Stuart","family":"Peacock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5391-7769","authenticated-orcid":false,"given":"Ambreen","family":"Sayani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5179-7043","authenticated-orcid":false,"given":"Simron","family":"Singh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5533-7418","authenticated-orcid":false,"given":"Monika K","family":"Krzyzanowska","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,12,1]]},"reference":[{"issue":"6","key":"R1","doi-asserted-by":"publisher","first-page":"1216","DOI":"10.1016\/j.clinthera.2015.03.022","article-title":"Evaluation of a remote monitoring system for diabetes control","volume":"37","author":"Katalenich","journal-title":"Clin Ther"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1093\/europace\/eut108","article-title":"Remote monitoring as a key innovation in the management of cardiac patients including those with implantable electronic devices","volume":"15 Suppl 1","author":"Sutton","journal-title":"Europace"},{"issue":"8-9","key":"R3","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1093\/jamia\/ocz108","article-title":"Advancing health equity and access using telemedicine: a geospatial assessment","volume":"26","author":"Khairat","journal-title":"J Am Med Inform Assoc"},{"key":"R4","unstructured":"Use of digital health tools in europe before, during and after COVID-19. European Observatory on Health Systems and Policy. URL: https:\/\/eurohealthobservatory.who.int\/publications\/i\/use-of-digital-health-tools-in-europe-before-during-and-after-covid-19 [Accessed 13-06-2022]"},{"issue":"5","key":"R5","doi-asserted-by":"publisher","first-page":"923","DOI":"10.1177\/0194599820985483","article-title":"Patient perceptions of head and neck ambulatory telemedicine visits: a qualitative study","volume":"164","author":"Triantafillou","journal-title":"Otolaryngol Head Neck Surg"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1200\/CCI.21.00032","article-title":"Patient and physician attitudes toward telemedicine in cancer clinics following the COVID-19 pandemic","volume":"5","author":"Wehrle","journal-title":"JCO Clin Cancer Inform"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.33967","article-title":"Medical oncology professionals\u2019 perceptions of telehealth video visits","volume":"4","author":"Heyer","journal-title":"JAMA Netw Open"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1177\/23743735211039328","article-title":"Cancer treatment during COVID-19: a qualitative analysis of patient-perceived risks and experiences with virtual care","volume":"8","author":"Lesley","journal-title":"J Patient Exp"},{"key":"R9","unstructured":"COVID-19 Healthcare Coalition Telehealth Impact Study Work Group. Telehealth impact: patient survey analysis. MITRE. URL: https:\/\/www.mitre.org\/news-insights\/news-release\/covid-19-healthcare-coalition-surveys-patients-telehealth-impact-during [Accessed 13-09-2023]"},{"key":"R10","unstructured":"CADTH. CADTH health technology review: approaches to evaluations of virtual care in primary care. URL: https:\/\/www.cadth.ca\/sites\/default\/files\/ES\/ES0358%20Evaluations%20of%20virtual%20care-Final.pdf [Accessed 13-09-2023]"},{"issue":"2","key":"R11","doi-asserted-by":"publisher","first-page":"21","DOI":"10.37765\/ajac.2022.89166","article-title":"Measuring the effectiveness and value of virtual health care","volume":"10","author":"Schwimmer","journal-title":"Am J Accountable Care"},{"issue":"1","key":"R12","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.mayocpiqo.2022.12.001","article-title":"Quality frameworks for virtual care: expert panel recommendations","volume":"7","author":"Demaerschalk","journal-title":"Mayo Clin Proc Innov Qual Outcomes"},{"key":"R13","unstructured":"Virtual care in Canada: progress and potential. Canadian Medical Association. URL: https:\/\/www.cma.ca\/sites\/default\/files\/2022-02\/Virtual-Care-in-Canada-Progress-and-Potential-EN.pdf [Accessed 13-09-2023]"},{"issue":"2","key":"R14","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1007\/s10488-010-0319-7","article-title":"Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda","volume":"38","author":"Proctor","journal-title":"Adm Policy Ment Health"},{"issue":"1","key":"R15","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-019-4015-3","article-title":"Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes","volume":"19","author":"Nilsen","journal-title":"BMC Health Serv Res"},{"issue":"7","key":"R16","doi-asserted-by":"publisher","first-page":"467","DOI":"10.7326\/M18-0850","article-title":"PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation","volume":"169","author":"Tricco","journal-title":"Ann Intern Med"},{"key":"R17","unstructured":"Adab P Barrett T Bhopal R et al. The West Midlands ActiVe Lifestyle and Healthy Eating in School Children (WAVES) Study: A Cluster Randomised Controlled Trial Testing the Clinical Effectiveness and Cost-Effectiveness of A Multifaceted Obesity Prevention Intervention Programme Targeted at Children Aged 6\u20137 Years. NIHR Journals Library; URL: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK481700 [Accessed 13-09-2023]"},{"issue":"1","key":"R18","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1186\/s13012-021-01171-7","article-title":"Implementability of healthcare interventions: an overview of reviews and development of a conceptual framework","volume":"17","author":"Klaic","journal-title":"Implementation Sci"},{"key":"R19","unstructured":"Committee to Advise the Public Health Service on Clinical Practice Guidelines. Clinical Practice Guidelines: Directions for a New Program. National Academies Press; URL: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK235754 [Accessed 01-06-2024]"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-021-01407-y","article-title":"The most used questionnaires for evaluating telemedicine services","volume":"21","author":"Hajesmaeel-Gohari","journal-title":"BMC Med Inform Decis Mak"},{"issue":"2","key":"R21","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1370\/afm.1226","article-title":"Measuring patients\u2019 perceptions of patient-centered care: a systematic review of tools for family medicine","volume":"9","author":"Hudon","journal-title":"Ann Fam Med"},{"issue":"5","key":"R22","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1093\/intqhc\/14.5.353","article-title":"The Picker Patient Experience Questionnaire: development and validation using data from in-patient surveys in five countries","volume":"14","author":"Jenkinson","journal-title":"Int J Qual Health Care"},{"issue":"2","key":"R23","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1177\/0193945908326065","article-title":"Psychometric evaluation of the English language person-centered climate questionnaire--patient version","volume":"31","author":"Edvardsson","journal-title":"West J Nurs Res"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1136\/emermed-2020-210958","article-title":"Digital disparities: designing telemedicine systems with a health equity aim","volume":"38","author":"Samuels-Kalow","journal-title":"Emerg Med J"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1186\/s12939-023-01850-1","article-title":"Health equity related challenges and experiences during the rapid implementation of virtual care during COVID-19: a multiple case study","volume":"22","author":"Shahid","journal-title":"Int J Equity Health"},{"issue":"15","key":"R26","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph19159411","article-title":"Inequity in access and delivery of virtual care interventions: a scoping review","volume":"19","author":"Mistry","journal-title":"Int J Environ Res Public Health"},{"issue":"9 Suppl 2","key":"R27","doi-asserted-by":"publisher","first-page":"S22","DOI":"10.1097\/MLR.0b013e318263134b","article-title":"The Consumer Assessment of Healthcare Providers and Systems (CAHPS) cultural competence (CC) item set","volume":"50","author":"Weech-Maldonado","journal-title":"Med Care"},{"issue":"1","key":"R28","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1037\/0033-3204.44.1.30","article-title":"Development and initial validation of the Multicultural Counseling Self-Efficacy Scale--Racial Diversity Form","volume":"44","author":"Sheu","journal-title":"Psychother Theory Res Pract Train"},{"key":"R29","unstructured":"Measuring cultural safety in health systems. Canadian Institute for Health Information. URL: https:\/\/www.cihi.ca\/sites\/default\/files\/document\/measuring-cultural-safety-in-health-systems-report-en.pdf [Accessed 01-06-2024]"},{"issue":"5","key":"R30","doi-asserted-by":"publisher","first-page":"643","DOI":"10.3390\/ijerph19159411","article-title":"Virtual cancer care beyond the COVID-19 pandemic: patient and staff perspectives and recommendations","volume":"20","author":"Abdelmutti","journal-title":"JCO Oncol Pract"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.1177\/1357633X231167252","article-title":"Measuring disparities in virtual healthcare and outcomes in chronic obstructive pulmonary disease patients during the COVID-19 pandemic","volume":"0","author":"Cherabuddi","journal-title":"J Telemed Telecare"},{"issue":"3","key":"R32","doi-asserted-by":"publisher","DOI":"10.1001\/jamahealthforum.2024.0131","article-title":"Racial and ethnic differences in telemedicine use","volume":"5","author":"Marcondes","journal-title":"JAMA Health Forum"},{"issue":"1","key":"R33","doi-asserted-by":"publisher","DOI":"10.2196\/29876","article-title":"The future of virtual care for older ethnic adults beyond the COVID-19 pandemic","volume":"24","author":"Pham","journal-title":"J Med Internet Res"},{"issue":"1","key":"R34","doi-asserted-by":"publisher","first-page":"E165","DOI":"10.9778\/cmajo.20210065","article-title":"Patient and caregiver perspectives on virtual care: a patient-oriented qualitative study","volume":"10","author":"Chan-Nguyen","journal-title":"cmajo"},{"issue":"1","key":"R35","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-11-15","article-title":"Methodology in conducting a systematic review of systematic reviews of healthcare interventions","volume":"11","author":"Smith","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"R36","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1089\/tmr.2022.0021","article-title":"Asynchronous telemedicine: a systematic literature review","volume":"4","author":"Culmer","journal-title":"Telemed Rep"},{"key":"R37","unstructured":"Global strategy on digital health 2020-2025. World Health Organization. URL: https:\/\/iris.who.int\/bitstream\/handle\/10665\/344249\/9789240020924-eng.pdf?sequence=1 [Accessed 01-06-2024]"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e65312","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:29:45Z","timestamp":1785536985000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e65312"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,1]]},"references-count":37,"URL":"https:\/\/doi.org\/10.2196\/65312","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,1]]},"article-number":"v27i6e65312"}}