{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,18]],"date-time":"2026-11-18T06:12:16Z","timestamp":1794982336799,"version":"4.9.1"},"reference-count":78,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T00:00:00Z","timestamp":1685404800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T00:00:00Z","timestamp":1685404800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National eHealth Living Lab"},{"name":"National Health and Medical Research Council (NHMRC) of Australia Principal Research Fellowship","award":["APP1155125"],"award-info":[{"award-number":["APP1155125"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Public Health"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The digitalization of healthcare requires users to have sufficient competence in using digital health technologies. In the Netherlands, as well as in other countries, there is a need for a comprehensive, person-centered assessment of eHealth literacy to understand and address eHealth literacy related needs, to improve equitable uptake and use of digital health technologies.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Objective<\/jats:title>\n                <jats:p>We aimed to translate and culturally adapt the original eHealth Literacy Questionnaire (eHLQ) to Dutch and to collect initial validity evidence.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>The eHLQ was translated using a systematic approach with forward translation, an item intent matrix, back translation, and consensus meetings with the developer. A validity-driven and multi-study approach was used to collect validity evidence on 1) test content, 2) response processes and 3) internal structure. Cognitive interviews (<jats:italic>n<\/jats:italic>\u2009=\u200914) were held to assess test content and response processes (Study 1). A pre-final eHLQ version was completed by 1650 people participating in an eHealth study (Study 2). A seven-factor Confirmatory Factor Analysis (CFA) model was fitted to the data to assess the internal structure of the eHLQ. Invariance testing was performed across gender, age, education and current diagnosis.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Cognitive interviews showed some problems in wording, phrasing and resonance with individual\u2019s world views. CFA demonstrated an equivalent internal structure to the hypothesized (original) eHLQ with acceptable fit indices. All items loaded substantially on their corresponding latent factors (range 0.51\u20130.81). The model was partially metric invariant across all subgroups. Comparison of scores between groups showed that people who were younger, higher educated and who had a current diagnosis generally scored higher across domains, however effect sizes were small. Data from both studies were triangulated, resulting in minor refinements to eight items and recommendations on use, score interpretation and reporting.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The Dutch version of the eHLQ showed strong properties for assessing eHealth literacy in the Dutch context. While ongoing collection of validity evidence is recommended, the evidence presented indicate that the eHLQ can be used by researchers, eHealth developers and policy makers to identify eHealth literacy needs and inform the development of eHealth interventions to ensure that people with limited digital access and skills are not left behind.\n<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12889-023-15869-4","type":"journal-article","created":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T09:04:34Z","timestamp":1685437474000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Translation, cultural adaptation and validity assessment of the Dutch version of the eHealth Literacy Questionnaire: a mixed-method approach"],"prefix":"10.1186","volume":"23","author":[{"given":"Charlotte C.","family":"Poot","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eline","family":"Meijer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marjolein","family":"Fokkema","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niels H.","family":"Chavannes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard H.","family":"Osborne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lars","family":"Kayser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,5,30]]},"reference":[{"key":"15869_CR1","volume-title":"Global diffusion of eHealth: making universal health coverage achievable: report of the third global survey on eHealth","author":"World Health O","year":"2016","unstructured":"World Health O. Global diffusion of eHealth: making universal health coverage achievable: report of the third global survey on eHealth. Geneva: World Health Organization; 2016."},{"key":"15869_CR2","volume-title":"Regional Office for E. From innovation to implementation: eHealth in the WHO European Region","author":"World Health Organization","year":"2016","unstructured":"World Health Organization. Regional Office for E. From innovation to implementation: eHealth in the WHO European Region. Copenhagen: World Health Organization. Regional Office for Europe; 2016."},{"key":"15869_CR3","unstructured":"Council conclusions on Health in the Digital Society \u2014 making progress in data-driven innovation in the field of health, (2017)."},{"key":"15869_CR4","unstructured":"Council conclusions on Health in the Digital Society \u2014 making progress in data-driven innovation in the field of health (OJ C, C\/440, 21.12.2017, p. 3, CELEX: https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX:52017XG1221(01))."},{"key":"15869_CR5","first-page":"33","volume":"16","author":"JR Bautista","year":"2015","unstructured":"Bautista JR. From Solving a Health Problem to Achieving Quality of Life: Redefining eHealth Literacy. J Literacy Technol. 2015;16:33\u201354.","journal-title":"J Literacy Technol"},{"key":"15869_CR6","doi-asserted-by":"crossref","unstructured":"Monkman H, Kushniruk A. eHealth literacy issues, constructs, models, and methods for health information technology design and evaluation. 2015;7:541\u20139.","DOI":"10.34105\/j.kmel.2015.07.036"},{"key":"15869_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2196\/22051","volume":"23","author":"A Hunsaker","year":"2021","unstructured":"Hunsaker A, Hargittai E, Micheli M. Relationship between internet use and change in health status: panel study of young adults. J Med Internet Res. 2021;23:1.","journal-title":"J Med Internet Res"},{"issue":"1","key":"15869_CR8","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1186\/s12911-021-01500-2","volume":"21","author":"M Duplaga","year":"2021","unstructured":"Duplaga M. The association between Internet use and health-related outcomes in older adults and the elderly: a cross-sectional study. BMC Med Inform Decis Mak. 2021;21(1):150.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"2","key":"15869_CR9","doi-asserted-by":"publisher","first-page":"97","DOI":"10.7326\/0003-4819-155-2-201107190-00005","volume":"155","author":"ND Berkman","year":"2011","unstructured":"Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155(2):97\u2013107.","journal-title":"Ann Intern Med"},{"issue":"12","key":"15869_CR10","doi-asserted-by":"publisher","first-page":"1228","DOI":"10.1111\/j.1525-1497.2004.40153.x","volume":"19","author":"DA Dewalt","year":"2004","unstructured":"Dewalt DA, Berkman ND, Sheridan S, Lohr KN, Pignone MP. Literacy and health outcomes: a systematic review of the literature. J Gen Intern Med. 2004;19(12):1228\u201339.","journal-title":"J Gen Intern Med"},{"issue":"7","key":"15869_CR11","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1007\/s10916-020-01596-5","volume":"44","author":"AJ Bokolo","year":"2020","unstructured":"Bokolo AJ. Use of Telemedicine and Virtual Care for Remote Treatment in Response to COVID-19 Pandemic. J Med Syst. 2020;44(7):132.","journal-title":"J Med Syst"},{"issue":"12","key":"15869_CR12","doi-asserted-by":"publisher","first-page":"e24087","DOI":"10.2196\/24087","volume":"22","author":"S Doraiswamy","year":"2020","unstructured":"Doraiswamy S, Abraham A, Mamtani R, Cheema S. Use of Telehealth During the COVID-19 Pandemic: Scoping Review. J Med Internet Res. 2020;22(12):e24087.","journal-title":"J Med Internet Res"},{"key":"15869_CR13","doi-asserted-by":"publisher","unstructured":"Peek N, Sujan M, Scott PA-O. Digital health and care in pandemic times: impact of COVID-19. LID - https:\/\/doi.org\/10.1136\/bmjhci-2020-100166 LID - e100166 FAU - Peek, Niels. (2632\u20131009 (Electronic)).","DOI":"10.1136\/bmjhci-2020-100166"},{"key":"15869_CR14","doi-asserted-by":"publisher","first-page":"103644","DOI":"10.1016\/j.ijnurstu.2020.103644","volume":"108","author":"YY Chong","year":"2020","unstructured":"Chong YY, Cheng HY, Chan HYL, Chien WT, Wong SYS. COVID-19 pandemic, infodemic and the role of eHealth literacy. Int J Nurs Stud. 2020;108:103644.","journal-title":"Int J Nurs Stud"},{"issue":"9","key":"15869_CR15","doi-asserted-by":"publisher","first-page":"1118","DOI":"10.1089\/tmj.2020.0155","volume":"26","author":"AJ Triana","year":"2020","unstructured":"Triana AJ, Gusdorf RE, Shah KP, Horst SN. Technology Literacy as a Barrier to Telehealth During COVID-19. Telemed e-Health. 2020;26(9):1118\u20139.","journal-title":"Telemed e-Health"},{"issue":"3","key":"15869_CR16","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1001\/jamaoto.2020.5161","volume":"147","author":"I Darrat","year":"2021","unstructured":"Darrat I, Tam S, Boulis M, Williams AM. Socioeconomic Disparities in Patient Use of Telehealth During the Coronavirus Disease 2019 Surge. JAMA Otolaryngol Head Neck Surg. 2021;147(3):287\u201395.","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"issue":"7","key":"15869_CR17","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1093\/oncolo\/oyac046","volume":"27","author":"CC Shao","year":"2022","unstructured":"Shao CC, McLeod MC, Gleason LT, Marques ICDS, Chu DI, Wallace EL, et al. Inequity in Telemedicine Use Among Patients with Cancer in the Deep South During the COVID-19 Pandemic. Oncologist. 2022;27(7):555\u201364.","journal-title":"Oncologist"},{"issue":"6","key":"15869_CR18","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1177\/1474515120941307","volume":"19","author":"G Br\u00f8rs","year":"2020","unstructured":"Br\u00f8rs G, Norman CD, Norekv\u00e5l TM. Accelerated importance of eHealth literacy in the COVID-19 outbreak and beyond. Eur J Cardiovasc Nurs. 2020;19(6):458\u201361.","journal-title":"Eur J Cardiovasc Nurs"},{"key":"15869_CR19","doi-asserted-by":"publisher","unstructured":"Katzow MW, Steinway C, Jan S. Telemedicine and Health Disparities During COVID-19. LID - e20201586 [pii] LID - https:\/\/doi.org\/10.1542\/peds.2020-1586 FAU - Katzow, Michelle W. (1098\u20134275 (Electronic)).","DOI":"10.1542\/peds.2020-1586"},{"issue":"2","key":"15869_CR20","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1007\/s11524-020-00508-9","volume":"98","author":"CN Eruchalu","year":"2021","unstructured":"Eruchalu CN, Pichardo MS, Bharadwaj M, Rodriguez CB, Rodriguez JA, Bergmark RW, et al. The Expanding Digital Divide: Digital Health Access Inequities during the COVID-19 Pandemic in New York City. J Urban Health. 2021;98(2):183\u20136.","journal-title":"J Urban Health"},{"key":"15869_CR21","doi-asserted-by":"crossref","unstructured":"Aissaoui N. The digital divide: a literature review and some directions for future research in light of COVID-19. Global Knowledge, Memory and Communication. 2021;ahead-of-print(ahead-of-print).","DOI":"10.1108\/GKMC-06-2020-0075"},{"issue":"5","key":"15869_CR22","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1161\/CIRCULATIONAHA.120.048185","volume":"142","author":"LA Eberly","year":"2020","unstructured":"Eberly LA, Khatana SAM, Nathan AS, Snider C, Julien HM, Deleener ME, et al. Telemedicine Outpatient Cardiovascular Care During the COVID-19 Pandemic. Circulation. 2020;142(5):510\u20132.","journal-title":"Circulation"},{"key":"15869_CR23","first-page":"2021","volume-title":"Global strategy on digital health 2020\u20132025","author":"World Health O","year":"2021","unstructured":"World Health O. Global strategy on digital health 2020\u20132025. Geneva: World Health Organization; 2021. p. 2021."},{"issue":"1","key":"15869_CR24","first-page":"e27","volume":"19","author":"R van der Vaart","year":"2017","unstructured":"van der Vaart R, Drossaert C. Development of the Digital Health Literacy Instrument: Measuring a Broad Spectrum of Health 1.0 and Health 2.0 Skills. J Med Int Res. 2017;19(1):e27.","journal-title":"J Med Int Res"},{"key":"15869_CR25","first-page":"e27","volume-title":"eHEALS: the ehealth literacy scale","author":"C Norman","year":"2006","unstructured":"Norman C, Skinner H. eHEALS: the ehealth literacy scale. 2006. p. e27."},{"issue":"12","key":"15869_CR26","doi-asserted-by":"publisher","first-page":"e287","DOI":"10.2196\/jmir.3542","volume":"16","author":"W Hsu","year":"2014","unstructured":"Hsu W, Chiang C, Yang S. The effect of individual factors on health behaviors among college students: the mediating effects of eHealth literacy. J Med Internet Res. 2014;16(12):e287.","journal-title":"J Med Internet Res"},{"key":"15869_CR27","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1186\/1471-2296-15-18","volume":"15","author":"RJ Koopman","year":"2014","unstructured":"Koopman RJ, Petroski GF, Canfield SM, Stuppy JA, Mehr DR. Development of the PRE-HIT instrument: patient readiness to engage in health information technology. BMC Fam Pract. 2014;15:18.","journal-title":"BMC Fam Pract"},{"key":"15869_CR28","doi-asserted-by":"publisher","first-page":"11","DOI":"10.2196\/30644","volume":"23","author":"J Lee","year":"2021","unstructured":"Lee J, Lee EH, Chae D. eHealth literacy instruments: systematic review of measurement properties. J Med Internet Res. 2021;23:11.","journal-title":"J Med Internet Res"},{"issue":"2","key":"15869_CR29","doi-asserted-by":"publisher","first-page":"e9","DOI":"10.2196\/jmir.8.2.e9","volume":"8","author":"DC Norman","year":"2006","unstructured":"Norman DC, Skinner AH. eHealth Literacy: Essential Skills for Consumer Health in a Networked World. J Med Internet Res. 2006;8(2):e9.","journal-title":"J Med Internet Res"},{"issue":"4","key":"15869_CR30","first-page":"e125","volume":"13","author":"C Norman","year":"2011","unstructured":"Norman C. eHealth literacy 2.0: problems and opportunities with an evolving concept. J Med Int Res. 2011;13(4):e125.","journal-title":"J Med Int Res"},{"issue":"4","key":"15869_CR31","doi-asserted-by":"publisher","first-page":"e86","DOI":"10.2196\/jmir.1840","volume":"13","author":"R van der Vaart","year":"2011","unstructured":"van der Vaart R, van Deursen JAMA, Drossaert HCC, Taal E, van Dijk AMGJ, van de Laar AFJM. Does the eHealth Literacy Scale (eHEALS) Measure What it Intends to Measure? Validation of a Dutch Version of the eHEALS in Two Adult Populations. J Med Internet Res. 2011;13(4):e86.","journal-title":"J Med Internet Res"},{"key":"15869_CR32","doi-asserted-by":"publisher","first-page":"k1656","DOI":"10.1136\/bmj.k1656","volume":"361","author":"R Osborne","year":"2018","unstructured":"Osborne R, Kayser L. Skills and characteristics of the e-health literate patient. BMJ. 2018;361:k1656.","journal-title":"BMJ"},{"issue":"4","key":"15869_CR33","first-page":"522","volume":"7","author":"O Norgaard","year":"2015","unstructured":"Norgaard O, Furstrand D, Klokker L, Karnoe A, Batterham R, Kayser L, et al. The e-health literacy framework: a conceptual framework for characterizing e-health users and their interaction with e-health systems. Knowl Manage E-Learning. 2015;7(4):522\u201340.","journal-title":"Knowl Manage E-Learning"},{"issue":"5","key":"15869_CR34","doi-asserted-by":"publisher","first-page":"e178","DOI":"10.2196\/jmir.8347","volume":"20","author":"A Karnoe","year":"2018","unstructured":"Karnoe A, Furstrand D, Christensen BK, Norgaard O, Kayser L. Assessing Competencies Needed to Engage With Digital Health Services: Development of the eHealth Literacy Assessment Toolkit. J Med Internet Res. 2018;20(5):e178.","journal-title":"J Med Internet Res"},{"issue":"2","key":"15869_CR35","doi-asserted-by":"publisher","first-page":"e36","DOI":"10.2196\/jmir.8371","volume":"20","author":"L Kayser","year":"2018","unstructured":"Kayser L, Karnoe A, Furstrand D, Batterham R, Christensen KB, Elsworth G, et al. A Multidimensional Tool Based on the eHealth Literacy Framework: Development and Initial Validity Testing of the eHealth Literacy Questionnaire (eHLQ). J Med Internet Res. 2018;20(2):e36.","journal-title":"J Med Internet Res"},{"issue":"9","key":"15869_CR36","doi-asserted-by":"publisher","first-page":"e14517","DOI":"10.2196\/14517","volume":"8","author":"B Dinesen","year":"2019","unstructured":"Dinesen B, Dittmann L, Gade JD, J\u00f8rgensen CK, Hollingdal M, Leth S, et al. \u201cFuture Patient\u201d Telerehabilitation for Patients With Heart Failure: Protocol for a Randomized Controlled Trial. JMIR Res Protoc. 2019;8(9):e14517.","journal-title":"JMIR Res Protoc"},{"key":"15869_CR37","doi-asserted-by":"publisher","first-page":"2","DOI":"10.2196\/ijmr.8423","volume":"8","author":"KA Holt","year":"2019","unstructured":"Holt KA, Karnoe A, Overgaard D, Nielsen SE, Kayser L, R\u00f8der ME, et al. Differences in the level of electronic health literacy between users and nonusers of digital health services: an exploratory survey of a group of medical outpatients. Interact J Med Res. 2019;8:2.","journal-title":"Interact J Med Res"},{"issue":"1","key":"15869_CR38","doi-asserted-by":"publisher","first-page":"e15022","DOI":"10.2196\/15022","volume":"9","author":"JC Rawstorn","year":"2020","unstructured":"Rawstorn JC, Ball K, Oldenburg B, Chow CK, McNaughton SA, Lamb KE, et al. Smartphone Cardiac Rehabilitation, Assisted Self-Management Versus Usual Care: Protocol for a Multicenter Randomized Controlled Trial to Compare Effects and Costs Among People With Coronary Heart Disease. JMIR Res Protoc. 2020;9(1):e15022.","journal-title":"JMIR Res Protoc"},{"key":"15869_CR39","first-page":"5","volume":"10","author":"SF Illadsen","year":"2020","unstructured":"Illadsen SF, Hadi H, Ismail I, Osborne RH, Ekstr\u00f8m CT, Kayser L. ehealth literacy and health literacy among immigrants and their descendants compared with women of Danish origin: a cross-sectional study using a multidimensional approach among pregnant women. BMJ Open. 2020;10:5.","journal-title":"BMJ Open"},{"issue":"10","key":"15869_CR40","doi-asserted-by":"publisher","first-page":"e30243","DOI":"10.2196\/30243","volume":"23","author":"C Cheng","year":"2021","unstructured":"Cheng C, Elsworth G, Osborne RH. Validity Evidence Based on Relations to Other Variables of the eHealth Literacy Questionnaire (eHLQ): Bayesian Approach to Test for Known-Groups Validity. J Med Internet Res. 2021;23(10):e30243.","journal-title":"J Med Internet Res"},{"issue":"3","key":"15869_CR41","doi-asserted-by":"publisher","first-page":"e32777","DOI":"10.2196\/32777","volume":"24","author":"C Cheng","year":"2022","unstructured":"Cheng C, Elsworth GR, Osborne RH. Validity Evidence of the eHealth Literacy Questionnaire (eHLQ) Part 2: Mixed Methods Approach to Evaluate Test Content, Response Process, and Internal Structure in the Australian Community Health Setting. J Med Internet Res. 2022;24(3):e32777.","journal-title":"J Med Internet Res"},{"issue":"4","key":"15869_CR42","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1016\/j.jclinepi.2014.11.021","volume":"68","author":"J Epstein","year":"2015","unstructured":"Epstein J, Santo RM, Guillemin F. A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. J Clin Epidemiol. 2015;68(4):435\u201341.","journal-title":"J Clin Epidemiol"},{"key":"15869_CR43","doi-asserted-by":"publisher","unstructured":"Kane MT. Validating the interpretations and uses of test scores.\u00a0J Educ Meas 2013: official publication of the National Council on Measurement in Education. 50(1):1\u201373. https:\/\/doi.org\/10.1111\/jedm.12000.","DOI":"10.1111\/jedm.12000"},{"key":"15869_CR44","doi-asserted-by":"crossref","unstructured":"Cook DA, Beckman TJ. Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application. The American Journal of Medicine. 2006;119(2):166.e7-.e16.","DOI":"10.1016\/j.amjmed.2005.10.036"},{"issue":"7","key":"15869_CR45","doi-asserted-by":"publisher","first-page":"1695","DOI":"10.1007\/s11136-018-1815-6","volume":"27","author":"M Hawkins","year":"2018","unstructured":"Hawkins M, Elsworth GR, Osborne RH. Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity. Qual Life Res. 2018;27(7):1695\u2013710.","journal-title":"Qual Life Res"},{"key":"15869_CR46","volume-title":"Standards for educational and psychological testing","author":"American Educational Research Association APANCoMiEJCoSfE, Psychological T","year":"2014","unstructured":"American Educational Research Association APANCoMiEJCoSfE, Psychological T. Standards for educational and psychological testing. 2014."},{"issue":"6","key":"15869_CR47","first-page":"845","volume":"38","author":"NE van Hattem","year":"2021","unstructured":"van Hattem NE, Silven AV, Bonten TN, Chavannes NH. COVID-19\u2019s impact on the future of digital health technology in primary care. Family Practice. 2021;38(6):845\u20137.","journal-title":"Family Practice"},{"issue":"9","key":"15869_CR48","first-page":"e20953","volume":"22","author":"AV Silven","year":"2020","unstructured":"Silven AV, Petrus AHJ, Villalobos-Quesada M, Dirikgil E, Oerlemans CR, Landstra CP, et al. Telemonitoring for Patients With COVID-19: Recommendations for Design and Implementation. J Med Int Res. 2020;22(9):e20953-e.","journal-title":"J Med Int Res"},{"issue":"2","key":"15869_CR49","doi-asserted-by":"publisher","first-page":"2100636","DOI":"10.1183\/13993003.00636-2021","volume":"58","author":"E Dirikgil","year":"2021","unstructured":"Dirikgil E, Roos R, Groeneveld GH, Heringhaus C, Silven AV, Petrus AHJ, et al. Home-monitoring reduced short stay admissions in suspected COVID-19 patients: COVID-box project. Eur Respir J. 2021;58(2):2100636.","journal-title":"Eur Respir J"},{"issue":"24","key":"15869_CR50","doi-asserted-by":"publisher","first-page":"3186","DOI":"10.1097\/00007632-200012150-00014","volume":"25","author":"DE Beaton","year":"2000","unstructured":"Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186\u201391.","journal-title":"Spine"},{"issue":"2","key":"15869_CR51","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1111\/j.1365-2753.2010.01434.x","volume":"17","author":"VD Sousa","year":"2011","unstructured":"Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17(2):268\u201374.","journal-title":"J Eval Clin Pract"},{"key":"15869_CR52","doi-asserted-by":"publisher","DOI":"10.4135\/9781506335193","volume-title":"SAGE Handbook of Mixed Methods in Social & Behavioral Research","author":"A Tashakkori","year":"2010","unstructured":"Tashakkori A, Teddlie C. SAGE Handbook of Mixed Methods in Social & Behavioral Research. 2nd ed. Thousand Oaks: Sage; 2010.","edition":"2"},{"issue":"4","key":"15869_CR53","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1177\/1558689810382916","volume":"4","author":"FG Castro","year":"2010","unstructured":"Castro FG, Kellison JG, Boyd SJ, Kopak A. A Methodology for Conducting Integrative Mixed Methods Research and Data Analyses. J Mix Methods Res. 2010;4(4):342\u201360.","journal-title":"J Mix Methods Res"},{"key":"15869_CR54","unstructured":"Swinburn University of Technology CfGHaE. Ophelia and questionnaires: Swinburn University of Technology, Centre for Global Health and Equity; [Available from: https:\/\/www.swinburne.edu.au\/research\/global-health-equity\/ophelia-and-questionnaires\/."},{"issue":"1","key":"15869_CR55","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1186\/s12874-020-00962-8","volume":"20","author":"M Hawkins","year":"2020","unstructured":"Hawkins M, Cheng C, Elsworth GR, Osborne RH. Translation method is validity evidence for construct equivalence: analysis of secondary data routinely collected during translations of the Health Literacy Questionnaire (HLQ). BMC Med Res Methodol. 2020;20(1):130.","journal-title":"BMC Med Res Methodol"},{"issue":"4","key":"15869_CR56","doi-asserted-by":"publisher","first-page":"636","DOI":"10.1093\/poq\/nf","volume":"75","author":"J Blair","year":"2013","unstructured":"Blair J, Conrad FG. Sample size for cognitive interview pretesting. Public Opin Q. 2013;75(4):636\u201358. https:\/\/doi.org\/10.1093\/poq\/nf.","journal-title":"Public Opin Q"},{"key":"15869_CR57","unstructured":"Cognitive Interviewing. Thousand Oaks, California2005. Available from: https:\/\/methods.sagepub.com\/book\/cognitive-interviewing."},{"issue":"2","key":"15869_CR58","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1093\/poq\/nfm006","volume":"71","author":"PC Beatty","year":"2007","unstructured":"Beatty PC, Willis GB. Research Synthesis: The Practice of Cognitive Interviewing. Public Opin Q. 2007;71(2):287\u2013311.","journal-title":"Public Opin Q"},{"issue":"3","key":"15869_CR59","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1023\/A:1023254226592","volume":"12","author":"D Collins","year":"2003","unstructured":"Collins D. Pretesting survey instruments: An overview of cognitive methods. Qual Life Res. 2003;12(3):229\u201338.","journal-title":"Qual Life Res"},{"issue":"1","key":"15869_CR60","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.apnr.2005.06.001","volume":"19","author":"EJ Halcomb","year":"2006","unstructured":"Halcomb EJ, Davidson PM. Is verbatim transcription of interview data always necessary? Appl Nurs Res. 2006;19(1):38\u201342.","journal-title":"Appl Nurs Res"},{"issue":"2","key":"15869_CR61","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1002\/nur.20195","volume":"30","author":"K Knafl","year":"2007","unstructured":"Knafl K, Deatrick J, Gallo A, Holcombe G, Bakitas M, Dixon J, et al. The analysis and interpretation of cognitive interviews for instrument development. Res Nurs Health. 2007;30(2):224\u201334.","journal-title":"Res Nurs Health"},{"key":"15869_CR62","doi-asserted-by":"crossref","unstructured":"Ranatunga RVSPK, Priyanath HMS, Megama RGN. Methods and rule-of-thumbs in the determination of minimum sample size when appling structural equation modelling: a review. J Soc Sci Res. 2020;15:102\u20139.","DOI":"10.24297\/jssr.v15i.8670"},{"issue":"2","key":"15869_CR63","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v048.i02","volume":"48","author":"Y Rosseel","year":"2012","unstructured":"Rosseel Y. lavaan: an R package for structural equation modeling. J Stat Softw. 2012;48(2):1\u201336.","journal-title":"J Stat Softw"},{"key":"15869_CR64","doi-asserted-by":"crossref","unstructured":"M\u00eendril D. editor Maximum Likelihood ( ML ) and Diagonally Weighted Least Squares ( DWLS ) Estimation Procedures\u202f: A Comparison of Estimation Bias with Ordinal and Multivariate Non-Normal Data. 2010.","DOI":"10.20533\/ijds.2040.2570.2010.0010"},{"issue":"1","key":"15869_CR65","first-page":"1","volume":"6","author":"LT Hu","year":"1999","unstructured":"Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. Multidisciplinary J. 1999;6(1):1\u201355.","journal-title":"Multidisciplinary J"},{"key":"15869_CR66","unstructured":"Comrey AL, Lee HB. A first course in factor analysis, 2nd ed. Hillsdale, NJ, US: Lawrence Erlbaum Associates, Inc; 1992. xii, 430-xii,"},{"issue":"3","key":"15869_CR67","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1037\/0033-2909.105.3.456","volume":"105","author":"BM Byrne","year":"1989","unstructured":"Byrne BM, Shavelson RJ, Muth\u00e9n B. Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychol Bull. 1989;105(3):456.","journal-title":"Psychol Bull"},{"issue":"1","key":"15869_CR68","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1177\/109442810031002","volume":"3","author":"RJ Vandenberg","year":"2000","unstructured":"Vandenberg RJ, Lance CE. A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research. Organ Res Methods. 2000;3(1):4\u201370.","journal-title":"Organ Res Methods"},{"issue":"2","key":"15869_CR69","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1207\/S15328007SEM0902_5","volume":"9","author":"GW Cheung","year":"2002","unstructured":"Cheung GW, Rensvold RB. Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Struct Equ Modeling. 2002;9(2):233\u201355.","journal-title":"Struct Equ Modeling"},{"key":"15869_CR70","doi-asserted-by":"crossref","unstructured":"Willemsen RF, Aardoom JJ, Chavannes NH, Versluis A. Online synchronous focus group interviews: practical considerations. Qual Res. 2022;0(0).","DOI":"10.1177\/14687941221110161"},{"key":"15869_CR71","doi-asserted-by":"publisher","first-page":"658","DOI":"10.1186\/1471-2458-13-658","volume":"13","author":"RH Osborne","year":"2013","unstructured":"Osborne RH, Batterham RW, Elsworth GR. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658.","journal-title":"BMC Public Health"},{"issue":"1","key":"15869_CR72","doi-asserted-by":"publisher","first-page":"e32855","DOI":"10.2196\/32855","volume":"24","author":"Y-C Chen","year":"2022","unstructured":"Chen Y-C, Cheng C, Osborne RH, Kayser L, Liu C-Y, Chang L-C. Validity Testing and Cultural Adaptation of the eHealth Literacy Questionnaire (eHLQ) Among People With Chronic Diseases in Taiwan: Mixed Methods Study. J Med Internet Res. 2022;24(1):e32855.","journal-title":"J Med Internet Res"},{"issue":"2","key":"15869_CR73","doi-asserted-by":"publisher","first-page":"e16","DOI":"10.2196\/ijmr.4749","volume":"5","author":"S Xesfingi","year":"2016","unstructured":"Xesfingi S, Vozikis A. eHealth Literacy: In the Quest of the Contributing Factors. Interact J Med Res. 2016;5(2):e16.","journal-title":"Interact J Med Res"},{"issue":"9","key":"15869_CR74","doi-asserted-by":"publisher","first-page":"e009623","DOI":"10.1136\/bmjgh-2022-009623","volume":"7","author":"RH Osborne","year":"2022","unstructured":"Osborne RH, Cheng CC, Nolte S, Elmer S, Besancon S, Budhathoki SS, et al. Health literacy measurement: embracing diversity in a strengths-based approach to promote health and equity, and avoid epistemic injustice. BMJ Glob Health. 2022;7(9):e009623.","journal-title":"BMJ Glob Health"},{"key":"15869_CR75","unstructured":"Hibbard J. Patient activation and health literacy: What\u2019s the difference? How do each contribute to health outcomes. Stud Health Technol Inform. 2017;240:251\u201362."},{"issue":"2","key":"15869_CR76","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1007\/s11606-020-05912-0","volume":"36","author":"DM Muscat","year":"2021","unstructured":"Muscat DM, Shepherd HL, Nutbeam D, Trevena L, McCaffery KJ. Health literacy and shared decision-making: exploring the relationship to enable meaningful patient engagement in healthcare. J Gen Intern Med. 2021;36(2):521\u20134.","journal-title":"J Gen Intern Med"},{"issue":"6","key":"15869_CR77","doi-asserted-by":"publisher","first-page":"1298","DOI":"10.1093\/jamia\/ocab010","volume":"28","author":"MA Godinho","year":"2021","unstructured":"Godinho MA, Ansari S, Guo GN, Liaw S-T. Toolkits for implementing and evaluating digital health: A systematic review of rigor and reporting. J Am Med Inform Assoc. 2021;28(6):1298\u2013307.","journal-title":"J Am Med Inform Assoc"},{"key":"15869_CR78","doi-asserted-by":"crossref","unstructured":"Karn\u00f8e Knudsen A, Kayser L. Validation of the eHealth Literacy Assessment tool (eHLA). Int J Integr Care. 2016;16(6):A349.","DOI":"10.5334\/ijic.2897"}],"container-title":["BMC Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12889-023-15869-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12889-023-15869-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12889-023-15869-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T09:06:22Z","timestamp":1685437582000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcpublichealth.biomedcentral.com\/articles\/10.1186\/s12889-023-15869-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,30]]},"references-count":78,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["15869"],"URL":"https:\/\/doi.org\/10.1186\/s12889-023-15869-4","relation":{},"ISSN":["1471-2458"],"issn-type":[{"value":"1471-2458","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,30]]},"assertion":[{"value":"22 September 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The cognitive interview study and the FitKnip study were cleared for ethics by the Medical Ethical Review Committee of the Leiden University Medical Centre (No. 19 \u2013 078 and No. P20.001, respectively). All methods were carried out in accordance with relevant guidelines and regulations. Informed consent to participate in the study was obtained from all participants.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1006"}}