{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T19:41:18Z","timestamp":1786736478613,"version":"build-2736575974"},"reference-count":53,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Health misinformation has intensified worldwide, especially in digital environments, where low health and media literacy increase vulnerability. Thus, the MEDIATICH program of the University of Zaragoza launched OCODES (Observatorio Contra la Desinformaci\u00f3n en Salud), a participatory digital initiative designed to promote health media literacy and provide evidence-based information through a web platform and social media channels.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study describes the co-design and development of the OCODES strategy using 2 sequential nominal group technique (NGT) sessions, and assesses its preliminary usability, preliminary user perception, and user engagement after 6 months of activity as a digital initiative developed in response to health misinformation.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n NGT1 (n=15) aimed to identify and prioritize interventions to strengthen health literacy through an individual yes or no prioritization process, while NGT2 (n=18) translated selected priorities into concrete digital products, including website structure, social media selection, content lines, and interaction mechanisms. In addition, routine user feedback and website analytics data generated through the OCODES digital channels during the first 6 months of activity were retrospectively examined. Usability was explored using the System Usability Scale (SUS), while preliminary user perception was described through 2 study-specific indicators available in the public feedback tools: perceived usefulness (1\u20105 Likert scale) and willingness to recommend the website. Google Analytics provided complementary website engagement metrics.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n NGT-1 generated 11 interventions grouped into four categories. Digital actions were prioritized as the core strategy: a health dissemination portal and social media interventions in the context of health misinformation each achieved 93.3% (14 of the 15 participants) agreement. NGT-2 defined the digital architecture of OCODES, including a central website and presence on LinkedIn (Meta), X (formerly known as Twitter; X Corp), and Instagram (Meta), and established guiding principles such as transparency, scientific rigor, accessibility, and clear communication. A total of 99 adults provided routine usability feedback (65\/99, 65.7% women; mean age 44.7, SD 12.54 y). The mean SUS score was 83.10 (SD 10.09), with 94.9% (94\/99) achieving adequate usability (SUS \u226568). Perceived usefulness scored 4.52 (SD 0.71), and 97.9% (97\/99) of users who provided feedback indicated that they would recommend the site. Web metrics showed 5769 new users, 1935 returning users, 19,003 page views, a bounce rate of 53.32%, a total of 3.28 pages per active user, and 4.95 events per session, indicating strong initial engagement.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n OCODES is a feasible and well-received digital strategy developed through a participatory, consensus-driven process. Its favorable usability indicators, positive preliminary user perception, and encouraging early engagement metrics support its feasibility. However, the current findings do not provide evidence of effectiveness in reducing health misinformation or improving health media literacy. Future efforts should focus on reaching vulnerable populations, expanding evaluation approaches, and assessing long-term impact.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/93910","type":"journal-article","created":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T18:42:20Z","timestamp":1786732940000},"page":"e93910-e93910","source":"Crossref","is-referenced-by-count":0,"title":["Development and Preliminary Evaluation of the OCODES Digital Strategy in Response to Health Misinformation: Nominal Group Technique and Retrospective Usability Evaluation Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4753-630X","authenticated-orcid":false,"given":"Emmanuel","family":"Ech\u00e1niz-Serrano","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7911-9949","authenticated-orcid":false,"given":"Enrique","family":"Ram\u00f3n-Arbu\u00e9s","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0053-1429","authenticated-orcid":false,"given":"Jos\u00e9 Manuel","family":"Granada-L\u00f3pez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6455-119X","authenticated-orcid":false,"given":"Mar\u00eda Teresa","family":"Fern\u00e1ndez-Rodrigo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0083-5940","authenticated-orcid":false,"given":"Pedro Jos\u00e9","family":"Sat\u00fastegui-Dord\u00e1","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6170-072X","authenticated-orcid":false,"given":"Eva","family":"Benito-Ruiz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3699-3107","authenticated-orcid":false,"given":"Mar\u00eda Esther","family":"Samaniego-D\u00edaz de Corcuera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8234-1460","authenticated-orcid":false,"given":"Natalia","family":"Barrio-Forn\u00e9","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0045-7871","authenticated-orcid":false,"given":"Piedad","family":"G\u00f3mez-Torres","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,8,14]]},"reference":[{"issue":"9","key":"R1","doi-asserted-by":"publisher","first-page":"544","DOI":"10.2471\/BLT.21.287654","article-title":"Infodemics and health misinformation: a systematic review of reviews","volume":"100","author":"do Nascimento","journal-title":"Bull World Health Organ"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.2196\/56931","article-title":"A comprehensive analysis of COVID-19 misinformation, public health impacts, and communication strategies: scoping review","volume":"26","author":"Kisa","journal-title":"J Med Internet Res"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.2196\/38786","article-title":"Prevalence of health misinformation on social media-challenges and mitigation before, during, and beyond the COVID-19 pandemic: scoping literature review","volume":"26","author":"Kbaier","journal-title":"J Med Internet Res"},{"issue":"2","key":"R4","doi-asserted-by":"publisher","DOI":"10.1093\/heapro\/daaf023","article-title":"Social media and the spread of misinformation: infectious and a threat to public health","volume":"40","author":"Denniss","journal-title":"Health Promot Int"},{"issue":"Suppl_3","key":"R5","doi-asserted-by":"publisher","first-page":"e34","DOI":"10.1093\/cid\/ciac109","article-title":"Misinformation and disinformation: the potential disadvantages of social media in infectious disease and how to combat them","volume":"74","author":"Desai","journal-title":"Clin Infect Dis"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2019.112552","article-title":"Systematic literature review on the spread of health-related misinformation on social media","volume":"240","author":"Wang","journal-title":"Soc Sci Med"},{"issue":"3","key":"R7","doi-asserted-by":"publisher","first-page":"460","DOI":"10.1038\/s41591-022-01713-6","article-title":"Misinformation: susceptibility, spread, and interventions to immunize the public","volume":"28","author":"van der Linden","journal-title":"Nat Med"},{"issue":"15","key":"R8","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph18158091","article-title":"COVID-19 misinformation online and health literacy: a brief overview","volume":"18","author":"Naeem","journal-title":"Int J Environ Res Public Health"},{"issue":"8","key":"R9","doi-asserted-by":"publisher","first-page":"2030","DOI":"10.1177\/13591053241273647","article-title":"Why fall for misinformation? Role of information processing strategies, health consciousness, and overconfidence in health literacy","volume":"30","author":"Peng","journal-title":"J Health Psychol"},{"issue":"2","key":"R10","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0263381","article-title":"Misinformation, believability, and vaccine acceptance over 40 countries: takeaways from the initial phase of the COVID-19 infodemic","volume":"17","author":"Singh","journal-title":"PLoS ONE"},{"issue":"4","key":"R11","doi-asserted-by":"publisher","first-page":"1621","DOI":"10.4269\/ajtmh.20-0812","article-title":"COVID-19-related infodemic and its impact on public health: a global social media analysis","volume":"103","author":"Islam","journal-title":"Am J Trop Med Hyg"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2024.105478","article-title":"Have we found a solution for health misinformation? A ten-year systematic review of health misinformation literature 2013\u20132022","volume":"188","author":"Zhang","journal-title":"Int J Med Inf"},{"issue":"2","key":"R13","doi-asserted-by":"publisher","DOI":"10.2196\/35552","article-title":"A deadly infodemic: social media and the power of COVID-19 misinformation","volume":"24","author":"Gisondi","journal-title":"J Med Internet Res"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","DOI":"10.1080\/21645515.2021.1950504","article-title":"COVID-19 vaccine hesitancy: misinformation and perceptions of vaccine safety","volume":"18","author":"Kricorian","journal-title":"Hum Vaccines Immunother"},{"issue":"11","key":"R15","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0291423","article-title":"Trend analysis of COVID-19 mis\/disinformation narratives-a 3-year study","volume":"18","author":"Kotseva","journal-title":"PLoS One"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2022.115398","article-title":"Why do people believe health misinformation and who is at risk? A systematic review of individual differences in susceptibility to health misinformation","volume":"314","author":"Nan","journal-title":"Soc Sci Med"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.2196\/55086","article-title":"Racial and demographic disparities in susceptibility to health misinformation on social media: national survey-based analysis","volume":"26","author":"Chandrasekaran","journal-title":"J Med Internet Res"},{"issue":"4","key":"R18","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1037\/hea0000978","article-title":"Who is susceptible to online health misinformation? A test of four psychosocial hypotheses","volume":"40","author":"Scherer","journal-title":"Health Psychol"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.630268","article-title":"An examination of factors contributing to the acceptance of online health misinformation","volume":"12","author":"Pan","journal-title":"Front Psychol"},{"issue":"2","key":"R20","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1007\/s11606-024-08867-8","article-title":"A pandemic of misinformation: understanding influences on beliefs in health and conspiracy myths","volume":"40","author":"Carletto","journal-title":"J Gen Intern Med"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-20640-7","article-title":"Depression, reduced education, and bias perceptions as risk factors of beliefs in misinformation","volume":"12","author":"Delmastro","journal-title":"Sci Rep"},{"key":"R22","unstructured":"Wardle C Derakhshan H . Information disorder: toward an interdisciplinary framework for research and policy making. Council of Europe; 2017. URL: https:\/\/edoc.coe.int\/en\/media\/7495-information-disorder-toward-an-interdisciplinary-framework-for-research-and-policy-making.html [Accessed 31-07-2026]"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2025.118272","article-title":"Misinformation, trust, and health: the case for information environment as a major independent social determinant of health","volume":"381","author":"Palmer","journal-title":"Soc Sci Med"},{"key":"R24","unstructured":"Informe C: desinformaci\u00f3n en la era digital [Report in Spanish]. Oficina de Ciencia y Tecnolog\u00eda del Congreso de los Diputados (Oficina C); 2023. [doi: 10.57952\/j3p6-9086]"},{"key":"R25","unstructured":"A social media toolkit for healthcare practitioners - mobile. World Healh Organization; Aug 4, 2021. URL: https:\/\/www.who.int\/publications\/m\/item\/a-social-media-toolkit-for-healthcare-practitioners-desktop [Accessed 01-08-2026]"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-023-16612-9","article-title":"Fighting the infodemic: the 4 i Framework for Advancing Communication and Trust","volume":"23","author":"Sundelson","journal-title":"BMC Public Health"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1080\/10410236.2024.2332817","article-title":"Mitigating health and science misinformation: a scoping review of literature from 2017 to 2022","volume":"40","author":"Heley","journal-title":"Health Commun"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2023.1324330","article-title":"Navigating the infodemic: strategies and policies for promoting health literacy and effective communication","volume":"11","author":"Saleem","journal-title":"Front Public Health"},{"issue":"3","key":"R29","doi-asserted-by":"publisher","first-page":"655","DOI":"10.1007\/s11096-016-0257-x","article-title":"How to use the nominal group and Delphi techniques","volume":"38","author":"McMillan","journal-title":"Int J Clin Pharm"},{"issue":"6","key":"R30","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0302437","article-title":"The use of virtual nominal groups in healthcare research: an extended scoping review","volume":"19","author":"Lee","journal-title":"PLoS ONE"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2021.08.008","article-title":"Methodological options of the nominal group technique for survey item elicitation in health research: a scoping review","volume":"139","author":"Harb","journal-title":"J Clin Epidemiol"},{"issue":"18","key":"R32","doi-asserted-by":"publisher","DOI":"10.12688\/mep.19603.1","article-title":"Twelve tips for adopting the virtual nominal group technique (vNGT) in medical education research","volume":"13","author":"Khurshid","journal-title":"MedEdPublish"},{"issue":"6","key":"R33","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph21060711","article-title":"Using the nominal group technique to inform approaches for enhancing men\u2019s utilization of sexual and reproductive health services","volume":"21","author":"Nyalela","journal-title":"Int J Environ Res Public Health"},{"key":"R34","unstructured":"Brooke J . SUS: a \u201cquick and dirty\u201d usability scale. In: Usability Evaluation in Industry. CRC Press; 1996. URL: https:\/\/www.taylorfrancis.com\/chapters\/edit\/10.1201\/9781498710411-35\/sus-quick-dirty-usability-scale-john-brooke [Accessed 01-08-2026]"},{"issue":"4","key":"R35","doi-asserted-by":"publisher","DOI":"10.2196\/21161","article-title":"Spanish version of the system usability scale for the assessment of electronic tools: development and validation","volume":"7","author":"Sevilla-Gonzalez","journal-title":"JMIR Hum Factors"},{"key":"R36","unstructured":"Ley 14\/2007, de 3 de julio, de investigaci\u00f3n biom\u00e9dica. Agencia Estatal Bolet\u00edn Oficial del Estado; Jul 4, 2007:28826-28848. URL: https:\/\/www.boe.es\/eli\/es\/l\/2007\/07\/03\/14 [Accessed 05-08-2026]"},{"key":"R37","unstructured":"OCODES. URL: https:\/\/ocodes.es\/ [Accessed 01-08-2026]"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.1590\/1980-220X-REEUSP-2023-0298en","article-title":"Adapting the nominal group technique to a virtual version: an experience report","volume":"58","author":"Gusm\u00e3o","journal-title":"Rev Esc Enferm USP"},{"issue":"1","key":"R39","doi-asserted-by":"publisher","first-page":"14","DOI":"10.7748\/nr.2021.e1777","article-title":"A practical guide to the systematic application of nominal group technique","volume":"29","author":"Mullen","journal-title":"Nurse Res"},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.2196\/69618","article-title":"Online interventions addressing health misinformation: scoping review","volume":"27","author":"Grover","journal-title":"J Med Internet Res"},{"issue":"13","key":"R41","doi-asserted-by":"publisher","first-page":"1776","DOI":"10.1080\/10410236.2020.1794553","article-title":"Evaluating the impact of attempts to correct health misinformation on social media: a meta-analysis","volume":"36","author":"Walter","journal-title":"Health Commun"},{"issue":"14","key":"R42","doi-asserted-by":"publisher","DOI":"10.2196\/50178","article-title":"Examining challenges to co-design digital health interventions with end users: systematic review","volume":"27","author":"Duffy","journal-title":"J Med Internet Res"},{"issue":"1","key":"R43","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-024-11819-x","article-title":"Essential strategic principles for planning and developing digitally enabled interventions in health and care settings","volume":"24","author":"Cresswell","journal-title":"BMC Health Serv Res"},{"issue":"9","key":"R44","doi-asserted-by":"publisher","DOI":"10.3390\/dj13090418","article-title":"Comparative usability evaluation of three digital smile design software tools using the system usability scale","volume":"13","author":"Macris","journal-title":"Dent J (Basel)"},{"issue":"9","key":"R45","doi-asserted-by":"publisher","DOI":"10.2196\/81841","article-title":"Digital inequalities in the use of eHealth services in european public health care systems: systematic review of observational studies","volume":"28","author":"Monasterio","journal-title":"J Med Internet Res"},{"issue":"7","key":"R46","doi-asserted-by":"publisher","first-page":"1348","DOI":"10.2105\/AJPH.2021.306282","article-title":"Digital health engagement in the US population: insights from the 2018 Health Information National Trends Survey","volume":"111","author":"Ratcliff","journal-title":"Am J Public Health"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.2196\/46811","article-title":"A technological tool aimed at self-care in patients with multimorbidity: cross-sectional usability study","volume":"11","author":"Medina-Garc\u00eda","journal-title":"JMIR Hum Factors"},{"issue":"4","key":"R48","doi-asserted-by":"publisher","DOI":"10.2196\/28291","article-title":"Methodological guidelines for systematic assessments of health care websites using web analytics: tutorial","volume":"24","author":"Fundingsland","journal-title":"J Med Internet Res"},{"key":"R49","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2023.105124","article-title":"Sociodemographic determinants of digital health literacy: a systematic review and meta-analysis","volume":"177","author":"Estrela","journal-title":"Int J Med Inf"},{"issue":"6","key":"R50","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0234663","article-title":"Studying health-related internet and mobile device use using web logs and smartphone records","volume":"15","author":"Bach","journal-title":"PLoS One"},{"issue":"5","key":"R51","doi-asserted-by":"publisher","DOI":"10.2196\/11931","article-title":"Profiles of a health information-seeking population and the current digital divide: cross-sectional analysis of the 2015-2016 California Health Interview Survey","volume":"21","author":"Din","journal-title":"J Med Internet Res"},{"issue":"350","key":"R52","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2024.116895","article-title":"The potential and paradoxes of eHealth research for digitally marginalised groups: a qualitative meta-review","volume":"350","author":"Coetzer","journal-title":"Soc Sci Med"},{"key":"R53","doi-asserted-by":"publisher","DOI":"10.2196\/80013","article-title":"Bridging the infodemic equity gap: north-south digital health disparities and a framework for action","volume":"27","author":"Osborne","journal-title":"J Med Internet Res"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T18:42:22Z","timestamp":1786732942000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e93910"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,14]]},"references-count":53,"URL":"https:\/\/doi.org\/10.2196\/93910","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,14]]},"article-number":"v10i9e93910"}}