{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T09:44:23Z","timestamp":1783071863791,"version":"3.54.6"},"reference-count":70,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T00:00:00Z","timestamp":1734912000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T00:00:00Z","timestamp":1734912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Manchester Melbourne Toronto Joint Research Fund"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Co-design has been suggested to improve intervention effectiveness and sustainability. However, digital health intervention co-design is inconsistently reported. This umbrella review aims to synthesize what is known about co-design of digital health interventions. We searched five databases from inception. Reviews which reported on co-design methodologies used in digital health were eligible. Information on review type, health conditions, and reported specifics of co-design were extracted and synthesized. Methodological quality was assessed using the AMSTAR2 tool. We included 21 reviews published between 2015 and 2023. Co-design participants included patients, caregivers and healthcare professionals. The frequency and breadth of participant involvement in co-design activities were reported in less than half of reviews. Participants evaluated intervention co-design as a positive process. All reviews were rated as critically low quality. This umbrella review highlights the inconsistent reporting of co-design in digital health. Here, we emphasize the importance of creating guidelines to direct co-design activities.<\/jats:p>","DOI":"10.1038\/s41746-024-01385-1","type":"journal-article","created":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T02:31:18Z","timestamp":1734921078000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":73,"title":["An umbrella review on how digital health intervention co-design is conducted and described"],"prefix":"10.1038","volume":"7","author":[{"given":"Alicia","family":"Kilfoy","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0233-2469","authenticated-orcid":false,"given":"Ting-Chen Chloe","family":"Hsu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charlotte","family":"Stockton-Powdrell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8689-3919","authenticated-orcid":false,"given":"Pauline","family":"Whelan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charlene H.","family":"Chu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6995-2825","authenticated-orcid":false,"given":"Lindsay","family":"Jibb","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,12,23]]},"reference":[{"key":"1385_CR1","doi-asserted-by":"publisher","first-page":"2680","DOI":"10.1016\/j.jacc.2018.03.523","volume":"71","author":"A Sharma","year":"2018","unstructured":"Sharma, A. et al. Using digital health technology to better generate evidence and deliver evidence-based care. J. Am. Coll. Cardiol. 71, 2680\u20132690 (2018).","journal-title":"J. Am. Coll. Cardiol."},{"key":"1385_CR2","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1038\/s41746-023-00899-4","volume":"6","author":"IJ Borges Do Nascimento","year":"2023","unstructured":"Borges Do Nascimento, I. J. et al. Barriers and facilitators to utilizing digital health technologies by healthcare professionals. npj Digital Med. 6, 161 (2023).","journal-title":"npj Digital Med."},{"key":"1385_CR3","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1016\/j.amepre.2016.06.008","volume":"51","author":"E Murray","year":"2016","unstructured":"Murray, E. et al. Evaluating digital health interventions. Am. J. Prev. Med. 51, 843\u2013851 (2016).","journal-title":"Am. J. Prev. Med."},{"key":"1385_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.31478\/202206e","volume":"6","author":"A Abernethy","year":"2022","unstructured":"Abernethy, A. et al. The Promise of Digital Health: Then, Now, and the Future. NAM Perspect 6, 1\u201316 (2022).","journal-title":"NAM Perspect"},{"key":"1385_CR5","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1001\/jamapediatrics.2017.0042","volume":"171","author":"DA Fedele","year":"2017","unstructured":"Fedele, D. A., Cushing, C. C., Fritz, A., Amaro, C. M. & Ortega, A. Mobile health interventions for improving health outcomes in youth: a meta-analysis. JAMA Pediatr. 171, 461 (2017).","journal-title":"JAMA Pediatr."},{"key":"1385_CR6","doi-asserted-by":"publisher","first-page":"e33085","DOI":"10.2196\/33085","volume":"5","author":"A Garnett","year":"2022","unstructured":"Garnett, A., Northwood, M., Ting, J. & Sangrar, R. mHealth interventions to support caregivers of older adults: equity-focused systematic review. JMIR Aging 5, e33085 (2022).","journal-title":"JMIR Aging"},{"key":"1385_CR7","doi-asserted-by":"publisher","first-page":"105214","DOI":"10.1016\/j.ijmedinf.2023.105214","volume":"179","author":"M Samadbeik","year":"2023","unstructured":"Samadbeik, M., Garavand, A., Aslani, N., Sajedimehr, N. & Fatehi, F. Mobile health interventions for cancer patient education: a scoping review. Int. J. Med. Inform. 179, 105214 (2023).","journal-title":"Int. J. Med. Inform."},{"key":"1385_CR8","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1177\/1043454217697022","volume":"34","author":"LA Jibb","year":"2017","unstructured":"Jibb, L. A. et al. Development of a mHealth real-time pain self-management app for adolescents with cancer: an iterative usability testing study. J. Pediatr. Oncol. Nurs. 34, 283\u2013294 (2017).","journal-title":"J. Pediatr. Oncol. Nurs."},{"key":"1385_CR9","doi-asserted-by":"publisher","DOI":"10.1002\/pbc.28278","volume":"67","author":"JF Hunter","year":"2020","unstructured":"Hunter, J. F. et al. A pilot study of the preliminary efficacy of Pain Buddy: a novel intervention for the management of children\u2019s cancer\u2010related pain. Pediatr. Blood Cancer 67, e28278 (2020).","journal-title":"Pediatr. Blood Cancer"},{"key":"1385_CR10","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1161\/CIR.0000000000000232","volume":"132","author":"LE Burke","year":"2015","unstructured":"Burke, L. E. et al. Current science on consumer use of mobile health for cardiovascular disease prevention: a scientific statement from the American Heart Association. Circulation 132, 1157\u20131213 (2015).","journal-title":"Circulation"},{"key":"1385_CR11","doi-asserted-by":"crossref","unstructured":"Winters, N., Oliver, M. & Langer, L. Can mobile health training meet the challenge of \u2018measuring better\u2019? In Measuring the Unmeasurable in Education (ed. Unterhalter, E.) 115\u2013131 (Routledge, 2020).","DOI":"10.4324\/9780429444494-6"},{"key":"1385_CR12","doi-asserted-by":"publisher","first-page":"e38635","DOI":"10.2196\/38635","volume":"11","author":"JA Malloy","year":"2022","unstructured":"Malloy, J. A., Partridge, S. R., Kemper, J. A., Braakhuis, A. & Roy, R. Co-design of digital health interventions for young adults: protocol for a scoping review. JMIR Res. Protoc. 11, e38635 (2022).","journal-title":"JMIR Res. Protoc."},{"key":"1385_CR13","doi-asserted-by":"publisher","first-page":"e27896","DOI":"10.2196\/27896","volume":"9","author":"TJ Noorbergen","year":"2021","unstructured":"Noorbergen, T. J., Adam, M. T. P., Teubner, T. & Collins, C. E. Using co-design in mobile health system development: a qualitative study with experts in co-design and mobile health system development. JMIR Mhealth Uhealth 9, e27896 (2021).","journal-title":"JMIR Mhealth Uhealth"},{"key":"1385_CR14","doi-asserted-by":"publisher","first-page":"e038339","DOI":"10.1136\/bmjopen-2020-038339","volume":"10","author":"S Moll","year":"2020","unstructured":"Moll, S. et al. Are you really doing \u2018codesign\u2019? Critical reflections when working with vulnerable populations. BMJ Open 10, e038339 (2020).","journal-title":"BMJ Open"},{"key":"1385_CR15","doi-asserted-by":"publisher","first-page":"47","DOI":"10.15265\/IY-2015-011","volume":"24","author":"MT Baysari","year":"2015","unstructured":"Baysari, M. T. & Westbrook, J. I. Mobile applications for patient-centered care coordination: a review of human factors methods applied to their design, development, and evaluation. Yearb. Med. Inf. 24, 47\u201354 (2015).","journal-title":"Yearb. Med. Inf."},{"key":"1385_CR16","doi-asserted-by":"publisher","first-page":"e12","DOI":"10.2196\/humanfactors.4361","volume":"2","author":"SK Orlowski","year":"2015","unstructured":"Orlowski, S. K. et al. Participatory research as one piece of the puzzle: a systematic review of consumer involvement in design of technology-based youth mental health and well-being interventions. JMIR Hum. Factors 2, e12 (2015).","journal-title":"JMIR Hum. Factors"},{"key":"1385_CR17","doi-asserted-by":"crossref","unstructured":"The University of Newcastle et al. Co-design in mHealth systems development: insights from a systematic literature review. THCI 13, 175\u2013205 (2021).","DOI":"10.17705\/1thci.00147"},{"key":"1385_CR18","first-page":"373","volume":"37","author":"L Woods","year":"2019","unstructured":"Woods, L., Duff, J., Cummings, E. & Walker, K. Evaluating the development processes of consumer mHealth interventions for chronic condition self-management: a scoping review. Comput. Inform. Nurs. 37, 373\u2013385 (2019).","journal-title":"Comput. Inform. Nurs."},{"key":"1385_CR19","doi-asserted-by":"publisher","first-page":"1232","DOI":"10.1111\/hex.13506","volume":"25","author":"R Baines","year":"2022","unstructured":"Baines, R. et al. Meaningful patient and public involvement in digital health innovation, implementation and evaluation: a systematic review. Health Expect. 25, 1232\u20131245 (2022).","journal-title":"Health Expect."},{"key":"1385_CR20","doi-asserted-by":"publisher","first-page":"928","DOI":"10.1111\/jcpp.13258","volume":"61","author":"R Bevan Jones","year":"2020","unstructured":"Bevan Jones, R. et al. Practitioner review: Co\u2010design of digital mental health technologies with children and young people. J. Child Psychol. Psychiatr. 61, 928\u2013940 (2020).","journal-title":"J. Child Psychol. Psychiatr."},{"key":"1385_CR21","doi-asserted-by":"publisher","first-page":"e15106","DOI":"10.2196\/15106","volume":"2","author":"M Bird","year":"2019","unstructured":"Bird, M. et al. Use of synchronous digital health technologies for the care of children with special health care needs and their families: scoping review. JMIR Pediatr. Parent 2, e15106 (2019).","journal-title":"JMIR Pediatr. Parent"},{"key":"1385_CR22","doi-asserted-by":"publisher","first-page":"879","DOI":"10.1016\/j.jpedsurg.2023.01.030","volume":"58","author":"M Cwintal","year":"2023","unstructured":"Cwintal, M. et al. A rapid review for developing a co-design framework for a pediatric surgical communication application. J. Pediatr. Surg. 58, 879\u2013890 (2023).","journal-title":"J. Pediatr. Surg."},{"key":"1385_CR23","doi-asserted-by":"crossref","unstructured":"Cole, A., Adapa, K., Richardson, D. R. & Mazur, L. M. Co-design approaches involving older adults in the development of electronic healthcare tools: a systematic review. in Studies in Health Technology and Informatics (eds Otero, P., Scott, P., Martin, S. Z. & Huesing, E.) (IOS Press, 2022).","DOI":"10.3233\/SHTI220293"},{"key":"1385_CR24","doi-asserted-by":"publisher","first-page":"1012","DOI":"10.1089\/tmj.2018.0236","volume":"25","author":"KM Mitchell","year":"2019","unstructured":"Mitchell, K. M., Holtz, B. E. & McCarroll, A. Patient-centered methods for designing and developing health information communication technologies: a systematic review. Telemed. J. E Health 25, 1012\u20131021 (2019).","journal-title":"Telemed. J. E Health"},{"key":"1385_CR25","doi-asserted-by":"publisher","first-page":"e31858","DOI":"10.2196\/31858","volume":"24","author":"H Kip","year":"2022","unstructured":"Kip, H. et al. Methods for human-centered eHealth development: narrative scoping review. J. Med. Internet Res. 24, e31858 (2022).","journal-title":"J. Med. Internet Res."},{"key":"1385_CR26","doi-asserted-by":"publisher","first-page":"e13780","DOI":"10.2196\/13780","volume":"22","author":"P Vandekerckhove","year":"2020","unstructured":"Vandekerckhove, P., De Mul, M., Bramer, W. M. & De Bont, A. A. Generative participatory design methodology to develop electronic health interventions: systematic literature review. J. Med. Internet Res. 22, e13780 (2020).","journal-title":"J. Med. Internet Res."},{"key":"1385_CR27","doi-asserted-by":"publisher","first-page":"937","DOI":"10.1017\/S1041610219001704","volume":"32","author":"L \u00d8ksnebjerg","year":"2020","unstructured":"\u00d8ksnebjerg, L., Janbek, J., Woods, B. & Waldemar, G. Assistive technology designed to support self-management of people with dementia: user involvement, dissemination, and adoption. A scoping review. Int. Psychogeriatr. 32, 937\u2013953 (2020).","journal-title":"Int. Psychogeriatr."},{"key":"1385_CR28","doi-asserted-by":"publisher","first-page":"e37785","DOI":"10.2196\/37785","volume":"10","author":"EK Wegener","year":"2023","unstructured":"Wegener, E. K., Bergsch\u00f6ld, J. M., Whitmore, C., Winters, M. & Kayser, L. Involving older people with frailty or impairment in the design process of digital health technologies to enable aging in place: scoping review. JMIR Hum. Factors 10, e37785 (2023).","journal-title":"JMIR Hum. Factors"},{"key":"1385_CR29","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-021-12393-1","volume":"22","author":"SH Henni","year":"2022","unstructured":"Henni, S. H., Maurud, S., Fuglerud, K. S. & Moen, A. The experiences, needs and barriers of people with impairments related to usability and accessibility of digital health solutions, levels of involvement in the design process and strategies for participatory and universal design: a scoping review. BMC Public Health 22, 35 (2022).","journal-title":"BMC Public Health"},{"key":"1385_CR30","doi-asserted-by":"publisher","first-page":"e29512","DOI":"10.2196\/29512","volume":"10","author":"Z Nimmanterdwong","year":"2022","unstructured":"Nimmanterdwong, Z., Boonviriya, S. & Tangkijvanich, P. Human-centered design of mobile health apps for older adults: systematic review and narrative synthesis. JMIR Mhealth Uhealth 10, e29512 (2022).","journal-title":"JMIR Mhealth Uhealth"},{"key":"1385_CR31","doi-asserted-by":"publisher","unstructured":"Nusir, M. & Rekik, M. Systematic review of co-design in digital health for COVID-19 research. Univ. Access Inf. Soc. https:\/\/doi.org\/10.1007\/s10209-022-00964-x (2022).","DOI":"10.1007\/s10209-022-00964-x"},{"key":"1385_CR32","doi-asserted-by":"publisher","first-page":"16","DOI":"10.5334\/ijic.5573","volume":"21","author":"MF Sanz","year":"2021","unstructured":"Sanz, M. F., Acha, B. V. & Garc\u00eda, M. F. Co-design for people-centred care digital solutions: a literature review. Int. J. Integr. Care 21, 16 (2021).","journal-title":"Int. J. Integr. Care"},{"key":"1385_CR33","doi-asserted-by":"publisher","first-page":"e395","DOI":"10.1093\/geront\/gnaa064","volume":"61","author":"J Sumner","year":"2021","unstructured":"Sumner, J., Chong, L. S., Bundele, A. & Wei Lim, Y. Co-designing technology for aging in place: a systematic review. Gerontologist 61, e395\u2013e409 (2021).","journal-title":"Gerontologist"},{"key":"1385_CR34","doi-asserted-by":"publisher","first-page":"e94","DOI":"10.2196\/jmir.4444","volume":"18","author":"A DeSmet","year":"2016","unstructured":"DeSmet, A. et al. Is participatory design associated with the effectiveness of serious digital games for healthy lifestyle promotion? A meta-analysis. J. Med. Internet Res. 18, e94 (2016).","journal-title":"J. Med. Internet Res."},{"key":"1385_CR35","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1007\/s13668-016-0165-7","volume":"5","author":"H Eyles","year":"2016","unstructured":"Eyles, H. et al. Co-design of mHealth delivered interventions: a systematic review to assess key methods and processes. Curr. Nutr. Rep. 5, 160\u2013167 (2016).","journal-title":"Curr. Nutr. Rep."},{"key":"1385_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.35844\/001c.13244","volume":"1","author":"LM Vaughn","year":"2020","unstructured":"Vaughn, L. M. & Jacquez, F. Participatory research methods\u2014choice points in the research process. J. Particip. Res. Methods 1, 1\u20139 (2020).","journal-title":"J. Particip. Res. Methods"},{"key":"1385_CR37","doi-asserted-by":"publisher","first-page":"205520761774001","DOI":"10.1177\/2055207617740018","volume":"3","author":"D Lupton","year":"2017","unstructured":"Lupton, D. Digital health now and in the future: findings from a participatory design stakeholder workshop. Digital Health 3, 205520761774001 (2017).","journal-title":"Digital Health"},{"key":"1385_CR38","doi-asserted-by":"publisher","first-page":"101230","DOI":"10.1016\/j.destud.2023.101230","volume":"89","author":"M Sadek","year":"2023","unstructured":"Sadek, M., Calvo, R. A. & Mougenot, C. Co-designing conversational agents: a comprehensive review and recommendations for best practices. Des. Stud. 89, 101230 (2023).","journal-title":"Des. Stud."},{"key":"1385_CR39","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1186\/s12961-020-0528-9","volume":"18","author":"P Slattery","year":"2020","unstructured":"Slattery, P., Saeri, A. K. & Bragge, P. Research co-design in health: a rapid overview of reviews. Health Res. Policy Syst. 18, 17 (2020).","journal-title":"Health Res. Policy Syst."},{"key":"1385_CR40","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1515\/edu-2022-0017","volume":"4","author":"F Iniesto","year":"2022","unstructured":"Iniesto, F., Charitonos, K. & Littlejohn, A. A review of research with co-design methods in health education. Open Educ. Stud. 4, 273\u2013295 (2022).","journal-title":"Open Educ. Stud."},{"key":"1385_CR41","doi-asserted-by":"publisher","first-page":"947","DOI":"10.1093\/geront\/gnab167","volume":"62","author":"CH Chu","year":"2022","unstructured":"Chu, C. H. et al. Digital ageism: challenges and opportunities in artificial intelligence for older adults. Gerontologist 62, 947\u2013955 (2022).","journal-title":"Gerontologist"},{"key":"1385_CR42","doi-asserted-by":"publisher","first-page":"e0000213","DOI":"10.1371\/journal.pdig.0000213","volume":"2","author":"P Voorheis","year":"2023","unstructured":"Voorheis, P., Petch, J., Pham, Q. & Kuluski, K. Maximizing the value of patient and public involvement in the digital health co-design process: a qualitative descriptive study with design leaders and patient-public partners. PLoS Digit. Health 2, e0000213 (2023).","journal-title":"PLoS Digit. Health"},{"key":"1385_CR43","doi-asserted-by":"publisher","DOI":"10.1186\/s41256-023-00290-6","volume":"8","author":"DR Singh","year":"2023","unstructured":"Singh, D. R., Sah, R. K., Simkhada, B. & Darwin, Z. Potentials and challenges of using co-design in health services research in low- and middle-income countries. Glob. Health Res. Policy 8, 5 (2023).","journal-title":"Glob. Health Res. Policy"},{"key":"1385_CR44","first-page":"S4539","volume":"20","author":"L S\u00e1nchez De La Gu\u00eda","year":"2017","unstructured":"S\u00e1nchez De La Gu\u00eda, L., Puyuelo Cazorla, M. & de-Miguel-Molina, B. Terms and meanings of \u201cparticipation\u201d in product design: from \u201cuser involvement\u201d to \u201cco-design. Des. J. 20, S4539\u2013S4551 (2017).","journal-title":"Des. J."},{"key":"1385_CR45","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/15710880701875068","volume":"4","author":"EB-N Sanders","year":"2008","unstructured":"Sanders, E. B.-N. & Stappers, P. J. Co-creation and the new landscapes of design. CoDesign 4, 5\u201318 (2008).","journal-title":"CoDesign"},{"key":"1385_CR46","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1145\/2670616","volume":"21","author":"L Sanders","year":"2014","unstructured":"Sanders, L. & Stappers, P. J. From designing to co-designing to collective dreaming: three slices in time. Interactions 21, 24\u201333 (2014).","journal-title":"Interactions"},{"key":"1385_CR47","doi-asserted-by":"publisher","first-page":"e436","DOI":"10.1016\/S2666-7568(21)00115-X","volume":"2","author":"T Diaz","year":"2021","unstructured":"Diaz, T. et al. A call for standardised age-disaggregated health data. Lancet Healthy Longev. 2, e436\u2013e443 (2021).","journal-title":"Lancet Healthy Longev."},{"key":"1385_CR48","doi-asserted-by":"crossref","unstructured":"Flanagin, A., Frey, T., Christiansen, S. L. & AMA Manual of Style Committee. Updated guidance on the reporting of race and ethnicity in medical and science journals. JAMA 326, 621\u2013627 (2021).","DOI":"10.1001\/jama.2021.13304"},{"key":"1385_CR49","doi-asserted-by":"publisher","first-page":"E236","DOI":"10.1503\/cmaj.230144","volume":"195","author":"MB Stanbrook","year":"2023","unstructured":"Stanbrook, M. B. & Salami, B. CMAJ \u2019s new guidance on the reporting of race and ethnicity in research articles. CMAJ 195, E236\u2013E238 (2023).","journal-title":"CMAJ"},{"key":"1385_CR50","doi-asserted-by":"publisher","first-page":"240, s12939-021","DOI":"10.1186\/s12939-021-01579-z","volume":"20","author":"A Chauhan","year":"2021","unstructured":"Chauhan, A., Leefe, J., Sh\u00e9, \u00c9. N. & Harrison, R. Optimising co-design with ethnic minority consumers. Int. J. Equity Health 20, 240, s12939-021-01579-z (2021).","journal-title":"Int. J. Equity Health"},{"key":"1385_CR51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/hsc.13105","volume":"29","author":"J O\u2019Brien","year":"2021","unstructured":"O\u2019Brien, J., Fossey, E. & Palmer, V. J. A scoping review of the use of co\u2010design methods with culturally and linguistically diverse communities to improve or adapt mental health services. Health Soc. Care Community 29, 1\u201317 (2021).","journal-title":"Health Soc. Care Community"},{"key":"1385_CR52","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1002\/hpja.387","volume":"32","author":"E Kemp","year":"2021","unstructured":"Kemp, E. et al. Health literacy, digital health literacy and the implementation of digital health technologies in cancer care: the need for a strategic approach. Health Prom. J. Aust. 32, 104\u2013114 (2021).","journal-title":"Health Prom. J. Aust."},{"key":"1385_CR53","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1111\/hex.12865","volume":"22","author":"\u00c9 N\u00ed Sh\u00e9","year":"2019","unstructured":"N\u00ed Sh\u00e9, \u00c9. et al. Clarifying the mechanisms and resources that enable the reciprocal involvement of seldom heard groups in health and social care research: a collaborative rapid realist review process. Health Expect. 22, 298\u2013306 (2019).","journal-title":"Health Expect."},{"key":"1385_CR54","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1111\/hex.12888","volume":"22","author":"T Greenhalgh","year":"2019","unstructured":"Greenhalgh, T. et al. Frameworks for supporting patient and public involvement in research: systematic review and co\u2010design pilot. Health Expect. 22, 785\u2013801 (2019).","journal-title":"Health Expect."},{"key":"1385_CR55","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1038\/s43586-023-00214-1","volume":"3","author":"F Cornish","year":"2023","unstructured":"Cornish, F. et al. Participatory action research. Nat. Rev. Methods Prim. 3, 34 (2023).","journal-title":"Nat. Rev. Methods Prim."},{"key":"1385_CR56","doi-asserted-by":"publisher","first-page":"1075","DOI":"10.1111\/hex.12804","volume":"21","author":"A Boivin","year":"2018","unstructured":"Boivin, A. et al. Patient and public engagement in research and health system decision making: a systematic review of evaluation tools. Health Expect. 21, 1075\u20131084 (2018).","journal-title":"Health Expect."},{"key":"1385_CR57","doi-asserted-by":"publisher","first-page":"1255","DOI":"10.1111\/hex.13742","volume":"26","author":"J Abelson","year":"2023","unstructured":"Abelson, J. et al. Development of the engage with impact toolkit: a comprehensive resource to support the evaluation of patient, family and caregiver engagement in health systems. Health Expect. 26, 1255\u20131265 (2023).","journal-title":"Health Expect."},{"key":"1385_CR58","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1111\/hex.13040","volume":"23","author":"M Bird","year":"2020","unstructured":"Bird, M. et al. Preparing for patient partnership: a scoping review of patient partner engagement and evaluation in research. Health Expect. 23, 523\u2013539 (2020).","journal-title":"Health Expect."},{"key":"1385_CR59","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1017\/S0266462311000481","volume":"27","author":"S Staniszewska","year":"2011","unstructured":"Staniszewska, S., Brett, J., Mockford, C. & Barber, R. The GRIPP checklist: strengthening the quality of patient and public involvement reporting in research. Int. J. Technol. Assess. Health care 27, 391\u2013399 (2011).","journal-title":"Int. J. Technol. Assess. Health care"},{"key":"1385_CR60","first-page":"1","volume":"358","author":"S Staniszewska","year":"2017","unstructured":"Staniszewska, S. et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. BMJ 358, 1\u20136 (2017).","journal-title":"BMJ"},{"key":"1385_CR61","doi-asserted-by":"publisher","first-page":"e50463","DOI":"10.2196\/50463","volume":"12","author":"SE Munce","year":"2023","unstructured":"Munce, S. E. et al. Development of the preferred components for co-design in research guideline and checklist: protocol for a scoping review and a modified Delphi process. JMIR Res. Protoc. 12, e50463 (2023).","journal-title":"JMIR Res. Protoc."},{"key":"1385_CR62","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1038\/s41746-024-01105-9","volume":"7","author":"C Landers","year":"2024","unstructured":"Landers, C., Blasimme, A. & Vayena, E. Sync fast and solve things\u2014best practices for responsible digital health. npj Digital Med. 7, 113 (2024).","journal-title":"npj Digital Med."},{"key":"1385_CR63","first-page":"1","volume":"374","author":"K Skivington","year":"2021","unstructured":"Skivington, K. et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ 374, 1\u20139 (2021).","journal-title":"BMJ"},{"key":"1385_CR64","doi-asserted-by":"publisher","first-page":"251, s41746-024","DOI":"10.1038\/s41746-024-01256-9","volume":"7","author":"GC Nickel","year":"2024","unstructured":"Nickel, G. C., Wang, S., Kwong, J. C. C. & Kvedar, J. C. The case for inclusive co-creation in digital health innovation. npj Digital Med. 7, 251, s41746-024-01256-9 (2024).","journal-title":"npj Digital Med."},{"key":"1385_CR65","doi-asserted-by":"publisher","first-page":"3","DOI":"10.12997\/jla.2023.12.1.3","volume":"12","author":"GJ Choi","year":"2023","unstructured":"Choi, G. J. & Kang, H. Introduction to umbrella reviews as a useful evidence-based practice. J. Lipid Atheroscler. 12, 3 (2023).","journal-title":"J. Lipid Atheroscler."},{"key":"1385_CR66","first-page":"1","volume":"378","author":"M Gates","year":"2022","unstructured":"Gates, M. et al. Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement. BMJ 378, 1\u201311 (2022).","journal-title":"BMJ"},{"key":"1385_CR67","doi-asserted-by":"publisher","DOI":"10.1177\/2055207619898984","volume":"6","author":"T Jandoo","year":"2020","unstructured":"Jandoo, T. WHO guidance for digital health: what it means for researchers. Digital Health 6, 2055207619898984 (2020).","journal-title":"Digital Health"},{"key":"1385_CR68","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1002\/acr2.11114","volume":"2","author":"HR Holman","year":"2020","unstructured":"Holman, H. R. The relation of the chronic disease epidemic to the health care crisis. ACR Open Rheumatol. 2, 167\u2013173 (2020).","journal-title":"ACR Open Rheumatol."},{"key":"1385_CR69","doi-asserted-by":"publisher","first-page":"1441","DOI":"10.1007\/s00431-008-0697-y","volume":"167","author":"The Dutch National Consensus Committee \u201cChronic Diseases and Health Conditions in Childhood\u201d","year":"2008","unstructured":"The Dutch National Consensus Committee \u201cChronic Diseases and Health Conditions in Childhood\u201d et al. Defining chronic diseases and health conditions in childhood (0\u201318 years of age): national consensus in the Netherlands. Eur. J. Pediatr. 167, 1441\u20131447 (2008).","journal-title":"Eur. J. Pediatr."},{"key":"1385_CR70","doi-asserted-by":"publisher","unstructured":"Shea, B. J. et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ j4008 https:\/\/doi.org\/10.1136\/bmj.j4008 (2017).","DOI":"10.1136\/bmj.j4008"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01385-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01385-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01385-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T04:02:43Z","timestamp":1751342563000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01385-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,23]]},"references-count":70,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["1385"],"URL":"https:\/\/doi.org\/10.1038\/s41746-024-01385-1","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-4731209\/v1","asserted-by":"object"}]},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,23]]},"assertion":[{"value":"12 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 July 2025","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This article has been updated to amend the license information.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"P.W. is a director and shareholder of CareLoop Health Ltd, a digital mental health company; CareLoop Health Ltd had no role in this project. L.J., C.H.C., C.S.P., A.K. and T.C.C.H. have no financial or non-financial competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"374"}}