{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T22:17:26Z","timestamp":1776896246307,"version":"3.51.2"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T00:00:00Z","timestamp":1747180800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T00:00:00Z","timestamp":1747180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006259","name":"Bern University of Applied Sciences","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006259","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Healthc Inform Res"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Participatory design (PD) is an essential method in the development of digital health solutions since it promises to increase acceptance, usability, and trust in the developed solution. Although careful planning and preparation is crucial for the success of PD workshops, a framework of key components to consider is still missing. The objective of this work is to develop such framework enriched with examples for aspects to be considered when planning and conducting PD workshops for designing and developing digital interventions in healthcare. We applied the nominal group technique with four participants with backgrounds in computer science, health informatics, psychology, and social anthropology to identify key components of PD workshops. The resulting framework was applied by an expert in PD to a case of a digital health solution for fatigue self-management for multiple sclerosis. The feasibility and applicability of the framework and its shortcomings were assessed. As a result, a framework consisting of five main categories and a total of 36 factors were assigned and defined in relation to the categories. The categories are participatory process, involved persons and their roles, workshop definition, setting, privacy and ethics, including regulations. The application of the framework to the test case demonstrated the feasibility and applicability of the suggested framework as well as the shortcomings of the analyzed PD process. This framework provides practical guidance while highlighting the complexity of PD workshops, encouraging their broad adoption, critical reflection, and continuous refinement. It has potential to improve the conduct of PD workshops and, in this way, potential to improve usability, acceptance, and usefulness of digital health solutions. In future work, the user perspective could be used to extend the framework.<\/jats:p>","DOI":"10.1007\/s41666-025-00199-4","type":"journal-article","created":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T10:13:55Z","timestamp":1747217635000},"page":"359-379","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Key Components of Participatory Design Workshops for Digital Health Solutions: Nominal Group Technique and Feasibility Study"],"prefix":"10.1007","volume":"9","author":[{"given":"Kerstin","family":"Denecke","sequence":"first","affiliation":[]},{"given":"Octavio","family":"Rivera-Romero","sequence":"additional","affiliation":[]},{"given":"Guido","family":"Giunti","sequence":"additional","affiliation":[]},{"given":"Karin","family":"Van Holten","sequence":"additional","affiliation":[]},{"given":"Elia","family":"Gabarron","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,5,14]]},"reference":[{"key":"199_CR1","doi-asserted-by":"publisher","DOI":"10.2196\/26994","volume":"23","author":"DH Sorkin","year":"2021","unstructured":"Sorkin DH et al (2021) Rise in use of digital mental health tools and technologies in the United States during the COVID-19 pandemic: survey Study. J Med Internet Res 23:e26994","journal-title":"J Med Internet Res"},{"key":"199_CR2","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1055\/s-0043-1768730","volume":"32","author":"E Gabarron","year":"2023","unstructured":"Gabarron E, Reichenpfader D, Denecke K (2023) Exploring the evolution of social media in mental health interventions: a mapping review. Yearb Med Inform 32:152\u2013157","journal-title":"Yearb Med Inform"},{"key":"199_CR3","volume":"6","author":"JA Naslund","year":"2021","unstructured":"Naslund JA, Aschbrenner KA (2021) Technology use and interest in digital apps for mental health promotion and lifestyle intervention among young adults with serious mental illness. J Affect Disord Rep 6:100227","journal-title":"J Affect Disord Rep"},{"key":"199_CR4","doi-asserted-by":"publisher","DOI":"10.2196\/25847","volume":"8","author":"S Lehtimaki","year":"2021","unstructured":"Lehtimaki S, Martic J, Wahl B, Foster KT, Schwalbe N (2021) Evidence on digital mental health interventions for adolescents and young people: systematic overview. JMIR Ment Health 8:e25847","journal-title":"JMIR Ment Health"},{"key":"199_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3310\/RCTI6942","volume":"26","author":"L Gega","year":"2022","unstructured":"Gega L et al (2022) Digital interventions in mental health: evidence syntheses and economic modelling. Health Technol Assess 26:1\u2013182","journal-title":"Health Technol Assess"},{"key":"199_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.healthpol.2024.105122","volume":"146","author":"J Badr","year":"2024","unstructured":"Badr J, Motulsky A, Denis J-L (2024) Digital health technologies and inequalities: a scoping review of potential impacts and policy recommendations. Health Policy 146:105122","journal-title":"Health Policy"},{"key":"199_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3152421","volume":"25","author":"S B\u00f8dker","year":"2018","unstructured":"B\u00f8dker S, Kyng M (2018) Participatory design that matters\u2014facing the big issues. ACM Trans Comput Hum Interact 25:1\u201331","journal-title":"ACM Trans Comput Hum Interact"},{"key":"199_CR8","unstructured":"Hagen P et al (2012) Participatory design of evidence-based online youth mental health promotion, intervention and treatment. (Young and Well Cooperative Research Centre, Abbotsford, Vic.)"},{"key":"199_CR9","first-page":"641","volume":"302","author":"K Denecke","year":"2023","unstructured":"Denecke K et al (2023) How to design successful participatory design workshops for digital health solutions? Stud Health Technol Inform 302:641\u2013645","journal-title":"Stud Health Technol Inform"},{"key":"199_CR10","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1057\/s41285-024-00208-3","volume":"22","author":"V Dumez","year":"2024","unstructured":"Dumez V, L\u2019Esp\u00e9rance A (2024) Beyond experiential knowledge: a classification of patient knowledge. Soc Theory Health 22:173\u2013186","journal-title":"Soc Theory Health"},{"key":"199_CR11","doi-asserted-by":"publisher","unstructured":"Hansen NB et al (2020) How participatory design works: mechanisms and effects. In: Proceedings of the 31st Australian Conference on Human-Computer-Interaction 30\u201341 (Association for Computing Machinery, New York). https:\/\/doi.org\/10.1145\/3369457.3369460","DOI":"10.1145\/3369457.3369460"},{"key":"199_CR12","doi-asserted-by":"publisher","first-page":"928","DOI":"10.1111\/jcpp.13258","volume":"61","author":"R Bevan Jones","year":"2020","unstructured":"Bevan Jones R et al (2020) Practitioner review: co-design of digital mental health technologies with children and young people. Child Psychol Psychiatry 61:928\u2013940","journal-title":"Child Psychol Psychiatry"},{"key":"199_CR13","doi-asserted-by":"publisher","DOI":"10.2196\/45234","volume":"7","author":"DZQ Gan","year":"2023","unstructured":"Gan DZQ, McGillivray L, Larsen ME, Bloomfield T, Torok M (2023) Promoting engagement with smartphone apps for suicidal ideation in young people: development of an adjunctive strategy using a lived experience participatory design approach. JMIR Form Res 7:e45234","journal-title":"JMIR Form Res"},{"key":"199_CR14","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/1524839919850557","volume":"21","author":"E Chen","year":"2020","unstructured":"Chen E, Leos C, Kowitt SD, Moracco KE (2020) Enhancing community-based participatory research through human-centered design strategies. Health Promot Pract 21:37\u201348","journal-title":"Health Promot Pract"},{"key":"199_CR15","doi-asserted-by":"publisher","first-page":"1461422","DOI":"10.3389\/fpubh.2024.1461422","volume":"12","author":"F Doerwald","year":"2024","unstructured":"Doerwald F et al (2024) A rapid review of digital approaches for the participatory development of health-related interventions. Front Public Health 12:1461422","journal-title":"Front Public Health"},{"key":"199_CR16","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1186\/s13643-023-02262-w","volume":"12","author":"J Povey","year":"2023","unstructured":"Povey J et al (2023) An emerging framework for digital mental health design with Indigenous young people: a scoping review of the involvement of Indigenous young people in the design and evaluation of digital mental health interventions. Syst Rev 12:108","journal-title":"Syst Rev"},{"key":"199_CR17","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1093\/jpepsy\/jsy084","volume":"44","author":"DA Fedele","year":"2019","unstructured":"Fedele DA, McConville A, Moon J, Thomas JG (2019) Topical review: design considerations when creating pediatric mobile health interventions: applying the IDEAS framework. J Pediatr Psychol 44:343\u2013348","journal-title":"J Pediatr Psychol"},{"key":"199_CR18","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0237910","volume":"15","author":"J Farao","year":"2020","unstructured":"Farao J et al (2020) A user-centred design framework for mHealth. PLoS ONE 15:e0237910","journal-title":"PLoS ONE"},{"key":"199_CR19","first-page":"253","volume":"61","author":"T Kowatsch","year":"2019","unstructured":"Kowatsch T, Otto L, Harperink S, Cotti A, Schlieter H (2019) A design and evaluation framework for digital health interventions. IT-Inf Technol 61:253\u2013263","journal-title":"IT-Inf Technol"},{"key":"199_CR20","doi-asserted-by":"publisher","DOI":"10.1016\/j.invent.2022.100589","volume":"30","author":"A P\u00e9rez-Aronsson","year":"2022","unstructured":"P\u00e9rez-Aronsson A et al (2022) Adaptation of the trauma group intervention \u2018Teaching recovery techniques\u2019 for online delivery: a participatory design and usability study. Internet Interv 30:100589","journal-title":"Internet Interv"},{"key":"199_CR21","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1080\/17538157.2021.1878185","volume":"46","author":"T Schmidt","year":"2021","unstructured":"Schmidt T et al (2021) Development of an internet-delivered program and platform for the treatment of depression and anxiety in patients with ischemic heart disease in eMindYourHeart. Inform Health Soc Care 46:178\u2013191","journal-title":"Inform Health Soc Care"},{"key":"199_CR22","doi-asserted-by":"publisher","DOI":"10.2196\/34477","volume":"6","author":"O Ben-Yehuda","year":"2022","unstructured":"Ben-Yehuda O, Dreazen E, Koren D, Peleg M (2022) Participatory design of a mobile app to safeguard mental resilience in the context of drug use in young adults: multi-method study. JMIR Form Res 6:e34477","journal-title":"JMIR Form Res"},{"key":"199_CR23","doi-asserted-by":"publisher","DOI":"10.1111\/hex.14164","volume":"27","author":"S McKay","year":"2024","unstructured":"McKay S et al (2024) Participatory design in suicide prevention: a qualitative study of international students\u2019 experiences of adapting the livingworks safeTALK programme. Health Expect 27:e14164","journal-title":"Health Expect"},{"key":"199_CR24","doi-asserted-by":"publisher","DOI":"10.2196\/19532","volume":"23","author":"AC Milton","year":"2021","unstructured":"Milton AC et al (2021) Technology-enabled reform in a nontraditional mental health service for eating disorders: participatory design study. J Med Internet Res 23:e19532","journal-title":"J Med Internet Res"},{"key":"199_CR25","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5927","volume":"18","author":"SA Mummah","year":"2016","unstructured":"Mummah SA, Robinson TN, King AC, Gardner CD, Sutton S (2016) IDEAS (integrate, design, assess, and share): a framework and toolkit of strategies for the development of more effective digital interventions to change health behavior. J Med Internet Res 18:e317","journal-title":"J Med Internet Res"},{"key":"199_CR26","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1007\/s10742-014-0121-1","volume":"14","author":"SS McMillan","year":"2014","unstructured":"McMillan SS et al (2014) Using the nominal group technique: how to analyse across multiple groups. Health Serv Outcomes Res Method 14:92\u2013108","journal-title":"Health Serv Outcomes Res Method"},{"key":"199_CR27","first-page":"655","volume":"38","author":"SS McMillan","year":"2016","unstructured":"McMillan SS, King M, Tully MP (2016) How to use the nominal group and Delphi techniques. Int J Clin Pharm 38:655\u2013662","journal-title":"Int J Clin Pharm"},{"key":"199_CR28","unstructured":"Miro. https:\/\/miro.com\/de\/login\/.\u00a0Accessed 14 October 2024"},{"key":"199_CR29","unstructured":"Giunti G. More stamina - an evidence-based fatigue management solution for persons with multiple sclerosis. More Stamina. https:\/\/www.morestaminaapp.com\/.\u00a0Accessed 27 Oct 2024"},{"key":"199_CR30","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.9437","volume":"6","author":"G Giunti","year":"2018","unstructured":"Giunti G, Mylonopoulou V, Rivera Romero O (2018) More stamina, a gamified mHealth solution for persons with multiple sclerosis: research through design. JMIR Mhealth Uhealth 6:e51","journal-title":"JMIR Mhealth Uhealth"},{"key":"199_CR31","doi-asserted-by":"publisher","DOI":"10.2196\/18196","volume":"9","author":"G Giunti","year":"2020","unstructured":"Giunti G et al (2020) Evaluation of more stamina, a mobile app for fatigue management in persons with multiple sclerosis: Protocol for a Feasibility, Acceptability, and Usability Study. JMIR Res Protoc 9:e18196","journal-title":"JMIR Res Protoc"},{"key":"199_CR32","first-page":"605","volume":"225","author":"G Giunti","year":"2016","unstructured":"Giunti G (2016) Gamified design for health workshop. Stud Health Technol Inform 225:605\u2013606","journal-title":"Stud Health Technol Inform"},{"key":"199_CR33","first-page":"310","volume":"316","author":"T Yrttiaho","year":"2024","unstructured":"Yrttiaho T, Giunti G, Isomursu M (2024) Challenges implementing patient and public involvement in a digital health agile project which includes research, business and software development. Stud Health Technol Inform 316:310\u2013314","journal-title":"Stud Health Technol Inform"},{"key":"199_CR34","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.8996","volume":"6","author":"G Giunti","year":"2018","unstructured":"Giunti G, Kool J, Rivera Romero O, Dorronzoro Zubiete E (2018) Exploring the specific needs of persons with multiple sclerosis for mhealth solutions for physical activity: mixed-methods study. JMIR Mhealth Uhealth 6:e37","journal-title":"JMIR Mhealth Uhealth"},{"key":"199_CR35","doi-asserted-by":"publisher","unstructured":"Giunti G, Guisado-Fernandez E, Caulfield B (2017) Connected health in multiple sclerosis: a mobile applications review. In: 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS). IEEE, Thessaloniki, pp 660\u2013665. https:\/\/doi.org\/10.1109\/CBMS.2017.27.","DOI":"10.1109\/CBMS.2017.27"},{"key":"199_CR36","doi-asserted-by":"publisher","DOI":"10.2196\/10512","volume":"6","author":"G Giunti","year":"2018","unstructured":"Giunti G, Guisado Fern\u00e1ndez E, Dorronzoro Zubiete E, Rivera Romero O (2018) Supply and demand in mhealth apps for persons with multiple sclerosis: systematic search in app stores and scoping literature review. JMIR Mhealth Uhealth 6:e10512","journal-title":"JMIR Mhealth Uhealth"},{"key":"199_CR37","doi-asserted-by":"publisher","unstructured":"Giunti G, Haverinen J, Reponen J (2022) Informing the product development of an mHealth solution for people with multiple sclerosis through early health technology assessment. In:\u00a0Otero P, Scott P, Martin SZ, Huesing E (eds) Studies in Health Technology and Informatics. IOS Press. https:\/\/doi.org\/10.3233\/SHTI220258","DOI":"10.3233\/SHTI220258"},{"key":"199_CR38","doi-asserted-by":"publisher","unstructured":"Guardado S, Isomursu M, Giunti G (2022) Health care professionals\u2019 perspectives on the uses of patient-generated health data. In: S\u00e9roussi B et al. (eds) Studies in Health Technology and Informatics. IOS Press. https:\/\/doi.org\/10.3233\/SHTI220577","DOI":"10.3233\/SHTI220577"},{"key":"199_CR39","doi-asserted-by":"publisher","DOI":"10.1016\/j.msard.2025.106379","volume":"97","author":"G Giunti","year":"2025","unstructured":"Giunti G et al (2025) Feasibility and usability evaluation of a gamified fatigue management mobile application for persons with multiple sclerosis in everyday life. Multiple Sclerosis and Related Disorders 97:106379","journal-title":"Mult Scler Relat Disord"},{"key":"199_CR40","doi-asserted-by":"publisher","first-page":"1232","DOI":"10.1111\/hex.13506","volume":"25","author":"R Baines","year":"2022","unstructured":"Baines R et al (2022) Meaningful patient and public involvement in digital health innovation, implementation and evaluation: a systematic review. Health Expect 25:1232\u20131245","journal-title":"Health Expect"},{"key":"199_CR41","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/s40900-022-00374-6","volume":"8","author":"E Osmanlliu","year":"2022","unstructured":"Osmanlliu E et al (2022) Fantastic perspectives and where to find them: involving patients and citizens in digital health research. Res Involv Engagem 8:37","journal-title":"Res Involv Engagem"},{"key":"199_CR42","doi-asserted-by":"publisher","first-page":"116307","DOI":"10.1016\/j.socscimed.2023.116307","volume":"337","author":"B Marent","year":"2023","unstructured":"Marent B, Henwood F, Darking M, EmERGE Consortium (2023) Participation through the lens of care: situated accountabilities in the codesign of a digital health platform for HIV care. Soc Sci Med 337:116307","journal-title":"Soc Sci Med"},{"key":"199_CR43","doi-asserted-by":"publisher","DOI":"10.2196\/24669","volume":"8","author":"M Guay","year":"2021","unstructured":"Guay M et al (2021) Adapting a person\u2019s home in 3D using a mobile app (MapIt): participatory design framework investigating the app\u2019s acceptability. JMIR Rehabil Assist Technol 8:e24669","journal-title":"JMIR Rehabil Assist Technol"},{"key":"199_CR44","first-page":"49","volume":"263","author":"A Good","year":"2019","unstructured":"Good A, Omisade O (2019) Linking activity theory with user centred design: a human computer interaction framework for the design and evaluation of mHealth interventions. Stud Health Technol Inform 263:49\u201363","journal-title":"Stud Health Technol Inform"},{"key":"199_CR45","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1258\/jtt.2008.080601","volume":"15","author":"PE Esser","year":"2009","unstructured":"Esser PE, Goossens RHM (2009) A framework for the design of user-centred teleconsulting systems. J Telemed Telecare 15:32\u201339","journal-title":"J Telemed Telecare"},{"key":"199_CR46","first-page":"1186","volume":"2021","author":"N Veggiotti","year":"2021","unstructured":"Veggiotti N, Sacchi L, Peleg M (2021) Enhancing the IDEAS framework with ontology: designing digital interventions for improving cancer patients\u2019 wellbeing. AMIA Annu Symp Proc 2021:1186\u20131195","journal-title":"AMIA Annu Symp Proc"},{"key":"199_CR47","doi-asserted-by":"publisher","unstructured":"Yrttiaho T, Isomursu M, Giunti G (2022) Experiences using patient and public involvement in digital health research for multiple sclerosis. In: S\u00e9roussi B et al. (eds) Studies in Health Technology and Informatics. IOS Press. https:\/\/doi.org\/10.3233\/SHTI220574","DOI":"10.3233\/SHTI220574"},{"key":"199_CR48","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000213","volume":"2","author":"P Voorheis","year":"2023","unstructured":"Voorheis P, Petch J, Pham Q, Kuluski K (2023) Maximizing the value of patient and public involvement in the digital health co-design process: a qualitative descriptive study with design leaders and patient-public partners. PLOS Digit Health 2:e0000213","journal-title":"PLOS Digit Health"},{"key":"199_CR49","doi-asserted-by":"publisher","DOI":"10.2196\/35591","volume":"9","author":"S Vial","year":"2022","unstructured":"Vial S, Boudhra\u00e2 S, Dumont M (2022) Human-centered design approaches in digital mental health interventions: exploratory mapping review. JMIR Ment Health 9:e35591","journal-title":"JMIR Ment Health"}],"container-title":["Journal of Healthcare Informatics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41666-025-00199-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41666-025-00199-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41666-025-00199-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,6]],"date-time":"2025-09-06T15:39:02Z","timestamp":1757173142000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41666-025-00199-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,14]]},"references-count":49,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["199"],"URL":"https:\/\/doi.org\/10.1007\/s41666-025-00199-4","relation":{},"ISSN":["2509-4971","2509-498X"],"issn-type":[{"value":"2509-4971","type":"print"},{"value":"2509-498X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,14]]},"assertion":[{"value":"6 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 May 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 May 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}]}}