{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T21:05:10Z","timestamp":1790802310086,"version":"4.1.0"},"reference-count":54,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Hum Factors"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n \n Individuals with\n BRCA1\/2<\/jats:italic>\n germline variants face complex, preference-sensitive medical decisions under psychological distress. Structural constraints in genetic counseling create support gaps during waiting periods, prompting patients to rely on fragmented or misleading online information. Conversational AI may offer low-threshold, continuous informational support, yet methods for its responsible integration into clinical care remain unclear.\n <\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n \n This study identifies and systematizes stakeholder-informed sociotechnical design requirements and governance conditions for a clinically bounded conversational AI system intended to support comprehension, appraisal, and appropriate use of complex hereditary cancer information in\n BRCA1\/2<\/jats:italic>\n -related care.\n <\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n We conducted an exploratory, qualitative, predevelopment requirements study using 2 structured participatory workshops with interdisciplinary stakeholders (N=18). Guided exercises included stakeholder analysis, the value proposition canvas, and the sustainability awareness framework. Structured workshop outputs, field notes, and artifacts were analyzed using inductive thematic analysis.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Stakeholder workshops revealed that responsible design was shaped less by consensus around standalone responsible AI principles than by three recurrent cross-stakeholder tensions: (1) accessibility and continuity of support versus clinical role boundaries, (2) simplification and emotional reassurance versus medical precision and epistemic transparency, and (3) technical scalability versus governance, data protection, and institutional accountability. These tensions translated into design requirements for constrained system authority, mandatory human oversight, context-sensitive communication, and integration into clinical and regulatory governance structures.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Conversational AI in this context should be explicitly constrained and embedded within clinical governance structures to be perceived as responsible. Responsible implementation requires transparent design, human oversight, integration into existing care pathways, and early alignment with German\/European Union (EU) regulatory requirements concerning data protection, medical device classification, genetic data, and AI transparency.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/97869","type":"journal-article","created":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T20:26:06Z","timestamp":1790799966000},"page":"e97869-e97869","source":"Crossref","is-referenced-by-count":0,"title":["Conversational AI in Hereditary Cancer Care: Sociotechnical Study of Responsible Design Requirements"],"prefix":"10.2196","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0294-000X","authenticated-orcid":false,"given":"Dominic","family":"Lammert","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0380-574X","authenticated-orcid":false,"given":"Jacqueline","family":"Lammert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-5024-5834","authenticated-orcid":false,"given":"Justin","family":"Hofenbitzer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5014-3479","authenticated-orcid":false,"given":"Tristan","family":"Radtke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-1204-6675","authenticated-orcid":false,"given":"Yingping","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7025-942X","authenticated-orcid":false,"given":"Martin","family":"Haimerl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3613-5893","authenticated-orcid":false,"given":"Stefanie","family":"Betz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8767-4230","authenticated-orcid":false,"given":"Doran Holger","family":"Scholl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1677-150X","authenticated-orcid":false,"given":"J\u00fcrgen","family":"Pfeffer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,9,30]]},"reference":[{"issue":"23","key":"R1","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2017.7112","article-title":"Risks of breast, ovarian, and contralateral breast cancer for BRCA1 and BRCA2 mutation carriers","volume":"317","author":"Kuchenbaecker","journal-title":"JAMA"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1093\/jsxmed\/qdad143","article-title":"Quality of life after risk-reducing salpingo-oophorectomy in women with a pathogenic BRCA variant","volume":"21","author":"Zilski","journal-title":"J Sex Med"},{"issue":"2","key":"R3","doi-asserted-by":"publisher","first-page":"E118","DOI":"10.1503\/cjs.001523","article-title":"Knowledge, perceptions, attitudes, and barriers pertaining to genetic literacy among surgeons: a scoping review","volume":"67","author":"Mir","journal-title":"Can J Surg"},{"key":"R4","unstructured":"Genetic testing: results from FORCE\u2019s 2024 survey highlighting the needs of people at high risk for breast cancer. 2024. URL: https:\/\/www.facingourrisk.org\/blog\/results-from-forces-2024-survey-highlighting-the-needs-of-people-at-high-risk-for-breast-cancer [Accessed 08-09-2026]"},{"issue":"15","key":"R5","doi-asserted-by":"publisher","first-page":"1262","DOI":"10.1001\/jama.2024.1280","article-title":"Patients are turning to TikTok for health information\u2014here\u2019s what clinicians need to know","volume":"331","author":"Anderer","journal-title":"JAMA"},{"key":"R6","unstructured":"Schaeffer D Berens EM Gille S Griese L Klinger J de Sombre S et al. Health literacy of the population in germany before and during the corona pandemic: results of the HLS-GER 2. Bielefeld University, Interdisciplinary Centre for Health Literacy Research; 2021. URL: https:\/\/pub.uni-bielefeld.de\/record\/2950305 [Accessed 08-09-2026]"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1177\/20552076251319174","article-title":"Transforming healthcare with chatbots: Uses and applications-a scoping review","volume":"11","author":"Barreda","journal-title":"Digit HEALTH"},{"issue":"1","key":"R8","doi-asserted-by":"publisher","DOI":"10.2196\/56628","article-title":"Transforming health care through chatbots for medical history-taking and future directions: comprehensive systematic review","volume":"12","author":"Hindelang","journal-title":"JMIR Med Inform"},{"key":"R9","doi-asserted-by":"crossref","unstructured":"Simonsen J Robertson T , editors. Routledge International Handbook of Participatory Design. Routledge; 2012. [doi: 10.4324\/9780203108543]","DOI":"10.4324\/9780203108543"},{"key":"R10","unstructured":"Osterwalder A Pigneur Y Bernarda G Smith A Papadakos T . Value Proposition Design: How to Create Products and Services Customers Want. John Wiley & Sons; 2014:1-320. ISBN: 978-1118968055"},{"issue":"1","key":"R11","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/MS.2015.158","article-title":"Requirements: the key to sustainability","volume":"33","author":"Becker","journal-title":"IEEE Softw"},{"issue":"5","key":"R12","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1159\/000505449","article-title":"Quality of life after bilateral and contralateral prophylactic mastectomy with implant reconstruction","volume":"15","author":"Klapdor","journal-title":"Breast Care (Basel)"},{"key":"R13","unstructured":"Kommission ovar. AGO \u2013 die arbeitsgemeinschaft gyn\u00e4kologische onkologie. 2024. URL: https:\/\/www.ago-online.de\/ago-kommissionen\/kommission-ovar [Accessed 08-09-2026]"},{"key":"R14","unstructured":"Kommission mamma. AGO \u2013 Die Arbeitsgemeinschaft Gyn\u00e4kologische Onkologie. 2024. URL: https:\/\/www.ago-online.de\/ago-kommissionen\/kommission-mamma [Accessed 08-09-2026]"},{"issue":"9","key":"R15","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.2217\/fon-2021-1387","article-title":"Real-world multi-country study of mutation testing among adult women with HER2-negative advanced breast cancer","volume":"18","author":"Lux","journal-title":"Future Oncol"},{"issue":"7","key":"R16","doi-asserted-by":"publisher","DOI":"10.3390\/cancers15072038","article-title":"Current treatment practices and prognostic factors in early-stage ovarian cancer-an analysis of the NOGGO\/JAGO","volume":"15","author":"Heublein","journal-title":"Cancers (Basel)"},{"issue":"2","key":"R17","doi-asserted-by":"publisher","first-page":"2429","DOI":"10.3390\/curroncol30020185","article-title":"The psychosocial impact of the decision to undergo risk-reducing salpingo-oophorectomy surgery in BRCA mutation carriers and the role of physician-patient communication","volume":"30","author":"Alves-Nogueira","journal-title":"Curr Oncol"},{"issue":"12","key":"R18","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1177\/07067437221082854","article-title":"TikTok and attention-deficit\/hyperactivity disorder: a cross-sectional study of social media content quality","volume":"67","author":"Yeung","journal-title":"Can J Psychiatry"},{"issue":"3","key":"R19","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1038\/s41562-021-01056-1","article-title":"Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA","volume":"5","author":"Loomba","journal-title":"Nat Hum Behav"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/j.jaad.2020.12.028","article-title":"Overview of TikTok\u2019s most viewed dermatologic content and assessment of its reliability","volume":"85","author":"Villa-Ruiz","journal-title":"J Am Acad Dermatol"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1145\/365153.365168","article-title":"ELIZA\u2014a computer program for the study of natural language communication between man and machine","volume":"9","author":"Weizenbaum","journal-title":"Commun ACM"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(72)90049-5","article-title":"Turing-like indistinguishability tests for the validation of a computer simulation of paranoid processes","volume":"3","author":"Colby","journal-title":"Artif Intell"},{"issue":"6","key":"R23","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1108\/JHOM-12-2023-0376","article-title":"A systematic review of AI-based chatbot usages in healthcare services","volume":"39","author":"Mohamed Jasim","journal-title":"J Health Organ Manag"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.2147\/IJGM.S408208","article-title":"The use of chatbots in oncological care: a narrative review","volume":"16","author":"Wang","journal-title":"Int J Gen Med"},{"issue":"4","key":"R25","doi-asserted-by":"publisher","DOI":"10.2196\/27850","article-title":"Chatbot for health care and oncology applications using artificial intelligence and machine learning: systematic review","volume":"7","author":"Xu","journal-title":"JMIR Cancer"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s00520-024-09096-9","article-title":"Chatbots for breast cancer education: a systematic review and meta-analysis","volume":"33","author":"Lin","journal-title":"Support Care Cancer"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","DOI":"10.1093\/bmb\/ldaf017","article-title":"AI chatbots versus human healthcare professionals: a systematic review and meta-analysis of empathy in patient care","volume":"156","author":"Howcroft","journal-title":"Br Med Bull"},{"issue":"6","key":"R28","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","article-title":"Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum","volume":"183","author":"Ayers","journal-title":"JAMA Intern Med"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.2196\/60205","article-title":"User and provider experiences with health education chatbots: qualitative systematic review","volume":"12","author":"Choi","journal-title":"JMIR Hum Factors"},{"issue":"1","key":"R30","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1007\/s10209-024-01118-x","article-title":"A systematic review of chatbots in inclusive healthcare: insights from the last 5 years","volume":"24","author":"Grassini","journal-title":"Univ Access Inf Soc"},{"issue":"2","key":"R31","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1111\/apt.18058","article-title":"Systematic review: the use of large language models as medical chatbots in digestive diseases","volume":"60","author":"Giuffr\u00e8","journal-title":"Aliment Pharmacol Ther"},{"issue":"4","key":"R32","doi-asserted-by":"publisher","DOI":"10.1093\/oncolo\/oyaf038","article-title":"Medical accuracy of artificial intelligence chatbots in oncology: a scoping review","volume":"30","author":"Chen","journal-title":"Oncologist"},{"issue":"2","key":"R33","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.57879","article-title":"Large language models for chatbot health advice studies: a systematic review","volume":"8","author":"Huo","journal-title":"JAMA Netw Open"},{"issue":"7","key":"R34","doi-asserted-by":"publisher","first-page":"549","DOI":"10.3390\/info16070549","article-title":"Large language models in medical chatbots: opportunities, challenges, and the need to address AI risks","volume":"16","author":"Chow","journal-title":"Information"},{"key":"R35","doi-asserted-by":"crossref","unstructured":"Wulf V Pipek V Randall D Rohde M Schmidt K . Stevens G , editor. Socio-Informatics: A Practice-Based Perspective on the Design and Use of IT Artefacts. Oxford University Press; 2018:35-37.","DOI":"10.1093\/oso\/9780198733249.001.0001"},{"key":"R36","doi-asserted-by":"crossref","unstructured":"Zweig KA Krafft TD Klingel A Park E . Sozioinformatik: Ein Neuer Blick Auf Informatik Und Gesellschaft. Carl Hanser Verlag; 2021. ISBN: 3-446-45213-3","DOI":"10.3139\/9783446468030.fm"},{"key":"R37","doi-asserted-by":"crossref","unstructured":"Chun J Schroeder de Witt C Elkins K . Comparative global AI regulation: policy perspectives from the EU, china, and the US. arXiv. Preprint posted online on 2024. [doi: 10.2139\/ssrn.5104429]","DOI":"10.2139\/ssrn.5104429"},{"issue":"1","key":"R38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.47912\/jscdm.412","article-title":"Navigating the path to ethical and responsible AI integration in health and life sciences with human and machine collaboration","volume":"5","author":"Shrotriya","journal-title":"J Soc Clin Data Manag"},{"key":"R39","unstructured":"European Commission, High-Level Expert Group on Artificial Intelligence. Ethics guidelines for trustworthy AI. Publications Office of the European Union; 2019. [doi: 10.2759\/22710]"},{"issue":"2","key":"R40","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1007\/s00146-022-01455-6","article-title":"Beyond bias and discrimination: redefining the AI ethics principle of fairness in healthcare machine-learning algorithms","volume":"38","author":"Giovanola","journal-title":"AI Soc"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.07.007","article-title":"Explanation in artificial intelligence: insights from the social sciences","volume":"267","author":"Miller","journal-title":"Artif Intell"},{"key":"R42","unstructured":"Bostrom N . Superintelligence: Paths, Dangers, Strategies. Oxford University Press; 2014. ISBN: 978-0199678112"},{"issue":"4","key":"R43","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1007\/s11023-018-9482-5","article-title":"AI4People\u2014an ethical framework for a good AI society: opportunities, risks, principles, and recommendations","volume":"28","author":"Floridi","journal-title":"Minds Mach"},{"key":"R44","unstructured":"Grunwald A . Technikfolgenabsch\u00e4tzung: Eine Einf\u00fchrung. 2nd ed. edition sigma, Berlin; 2010:1-346. ISBN: 978-3-89404-950-8"},{"key":"R45","doi-asserted-by":"crossref","unstructured":"Friedman B Hendry DG . Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press; 2019. ISBN: 9780262039536","DOI":"10.7551\/mitpress\/7585.001.0001"},{"key":"R46","unstructured":"EDPB Guidelines 2\/2019 on the processing of personal data under Article 6(1)(b) GDPR in the context of the provision of online services to data subjects. European Data Protection Board (EDPB); Oct 8, 2019. URL: https:\/\/content.next.westlaw.com\/practical-law\/document\/Ic162f9fbeff311e9adfea82903531a62\/EDPB-Guidelines-2-2019-on-the-processing-of-personal-data-under-Article-6-1-b-GDPR-in-the-context-of-the-provision-of-online-services-to-data-subjects?viewType=FullText&transitionType=Default&contextData=(sc.Default) [Accessed 19-09-2026]"},{"key":"R47","doi-asserted-by":"crossref","unstructured":"Ebner GK . Weniger ist mehr? die informationspflichten der DS-GVO \u2013 eine kritische analyse. Nomos, Baden-Baden; 2022. [doi: 10.5771\/9783748936879]","DOI":"10.5771\/9783748936879"},{"key":"R48","author":"Burk","journal-title":"Medizin Produkte Recht"},{"issue":"1","key":"R49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18261\/olr.11.1.2","article-title":"AI robotics in healthcare between the EU medical device regulation and the Artificial Intelligence Act: gaps and inconsistencies in the protection of patients and care recipients","volume":"11","author":"Ebers","journal-title":"Oslo Law Rev"},{"issue":"1","key":"R50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18261\/olr.10.1.1","article-title":"Doctor chatbot: the EU\u02bcs regulatory prescription for generative medical AI","volume":"10","author":"Hauglid","journal-title":"Oslo Law Rev"},{"key":"R51","unstructured":"Schulz-Gro\u00dfe S Genske A . Auswirkungen der neuen KI-Verordnung auf den Behandlungsalltag \u2013 Datenschutzrechtliche Anforderungen und Sorgfaltspflichten der Behandelnden beim Einsatz von k\u00fcnstlicher Intelligenz zu Behandlungszwecken. Gesundheit und Pflege; 2023:81-94. URL: https:\/\/beck-online.beck.de\/Dokument?vpath=bibdata%2Fzeits%2Fgup%2F2023%2Fcont%2Fgup.2023.81.1.htm&pos=6 [Accessed 19-09-2026]"},{"key":"R52","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejmp.2021.02.011","article-title":"The EU medical device regulation: Implications for artificial intelligence-based medical device software in medical physics","volume":"83","author":"Beckers","journal-title":"Phys Med"},{"key":"R53","unstructured":"Digital omnibus on AI regulation proposal. European Commission. 2025. URL: https:\/\/digital-strategy.ec.europa.eu\/en\/library\/digital-omnibus-ai-regulation-proposal [Accessed 08-09-2026]"},{"issue":"4","key":"R54","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1628\/jz-2026-0051","article-title":"Die (unzureichende) private Rechtsdurchsetzung unter der KI-Verordnung","volume":"81","author":"Radtke","journal-title":"JZ"}],"container-title":["JMIR Human Factors"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T20:26:11Z","timestamp":1790799971000},"score":1,"resource":{"primary":{"URL":"https:\/\/humanfactors.jmir.org\/2026\/1\/e97869"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,30]]},"references-count":54,"URL":"https:\/\/doi.org\/10.2196\/97869","relation":{},"ISSN":["2292-9495"],"issn-type":[{"value":"2292-9495","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,30]]},"article-number":"v13i23e97869"}}