{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,11]],"date-time":"2026-10-11T13:55:07Z","timestamp":1791726907883,"version":"4.3.4"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T00:00:00Z","timestamp":1716940800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T00:00:00Z","timestamp":1716940800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008967","name":"Philipps-Universit\u00e4t Marburg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008967","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Arch Gynecol Obstet"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>This study investigated the concordance of five different publicly available Large Language Models (LLM) with the recommendations of a multidisciplinary tumor board regarding treatment recommendations for complex breast cancer patient profiles.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Five LLM, including three versions of ChatGPT (version 4 and 3.5, with data access until September 3021 and January 2022), Llama2, and Bard were prompted to produce treatment recommendations for 20 complex breast cancer patient profiles. LLM recommendations were compared to the recommendations of a multidisciplinary tumor board (gold standard), including surgical, endocrine and systemic treatment, radiotherapy, and genetic testing therapy options.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>GPT4 demonstrated the highest concordance (70.6%) for invasive breast cancer patient profiles, followed by GPT3.5 September 2021 (58.8%), GPT3.5 January 2022 (41.2%), Llama2 (35.3%) and Bard (23.5%). Including precancerous lesions of ductal carcinoma in situ, the identical ranking was reached with lower overall concordance for each LLM (GPT4 60.0%, GPT3.5 September 2021 50.0%, GPT3.5 January 2022 35.0%, Llama2 30.0%, Bard 20.0%). GPT4 achieved full concordance (100%) for radiotherapy. Lowest alignment was reached in recommending genetic testing, demonstrating a varying concordance (55.0% for GPT3.5 January 2022, Llama2 and Bard up to 85.0% for GPT4).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>This early feasibility study is the first to compare different LLM in breast cancer care with regard to changes in accuracy over time, i.e., with access to more data or through technological upgrades. Methodological advancement, i.e., the optimization of prompting techniques, and technological development, i.e., enabling data input control and secure data processing, are necessary in the preparation of large-scale and multicenter studies to provide evidence on their safe and reliable clinical application. At present, safe and evidenced use of LLM in clinical breast cancer care is not yet feasible.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s00404-024-07565-4","type":"journal-article","created":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T02:01:38Z","timestamp":1716948098000},"page":"537-550","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Evolution of publicly available large language models for complex decision-making in breast cancer care"],"prefix":"10.1007","volume":"310","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5355-8903","authenticated-orcid":false,"given":"Sebastian","family":"Griewing","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9695-0657","authenticated-orcid":false,"given":"Johannes","family":"Knitza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jelena","family":"Boekhoff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Hillen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabian","family":"Lechner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Uwe","family":"Wagner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4139-9340","authenticated-orcid":false,"given":"Markus","family":"Wallwiener","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8031-2973","authenticated-orcid":false,"given":"Sebastian","family":"Kuhn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,5,29]]},"reference":[{"key":"7565_CR1","doi-asserted-by":"publisher","unstructured":"Brustdr\u00fcse\u2013C 50 (2023) In: Robert Koch Institut (ed) Krebs in Deutschland f\u00fcr 2019\/2020, 14th edition, Berlin, pp 78\u201381. https:\/\/doi.org\/10.25646\/11357","DOI":"10.25646\/11357"},{"key":"7565_CR2","unstructured":"European Commission (2021) Europe\u2019s beating cancer plan. https:\/\/health.ec.europa.eu\/system\/files\/2022-02\/eu_cancer-plan_en_0.pdf. Accessed 20 Dec 2023"},{"key":"7565_CR3","unstructured":"German Guideline Program in Oncology (German Cancer Society, German Cancer Ais, AWMF (2021) Interdisciplinary evidence-based pratice guideline for early detection, diagnosis, treatment and follow-up of breast cancer long version 4.4 AWMF registration number: 032\/045OL. https:\/\/www.leitlinienprogramm-onkologie.de\/fileadmin\/user_upload\/S3_Guideline_Breast_Cancer.pdf. Accessed 20 Dec 2023"},{"key":"7565_CR4","doi-asserted-by":"publisher","DOI":"10.3390\/cancers14184430","author":"TS Tarawneh","year":"2022","unstructured":"Tarawneh TS, Rodepeter FR, Teply-Szymanski J et al (2022) Combined focused next-generation sequencing assays to guide precision oncology in solid tumors: a retrospective analysis from an institutional molecular tumor board. Cancers (Basel). https:\/\/doi.org\/10.3390\/cancers14184430","journal-title":"Cancers (Basel)"},{"issue":"4","key":"7565_CR5","doi-asserted-by":"publisher","first-page":"732","DOI":"10.1200\/JCO.22.02217","volume":"41","author":"CA Santa-Maria","year":"2023","unstructured":"Santa-Maria CA, Wolff AC (2023) Antibody-drug conjugates in breast cancer: searching for magic bullets. J Clin Oncol 41(4):732\u2013735. https:\/\/doi.org\/10.1200\/JCO.22.02217","journal-title":"J Clin Oncol"},{"issue":"9","key":"7565_CR6","doi-asserted-by":"publisher","first-page":"984","DOI":"10.3389\/fonc.2019.00984","volume":"2","author":"T Bhattacharya","year":"2019","unstructured":"Bhattacharya T, Brettin T, Doroshow JH et al (2019) AI meets exascale computing: advancing cancer research with large-scale high performance computing. Front Oncol 2(9):984. https:\/\/doi.org\/10.3389\/fonc.2019.00984","journal-title":"Front Oncol"},{"key":"7565_CR7","doi-asserted-by":"publisher","first-page":"2072","DOI":"10.1158\/0008-5472.CAN-22-0100","volume":"82","author":"AD Barker","year":"2022","unstructured":"Barker AD, Lee JSH (2022) Translating \u201cBig Data\u201d in oncology for clinical benefit: progress or paralysis. Cancer Res 82:2072\u20132075. https:\/\/doi.org\/10.1158\/0008-5472.CAN-22-0100","journal-title":"Cancer Res"},{"key":"7565_CR8","doi-asserted-by":"publisher","DOI":"10.1056\/AI-S2300233","author":"H Poon","year":"2023","unstructured":"Poon H (2023) Multimodal generative AI for precision health. NEJM AI. https:\/\/doi.org\/10.1056\/AI-S2300233","journal-title":"NEJM AI"},{"key":"7565_CR9","doi-asserted-by":"publisher","DOI":"10.1056\/AIp2300189","author":"C Goldberg","year":"2023","unstructured":"Goldberg C (2023) Patient portal. NEJM AI. https:\/\/doi.org\/10.1056\/AIp2300189","journal-title":"NEJM AI"},{"key":"7565_CR10","unstructured":"Rainer Thiel A, Deimel L, Schmidtmann D, et al (2018) Gesundheitssystem-Vergleich Fokus Digitalisierung #SmartHealthSystems Digitalisierungsstrategien im internationalen Vergleich. https:\/\/www.bertelsmann-stiftung.de\/fileadmin\/files\/Projekte\/Der_digitale_Patient\/VV_SHS-Gesamtstudie_dt.pdf. Accessed 20 Dec 2023"},{"key":"7565_CR11","doi-asserted-by":"publisher","first-page":"1823","DOI":"10.1007\/s00404-023-07223-1","volume":"308","author":"A Pfob","year":"2023","unstructured":"Pfob A, Griewing S, Seitz K et al (2023) Current landscape of hospital information systems in gynecology and obstetrics in Germany: a survey of the commission Digital Medicine of the German Society for Gynecology and Obstetrics. Arch Gynecol Obstet 308:1823\u20131830. https:\/\/doi.org\/10.1007\/s00404-023-07223-1","journal-title":"Arch Gynecol Obstet"},{"key":"7565_CR12","doi-asserted-by":"publisher","DOI":"10.1007\/s00404-023-07222-2","author":"A Pfob","year":"2023","unstructured":"Pfob A, Hillen C, Seitz K et al (2023) Status quo and future directions of digitalization in gynecology and obstetrics in Germany: a survey of the commission Digital Medicine of the German Society for Gynecology and Obstetrics. Arch Gynecol Obstet. https:\/\/doi.org\/10.1007\/s00404-023-07222-2","journal-title":"Arch Gynecol Obstet"},{"issue":"3","key":"7565_CR13","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1515\/dx-2018-0009","volume":"5","author":"ML Millenson","year":"2018","unstructured":"Millenson ML, Baldwin JL, Zipperer L et al (2018) Beyond Dr. Google: the evidence on consumer-facing digital tools for diagnosis. Diagnosis (Berl) 5(3):95\u2013105. https:\/\/doi.org\/10.1515\/dx-2018-0009","journal-title":"Diagnosis (Berl)"},{"key":"7565_CR14","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.46489","author":"J Pergolizzi Jr","year":"2023","unstructured":"Pergolizzi J Jr, LeQuang JAK, Vasiliu-Feltes I et al (2023) Brave new healthcare: a narrative review of digital healthcare in American medicine. Cureus. https:\/\/doi.org\/10.7759\/cureus.46489","journal-title":"Cureus"},{"key":"7565_CR15","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2022.844669","author":"J Knitza","year":"2022","unstructured":"Knitza J, Muehlensiepen F, Ignatyev Y et al (2022) Patient\u2019s perception of digital symptom assessment technologies in rheumatology: results from a multicentre study. Front Public Health. https:\/\/doi.org\/10.3389\/fpubh.2022.844669","journal-title":"Front Public Health"},{"issue":"12","key":"7565_CR16","doi-asserted-by":"publisher","first-page":"e917","DOI":"10.1016\/S2589-7500(23)00201-7","volume":"5","author":"BK Betzler","year":"2023","unstructured":"Betzler BK, Chen H, Cheng CY et al (2023) Large language models and their impact in ophthalmology. Lancet Digit Health 5(12):e917\u2013e924. https:\/\/doi.org\/10.1016\/S2589-7500(23)00201-7","journal-title":"Lancet Digit Health"},{"key":"7565_CR17","doi-asserted-by":"publisher","first-page":"e49183","DOI":"10.2196\/49183","volume":"9","author":"CR Buhr","year":"2023","unstructured":"Buhr CR, Smith H, Huppertz T et al (2023) ChatGPT versus consultants: blinded evaluation on answering otorhinolaryngology case\u2013based questions. JMIR Med Educ 9:e49183. https:\/\/doi.org\/10.2196\/49183","journal-title":"JMIR Med Educ"},{"issue":"23","key":"7565_CR18","doi-asserted-by":"publisher","first-page":"1173","DOI":"10.5435\/JAAOS-D-23-00396","volume":"31","author":"PA Massey","year":"2023","unstructured":"Massey PA, Montgomery C, Zhang AS (2023) Comparison of ChatGPT\u20133.5, ChatGPT-4, and orthopaedic resident performance on orthopaedic assessment examinations. J Am Acad Orthop Surg 31(23):1173\u20131179. https:\/\/doi.org\/10.5435\/JAAOS-D-23-00396","journal-title":"J Am Acad Orthop Surg"},{"key":"7565_CR19","doi-asserted-by":"publisher","DOI":"10.2196\/46482","author":"J Roos","year":"2023","unstructured":"Roos J, Kasapovic A, Jansen T et al (2023) Artificial intelligence in medical education: comparative analysis of ChatGPT, Bing, and medical students in Germany. JMIR Med Educ. https:\/\/doi.org\/10.2196\/46482","journal-title":"JMIR Med Educ"},{"key":"7565_CR20","doi-asserted-by":"publisher","DOI":"10.2196\/48002","author":"S Takagi","year":"2023","unstructured":"Takagi S, Watari T, Erabi A et al (2023) Performance of GPT-3.5 and GPT-4 on the Japanese Medical Licensing Examination: comparison study. JMIR Med Educ. https:\/\/doi.org\/10.2196\/48002","journal-title":"JMIR Med Educ"},{"key":"7565_CR21","doi-asserted-by":"publisher","DOI":"10.2196\/48933","author":"N Schopow","year":"2023","unstructured":"Schopow N, Osterhoff G, Baur D (2023) NLP applications in clinical practice: a comparative study and augmented systematic review with ChatGPT (Preprint). JMIR Med Inform. https:\/\/doi.org\/10.2196\/48933","journal-title":"JMIR Med Inform"},{"key":"7565_CR22","doi-asserted-by":"publisher","first-page":"1831","DOI":"10.1007\/s00404-023-07130-5","volume":"308","author":"S Lukac","year":"2023","unstructured":"Lukac S, Dayan D, Fink V et al (2023) Evaluating ChatGPT as an adjunct for the multidisciplinary tumor board decision-making in primary breast cancer cases. Arch Gynecol Obstet 308:1831\u20131844. https:\/\/doi.org\/10.1007\/s00404-023-07130-5","journal-title":"Arch Gynecol Obstet"},{"key":"7565_CR23","doi-asserted-by":"publisher","DOI":"10.1038\/s41523-023-00557-8","author":"V Sorin","year":"2023","unstructured":"Sorin V, Klang E, Sklair-Levy M et al (2023) Large language model (ChatGPT) as a support tool for breast tumor board. NPJ Breast Cancer. https:\/\/doi.org\/10.1038\/s41523-023-00557-8","journal-title":"NPJ Breast Cancer"},{"key":"7565_CR24","doi-asserted-by":"publisher","DOI":"10.3390\/jpm13101502","author":"S Griewing","year":"2023","unstructured":"Griewing S, Gremke N, Wagner U et al (2023) Challenging ChatGPT 3.5 in senology\u2014an assessment of concordance with breast cancer tumor board decision making. J Pers Med. https:\/\/doi.org\/10.3390\/jpm13101502","journal-title":"J Pers Med"},{"key":"7565_CR25","doi-asserted-by":"publisher","unstructured":"Chen L, Zaharia M, Zou J (2023) How is ChatGPT\u2019s behavior changing over time? (preprint). arxiv. https:\/\/doi.org\/10.48550\/arXiv.2307.09009","DOI":"10.48550\/arXiv.2307.09009"},{"key":"7565_CR26","unstructured":"U.S. Food and Drug Administration (2013) Investigational Device Exemptions (IDEs) for early feasibility medical device clinical studies, including certain First in Human (FIH) studies guidance for industry and food and drug administration staff. https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/investigational-device-exemptions-ides-early-feasibility-medical-device-clinical-studies-including Accessed 5 Mar 2024"},{"key":"7565_CR27","unstructured":"Innovative Health Initiative (2023) Improving patient access to innovative medical technologies in the European Union. https:\/\/heuefs.eu\/wp-content\/uploads\/2024\/01\/HEU-EFS_consortium_press_release.pdf. Accessed 5 Mar 2024"},{"issue":"25","key":"7565_CR28","doi-asserted-by":"publisher","first-page":"e48659","DOI":"10.2196\/48659","volume":"22","author":"A Rao","year":"2023","unstructured":"Rao A, Pang M, Kim J et al (2023) Assessing the utility of ChatGPT throughout the entire clinical workflow: development and usability study. J Med Internet Res 22(25):e48659. https:\/\/doi.org\/10.2196\/48659","journal-title":"J Med Internet Res"},{"key":"7565_CR29","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacr.2023.05.003","author":"A Rao","year":"2023","unstructured":"Rao A, Kim J, Kamineni M et al (2023) Evaluating GPT as an adjunct for radiologic decision making_ GPT-4 versus GPT-3.5 in a breast imaging pilot. J Am Coll Radiol. https:\/\/doi.org\/10.1016\/j.jacr.2023.05.003","journal-title":"J Am Coll Radiol"},{"key":"7565_CR30","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.230424","author":"HL Haver","year":"2023","unstructured":"Haver HL, Ambinder EB, Bahl M et al (2023) Appropriateness of breast cancer prevention and screening recommendations provided by ChatGPT. Radiology. https:\/\/doi.org\/10.1148\/radiol.230424","journal-title":"Radiology"},{"key":"7565_CR31","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3857\/roj.2023.00633","volume":"41","author":"HS Choi","year":"2023","unstructured":"Choi HS, Song JY, Shin KH et al (2023) Developing prompts from large language model for extracting clinical information from pathology and ultrasound reports in breast cancer. Radiat Oncol J 41:209\u2013216. https:\/\/doi.org\/10.3857\/roj.2023.00633","journal-title":"Radiat Oncol J"},{"key":"7565_CR32","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-023-00819-6","author":"CA Gao","year":"2023","unstructured":"Gao CA, Howard FM, Markov NS et al (2023) Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. https:\/\/doi.org\/10.1038\/s41746-023-00819-6","journal-title":"NPJ Digit Med"},{"key":"7565_CR33","doi-asserted-by":"publisher","DOI":"10.1056\/aip2300031","author":"AV Eriksen","year":"2023","unstructured":"Eriksen AV, M\u00f6ller S, Ryg J (2023) Use of GPT-4 to diagnose complex clinical cases. NEJM AI. https:\/\/doi.org\/10.1056\/aip2300031","journal-title":"NEJM AI"},{"key":"7565_CR34","doi-asserted-by":"publisher","first-page":"113244","DOI":"10.1016\/j.ejca.2023.113244","volume":"192","author":"L van Walle","year":"2023","unstructured":"van Walle L, Verhoeven D, Marotti L, Ponti A, Tomatis M, Rubio IT, EUSOMA Working Group (2023) Trends and variation in treatment of early breast cancer in European certified breast centres: an EUSOMA-based analysis. Eur J Cancer 192:113244. https:\/\/doi.org\/10.1016\/j.ejca.2023.113244","journal-title":"Eur J Cancer"},{"key":"7565_CR35","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1038\/s41416-018-0090-1","volume":"119","author":"MGM Derks","year":"2018","unstructured":"Derks MGM, Bastiaannet E, Kiderlen M et al (2018) Variation in treatment and survival of older patients with non-metastatic breast cancer in five European countries: a population-based cohort study from the EURECCA Breast Cancer Group. Br J Cancer 119:121\u2013129. https:\/\/doi.org\/10.1038\/s41416-018-0090-1","journal-title":"Br J Cancer"},{"key":"7565_CR36","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1007\/s12253-018-0553-y","volume":"26","author":"Y Yan","year":"2020","unstructured":"Yan Y, Zhang L, Tan L et al (2020) Endocrine therapy for Ductal Carcinoma In Situ (DCIS) of the breast with Breast Conserving Surgery (BCS) and Radiotherapy (RT): a meta-analysis. Pathol Oncol Res 26:521\u2013531. https:\/\/doi.org\/10.1007\/s12253-018-0553-y","journal-title":"Pathol Oncol Res"},{"issue":"9","key":"7565_CR37","doi-asserted-by":"publisher","first-page":"e233909","DOI":"10.1001\/jamahealthforum.2023.3909","volume":"4","author":"S Gottlieb","year":"2023","unstructured":"Gottlieb S, Silvis L (2023) How to safely integrate large language models into health care. JAMA Health Forum 4(9):e233909. https:\/\/doi.org\/10.1001\/jamahealthforum.2023.3909","journal-title":"JAMA Health Forum"}],"container-title":["Archives of Gynecology and Obstetrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00404-024-07565-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00404-024-07565-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00404-024-07565-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,12]],"date-time":"2024-06-12T12:13:04Z","timestamp":1718194384000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00404-024-07565-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,29]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["7565"],"URL":"https:\/\/doi.org\/10.1007\/s00404-024-07565-4","relation":{},"ISSN":["1432-0711"],"issn-type":[{"value":"1432-0711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,29]]},"assertion":[{"value":"21 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 May 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This is an observational study. The Philipps-University Marburg Research Ethics Committee has confirmed that no ethical approval is required (23\u2013300 ANZ).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Does not apply.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Does not apply.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to publish"}}]}}