{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T15:51:36Z","timestamp":1753890696249,"version":"3.41.2"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T00:00:00Z","timestamp":1729728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:sec><jats:title>Objective<\/jats:title><jats:p>Artificial intelligence (AI) is revolutionizing healthcare, but less is known about how it may facilitate methodological innovations in research settings. In this manuscript, we describe a novel use of AI in summarizing and reporting qualitative data generated from an expert panel discussion about the role of electronic health records (EHRs) in implementation science.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and methods<\/jats:title><jats:p>15 implementation scientists participated in an hour-long expert panel discussion addressing how EHRs can support implementation strategies, measure implementation outcomes, and influence implementation science. Notes from the discussion were synthesized by ChatGPT (a large language model\u2014LLM) to generate a manuscript summarizing the discussion, which was later revised by participants. We also surveyed participants on their experience with the process.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Panelists identified implementation strategies and outcome measures that can be readily supported by EHRs and noted that implementation science will need to evolve to assess future EHR advancements. The ChatGPT-generated summary of the panel discussion was generally regarded as an efficient means to offer a high-level overview of the discussion, although participants felt it lacked nuance and context. Extensive editing was required to contextualize the LLM-generated text and situate it in relevant literature.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion and conclusions<\/jats:title><jats:p>Our qualitative findings highlight the central role EHRs can play in supporting implementation science, which may require additional informatics and implementation expertise and a different way to think about the combined fields. Our experience using ChatGPT as a research methods innovation was mixed and underscores the need for close supervision and attentive human involvement.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fdgth.2024.1426057","type":"journal-article","created":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T05:10:39Z","timestamp":1729746639000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["A use case of ChatGPT: summary of an expert panel discussion on electronic health records and implementation science"],"prefix":"10.3389","volume":"6","author":[{"given":"Seppo T.","family":"Rinne","sequence":"first","affiliation":[]},{"given":"Julian","family":"Brunner","sequence":"additional","affiliation":[]},{"given":"Timothy P.","family":"Hogan","sequence":"additional","affiliation":[]},{"given":"Jacqueline M.","family":"Ferguson","sequence":"additional","affiliation":[]},{"given":"Drew A.","family":"Helmer","sequence":"additional","affiliation":[]},{"given":"Sylvia J.","family":"Hysong","sequence":"additional","affiliation":[]},{"given":"Grace","family":"McKee","sequence":"additional","affiliation":[]},{"given":"Amanda","family":"Midboe","sequence":"additional","affiliation":[]},{"given":"Megan E.","family":"Shepherd-Banigan","sequence":"additional","affiliation":[]},{"given":"A. Rani","family":"Elwy","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,10,24]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/s10916-023-01925-4","article-title":"Evaluating the feasibility of ChatGPT in healthcare: an analysis of multiple clinical and research scenarios","volume":"47","author":"Cascella","year":"2023","journal-title":"J Med Syst"},{"key":"B2","doi-asserted-by":"publisher","first-page":"887","DOI":"10.3390\/healthcare11060887","article-title":"ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns","volume":"11","author":"Sallam","year":"2023","journal-title":"Healthcare (Basel)"},{"volume-title":"ChatGPT Hack for Summarizing Your Work","year":"2023","author":"McCue","key":"B3"},{"volume-title":"Use ChatGPT for Mundane Tasks Like Summarizing Meeting Notes and Formatting","year":"2023","author":"Pionk","key":"B4"},{"volume-title":"Meeting Summaries in Minutes with ChatGPT","year":"2023","key":"B5"},{"key":"B6","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1186\/1748-5908-8-139","article-title":"Implementation strategies: recommendations for specifying and reporting","volume":"8","author":"Proctor","year":"2013","journal-title":"Implement Sci"},{"key":"B7","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/s13012-015-0209-1","article-title":"A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project","volume":"10","author":"Powell","year":"2015","journal-title":"Implement Sci"},{"key":"B8","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1007\/s10488-010-0319-7","article-title":"Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda","volume":"38","author":"Proctor","year":"2011","journal-title":"Adm Policy Ment Health"},{"key":"B9","doi-asserted-by":"publisher","first-page":"1416","DOI":"10.1377\/hlthaff.2016.1651","article-title":"HITECH act drove large gains in hospital electronic health record adoption","volume":"36","author":"Adler-Milstein","year":"2017","journal-title":"Health Aff (Millwood)"},{"key":"B10","doi-asserted-by":"publisher","first-page":"e26323","DOI":"10.2196\/26323","article-title":"Value of the electronic medical record for hospital care: update from the literature","volume":"23","author":"Uslu","year":"2021","journal-title":"J Med Internet Res"},{"key":"B11","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1186\/s13012-015-0295-0","article-title":"Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the expert recommendations for implementing change (ERIC) study","volume":"10","author":"Waltz","year":"2015","journal-title":"Implement Sci"},{"key":"B12","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1038\/s41537-023-00379-4","article-title":"ChatGPT: these are not hallucinations\u2014they're fabrications and falsifications","volume":"9","author":"Emsley","year":"2023","journal-title":"Schizophrenia (Heidelb)"},{"year":"2023","key":"B13","article-title":"Version 2023"},{"key":"B14","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1002\/1098-240X(200008)23:4%3C334::AID-NUR9%3E3.0.CO;2-G","article-title":"Whatever happened to qualitative description?","volume":"23","author":"Sandelowski","year":"2000","journal-title":"Res Nurs Health"},{"key":"B15","doi-asserted-by":"publisher","first-page":"2489","DOI":"10.3390\/ijerph19042489","article-title":"Pain evaluation in the paediatric emergency department: differences in ratings by patients, parents and nurses","volume":"19","author":"Rybojad","year":"2022","journal-title":"Int J Environ Res Public Health"},{"key":"B16","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1001\/jamainternmed.2023.1832","article-title":"Medicine in the era of artificial intelligence","volume":"183","author":"Brender","year":"2023","journal-title":"JAMA Intern Med"},{"key":"B17","doi-asserted-by":"publisher","first-page":"e0267915","DOI":"10.1371\/journal.pone.0267915","article-title":"Using electronic health records to streamline provider recruitment for implementation science studies","volume":"17","author":"Okorie","year":"2022","journal-title":"PLoS One"},{"key":"B18","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1111\/wvn.12492","article-title":"Audit and feedback: an evidence-based practice literature review of nursing report cards","volume":"18","author":"Whalen","year":"2021","journal-title":"Worldviews Evid Based Nurs"},{"key":"B19","doi-asserted-by":"publisher","first-page":"S123","DOI":"10.7326\/M19-0876","article-title":"Using electronic health record portals to improve patient engagement: research priorities and best practices","volume":"172","author":"Lyles","year":"2020","journal-title":"Ann Intern Med"},{"key":"B20","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1097\/NNR.0000000000000094","article-title":"Electronic alerts for triage protocol compliance among emergency department triage nurses","volume":"64","author":"Holmes","year":"2015","journal-title":"Nurs Res"},{"key":"B21","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1017\/cts.2017.301","article-title":"A survey of practices for the use of electronic health records to support research recruitment","volume":"1","author":"Obeid","year":"2017","journal-title":"J Clin Transl Sci"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1526","DOI":"10.1093\/jamia\/ocab038","article-title":"Cancelrx: a health IT tool to reduce medication discrepancies in the outpatient setting","volume":"28","author":"Watterson","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"B23","doi-asserted-by":"publisher","first-page":"478","DOI":"10.1055\/a-2073-3736","article-title":"Leveraging the electronic health record to implement emergency department delirium screening","volume":"14","author":"Chary","year":"2023","journal-title":"Appl Clin Inform"},{"key":"B24","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.ijmedinf.2019.01.008","article-title":"Feasibility study of an EHR-integrated mobile shared decision making application","volume":"124","author":"Da","year":"2019","journal-title":"Int J Med Inform"},{"key":"B25","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1186\/s12911-019-0897-6","article-title":"Delivering person-centered care with an electronic health record","volume":"19","author":"Stanhope","year":"2019","journal-title":"BMC Med Inform Decis Mak"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1259","DOI":"10.1186\/s12913-021-07287-2","article-title":"Evaluating implementation outcomes (acceptability, adoption, and feasibility) of two initiatives to improve the medication prior authorization process","volume":"21","author":"Jones","year":"2021","journal-title":"BMC Health Serv Res"},{"key":"B27","doi-asserted-by":"publisher","first-page":"e001741","DOI":"10.1136\/bmjoq-2021-001741","article-title":"Indicators for implementation outcome monitoring of reporting and learning systems in hospitals: an underestimated need for patient safety","volume":"11","author":"Kuske","year":"2022","journal-title":"BMJ Open Qual"},{"key":"B28","doi-asserted-by":"publisher","first-page":"46958019861257","DOI":"10.1177\/0046958019861257","article-title":"Implementation outcomes and indicators as a new challenge in health services research: a systematic scoping review","volume":"56","author":"Willmeroth","year":"2019","journal-title":"Inquiry"},{"key":"B29","doi-asserted-by":"publisher","first-page":"310","DOI":"10.12788\/cutis.0402","article-title":"Can artificial intelligence technology replace human scribes?","volume":"108","author":"Anzelc","year":"2021","journal-title":"Cutis"},{"key":"B30","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1038\/s41746-018-0066-9","article-title":"The digital scribe","volume":"1","author":"Coiera","year":"2018","journal-title":"NPJ Digit Med"},{"key":"B31","doi-asserted-by":"publisher","first-page":"102487","DOI":"10.1016\/j.artmed.2023.102487","article-title":"Automatic documentation of professional health interactions: a systematic review","volume":"137","author":"Falcetta","year":"2023","journal-title":"Artif Intell Med"},{"key":"B32","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1016\/j.amjmed.2019.01.017","article-title":"Artificial intelligence transforms the future of health care","volume":"132","author":"Noorbakhsh-Sabet","year":"2019","journal-title":"Am J Med"},{"key":"B33","doi-asserted-by":"publisher","first-page":"1716","DOI":"10.1038\/s41591-018-0213-5","article-title":"The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care","volume":"24","author":"Komorowski","year":"2018","journal-title":"Nat Med"},{"key":"B34","doi-asserted-by":"publisher","first-page":"e37188","DOI":"10.2196\/37188","article-title":"Randomized controlled trials of artificial intelligence in clinical practice: systematic review","volume":"24","author":"Lam","year":"2022","journal-title":"J Med Internet Res"},{"key":"B35","doi-asserted-by":"publisher","first-page":"e10010","DOI":"10.2196\/10010","article-title":"Artificial intelligence versus clinicians in disease diagnosis: systematic review","volume":"7","author":"Shen","year":"2019","journal-title":"JMIR Med Inform"},{"key":"B36","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1016\/j.beth.2021.09.007","article-title":"Chatbot-delivered psychotherapy for adults with depressive and anxiety symptoms: a systematic review and meta-regression","volume":"53","author":"Lim","year":"2022","journal-title":"Behav Ther"},{"key":"B37","doi-asserted-by":"publisher","first-page":"e20346","DOI":"10.2196\/20346","article-title":"The effectiveness of artificial intelligence conversational agents in health care: systematic review","volume":"22","author":"Milnes-Ives","year":"2020","journal-title":"J Med Internet Res"},{"key":"B38","doi-asserted-by":"publisher","first-page":"1802","DOI":"10.1177\/1049732316654870","article-title":"Member checking","volume":"26","author":"Birt","year":"2016","journal-title":"Qual Health Res"}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2024.1426057\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T05:10:42Z","timestamp":1729746642000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2024.1426057\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,24]]},"references-count":38,"alternative-id":["10.3389\/fdgth.2024.1426057"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2024.1426057","relation":{},"ISSN":["2673-253X"],"issn-type":[{"type":"electronic","value":"2673-253X"}],"subject":[],"published":{"date-parts":[[2024,10,24]]},"article-number":"1426057"}}