{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:28:22Z","timestamp":1776094102704,"version":"3.50.1"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T00:00:00Z","timestamp":1721001600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["1K99LM014429-01"],"award-info":[{"award-number":["1K99LM014429-01"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["1U24TR004432-01"],"award-info":[{"award-number":["1U24TR004432-01"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Returning aggregate study results is an important ethical responsibility to promote trust and inform decision making, but the practice of providing results to a lay audience is not widely adopted. Barriers include significant cost and time required to develop lay summaries and scarce infrastructure necessary for returning them to the public. Our study aims to generate, evaluate, and implement ChatGPT 4 lay summaries of scientific abstracts on a national clinical study recruitment platform, ResearchMatch, to facilitate timely and cost-effective return of study results at scale.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We engineered prompts to summarize abstracts at a literacy level accessible to the public, prioritizing succinctness, clarity, and practical relevance. Researchers and volunteers assessed ChatGPT-generated lay summaries across five dimensions: accuracy, relevance, accessibility, transparency, and harmfulness. We used precision analysis and adaptive random sampling to determine the optimal number of summaries for evaluation, ensuring high statistical precision.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>ChatGPT achieved 95.9% (95% CI, 92.1\u201397.9) accuracy and 96.2% (92.4\u201398.1) relevance across 192 summary sentences from 33 abstracts based on researcher review. 85.3% (69.9\u201393.6) of 34 volunteers perceived ChatGPT-generated summaries as more accessible and 73.5% (56.9\u201385.4) more transparent than the original abstract. None of the summaries were deemed harmful. We expanded ResearchMatch\u2019s technical infrastructure to automatically generate and display lay summaries for over 750 published studies that resulted from the platform\u2019s recruitment mechanism.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion and Conclusion<\/jats:title>\n                  <jats:p>Implementing AI-generated lay summaries on ResearchMatch demonstrates the potential of a scalable framework generalizable to broader platforms for enhancing research accessibility and transparency.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae186","type":"journal-article","created":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T20:36:00Z","timestamp":1721075760000},"page":"2294-2303","source":"Crossref","is-referenced-by-count":24,"title":["Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7466-0034","authenticated-orcid":false,"given":"Cathy","family":"Shyr","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37203, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2911-6782","authenticated-orcid":false,"given":"Randall W","family":"Grout","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Indiana University School of Medicine , Indianapolis, IN 46202, United States"},{"name":"Regenstrief Institute, Inc , Indianapolis, IN 46202, United States"}]},{"given":"Nan","family":"Kennedy","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center , Nashville, TN 37203, United States"}]},{"given":"Yasemin","family":"Akdas","sequence":"additional","affiliation":[{"name":"Division of Emergency Medicine Research, Vanderbilt University Medical Center , Nashville, TN 37232, United States"}]},{"given":"Maeve","family":"Tischbein","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center , Nashville, TN 37203, United States"}]},{"given":"Joshua","family":"Milford","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center , Nashville, TN 37203, United States"}]},{"given":"Jason","family":"Tan","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center , Nashville, TN 37203, United States"}]},{"given":"Kaysi","family":"Quarles","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center , Nashville, TN 37203, United States"}]},{"given":"Terri L","family":"Edwards","sequence":"additional","affiliation":[{"name":"Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center , Nashville, TN 37203, United States"}]},{"given":"Laurie L","family":"Novak","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37203, United States"}]},{"given":"Jules","family":"White","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, Vanderbilt University , Nashville, TN 37240, United States"}]},{"given":"Consuelo H","family":"Wilkins","sequence":"additional","affiliation":[{"name":"Department of Medicine, Vanderbilt University Medical Center , Nashville, TN 37232, United States"}]},{"given":"Paul A","family":"Harris","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37203, United States"},{"name":"Department of Biostatistics, Vanderbilt University Medical Center , Nashville, TN 37203, United States"},{"name":"Department of Biomedical Engineering, Vanderbilt University , Nashville, TN 37240, United States"}]}],"member":"286","published-online":{"date-parts":[[2024,7,15]]},"reference":[{"issue":"7","key":"2024092007531286200_ocae186-B1","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1080\/17512433.2019.1615441","article-title":"Assessing the adoption of clinical trial results summary disclosure to patients and the public","volume":"12","author":"Getz","year":"2019","journal-title":"Expert Rev Clin Pharmacol"},{"issue":"1","key":"2024092007531286200_ocae186-B2","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1186\/s12961-019-0422-5","article-title":"Health researchers\u2019 experiences, perceptions and barriers related to sharing study results with participants","volume":"17","author":"Long","year":"2019","journal-title":"Health Res Policy Syst"},{"key":"2024092007531286200_ocae186-B3","author":"Patient-Centered Outcomes Research Institute"},{"issue":"4","key":"2024092007531286200_ocae186-B4","doi-asserted-by":"publisher","first-page":"1199","DOI":"10.1182\/blood-2005-02-0556","article-title":"Providing research results to study participants: support versus practice of researchers presenting at the American Society of Hematology annual meeting","volume":"106","author":"Rigby","year":"2005","journal-title":"Blood"},{"issue":"2","key":"2024092007531286200_ocae186-B5","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1080\/23294515.2017.1310146","article-title":"Qualitative study of participants\u2019 perceptions and preferences regarding research dissemination","volume":"8","author":"Purvis","year":"2017","journal-title":"AJOB Empir Bioeth"},{"issue":"8","key":"2024092007531286200_ocae186-B6","doi-asserted-by":"publisher","first-page":"629","DOI":"10.1093\/jnci\/djh096","article-title":"Oncology physician and nurse practices and attitudes regarding offering clinical trial results to study participants","volume":"96","author":"Partridge","year":"2004","journal-title":"J Natl Cancer Inst"},{"key":"2024092007531286200_ocae186-B7","doi-asserted-by":"publisher","first-page":"100543","DOI":"10.1016\/j.conctc.2020.100543","article-title":"\u201cThe results are encouragements to make positive changes to be healthier:\u201d qualitative evaluation of Marshallese participants\u2019 perceptions when receiving study results in a randomized control trial","volume":"17","author":"McElfish","year":"2020","journal-title":"Contemp Clin Trials Commun"},{"issue":"3","key":"2024092007531286200_ocae186-B8","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1377\/hlthaff.2018.05046","article-title":"Understanding what information is valued by research participants, and why","volume":"38","author":"Wilkins","year":"2019","journal-title":"Health Aff (Millwood)"},{"issue":"7","key":"2024092007531286200_ocae186-B9","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1001\/jama.2012.127","article-title":"Few studies reporting results at US government clinical trials site","volume":"307","author":"Kuehn","year":"2012","journal-title":"JAMA"},{"issue":"1","key":"2024092007531286200_ocae186-B10","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1186\/s13063-017-2200-4","article-title":"Health research participants are not receiving research results: a collaborative solution is needed","volume":"18","author":"Long","year":"2017","journal-title":"Trials"},{"issue":"1","key":"2024092007531286200_ocae186-B11","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1136\/jme.2010.041350","article-title":"What does \u2018respect for persons\u2019 require? Attitudes and reported practices of genetics researchers in informing research participants about research","volume":"38","author":"Miller","year":"2012","journal-title":"J Med Ethics"},{"issue":"10","key":"2024092007531286200_ocae186-B12","doi-asserted-by":"publisher","first-page":"e032701","DOI":"10.1136\/bmjopen-2019-032701","article-title":"Frequency and format of clinical trial results dissemination to patients: a survey of authors of trials indexed in PubMed","volume":"9","author":"Schroter","year":"2019","journal-title":"BMJ Open"},{"key":"2024092007531286200_ocae186-B13","author":"OpenAI"},{"issue":"1","key":"2024092007531286200_ocae186-B14","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1097\/ACM.0b013e31823ab7d2","article-title":"ResearchMatch: a national registry to recruit volunteers for clinical research","volume":"87","author":"Harris","year":"2012","journal-title":"Acad Med"},{"key":"2024092007531286200_ocae186-B15","author":"Pu","year":"2023"},{"key":"2024092007531286200_ocae186-B16","author":"OpenAI"},{"key":"2024092007531286200_ocae186-B17","first-page":"1","author":"Raffel","year":"2019"},{"key":"2024092007531286200_ocae186-B18","doi-asserted-by":"publisher","first-page":"104580","DOI":"10.1016\/j.jbi.2023.104580","article-title":"Retrieval augmentation of large language models for lay language generation","volume":"149","author":"Guo","year":"2024","journal-title":"J Biomed Inform"},{"key":"2024092007531286200_ocae186-B19","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1109\/TMM.2021.3132724","article-title":"ChestXRayBERT: a pretrained language model for chest radiology report summarization","volume":"25","author":"Cai","year":"2023","journal-title":"IEEE Trans Multimedia"},{"key":"2024092007531286200_ocae186-B20","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1016\/j.jbi.2016.10.014","article-title":"Extractive text summarization system to aid data extraction from full text in systematic review development","volume":"64","author":"Bui","year":"2016","journal-title":"J Biomed Inform"},{"key":"2024092007531286200_ocae186-B21","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1016\/j.jbi.2014.06.009","article-title":"Text summarization in the biomedical domain: a systematic review of recent research","volume":"52","author":"Mishra","year":"2014","journal-title":"J Biomed Inform"},{"key":"2024092007531286200_ocae186-B22","doi-asserted-by":"publisher","first-page":"204","DOI":"10.18653\/v1\/W18-5623","author":"Zhang","year":"2018"},{"issue":"10","key":"2024092007531286200_ocae186-B23","doi-asserted-by":"publisher","first-page":"2287","DOI":"10.1093\/jamia\/ocab143","article-title":"A systematic review of automatic text summarization for biomedical literature and EHRs","volume":"28","author":"Wang","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2024092007531286200_ocae186-B24","author":"Lin"},{"key":"2024092007531286200_ocae186-B25","first-page":"311","author":"Papineni","year":"2002"},{"key":"2024092007531286200_ocae186-B26","author":"Guo"},{"key":"2024092007531286200_ocae186-B27","author":"Taylor and Francis Author Services"},{"issue":"2","key":"2024092007531286200_ocae186-B28","doi-asserted-by":"publisher","first-page":"e155","DOI":"10.3928\/24748307-20210524-01","article-title":"Lessons learned from developing plain language summaries of research studies","volume":"5","author":"Maurer","year":"2021","journal-title":"Health Lit Res Pract"},{"key":"2024092007531286200_ocae186-B29","author":"Wiley Editing Services"},{"issue":"12","key":"2024092007531286200_ocae186-B30","doi-asserted-by":"publisher","first-page":"e062981","DOI":"10.1136\/bmjopen-2022-062981","article-title":"Supporting patient and public partners in writing lay summaries of scientific evidence in healthcare: a scoping review protocol","volume":"12","author":"Zarshenas","year":"2022","journal-title":"BMJ Open"},{"issue":"3","key":"2024092007531286200_ocae186-B31","doi-asserted-by":"publisher","first-page":"201","DOI":"10.2190\/J8JJ-4YD0-4R00-G5N0","article-title":"Scientific jargon, good and bad","volume":"33","author":"Hirst","year":"2003","journal-title":"J Tech Writing Commun"},{"issue":"7","key":"2024092007531286200_ocae186-B32","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1177\/0963662519865687","article-title":"Jargon as a barrier to effective science communication: evidence from metacognition","volume":"28","author":"Bullock","year":"2019","journal-title":"Public Underst Sci"},{"key":"2024092007531286200_ocae186-B33","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1515\/9783110255522-002","volume-title":"Science Communication","author":"Hendriks","year":"2019"},{"key":"2024092007531286200_ocae186-B34","author":"Weiss","year":"2003"},{"key":"2024092007531286200_ocae186-B35","author":"Wei"},{"issue":"2","key":"2024092007531286200_ocae186-B36","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1016\/j.jbi.2008.08.010","article-title":"Research electronic data capture (REDCap)\u2014a metadata-driven methodology and workflow process for providing translational research informatics support","volume":"42","author":"Harris","year":"2009","journal-title":"J Biomed Inform"},{"key":"2024092007531286200_ocae186-B37","author":"R Core Team","year":"2021"},{"issue":"2","key":"2024092007531286200_ocae186-B38","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1111\/jch.12032","article-title":"Randomized study of antihypertensive efficacy and safety of combination aliskiren\/valsartan vs valsartan monotherapy in hypertensive participants with type 2 diabetes mellitus","volume":"15","author":"Bakris","year":"2013","journal-title":"J Clin Hypertens (Greenwich)"},{"issue":"8","key":"2024092007531286200_ocae186-B39","doi-asserted-by":"publisher","first-page":"990","DOI":"10.1037\/adb0000868","article-title":"Augmented reality for extinction of cue-provoked urges to smoke: proof of concept","volume":"36","author":"Yang","year":"2022","journal-title":"Psychol Addict Behav"},{"issue":"6","key":"2024092007531286200_ocae186-B40","doi-asserted-by":"publisher","first-page":"1470","DOI":"10.1007\/s10803-013-1992-7","article-title":"Brief report: arrested development of audiovisual speech perception in autism spectrum disorders","volume":"44","author":"Stevenson","year":"2014","journal-title":"J Autism Dev Disord"},{"issue":"4","key":"2024092007531286200_ocae186-B41","first-page":"1148","article-title":"The role of ChatGPT in scientific communication: writing better scientific review articles","volume":"13","author":"Huang","year":"2023","journal-title":"Am J Cancer Res"},{"issue":"3","key":"2024092007531286200_ocae186-B42","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1038\/s42254-024-00691-7","article-title":"Generative AI and science communication in the physical sciences","volume":"6","author":"Biyela","year":"2024","journal-title":"Nat Rev Phys"},{"key":"2024092007531286200_ocae186-B43","doi-asserted-by":"publisher","first-page":"20552076231186245","DOI":"10.1177\/20552076231186245","article-title":"Improving accessibility of scientific research by artificial intelligence\u2014an example for lay abstract generation","volume":"9","author":"Schmitz","year":"2023","journal-title":"Digit Health"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/10\/2294\/59206361\/ocae186.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/10\/2294\/59206361\/ocae186.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T07:53:36Z","timestamp":1726818816000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/10\/2294\/7713890"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,15]]},"references-count":43,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,7,15]]},"published-print":{"date-parts":[[2024,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae186","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,10]]},"published":{"date-parts":[[2024,7,15]]}}}