{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T18:06:58Z","timestamp":1789668418446,"version":"4.0.1"},"reference-count":9,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T00:00:00Z","timestamp":1789603200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosdigitalhealth.org"],"crossmark-restriction":false},"short-container-title":["PLOS Digit Health"],"abstract":"<jats:p>Despite growing interest in LLM chatbots, little evidence exists on usage patterns in hospital systems. This paper presents a mixed-methods case study of \u201cInternalGPT,\u201d a HIPAA-compliant LLM chatbot made available to employees of the institution. Survey responses and 14 months of system utilization data were analyzed across diverse professional roles in the institution. Of approximately 15,800 hospital employees, 2,149 (13.6%) requested InternalGPT access. Motivations for sign-up aligned with professional roles: operations professionals prioritized administrative automation, clinicians focused on clinical augmentation, and scientists on research and coding. Among InternalGPT users, 52.8% recorded at least one token use; 33.6% never logged-in, and 13.7% logged-in but never used the tool. The top 20% of users consumed 69.4% of tokens. Key barriers to engagement among non-users included limited time for exploration (51.4%) and difficulty using (21.8%), integrating (15.5%), or accessing (9.2%) InternalGPT. Among a small group of employees with sustained InternalGPT use (n\u2009=\u2009461), a subset who responded to a self-report survey (n\u2009=\u200992) indicated a mean productivity gain of 30%, corresponding to an exploratory perceived productivity value of $6.3M to $18.9M under varying extrapolation assumptions. Although most hospital employees never used the HIPAA-compliant LLM chatbot, a small minority who utilized it regularly reported substantial productivity improvements, highlighting both the value proposition of LLMs in healthcare and potential for increased engagement. Implementation and knowledge challenges were more frequently cited than AI-feature and performance concerns as key barriers to adoption. These findings underscore that successful LLM implementation in healthcare hinges not only on advanced AI technology, but also on robust system capacity building including investments in user education and technical integration.<\/jats:p>","DOI":"10.1371\/journal.pdig.0001684","type":"journal-article","created":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T17:32:43Z","timestamp":1789666363000},"page":"e0001684","update-policy":"https:\/\/doi.org\/10.1371\/journal.pdig.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Utilization of a HIPAA-compliant large language model chatbot in an academic pediatric medical center"],"prefix":"10.1371","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6095-0193","authenticated-orcid":true,"given":"Benjamin","family":"Rader","sequence":"first","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]},{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Department of Anesthesiology, Critical Care and Pain Medicine"]},{"name":"Harvard Medical School","place":["Boston, Massachusetts, United States of America"],"department":["Department of Anesthesia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dinesh K.","family":"Rai","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melissa L.","family":"Stewart","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Lejfer","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sampath","family":"Chennuri","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Hartwell","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victor","family":"Moyano","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-9520-9163","authenticated-orcid":true,"given":"Max H.","family":"Witwer","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter C.","family":"Laussen","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Department of Anesthesiology, Critical Care and Pain Medicine"]},{"name":"Harvard Medical School","place":["Boston, Massachusetts, United States of America"],"department":["Department of Anesthesia"]},{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Executive Vice President of Health Affairs"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heather L.","family":"Nelson","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Chief Information Officer"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John S.","family":"Brownstein","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital","place":["Boston, Massachusetts, United States of America"],"department":["Innovation & Digital Health Accelerator"]},{"name":"Harvard Medical School","place":["Boston, Massachusetts, United States of America"],"department":["Department of Pediatrics"]},{"name":"Harvard Medical School","place":["Boston, Massachusetts, United States of America"],"department":["Department of Biomedical Informatics"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,9,17]]},"reference":[{"issue":"1","key":"pdig.0001684.ref001","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1038\/s41746-025-01895-6","article-title":"Beyond human ears: navigating the uncharted risks of AI scribes in clinical practice","volume":"8","author":"M Topaz","year":"2025","journal-title":"NPJ Digit Med"},{"issue":"1","key":"pdig.0001684.ref002","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1038\/s41746-023-00958-w","article-title":"A study of generative large language model for medical research and healthcare","volume":"6","author":"C Peng","year":"2023","journal-title":"NPJ Digit Med"},{"key":"pdig.0001684.ref003","article-title":"How artificial intelligence can promote inclusive health","author":"DA Christakis","year":"2025","journal-title":"JAMA Pediatr"},{"issue":"1","key":"pdig.0001684.ref004","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1038\/s41746-025-01475-8","article-title":"Large language model agents can use tools to perform clinical calculations","volume":"8","author":"AJ Goodell","year":"2025","journal-title":"NPJ Digit Med"},{"issue":"4","key":"pdig.0001684.ref005","doi-asserted-by":"crossref","DOI":"10.1056\/AIcs2300191","article-title":"GPT-4 in a cancer center \u2014 institute-wide deployment challenges and lessons learned","volume":"1","author":"R Umeton","year":"2024","journal-title":"NEJM AI"},{"issue":"17","key":"pdig.0001684.ref006","doi-asserted-by":"crossref","first-page":"1564","DOI":"10.1056\/NEJMp2404691","article-title":"Compared with what? Measuring AI against the health care we have","volume":"391","author":"IS Kohane","year":"2024","journal-title":"N Engl J Med"},{"issue":"6654","key":"pdig.0001684.ref007","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1126\/science.adh2586","article-title":"Experimental evidence on the productivity effects of generative artificial intelligence","volume":"381","author":"S Noy","year":"2023","journal-title":"Science"},{"issue":"6","key":"pdig.0001684.ref008","doi-asserted-by":"crossref","DOI":"10.1097\/PCC.0000000000003468","article-title":"Comparing the quality of domain-specific versus general language models for artificial intelligence-generated differential diagnoses in PICU patients","volume":"25","author":"A Akhondi-Asl","year":"2024","journal-title":"Pediatr Crit Care Med"},{"issue":"8","key":"pdig.0001684.ref009","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2021-054243","article-title":"Predictors of burnout among US healthcare providers: a systematic review","volume":"12","author":"LS Meredith","year":"2022","journal-title":"BMJ Open"}],"container-title":["PLOS Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0001684","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T17:32:45Z","timestamp":1789666365000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0001684"}},"subtitle":[],"editor":[{"given":"David Fraile","family":"Navarro","sequence":"first","affiliation":[{"name":"Australian Institute of Health Innovation","place":["AUSTRALIA"]}],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,9,17]]},"references-count":9,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9,17]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pdig.0001684","relation":{},"ISSN":["2767-3170"],"issn-type":[{"value":"2767-3170","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,17]]}}}