{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T10:22:08Z","timestamp":1792059728206,"version":"4.4.0"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T00:00:00Z","timestamp":1736208000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T00:00:00Z","timestamp":1736208000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National science foundation","award":["2141064"],"award-info":[{"award-number":["2141064"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Continuous glucose monitors (CGM) provide valuable insights about glycemic control that aid in diabetes management. However, interpreting metrics and charts and synthesizing them into linguistic summaries is often non-trivial for patients and providers. The advent of large language models (LLMs) has enabled real-time text generation and summarization of medical data. The objective of this study was to assess the strengths and limitations of using an LLM to analyze raw CGM data and produce summaries of 14\u00a0days of data for patients with type 1 diabetes. We first evaluated the ability of GPT-4 to compute quantitative metrics specific to diabetes found in an Ambulatory Glucose Profile (AGP). Then, using two independent clinician graders, we evaluated the accuracy, completeness, safety, and suitability of qualitative descriptions produced by GPT-4 across five different CGM analysis tasks. GPT-4 performed 9 out of the 10 quantitative metrics tasks with perfect accuracy across all 10 cases. The clinician-evaluated CGM analysis tasks had good performance across measures of accuracy [lowest task mean score 8\/10, highest task mean score 10\/10], completeness [lowest task mean score 7.5\/10, highest task mean score 10\/10], and safety [lowest task mean score 9.5\/10, highest task mean score 10\/10]. Our work serves as a preliminary study on how generative language models can be integrated into diabetes care through data summarization and, more broadly, the potential to leverage LLMs for streamlined medical time series analysis.<\/jats:p>","DOI":"10.1038\/s41598-024-84003-0","type":"journal-article","created":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T06:29:26Z","timestamp":1736231366000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["A case study on using a large language model to analyze continuous glucose monitoring data"],"prefix":"10.1038","volume":"15","author":[{"given":"Elizabeth","family":"Healey","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amelia Li Min","family":"Tan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristen L.","family":"Flint","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica L.","family":"Ruiz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isaac","family":"Kohane","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,1,7]]},"reference":[{"key":"84003_CR1","doi-asserted-by":"publisher","first-page":"383","DOI":"10.4093\/dmj.2019.0121","volume":"43","author":"G Cappon","year":"2019","unstructured":"Cappon, G., Vettoretti, M., Sparacino, G. & Facchinetti, A. Continuous glucose monitoring sensors for diabetes management: a review of technologies and applications. Diabetes Metab. J. 43, 383\u2013397 (2019).","journal-title":"Diabetes Metab. J."},{"key":"84003_CR2","doi-asserted-by":"publisher","first-page":"2076","DOI":"10.1056\/NEJMra2215899","volume":"389","author":"MS Hughes","year":"2023","unstructured":"Hughes, M. S., Addala, A. & Buckingham, B. Digital technology for diabetes. N. Engl. J. Med. 389, 2076\u20132086 (2023).","journal-title":"N. Engl. J. Med."},{"key":"84003_CR3","unstructured":"International Diabetes Center. Ambulatory Glucose Profile: AGP reports. Available from: http:\/\/www.agpreport.org\/agp\/agpreports."},{"key":"84003_CR4","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.jcjd.2023.01.001","volume":"47","author":"K Mackett","year":"2023","unstructured":"Mackett, K., Gerstein, H. & Santesso, N. Patient perspectives on the ambulatory glucose profile report for type 1 diabetes management in adults: a national online survey. Can. J. Diabetes 47, 243-249.e2 (2023).","journal-title":"Can. J. Diabetes"},{"key":"84003_CR5","doi-asserted-by":"publisher","first-page":"2458","DOI":"10.1111\/dom.13408","volume":"20","author":"R Nimri","year":"2018","unstructured":"Nimri, R. et al. Adjusting insulin doses in patients with type 1 diabetes who use insulin pump and continuous glucose monitoring: Variations among countries and physicians. Diabetes Obes. Metab. 20, 2458\u20132466 (2018).","journal-title":"Diabetes Obes. Metab."},{"key":"84003_CR6","unstructured":"Chen, S. et al. The impact of responding to patient messages with large language model assistance. arXiv e-prints arXiv:2310.17703 (2023)."},{"key":"84003_CR7","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1001\/jama.2023.8288","volume":"330","author":"Z Kanjee","year":"2023","unstructured":"Kanjee, Z., Crowe, B. & Rodman, A. Accuracy of a generative artificial intelligence model in a complex diagnostic challenge. JAMA 330, 78\u201380 (2023).","journal-title":"JAMA"},{"key":"84003_CR8","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","volume":"620","author":"K Singhal","year":"2023","unstructured":"Singhal, K. et al. Large language models encode clinical knowledge. Nature 620, 172\u2013180 (2023).","journal-title":"Nature"},{"key":"84003_CR9","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1111\/ijd.16913","volume":"63","author":"ML Elias","year":"2024","unstructured":"Elias, M. L., Burshtein, J. & Sharon, V. R. OpenAI\u2019s GPT-4 performs to a high degree on board-style dermatology questions. Int. J. Dermatol. 63, 73\u201378 (2024).","journal-title":"Int. J. Dermatol."},{"key":"84003_CR10","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1016\/j.scib.2024.01.004","volume":"69","author":"B Sheng","year":"2024","unstructured":"Sheng, B. et al. Large language models for diabetes care: potentials and prospects. Sci. Bull. (Beijing) 69, 583\u2013588 (2024).","journal-title":"Sci. Bull. (Beijing)"},{"key":"84003_CR11","doi-asserted-by":"publisher","first-page":"e2340232","DOI":"10.1001\/jamanetworkopen.2023.40232","volume":"6","author":"A Nayak","year":"2023","unstructured":"Nayak, A. et al. Use of voice-based conversational artificial intelligence for basal insulin prescription management among patients with type 2 diabetes: a randomized clinical trial. JAMA Netw. Open 6, e2340232\u2013e2340232 (2023).","journal-title":"JAMA Netw. Open"},{"key":"84003_CR12","doi-asserted-by":"publisher","unstructured":"Martinez-Cruz, C., Guerrero, J. F. G., Ruiz, J. L. L., Rueda, A. J. & Espinilla, M. 2023 A First Approach to the Generation of Linguistic Summaries from Glucose Sensors Using GPT-4. In Proceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023) 33\u201343 Springer Nature Switzerland. https:\/\/doi.org\/10.1007\/978-3-031-48642-5_4","DOI":"10.1007\/978-3-031-48642-5_4"},{"key":"84003_CR13","doi-asserted-by":"publisher","first-page":"e103","DOI":"10.2337\/dc23-0197","volume":"46","author":"GGR Sng","year":"2023","unstructured":"Sng, G. G. R., Tung, J. Y. M., Lim, D. Y. Z. & Bee, Y. M. Potential and pitfalls of ChatGPT and natural-language artificial intelligence models for diabetes education. Diabetes Care 46, e103\u2013e105 (2023).","journal-title":"Diabetes Care"},{"key":"84003_CR14","doi-asserted-by":"publisher","first-page":"1603","DOI":"10.1038\/s41467-024-45879-8","volume":"15","author":"S Tayebi Arasteh","year":"2024","unstructured":"Tayebi Arasteh, S. et al. Large language models streamline automated machine learning for clinical studies. Nat. Commun. 15, 1603 (2024).","journal-title":"Nat. Commun."},{"key":"84003_CR15","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1007\/s10439-023-03324-9","volume":"52","author":"L Wang","year":"2024","unstructured":"Wang, L., Ge, X., Liu, L. & Hu, G. Code Interpreter for bioinformatics: are we there yet?. Ann. Biomed. Eng. 52, 754\u2013756 (2024).","journal-title":"Ann. Biomed. Eng."},{"key":"84003_CR16","unstructured":"OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I. et al. GPT-4 Technical Report. arXiv [cs.CL]. 2023. Available: http:\/\/arxiv.org\/abs\/2303.08774"},{"key":"84003_CR17","unstructured":"OpenAI. Data Analyst by ChatGPT. 2024. https:\/\/chat.openai.com\/g\/g-HMNcP6w7d-data-analyst (accessed Feb 5, 2024)."},{"key":"84003_CR18","unstructured":"Jinyu Xie. Simglucose v0.2.1 (2018) [Online]. Available: https:\/\/github.com\/jxx123\/simglucose. Accessed on: 11\u201309\u20132023."},{"key":"84003_CR19","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1177\/1932296813514502","volume":"8","author":"CD Man","year":"2014","unstructured":"Man, C. D. et al. The UVA\/PADOVA Type 1 diabetes simulator: new features. J. Diabetes Sci. Technol. 8, 26\u201334 (2014).","journal-title":"J. Diabetes Sci. Technol."},{"key":"84003_CR20","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1007\/s13300-022-01229-9","volume":"13","author":"L Czupryniak","year":"2022","unstructured":"Czupryniak, L. et al. Ambulatory glucose profile (AGP) report in daily care of patients with diabetes: practical tips and recommendations. Diabetes Ther. 13, 811\u2013821 (2022).","journal-title":"Diabetes Ther."},{"key":"84003_CR21","doi-asserted-by":"publisher","first-page":"1593","DOI":"10.2337\/dci19-0028","volume":"42","author":"T Battelino","year":"2019","unstructured":"Battelino, T. et al. Clinical targets for continuous glucose monitoring data interpretation: recommendations from the international consensus on time in range. Diabetes Care 42, 1593\u20131603 (2019).","journal-title":"Diabetes Care"},{"key":"84003_CR22","doi-asserted-by":"publisher","first-page":"S97","DOI":"10.2337\/dc23-S006","volume":"46","author":"NA ElSayed","year":"2022","unstructured":"ElSayed, N. A. et al. 6. Glycemic Targets: Standards of Care in Diabetes\u20142023. Diabetes Care 46, S97\u2013S110 (2022).","journal-title":"Diabetes Care"},{"issue":"4","key":"84003_CR23","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0248560","volume":"16","author":"S Broll","year":"2021","unstructured":"Broll, S. et al. Interpreting blood glucose data with R package iglu. PloS. One 16(4), e0248560 (2021).","journal-title":"PloS. One"},{"key":"84003_CR24","unstructured":"Chun, E., Broll, S., Buchanan, D., Muschelli, J., Fernandes, N., Seo, J., Shih, J., Urbanek, J., Schwenck, J., Gaynanova, I. iglu: Interpreting Glucose Data from Continuous Glucose Monitors. R package version 3.5.0. (2023)."},{"key":"84003_CR25","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1348\/000711006X126600","volume":"61","author":"KL Gwet","year":"2008","unstructured":"Gwet, K. L. Computing inter-rater reliability and its variance in the presence of high agreement. Br. J. Math. Stat. Psychol. 61, 29\u201348 (2008).","journal-title":"Br. J. Math. Stat. Psychol."},{"key":"84003_CR26","unstructured":"Gwet, K. L. irrCAC: Computing Chance-Corrected Agreement Coefficients (CAC), R Package version 1.0. (2019)."},{"key":"84003_CR27","doi-asserted-by":"publisher","first-page":"1631","DOI":"10.2337\/dc17-1600","volume":"40","author":"T Danne","year":"2017","unstructured":"Danne, T. et al. International consensus on use of continuous glucose monitoring. Diabetes Care 40, 1631\u20131640 (2017).","journal-title":"Diabetes Care"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-024-84003-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-024-84003-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-024-84003-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T19:05:30Z","timestamp":1736276730000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-024-84003-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,7]]},"references-count":27,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["84003"],"URL":"https:\/\/doi.org\/10.1038\/s41598-024-84003-0","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.04.06.24305022","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,7]]},"assertion":[{"value":"30 August 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"E.H. is supported by the National Science Foundation Graduate Research Fellowship Program. J.R. is a Fellow in the Pediatric Scientist Development Program supported by the Cystic Fibrosis Foundation. All other authors report no conflicts of interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1143"}}