{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T04:35:03Z","timestamp":1773290103578,"version":"3.50.1"},"reference-count":45,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,10,9]],"date-time":"2023-10-09T00:00:00Z","timestamp":1696809600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000062","name":"NIDDK","doi-asserted-by":"publisher","award":["5R21DK128582-02"],"award-info":[{"award-number":["5R21DK128582-02"]}],"id":[{"id":"10.13039\/100000062","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007028","name":"The Leona M. and Harry B. Helmsley Charitable Trust","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007028","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,12,22]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Nocturnal hypoglycemia is a known challenge for people with type 1 diabetes, especially for physically active individuals or those on multiple daily injections. We developed an evidential neural network (ENN) to predict at bedtime the probability and timing of nocturnal hypoglycemia (0-4 vs 4-8\u00a0h after bedtime) based on several glucose metrics and physical activity patterns. We utilized these predictions in silico to prescribe bedtime carbohydrates with a Smart Snack intervention specific to the predicted minimum nocturnal glucose and timing of nocturnal hypoglycemia.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and methods<\/jats:title><jats:p>We leveraged free-living datasets collected from 366 individuals from the T1DEXI Study and Glooko. Inputs to the ENN used to model nocturnal hypoglycemia were derived from demographic information, continuous glucose monitoring, and physical activity data. We assessed the accuracy of the ENN using area under the receiver operating curve, and the clinical impact of the Smart Snack intervention through simulations.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The ENN achieved an area under the receiver operating curve of 0.80 and 0.71 to predict nocturnal hypoglycemic events during 0-4 and 4-8\u00a0h after bedtime, respectively, outperforming all evaluated baseline methods. Use of the Smart Snack intervention reduced probability of nocturnal hypoglycemia from 23.9\u2009\u00b1\u200914.1% to 14.0\u2009\u00b1\u200913.3% and duration from 7.4\u2009\u00b1\u20097.0% to 2.4\u2009\u00b1\u20093.3% in silico.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Our findings indicate that the ENN-based Smart Snack intervention has the potential to significantly reduce the frequency and duration of nocturnal hypoglycemic events.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>A decision support system that combines prediction of minimum nocturnal glucose and proactive recommendations for bedtime carbohydrate intake might effectively prevent nocturnal hypoglycemia and reduce the burden of glycemic self-management.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocad196","type":"journal-article","created":{"date-parts":[[2023,10,9]],"date-time":"2023-10-09T21:03:43Z","timestamp":1696885423000},"page":"109-118","source":"Crossref","is-referenced-by-count":13,"title":["Combining uncertainty-aware predictive modeling and a bedtime<i>Smart Snack<\/i>intervention to prevent nocturnal hypoglycemia in people with type 1 diabetes on multiple daily injections"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1586-2490","authenticated-orcid":false,"given":"Clara","family":"Mosquera-Lopez","sequence":"first","affiliation":[{"name":"Artificial Intelligence for Medical Systems (AIMS) Lab, Department of Biomedical Engineering, Oregon Health & Science University , Portland, OR 97239, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Valentina","family":"Roquemen-Echeverri","sequence":"additional","affiliation":[{"name":"Artificial Intelligence for Medical Systems (AIMS) Lab, Department of Biomedical Engineering, Oregon Health & Science University , Portland, OR 97239, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nichole S","family":"Tyler","sequence":"additional","affiliation":[{"name":"Artificial Intelligence for Medical Systems (AIMS) Lab, Department of Biomedical Engineering, Oregon Health & Science University , Portland, OR 97239, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susana R","family":"Patton","sequence":"additional","affiliation":[{"name":"Center for Healthcare Delivery Science, Nemours Children\u2019s Health , Jacksonville, FL 32207, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark A","family":"Clements","sequence":"additional","affiliation":[{"name":"Children\u2019s Mercy Hospital , Kansas City, MO 64111, United States"},{"name":"Glooko Inc. , Palo Alto, CA 94301, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Corby K","family":"Martin","sequence":"additional","affiliation":[{"name":"Pennington Biomedical Research Center, Louisiana State University , Baton Rouge, LA 70808, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael C","family":"Riddell","sequence":"additional","affiliation":[{"name":"Muscle Health Research Centre, York University , Toronto, ON M3J1P3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robin L","family":"Gal","sequence":"additional","affiliation":[{"name":"Jaeb Center for Health Research , Tampa, FL 33647, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Melanie","family":"Gillingham","sequence":"additional","affiliation":[{"name":"Molecular and Medical Genetics, School of Medicine, Oregon Health & Science University , Portland, OR 97239, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leah M","family":"Wilson","sequence":"additional","affiliation":[{"name":"Harold Schnitzer Diabetes Health Center, Oregon Health & Science University , Portland, OR 97239, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jessica R","family":"Castle","sequence":"additional","affiliation":[{"name":"Harold Schnitzer Diabetes Health Center, Oregon Health & Science University , Portland, OR 97239, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter G","family":"Jacobs","sequence":"additional","affiliation":[{"name":"Artificial Intelligence for Medical Systems (AIMS) Lab, Department of Biomedical Engineering, Oregon Health & Science University , Portland, OR 97239, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,10,9]]},"reference":[{"issue":"1","key":"2023122220294497600_ocad196-B1","doi-asserted-by":"crossref","first-page":"9","DOI":"10.2337\/dc13-2112","article-title":"The diabetes control and complications trial\/epidemiology of diabetes interventions and complications study at 30 years: overview","volume":"37","author":"Nathan","year":"2014","journal-title":"Diabetes Care"},{"issue":"25","key":"2023122220294497600_ocad196-B2","doi-asserted-by":"crossref","first-page":"2643","DOI":"10.1056\/NEJMoa052187","article-title":"Intensive diabetes treatment and cardiovascular disease in patients with type 1 diabetes","volume":"353","author":"Nathan","year":"2005","journal-title":"N Engl J Med"},{"issue":"5","key":"2023122220294497600_ocad196-B3","doi-asserted-by":"crossref","first-page":"584","DOI":"10.2337\/diacare.10.5.584","article-title":"Postexercise late-onset hypoglycemia in insulin-dependent diabetic patients","volume":"10","author":"MacDonald","year":"1987","journal-title":"Diabetes Care"},{"issue":"3","key":"2023122220294497600_ocad196-B4","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1210\/jc.2006-2263","article-title":"Glucose requirements to maintain euglycemia after moderate-intensity afternoon exercise in adolescents with type 1 diabetes are increased in a biphasic manner","volume":"92","author":"McMahon","year":"2007","journal-title":"J Clin Endocrinol Metab"},{"issue":"7","key":"2023122220294497600_ocad196-B5","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.2337\/diabetes.53.7.1798","article-title":"Effects of low and moderate antecedent exercise on counterregulatory responses to subsequent hypoglycemia in type 1 diabetes","volume":"53","author":"Sandoval","year":"2004","journal-title":"Diabetes"},{"issue":"6","key":"2023122220294497600_ocad196-B6","doi-asserted-by":"crossref","first-page":"E1331","DOI":"10.1152\/ajpendo.00283.2005","article-title":"Acute, same-day effects of antecedent exercise on counterregulatory responses to subsequent hypoglycemia in type 1 diabetes mellitus","volume":"290","author":"Sandoval","year":"2006","journal-title":"Am J Physiol Endocrinol Metab"},{"key":"2023122220294497600_ocad196-B7","doi-asserted-by":"crossref","first-page":"61)","DOI":"10.3389\/fendo.2015.00061","article-title":"Sexual dimorphism in glucose and lipid metabolism during fasting, hypoglycemia, and exercise","volume":"6","author":"Hedrington","year":"2015","journal-title":"Front Endocrinol (Lausanne)"},{"key":"2023122220294497600_ocad196-B8","doi-asserted-by":"crossref","first-page":"106670","DOI":"10.1016\/j.compbiomed.2023.106670","article-title":"Modeling risk of hypoglycemia during and following physical activity in people with type 1 diabetes using explainable mixed-effects machine learning","volume":"155","author":"Mosquera-Lopez","year":"2023","journal-title":"Comput Biol Med"},{"issue":"2","key":"2023122220294497600_ocad196-B9","first-page":"38","article-title":"Nocturnal hypoglycemia: answering the challenge with long-acting insulin analogs","volume":"9","author":"Brunton","year":"2007","journal-title":"Medscape Gen Med"},{"issue":"14","key":"2023122220294497600_ocad196-B10","doi-asserted-by":"crossref","first-page":"1464","DOI":"10.1056\/NEJMoa0805017","article-title":"Continuous glucose monitoring and intensive treatment of type 1 diabetes","volume":"359","author":"Juvenile Diabetes Research Foundation Continuous Glucose Monitoring Study Group","year":"2008","journal-title":"N Engl J Med"},{"issue":"S3","key":"2023122220294497600_ocad196-B11","doi-asserted-by":"crossref","first-page":"S3","DOI":"10.1089\/dia.2017.0090","article-title":"Continuous glucose monitoring with multiple daily insulin treatment: outcome studies","volume":"19","author":"McGill","year":"2017","journal-title":"Diabetes Technol Ther"},{"issue":"6","key":"2023122220294497600_ocad196-B12","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1089\/dia.2020.0589","article-title":"Less nocturnal hypoglycemia but equivalent time in range among adults with type 1 diabetes using insulin pumps versus multiple daily injections","volume":"23","author":"McAuley","year":"2021","journal-title":"Diabetes Technol Ther"},{"issue":"1","key":"2023122220294497600_ocad196-B13","doi-asserted-by":"crossref","first-page":"9","DOI":"10.2337\/diacare.26.1.9","article-title":"Impact of bedtime snack composition on prevention of nocturnal hypoglycemia in adults with type 1 diabetes undergoing intensive insulin management using lispro insulin before meals","volume":"26","author":"Kalergis","year":"2003","journal-title":"Diabetes Care"},{"issue":"1","key":"2023122220294497600_ocad196-B14","doi-asserted-by":"crossref","first-page":"e000085","DOI":"10.1136\/bmjdrc-2015-000085","article-title":"Insulin therapy and dietary adjustments to normalize glycemia and prevent nocturnal hypoglycemia after evening exercise in type 1 diabetes: a randomized controlled trial","volume":"3","author":"Campbell","year":"2015","journal-title":"BMJ Open Diabetes Res Care"},{"issue":"5","key":"2023122220294497600_ocad196-B15","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/S2213-8587(17)30014-1","article-title":"Exercise management in type 1 diabetes: a consensus statement","volume":"5","author":"Riddell","year":"2017","journal-title":"Lancet Diabetes Endocrinol"},{"issue":"6","key":"2023122220294497600_ocad196-B16","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.3390\/s20061705","article-title":"Prediction of nocturnal hypoglycemia in adults with type 1 diabetes under multiple daily injections using continuous glucose monitoring and physical activity monitor","volume":"20","author":"Bertachi","year":"2020","journal-title":"Sensors"},{"issue":"11","key":"2023122220294497600_ocad196-B17","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1089\/dia.2019.0458","article-title":"Predicting and preventing nocturnal hypoglycemia in type 1 diabetes using big data analytics and decision theoretic analysis","volume":"22","author":"Mosquera-Lopez","year":"2020","journal-title":"Diabetes Technol Ther"},{"issue":"2","key":"2023122220294497600_ocad196-B18","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1177\/1932296819868727","article-title":"Prediction of nocturnal hypoglycemia from continuous glucose monitoring data in people with type 1 diabetes: a proof-of-concept study","volume":"14","author":"Jensen","year":"2020","journal-title":"J Diabetes Sci Technol"},{"issue":"5","key":"2023122220294497600_ocad196-B19","doi-asserted-by":"crossref","first-page":"1439","DOI":"10.1109\/JBHI.2019.2938305","article-title":"Predicting quality of overnight glycaemic control in type 1 diabetes using binary classifiers","volume":"24","author":"Guemes","year":"2020","journal-title":"IEEE J Biomed Health Inform"},{"issue":"1","key":"2023122220294497600_ocad196-B20","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1111\/biom.13284","article-title":"Repeated measures random forests (RMRF): identifying factors associated with nocturnal hypoglycemia","volume":"77","author":"Calhoun","year":"2021","journal-title":"Biometrics"},{"issue":"8","key":"2023122220294497600_ocad196-B21","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.3390\/jpm12081262","article-title":"Machine learning models for nocturnal hypoglycemia prediction in hospitalized patients with type 1 diabetes","volume":"12","author":"Berikov","year":"2022","journal-title":"J Pers Med"},{"issue":"4","key":"2023122220294497600_ocad196-B22","doi-asserted-by":"crossref","first-page":"1665","DOI":"10.3390\/s22041665","article-title":"A machine learning approach to minimize nocturnal hypoglycemic events in type 1 diabetic patients under multiple doses of insulin","volume":"22","author":"Parcerisas","year":"2022","journal-title":"Sensors"},{"key":"2023122220294497600_ocad196-B23","doi-asserted-by":"crossref","first-page":"19322968231185796","DOI":"10.1177\/19322968231185796","article-title":"Development and validation of binary classifiers to predict nocturnal hypoglycemia in adults with type 1 diabetes","author":"Afentakis","year":"2023","journal-title":"J Diabetes Sci Technol"},{"issue":"2","key":"2023122220294497600_ocad196-B24","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1089\/dia.2020.0357","article-title":"Assessing mealtime macronutrient content: patient perceptions versus expert analyses via a novel phone app","volume":"23","author":"Gillingham","year":"2021","journal-title":"Diabetes Technol Ther"},{"issue":"4","key":"2023122220294497600_ocad196-B25","doi-asserted-by":"crossref","first-page":"704","DOI":"10.2337\/dc22-1721","article-title":"Examining the acute glycemic effects of different types of structured exercise sessions in type 1 diabetes in a real-world setting: the Type 1 Diabetes and Exercise Initiative (T1DEXI)","volume":"46","author":"Riddell","year":"2023","journal-title":"Diabetes Care"},{"issue":"7","key":"2023122220294497600_ocad196-B26","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1038\/nrendo.2017.3","article-title":"Metrics for glycaemic control\u2014from HbA1c to continuous glucose monitoring","volume":"13","author":"Kovatchev","year":"2017","journal-title":"Nat Rev Endocrinol"},{"issue":"1","key":"2023122220294497600_ocad196-B27","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/S2213-8587(22)00319-9","article-title":"Continuous glucose monitoring and metrics for clinical trials: an international consensus statement","volume":"11","author":"Battelino","year":"2023","journal-title":"Lancet Diabetes Endocrinol"},{"issue":"3","key":"2023122220294497600_ocad196-B28","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1093\/comjnl\/32.3.220","article-title":"Comparison of hierarchic agglomerative clustering methods for document retrieval","volume":"32","author":"Willett","year":"1989","journal-title":"Comput J"},{"key":"2023122220294497600_ocad196-B29","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","article-title":"Silhouettes: a graphical aid to the interpretation and validation of cluster analysis","volume":"20","author":"Rousseeuw","year":"1987","journal-title":"J Comput Appl Math"},{"issue":"1","key":"2023122220294497600_ocad196-B30","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the Lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J R Stat Soc Ser B Methodol"},{"issue":"2","key":"2023122220294497600_ocad196-B31","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"issue":"1","key":"2023122220294497600_ocad196-B32","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1186\/s40537-019-0274-4","article-title":"Severely imbalanced Big Data challenges: investigating data sampling approaches","volume":"6","author":"Hasanin","year":"2019","journal-title":"J Big Data"},{"issue":"9","key":"2023122220294497600_ocad196-B33","doi-asserted-by":"crossref","first-page":"1525","DOI":"10.1093\/jamia\/ocac093","article-title":"The harm of class imbalance corrections for risk prediction models: illustration and simulation using logistic regression","volume":"29","author":"Van Den Goorbergh","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2023122220294497600_ocad196-B34","volume-title":"Advances in Neural Information Processing Systems (NeurIPS 2020)","author":"Amini","year":"2020"},{"issue":"1","key":"2023122220294497600_ocad196-B35","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1109\/TBME.2022.3187703","article-title":"Personalized blood glucose prediction for type 1 diabetes using evidential deep learning and meta-learning","volume":"70","author":"Zhu","year":"2023","journal-title":"IEEE Trans Biomed Eng"},{"key":"2023122220294497600_ocad196-B36","author":"Kingma","year":"2017"},{"issue":"7","key":"2023122220294497600_ocad196-B37","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.2337\/dc18-0228","article-title":"Randomized outpatient trial of single- and dual-hormone closed-loop systems that adapt to exercise using wearable sensors","volume":"41","author":"Castle","year":"2018","journal-title":"Diabetes Care"},{"issue":"7","key":"2023122220294497600_ocad196-B38","doi-asserted-by":"crossref","first-page":"e0217301","DOI":"10.1371\/journal.pone.0217301","article-title":"A statistical virtual patient population for the glucoregulatory system in type 1 diabetes with integrated exercise model","volume":"14","author":"Resalat","year":"2019","journal-title":"PLoS One"},{"key":"2023122220294497600_ocad196-B39","volume-title":"Advances in Neural Information Processing Systems (NIPS 1996)","author":"Drucker","year":"1996"},{"key":"2023122220294497600_ocad196-B40","first-page":"785","author":"Chen","year":"2016"},{"key":"2023122220294497600_ocad196-B41","first-page":"55","author":"Nix","year":"1994"},{"key":"2023122220294497600_ocad196-B42","first-page":"1050","author":"Gal","year":"2016"},{"issue":"10","key":"2023122220294497600_ocad196-B43","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/34.58871","article-title":"Neural network ensembles","volume":"12","author":"Hansen","year":"1990","journal-title":"IEEE Trans Pattern Anal Machine Intell"},{"issue":"4","key":"2023122220294497600_ocad196-B44","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1016\/j.jpeds.2005.04.065","article-title":"Impact of exercise on overnight glycemic control in children with type 1 diabetes mellitus","volume":"147","author":"Tsalikian","year":"2005","journal-title":"J Pediatr"},{"issue":"12","key":"2023122220294497600_ocad196-B45","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1089\/dia.2022.0252","article-title":"Assessment of a decision support system for adults with type 1 diabetes on multiple daily insulin injections","volume":"24","author":"Castle","year":"2022","journal-title":"Diabetes Technol Ther"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/1\/109\/54761996\/ocad196.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/1\/109\/54761996\/ocad196.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,28]],"date-time":"2024-10-28T23:08:13Z","timestamp":1730156893000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/1\/109\/7301311"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,9]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,10,9]]},"published-print":{"date-parts":[[2023,12,22]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad196","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,10,9]]}}}