{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T02:10:29Z","timestamp":1784081429307,"version":"3.55.0"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Healthc Inform Res"],"published-print":{"date-parts":[[2020,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Many factors affect blood glucose levels in type 1 diabetics, several of which vary largely both in magnitude and delay of the effect. Modern rapid-acting insulins generally have a peak time after 60\u201390 min, while carbohydrate intake can affect blood glucose levels more rapidly for high glycemic index foods, or slower for other carbohydrate sources. It is important to have good estimates of the development of glucose levels in the near future both for diabetic patients managing their insulin distribution manually, as well as for closed-loop systems making decisions about the distribution. Modern continuous glucose monitoring systems provide excellent sources of data to train machine learning models to predict future glucose levels. In this paper, we present an approach for predicting blood glucose levels for diabetics up to 1 h into the future. The approach is based on recurrent neural networks trained in an end-to-end fashion, requiring nothing but the glucose level history for the patient. Our approach obtains results that are comparable to the state of the art on the Ohio T1DM dataset for blood glucose level prediction. In addition to predicting the future glucose value, our model provides an estimate of its certainty, helping users to interpret the predicted levels. This is realized by training the recurrent neural network to parameterize a univariate Gaussian distribution over the output. The approach needs no feature engineering or data preprocessing and is computationally inexpensive. We evaluate our method using the standard root-mean-squared error (RMSE) metric, along with a blood glucose-specific metric called the surveillance error grid (SEG). We further study the properties of the distribution that is learned by the model, using experiments that determine the nature of the certainty estimate that the model is able to capture.<\/jats:p>","DOI":"10.1007\/s41666-019-00059-y","type":"journal-article","created":{"date-parts":[[2019,12,2]],"date-time":"2019-12-02T16:15:36Z","timestamp":1575303336000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":144,"title":["Blood Glucose Prediction with Variance Estimation Using Recurrent Neural Networks"],"prefix":"10.1007","volume":"4","author":[{"given":"John","family":"Martinsson","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Schliep","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bj\u00f6rn","family":"Eliasson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9567-2218","authenticated-orcid":false,"given":"Olof","family":"Mogren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,12,1]]},"reference":[{"issue":"2","key":"59_CR1","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1109\/72.279181","volume":"5","author":"Y Bengio","year":"1994","unstructured":"Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157\u2013166","journal-title":"IEEE Trans Neural Netw"},{"key":"59_CR2","unstructured":"Bertachi A, Biagi L, Contreras I, Luo N, Vehi J (2018) Prediction of blood glucose levels and nocturnal hypoglycemia using physiological models and artificial neural networks. In: 3rd International workshop on knowledge discovery in healthcare data, KDH@ ICML\/IJCAI 2018, 13 July 2018, pp 85\u201390"},{"key":"59_CR3","unstructured":"Bishop CM (1994) Mixture density networks. Tech. rep., Citeseer"},{"issue":"3","key":"59_CR4","doi-asserted-by":"publisher","first-page":"445","DOI":"10.2337\/diabetes.48.3.445","volume":"48","author":"T Bremer","year":"1999","unstructured":"Bremer T, Gough DA (1999) Is blood glucose predictable from previous values? A solicitation for data. Diabetes 48(3):445\u2013451","journal-title":"Diabetes"},{"key":"59_CR5","doi-asserted-by":"crossref","unstructured":"Bunescu R, Struble N, Marling C, Shubrook J, Schwartz F (2013) Blood glucose level prediction using physiological models and support vector regression. In: 2013 12th International conference on machine learning and applications (ICMLA), vol 1. IEEE, pp 135\u2013140","DOI":"10.1109\/ICMLA.2013.30"},{"key":"59_CR6","unstructured":"Chen J, Li K, Herrero P, Zhu T, Georgiou P (2018) Dilated recurrent neural network for short-time prediction of glucose concentration. In: 3rd International workshop on knowledge discovery in healthcare data, KDH@ ICML\/IJCAI 2018, 13 July 2018, pp 69\u201373"},{"issue":"5","key":"59_CR7","doi-asserted-by":"publisher","first-page":"622","DOI":"10.2337\/diacare.10.5.622","volume":"10","author":"WL Clarke","year":"1987","unstructured":"Clarke WL, Cox D, Gonder-Frederick LA, Carter W, Pohl SL (1987) Evaluating clinical accuracy of systems for self-monitoring of blood glucose. Diab Care 10(5):622\u2013628","journal-title":"Diab Care"},{"key":"59_CR8","unstructured":"Contreras I, Bertachi A, Biagi L, Vehi J, Oviedo S (2018) Using grammatical evolution to generate short-term blood glucose prediction models. In: 3rd International workshop on knowledge discovery in healthcare data, KDH@ ICML\/IJCAI 2018, 13 July 2018, pp 91\u201396"},{"issue":"6","key":"59_CR9","doi-asserted-by":"publisher","first-page":"1902","DOI":"10.2337\/diacare.26.6.1902","volume":"26","author":"PE Cryer","year":"2003","unstructured":"Cryer PE, Davis SN, Shamoon H (2003) Hypoglycemia in diabetes. Diab Care 26(6):1902\u20131912","journal-title":"Diab Care"},{"issue":"5","key":"59_CR10","first-page":"1281","volume":"59","author":"SD Favero","year":"2012","unstructured":"Favero SD, Facchinetti A, Cobelli C (2012) . A glucose-specific metric to assess predictors and identify models 59(5):1281\u20131290","journal-title":"A glucose-specific metric to assess predictors and identify models"},{"key":"59_CR11","unstructured":"Graves A (2013) Generating sequences with recurrent neural networks. arXiv:1308.0850"},{"issue":"02","key":"59_CR12","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1142\/S0218488598000094","volume":"6","author":"S Hochreiter","year":"1998","unstructured":"Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertain Fuzziness Knowl-Based Syst 6 (02):107\u2013116","journal-title":"Int J Uncertain Fuzziness Knowl-Based Syst"},{"issue":"8","key":"59_CR13","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"issue":"4","key":"59_CR14","doi-asserted-by":"publisher","first-page":"658","DOI":"10.1177\/1932296814539589","volume":"8","author":"DC Klonoff","year":"2014","unstructured":"Klonoff DC, Lias C, Vigersky R, Clarke W, Parkes JL, Sacks DB, Kirkman MS, Kovatchev B (2014) The error grid panel: the surveillance error grid. J Diab Sci Technol 8(4):658\u2013672. https:\/\/doi.org\/10.1177\/1932296814539589. PMID: 25562886","journal-title":"J Diab Sci Technol"},{"issue":"6","key":"59_CR15","doi-asserted-by":"publisher","first-page":"1411","DOI":"10.1177\/1932296816665635","volume":"10","author":"D Lewis","year":"2016","unstructured":"Lewis D, Leibrand S, Community O (2016) Real-world use of open source artificial pancreas systems. J Diab Sci Technol 10(6):1411\u20131411","journal-title":"J Diab Sci Technol"},{"key":"59_CR16","unstructured":"Marling C, Bunescu R (2018) The OhioT1DM dataset for blood glucose level prediction. In: The 3rd International workshop on knowledge discovery in healthcare data. Stockholm, Sweden. CEUR proceedings in press, available at http:\/\/smarthealth.cs.ohio.edu\/bglp\/OhioT1DM-dataset-paper.pdf"},{"key":"59_CR17","unstructured":"Martinsson J, Schliep A, Eliasson B, Meijner C, Persson S, Mogren O (2018) Automatic blood glucose prediction with confidence using recurrent neural networks. In: 3rd International workshop on knowledge discovery in healthcare data, KDH@ ICML\/IJCAI 2018, 13 July 2018, pp 64\u201368"},{"key":"59_CR18","unstructured":"Midroni C, Leimbigler P, Baruah G, Kolla M, Whitehead A, Fossat Y (2018) Predicting glycemia in type 1 diabetes patients: experiments with xg-boost. In: 3rd International workshop on knowledge discovery in healthcare data, KDH@ ICML\/IJCAI 2018, 13 July 2018, pp 79\u201384"},{"key":"59_CR19","doi-asserted-by":"publisher","unstructured":"Mirshekarian S, Bunescu R, Marling C, Schwartz F (2017) Using LSTMs to learn physiological models of blood glucose behavior. In: Proceedings of the annual international conference of the IEEE engineering in medicine and biology society, EMBS, pp 2887\u20132891, DOI https:\/\/doi.org\/10.1109\/EMBC.2017.8037460","DOI":"10.1109\/EMBC.2017.8037460"},{"key":"59_CR20","doi-asserted-by":"crossref","unstructured":"Mougiakakou SG, Prountzou A, Iliopoulou D, Nikita KS, Vazeou A, Bartsocas CS (2006) Neural network based glucose-insulin metabolism models for children with type 1 diabetes. In: Engineering in medicine and biology society, 2006. EMBS\u201906. 28th annual international conference of the IEEE. IEEE, pp 3545\u20133548","DOI":"10.1109\/IEMBS.2006.260640"},{"issue":"2","key":"59_CR21","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1089\/dia.2010.0104","volume":"13","author":"SM Pappada","year":"2011","unstructured":"Pappada SM, Cameron BD, Rosman PM, Bourey RE, Papadimos TJ, Olorunto W, Borst MJ (2011) Neural network-based real-time prediction of glucose in patients with insulin-dependent diabetes. Diab Technol Therapeut 13 (2):135\u2013141","journal-title":"Diab Technol Therapeut"},{"issue":"1","key":"59_CR22","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1089\/dia.2009.0076","volume":"12","author":"C P\u00e9rez-Gand\u00eda","year":"2010","unstructured":"P\u00e9rez-Gand\u00eda C, Facchinetti A, Sparacino G, Cobelli C, G\u00f3mez E, Rigla M, de Leiva A, Hernando M (2010) Artificial neural network algorithm for online glucose prediction from continuous glucose monitoring. Diab Technol Therapeut 12(1):81\u201388","journal-title":"Diab Technol Therapeut"},{"issue":"5","key":"59_CR23","doi-asserted-by":"publisher","first-page":"931","DOI":"10.1109\/TBME.2006.889774","volume":"54","author":"G Sparacino","year":"2007","unstructured":"Sparacino G, Zanderigo F, Corazza S, Maran A, Facchinetti A, Cobelli C (2007) Glucose concentration can be predicted ahead in time from continuous glucose monitoring sensor time-series. IEEE Trans Biomed Eng 54(5):931\u2013937","journal-title":"IEEE Trans Biomed Eng"},{"key":"59_CR24","unstructured":"Wiley MT (2011) Machine learning for diabetes decision support, pp 55\u201372"},{"key":"59_CR25","unstructured":"Xie J, Wang Q (2018) Benchmark machine learning approaches with classical time series approaches on the blood glucose level prediction challenge. In: 3rd International workshop on knowledge discovery in healthcare data, KDH@ ICML\/IJCAI 2018, 13 July 2018, pp 97\u2013102"},{"key":"59_CR26","doi-asserted-by":"crossref","unstructured":"Zecchin C, Facchinetti A, Sparacino G, De Nicolao G, Cobelli C (2012) Neural network incorporating meal information improves accuracy of short-time prediction of glucose concentration, (6): 1550\u20131560","DOI":"10.1109\/TBME.2012.2188893"},{"key":"59_CR27","unstructured":"Zhu T, Li K, Herrero P, Chen J, Georgiou P (2018) A deep learning algorithm for personalized blood glucose prediction. In: 3rd International workshop on knowledge discovery in healthcare data, KDH@ ICML\/IJCAI 2018, 13 July 2018, pp 64\u201378"}],"container-title":["Journal of Healthcare Informatics Research"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s41666-019-00059-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s41666-019-00059-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s41666-019-00059-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,30]],"date-time":"2020-11-30T00:13:58Z","timestamp":1606695238000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s41666-019-00059-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,1]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,3]]}},"alternative-id":["59"],"URL":"https:\/\/doi.org\/10.1007\/s41666-019-00059-y","relation":{},"ISSN":["2509-4971","2509-498X"],"issn-type":[{"value":"2509-4971","type":"print"},{"value":"2509-498X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,1]]},"assertion":[{"value":"12 December 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 April 2019","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 October 2019","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 December 2019","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of Interests"}}]}}