{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T01:22:49Z","timestamp":1792804969217,"version":"4.5.0"},"reference-count":36,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,6,7]],"date-time":"2021-06-07T00:00:00Z","timestamp":1623024000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100018537","name":"National Science and Technology Major Project","doi-asserted-by":"publisher","award":["2017ZX10305501-009"],"award-info":[{"award-number":["2017ZX10305501-009"]}],"id":[{"id":"10.13039\/501100018537","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Special Foundation of Basic Science and Technology Resources Survey from Ministry of Science and Technology of China","award":["2017FY101201"],"award-info":[{"award-number":["2017FY101201"]}],"id":[{"id":"https:\/\/ror.org\/02kv4zf79","id-type":"ROR","asserted-by":"crossref"}]},{"name":"the Special Foundation of Basic Science and Technology Resources Survey from Ministry of Science and Technology of China","award":["2017FY101207"],"award-info":[{"award-number":["2017FY101207"]}],"id":[{"id":"https:\/\/ror.org\/02kv4zf79","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Background: This study intends to identify the best model for predicting the incidence of hand, foot and mouth disease (HFMD) in Ningbo by comparing Autoregressive Integrated Moving Average (ARIMA) and Long Short-Term Memory Neural Network (LSTM) models combined and uncombined with exogenous meteorological variables. Methods: The data of daily HFMD incidence in Ningbo from January 2014 to November 2017 were set as the training set, and the data of December 2017 were set as the test set. ARIMA and LSTM models combined and uncombined with exogenous meteorological variables were adopted to fit the daily incidence of HFMD by using the data of the training set. The forecasting performances of the four fitted models were verified by using the data of the test set. Root mean square error (RMSE) was selected as the main measure to evaluate the performance of the models. Results: The RMSE for multivariate LSTM, univariate LSTM, ARIMA and ARIMAX (Autoregressive Integrated Moving Average Model with Exogenous Input Variables) was 10.78, 11.20, 12.43 and 14.73, respectively. The LSTM model with exogenous meteorological variables has the best performance among the four models and meteorological variables can increase the prediction accuracy of LSTM model. For the ARIMA model, exogenous meteorological variables did not increase the prediction accuracy but became the interference factor of the model. Conclusions: Multivariate LSTM is the best among the four models to fit the daily incidence of HFMD in Ningbo. It can provide a scientific method to build the HFMD early warning system and the methodology can also be applied to other communicable diseases.<\/jats:p>","DOI":"10.3390\/ijerph18116174","type":"journal-article","created":{"date-parts":[[2021,6,7]],"date-time":"2021-06-07T13:25:43Z","timestamp":1623072343000},"page":"6174","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["Comparison of ARIMA and LSTM in Forecasting the Incidence of HFMD Combined and Uncombined with Exogenous Meteorological Variables in Ningbo, China"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4859-2968","authenticated-orcid":false,"given":"Rui","family":"Zhang","sequence":"first","affiliation":[{"name":"Chinese Center for Disease Control and Prevention, Beijing 102206, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7454-0750","authenticated-orcid":false,"given":"Zhen","family":"Guo","sequence":"additional","affiliation":[{"name":"Institute of Medical Information and Library, Chinese Academy of Medical Sciences\/Peking Union Medical College, Beijing 100020, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yujie","family":"Meng","sequence":"additional","affiliation":[{"name":"Chinese Center for Disease Control and Prevention, Beijing 102206, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Songwang","family":"Wang","sequence":"additional","affiliation":[{"name":"Chinese Center for Disease Control and Prevention, Beijing 102206, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaoqiong","family":"Li","sequence":"additional","affiliation":[{"name":"Chinese Center for Disease Control and Prevention, Beijing 102206, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ran","family":"Niu","sequence":"additional","affiliation":[{"name":"National Institute for Nutrition and Health, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Wang","sequence":"additional","affiliation":[{"name":"National Institute of Environmental Health, Chinese Center for Disease Control and Prevention, Beijing 100021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qing","family":"Guo","sequence":"additional","affiliation":[{"name":"Chinese Center for Disease Control and Prevention, Beijing 102206, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5534-1644","authenticated-orcid":false,"given":"Yonghong","family":"Li","sequence":"additional","affiliation":[{"name":"National Institute of Environmental Health, Chinese Center for Disease Control and Prevention, Beijing 100021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Du, Z., Zhang, W., Zhang, D., Yu, S., and Hao, Y. (2017). Estimating the basic reproduction rate of HFMD using the time series SIR model in Guangdong, China. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0179623"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yu, L., Zhou, L., Tan, L., Jiang, H., Wang, Y., Wei, S., and Nie, S. (2014). Application of a new hybrid model with seasonal auto-regressive integrated moving average (ARIMA) and nonlinear auto-regressive neural network (NARNN) in forecasting incidence cases of HFMD in Shenzhen, China. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0098241"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bo, Y.-C., Song, C., Wang, J.-F., and Li, X.-W. (2014). Using an autologistic regression model to identify spatial risk factors and spatial risk patterns of hand, foot and mouth disease (HFMD) in Mainland China. BMC Public Health, 14.","DOI":"10.1186\/1471-2458-14-358"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2896","DOI":"10.1017\/S0950268817001820","article-title":"Association between meteorological factors and reported cases of hand, foot, and mouth disease from 2000 to 2015 in Japan","volume":"145","author":"Sumi","year":"2017","journal-title":"Epidemiol. Infect."},{"key":"ref_5","first-page":"R81","article-title":"Epidemiological, virological, and clinical features of an epidemic of hand, foot, and mouth disease in England and Wales","volume":"6","author":"Bendig","year":"1996","journal-title":"Commun. Dis. Rep. CDR Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12879-019-4457-6","article-title":"Forecasting incidence of hand, foot and mouth disease using BP neural networks in Jiangsu province, China","volume":"19","author":"Liu","year":"2019","journal-title":"BMC Infect. Dis."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"450","DOI":"10.5582\/bst.2018.01126","article-title":"Forecasting hand, foot, and mouth disease in Shenzhen based on daily level clinical data and multiple environmental factors","volume":"12","author":"Zhong","year":"2018","journal-title":"Biosci. Trends"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1017\/S0950268815001144","article-title":"Predicting the incidence of hand, foot and mouth disease in Sichuan province, China using the ARIMA model","volume":"144","author":"Liu","year":"2016","journal-title":"Epidemiol. Infect."},{"key":"ref_9","unstructured":"Cryer, J.D., and Chan, K.-S. (2010). Time Series Analysis with Applications in R, Springer."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1016\/j.jiph.2020.06.019","article-title":"Research on COVID-19 based on ARIMA model (Delta)\u2014Taking Hubei, China as an example to see the epidemic in Italy","volume":"13","author":"Yang","year":"2020","journal-title":"J. Infect. Public Health"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, Y.-W., Shen, Z.-Z., and Jiang, Y. (2018). Comparison of ARIMA and GM(1,1) models for prediction of hepatitis B in China. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0201987"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.ijid.2018.07.003","article-title":"Epidemiology and ARIMA model of positive-rate of influenza viruses among children in Wuhan, China: A nine-year retrospective study","volume":"74","author":"He","year":"2018","journal-title":"Int. J. Infect. Dis."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1017\/S0950268816003216","article-title":"Hybrid methodology for tuberculosis incidence time-series forecasting based on ARIMA and a NAR neural network","volume":"145","author":"Wang","year":"2017","journal-title":"Epidemiol. Infect."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1251","DOI":"10.1109\/JBHI.2018.2840690","article-title":"An ARIMA Model with Adaptive Orders for Predicting Blood Glucose Concentrations and Hypoglycemia","volume":"23","author":"Yang","year":"2018","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Luo, L., Luo, L., Zhang, X., and He, X. (2017). Hospital daily outpatient visits forecasting using a combinatorial model based on ARIMA and SES models. BMC Health Serv. Res., 17.","DOI":"10.1186\/s12913-017-2407-9"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kim, T., and Kim, H.Y. (2019). Forecasting stock prices with a feature fusion LSTM-CNN model using different representations of the same data. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0212320"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1109\/TASLP.2017.2758999","article-title":"Speaker-Independent Silent Speech Recognition from Flesh-Point Articulatory Movements Using an LSTM Neural Network","volume":"25","author":"Kim","year":"2017","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-54495-2","article-title":"A method for hand-foot-mouth disease prediction using GeoDetector and LSTM model in Guangxi, China","volume":"9","author":"Gu","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"110015","DOI":"10.1016\/j.chaos.2020.110015","article-title":"Comparative analysis and forecasting of COVID-19 cases in various European countries with ARIMA, NARNN and LSTM approaches","volume":"138","author":"Kirbas","year":"2020","journal-title":"Chaos Solitons Fractals"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e194","DOI":"10.1017\/S095026881900075X","article-title":"Application of a long short-term memory neural network: A burgeoning method of deep learning in forecasting HIV incidence in Guangxi, China","volume":"147","author":"Wang","year":"2019","journal-title":"Epidemiol. Infect."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1017\/S0950268818001176","article-title":"Imported cases and minimum temperature drive dengue transmission in Guangzhou, China: Evidence from ARIMAX model","volume":"146","author":"Jing","year":"2018","journal-title":"Epidemiol. Infect."},{"key":"ref_22","unstructured":"(2020, March 25). National Population and Health Science Data Sharing Platform: The Datacenter of China Public Health Science. Available online: http:\/\/www.phsciencedata.cn\/Share\/en\/index.jsp."},{"key":"ref_23","first-page":"14","article-title":"Selection of Best ARIMA Model for Forecasting Average Daily Share Price Index of Pharmaceutical Companies in Bangladesh: A Case Study on Square Pharmaceutical Ltd","volume":"13","author":"Paul","year":"2013","journal-title":"Glob. J. Manag. Bus. Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.jbi.2015.06.022","article-title":"A comparison of multivariate and univariate time series approaches to modelling and forecasting emergency department demand in Western Australia","volume":"57","author":"Mai","year":"2015","journal-title":"J. Biomed. Inform."},{"key":"ref_25","unstructured":"(2020, December 02). Introduction to ARIMA Models. Available online: https:\/\/people.duke.edu\/~rnau\/411arim.htm."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural. Comput."},{"key":"ref_27","unstructured":"(2021, January 15). Understanding LSTM Networks. Available online: https:\/\/colah.github.io\/posts\/2015-08-Understanding-LSTMs\/."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chae, S., Kwon, S., and Lee, D. (2018). Predicting Infectious Disease Using Deep Learning and Big Data. Int. J. Environ. Res. Public Health, 15.","DOI":"10.3390\/ijerph15081596"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, P., Goggins, W.B., and Chan, E.Y.Y. (2016). Hand, Foot and Mouth Disease in Hong Kong: A Time-Series Analysis on Its Relationship with Weather. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0161006"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1016\/S1474-4422(10)70209-X","article-title":"Clinical features, diagnosis, and management of enterovirus 71","volume":"9","author":"Ooi","year":"2010","journal-title":"Lancet Neurol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chang, H., Chio, C., Su, H., Liao, C., Lin, C., and Shau, W. (2012). The Association between Enterovirus 71 Infections and Meteorological Parameters in Taiwan. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0046845"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"138548","DOI":"10.1016\/j.scitotenv.2020.138548","article-title":"Quantifying the risk of hand, foot, and mouth disease (HFMD) attributable to meteorological factors in East China: A time series modelling study","volume":"728","author":"Qi","year":"2020","journal-title":"Sci. Total Environ."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"8691","DOI":"10.3390\/ijerph120808691","article-title":"The Impact of Ambient Temperature on Childhood HFMD Incidence in Inland and Coastal Area: A Two-City Study in Shandong Province, China","volume":"12","author":"Zhu","year":"2015","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1186\/s40249-018-0388-5","article-title":"Impact of meteorological factors on the incidence of childhood hand, foot, and mouth disease (HFMD) analyzed by DLNMs-based time series approach","volume":"7","author":"Qi","year":"2018","journal-title":"Infect. Dis. Poverty"},{"key":"ref_35","first-page":"5","article-title":"Daily mean temperature and HFMD: Risk assessment and attributable fraction identification in Ningbo China","volume":"2","author":"Zhang","year":"2021","journal-title":"J. Expo. Sci. Environ. Epidemiol."},{"key":"ref_36","first-page":"1","article-title":"Performance Analysis of Different Optimizers for Deep Learning-Based Image Recognition","volume":"34","author":"Postalcolu","year":"2020","journal-title":"Int. J. Pattern Recognit. Artif. Intell."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/18\/11\/6174\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:11:45Z","timestamp":1760163105000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/18\/11\/6174"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,7]]},"references-count":36,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["ijerph18116174"],"URL":"https:\/\/doi.org\/10.3390\/ijerph18116174","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,7]]}}}