{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T18:04:55Z","timestamp":1784829895107,"version":"3.55.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T00:00:00Z","timestamp":1677024000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"The Business and Local Government Data Research Centre","award":["ES\/L011859\/1"],"award-info":[{"award-number":["ES\/L011859\/1"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2023,6,30]]},"abstract":"<jats:p>Time series classification has become an interesting field of research, thanks to the extensive studies conducted in the past two decades. Time series may have missing data, which may affect both the representation and also modeling of time series. Thus, recovering missing data using appropriate time series-based imputation methods is an essential step. Multiple imputation is a data recovery method where it produced multiple imputed data. The method proves its usefulness in terms of reflecting the uncertainty inherit in missing data; however, it is under-researched in time series problems. In this article, we propose two multiple imputation approaches for time series. The first is a multiple imputation method based on interpolation. The second is a multiple imputation and ensemble method. First, we simulate missing consecutive sub-sequences under a Missing Completely at Random mechanism; then, we use single\/multiple imputation methods. The imputed data are used to build bagging and stacking ensembles. We build ensembles using standard classification algorithms as well as time series classifiers. The standard classifiers involve Random Forest, Support Vector Machines, K-Nearest Neighbour, C4.5, and PART while TSCHIEF, Proximity Forest, Time Series Forest, RISE, and BOSS are chosen as time series classifiers. Our findings show that the combination of multiple imputation and ensemble improves the performance of the majority of classifiers tested in this study, often above the performance obtained from the complete data, even under increasing missing data scenarios. This may be because the diversity injected by multiple imputation has a very favourable and stabilising effect on the classifier performance, which is a very important finding.<\/jats:p>","DOI":"10.1145\/3551643","type":"journal-article","created":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T11:29:59Z","timestamp":1658834999000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Multiple Imputation Ensembles for Time Series (MIE-TS)"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9844-0327","authenticated-orcid":false,"given":"Aliya","family":"Aleryani","sequence":"first","affiliation":[{"name":"University of East Anglia, Norwich, Norfolk, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7300-6038","authenticated-orcid":false,"given":"Aaron","family":"Bostrom","sequence":"additional","affiliation":[{"name":"University of East Anglia, Norwich, Norfolk, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9372-0418","authenticated-orcid":false,"given":"Wenjia","family":"Wang","sequence":"additional","affiliation":[{"name":"University of East Anglia, Norwich, Norfolk, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2675-5826","authenticated-orcid":false,"given":"Beatriz","family":"Iglesia","sequence":"additional","affiliation":[{"name":"University of East Anglia, Norwich, Norfolk, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,2,22]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"W. Vickers A. Bagnall J. Lines and E. Keogh. 2021. The UEA & UCR Time Series Classification Repository. Retrieved from http:\/\/www.timeseriesclassification.com."},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022689900470"},{"key":"e_1_3_1_4_2","unstructured":"Aliya Aleryani. 2021. Simulation of Missing Data. Retrieved from https:\/\/github.com\/AliyaAleryani\/Simulation-of-Missing-Data.git."},{"key":"e_1_3_1_5_2","first-page":"289","volume-title":"Proceedings of the International Conference on Hybrid Artificial Intelligence Systems","author":"Aleryani Aliya","year":"2018","unstructured":"Aliya Aleryani, Wenjia Wang, and Beatriz De La Iglesia. 2018. Dealing with missing data and uncertainty in the context of data mining. In Proceedings of the International Conference on Hybrid Artificial Intelligence Systems. Springer, 289\u2013301."},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-020-00131-0"},{"key":"e_1_3_1_7_2","first-page":"2191","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Anava Oren","year":"2015","unstructured":"Oren Anava, Elad Hazan, and Assaf Zeevi. 2015. Online time series prediction with missing data. In Proceedings of the International Conference on Machine Learning. 2191\u20132199."},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.03.044"},{"key":"e_1_3_1_9_2","article-title":"The UEA multivariate time series classification archive, 2018","author":"Bagnall Anthony","year":"2018","unstructured":"Anthony Bagnall, Hoang Anh Dau, Jason Lines, Michael Flynn, James Large, Aaron Bostrom, Paul Southam, and Eamonn Keogh. 2018. The UEA multivariate time series classification archive, 2018. arXiv:1811.00075. Retrieved from https:\/\/arxiv.org\/abs\/1811.00075.","journal-title":"arXiv:1811.00075"},{"key":"e_1_3_1_10_2","unstructured":"Anthony Bagnall Michael Flynn James Large Jason Lines and Matthew Middlehurst. 2020. A tale of two toolkits report the third: on the usage and performance of HIVE-COTE v1.0. (2020). arxiv:cs.LG\/2004.06069. Retrieved from https:\/\/arxiv.org\/abs\/2004.06069."},{"key":"e_1_3_1_11_2","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1007\/s10618-016-0483-9","article-title":"The great time series classification bake off: A review and experimental evaluation of recent algorithmic advances","volume":"31","author":"Bagnall A.","year":"2017","unstructured":"A. Bagnall, J. Lines, A. Bostrom, J. Large, and E. Keogh. 2017. The great time series classification bake off: A review and experimental evaluation of recent algorithmic advances. Data Mining and Knowledge Discovery 31, 3 (2017), 606\u2013660.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-016-0483-9"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2017.03.097"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783286"},{"issue":"1","key":"e_1_3_1_15_2","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1007\/s10994-020-05923-2","article-title":"Imputation of clinical covariates in time series","volume":"110","author":"Bertsimas Dimitris","year":"2021","unstructured":"Dimitris Bertsimas, Agni Orfanoudaki, and Colin Pawlowski. 2021. Imputation of clinical covariates in time series. Machine Learning 110, 1 (2021), 185\u2013248.","journal-title":"Machine Learning"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3242053"},{"key":"e_1_3_1_17_2","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1007\/978-3-662-55608-5_2","volume-title":"Proceedings of the Transactions on Large-Scale Data-and Knowledge-Centered Systems XXXII","author":"Bostrom Aaron","year":"2017","unstructured":"Aaron Bostrom and Anthony Bagnall. 2017. Binary shapelet transform for multiclass time series classification. In Proceedings of the Transactions on Large-Scale Data-and Knowledge-Centered Systems XXXII. Springer, 24\u201346."},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_1_19_2","first-page":"1","article-title":"The truncated normal distribution","author":"Burkardt John","year":"2014","unstructured":"John Burkardt. 2014. The truncated normal distribution. Department of Scientific Computing Website, Florida State University 1 (2014), 1\u201335.","journal-title":"Department of Scientific Computing Website, Florida State University"},{"key":"e_1_3_1_20_2","first-page":"1","article-title":"mice: Multivariate imputation by chained equations in R","author":"Buuren S. van","year":"2010","unstructured":"S. van Buuren and Karin Groothuis-Oudshoorn. 2010. mice: Multivariate imputation by chained equations in R. Journal of Statistical Software 45, 3 (2010), 1\u201368.","journal-title":"Journal of Statistical Software"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-24271-9"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2013.02.030"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcm.2009.11.016"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0895-4356(03)00170-7"},{"key":"e_1_3_1_25_2","first-page":"381","volume-title":"Proceedings of the International Conference on Hybrid Artificial Intelligence Systems","author":"Flynn Michael","year":"2019","unstructured":"Michael Flynn, James Large, and Tony Bagnall. 2019. The contract random interval spectral ensemble (c-RISE): The effect of contracting a classifier on accuracy. In Proceedings of the International Conference on Hybrid Artificial Intelligence Systems. Springer, 381\u2013392."},{"key":"e_1_3_1_26_2","first-page":"144","volume-title":"Proceedings of the 15th International Conference on Machine Learning","author":"Frank Eibe","year":"1998","unstructured":"Eibe Frank and Ian H. Witten. 1998. Generating accurate rule sets without global optimization. In Proceedings of the 15th International Conference on Machine Learning, J. Shavlik (Ed.). Morgan Kaufmann, 144\u2013151."},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2009.12.010"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v031.i07"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-013-0322-1"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5907.2010.00447.x"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v045.i07"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1162\/089976601300014493"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1024988512476"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-004-0154-9"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339579"},{"key":"e_1_3_1_36_2","volume-title":"Statistical Analysis with Missing Data","author":"Little Roderick J. A.","year":"2014","unstructured":"Roderick J. A. Little and Donald B. Rubin. 2014. Statistical Analysis with Missing Data. John Wiley & Sons."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-019-00617-3"},{"key":"e_1_3_1_38_2","article-title":"truncnorm: Truncated normal distribution","author":"Mersmann Olaf","year":"2018","unstructured":"Olaf Mersmann, Heike Trautmann, Detlef Steuer, and Bjorn Bornkamp. 2018. truncnorm: Truncated normal distribution. R Package Version (2018), 1\u20130.","journal-title":"R Package Version"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.11.030"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2017.02.012"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btg287"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2004.17"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.5555\/152181"},{"key":"e_1_3_1_44_2","article-title":"Ghost imputation: Accurately reconstructing missing data of the off period","author":"Rawassizadeh Reza","year":"2019","unstructured":"Reza Rawassizadeh, Hamidreza Keshavarz, and Michael Pazzani. 2019. Ghost imputation: Accurately reconstructing missing data of the off period. IEEE Transactions on Knowledge and Data Engineering 32, 11 (2019), 2185\u20132197.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/967900.968015"},{"key":"e_1_3_1_46_2","first-page":"1","article-title":"The great multivariate time series classification bake off: A review and experimental evaluation of recent algorithmic advances","author":"Ruiz Alejandro Pasos","year":"2020","unstructured":"Alejandro Pasos Ruiz, Michael Flynn, James Large, Matthew Middlehurst, and Anthony Bagnall. 2020. The great multivariate time series classification bake off: A review and experimental evaluation of recent algorithmic advances. Data Mining and Knowledge Discovery (2020), 1\u201349.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TASSP.1978.1163055"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.7.2.147"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-014-0377-7"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132980"},{"key":"e_1_3_1_51_2","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1109\/ICIST.2014.6920359","volume-title":"Proceedings of the 2014 4th IEEE International Conference on Information Science and Technology","author":"Shao Chenxi","year":"2014","unstructured":"Chenxi Shao, Fang Fang, Fangzhou Bai, and Binghong Wang. 2014. An interpolation method combining Snurbs with window interpolation adjustment. In Proceedings of the 2014 4th IEEE International Conference on Information Science and Technology. IEEE, 176\u2013179."},{"issue":"15","key":"e_1_3_1_52_2","doi-asserted-by":"crossref","first-page":"2429","DOI":"10.1002\/sim.1519","article-title":"Last observation carry-forward and last observation analysis","volume":"22","author":"Shao Jun","year":"2003","unstructured":"Jun Shao and Bob Zhong. 2003. Last observation carry-forward and last observation analysis. Statistics in Medicine 22, 15 (2003), 2429\u20132441.","journal-title":"Statistics in Medicine"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-020-00679-8"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btr597"},{"key":"e_1_3_1_55_2","doi-asserted-by":"crossref","unstructured":"Yu-Sung Su Andrew E. Gelman Jennifer Hill and Masanao Yajima. 2011. Multiple imputation with diagnostics (mi) in R: Opening windows into the black box. 45 2 (2011) 1\u201331.","DOI":"10.18637\/jss.v045.i02"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2008.11.007"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150498"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v014.i06"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3551643","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3551643","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:26Z","timestamp":1750186826000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3551643"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,22]]},"references-count":57,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,6,30]]}},"alternative-id":["10.1145\/3551643"],"URL":"https:\/\/doi.org\/10.1145\/3551643","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,22]]},"assertion":[{"value":"2022-02-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-07-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}