{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T00:12:28Z","timestamp":1784679148456,"version":"3.55.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2018,7,5]],"date-time":"2018-07-05T00:00:00Z","timestamp":1530748800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"UK Engineering and Physical Sciences Research Council","doi-asserted-by":"crossref","award":["EP\/M015807\/1 and EP\/M014053\/1"],"award-info":[{"award-number":["EP\/M015807\/1 and EP\/M014053\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Research and Specialist Computing Support service at the University of East Anglia"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2018,10,31]]},"abstract":"<jats:p>A recent experimental evaluation assessed 19 time series classification (TSC) algorithms and found that one was significantly more accurate than all others: the Flat Collective of Transformation-based Ensembles (Flat-COTE). Flat-COTE is an ensemble that combines 35 classifiers over four data representations. However, while comprehensive, the evaluation did not consider deep learning approaches. Convolutional neural networks (CNN) have seen a surge in popularity and are now state of the art in many fields and raises the question of whether CNNs could be equally transformative for TSC.<\/jats:p>\n          <jats:p>We implement a benchmark CNN for TSC using a common structure and use results from a TSC-specific CNN from the literature. We compare both to Flat-COTE and find that the collective is significantly more accurate than both CNNs. These results are impressive, but Flat-COTE is not without deficiencies. We significantly improve the collective by proposing a new hierarchical structure with probabilistic voting, defining and including two novel ensemble classifiers built in existing feature spaces, and adding further modules to represent two additional transformation domains. The resulting classifier, the Hierarchical Vote Collective of Transformation-based Ensembles (HIVE-COTE), encapsulates classifiers built on five data representations. We demonstrate that HIVE-COTE is significantly more accurate than Flat-COTE (and all other TSC algorithms that we are aware of) over 100 resamples of 85 TSC problems and is the new state of the art for TSC. Further analysis is included through the introduction and evaluation of 3 new case studies and extensive experimentation on 1,000 simulated datasets of 5 different types.<\/jats:p>","DOI":"10.1145\/3182382","type":"journal-article","created":{"date-parts":[[2018,7,5]],"date-time":"2018-07-05T19:19:10Z","timestamp":1530818350000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":282,"title":["Time Series Classification with HIVE-COTE"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1496-5941","authenticated-orcid":false,"given":"Jason","family":"Lines","sequence":"first","affiliation":[{"name":"University of East Anglia, Norwich, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Taylor","sequence":"additional","affiliation":[{"name":"University of East Anglia, Norwich, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anthony","family":"Bagnall","sequence":"additional","affiliation":[{"name":"University of East Anglia, Norwich, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,7,5]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"A. Bagnall A. Bostrom J. Large and J. Lines. 2016. Simulated Data Experiments for Time Series Classification Part 1: Accuracy Comparison with Default Settings. Technical Report. School of Computing Sciences University of East Anglia.  A. Bagnall A. Bostrom J. Large and J. Lines. 2016. Simulated Data Experiments for Time Series Classification Part 1: Accuracy Comparison with Default Settings. Technical Report. School of Computing Sciences University of East Anglia."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 2012 SIAM International Conference on Data Mining","volume":"12","author":"Bagnall A.","unstructured":"A. Bagnall , L. M. Davis , J. Hills , and J. Lines . 2012. Transformation based ensembles for time series classification . In Proceedings of the 2012 SIAM International Conference on Data Mining , Vol. 12 . 307--318. A. Bagnall, L. M. Davis, J. Hills, and J. Lines. 2012. Transformation based ensembles for time series classification. In Proceedings of the 2012 SIAM International Conference on Data Mining, Vol. 12. 307--318."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00357-013-9135-6"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-016-0483-9"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2015.2416723"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-013-0312-3"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-015-0425-y"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.72"},{"key":"e_1_2_1_9_1","unstructured":"A. Benavoli G. Corani and F. Mangili. 2016. Should we really use post-hoc tests based on mean-ranks?Journal of Machine Learning Research 17 (2016) 1--10.   A. Benavoli G. Corani and F. Mangili. 2016. Should we really use post-hoc tests based on mean-ranks?Journal of Machine Learning Research 17 (2016) 1--10."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 17th International Conference on Big Data Analytics and Knowledge Discovery (DAWAK\u201915)","author":"Bostrom A.","unstructured":"A. Bostrom and A. Bagnall . 2015. Binary shapelet transform for multiclass time series classification . In Proceedings of the 17th International Conference on Big Data Analytics and Knowledge Discovery (DAWAK\u201915) . A. Bostrom and A. Bagnall. 2015. Binary shapelet transform for multiclass time series classification. In Proceedings of the 17th International Conference on Big Data Analytics and Knowledge Discovery (DAWAK\u201915)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018054314350"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2005.04.012"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.2229005"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2007.06.001"},{"key":"e_1_2_1_16_1","unstructured":"Z. Cui W. Chen and Y. Chen. 2016. Multi-scale convolutional neural networks for time series classification. arXiv:1603.06995.  Z. Cui W. Chen and Y. Chen. 2016. Multi-scale convolutional neural networks for time series classification. arXiv:1603.06995."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248548"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2013.02.030"},{"key":"e_1_2_1_19_1","first-page":"148","article-title":"Experiments with a new boosting algorithm","volume":"96","author":"Freund Y.","year":"1996","unstructured":"Y. Freund and R. Schapire . 1996 . Experiments with a new boosting algorithm . In Proceedings of ICML , Vol. 96. 148 -- 156 . Y. Freund and R. Schapire. 1996. Experiments with a new boosting algorithm. In Proceedings of ICML, Vol. 96. 148--156.","journal-title":"Proceedings of ICML"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2697065"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2316504"},{"key":"e_1_2_1_22_1","first-page":"2677","article-title":"An extension on statistical comparisons of classifiers over multiple data set for all pairwise comparisons","volume":"9","author":"Garc\u00eda S.","year":"2008","unstructured":"S. Garc\u00eda and F. Herrera . 2008 . An extension on statistical comparisons of classifiers over multiple data set for all pairwise comparisons . Journal of Machine Learning Research 9 (2008), 2677 -- 2694 . S. Garc\u00eda and F. Herrera. 2008. An extension on statistical comparisons of classifiers over multiple data set for all pairwise comparisons. Journal of Machine Learning Research 9 (2008), 2677--2694.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2014.02.011"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623613"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 6645--6649","author":"Graves A.","unstructured":"A. Graves , A. Mohamed , and G. Hinton . 2013. Speech recognition with deep recurrent neural networks . In Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 6645--6649 . A. Graves, A. Mohamed, and G. Hinton. 2013. Speech recognition with deep recurrent neural networks. In Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 6645--6649."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-013-0322-1"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2010.09.022"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"N. Kalchbrenner E. Grefenstette and P. Blunsom. 2014. A convolutional neural network for modelling sentences. arXiv:1404.2188.  N. Kalchbrenner E. Grefenstette and P. Blunsom. 2014. A convolutional neural network for modelling sentences. arXiv:1404.2188.","DOI":"10.3115\/v1\/P14-1062"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-015-0418-x"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 25th International Conference on Neural Information Processing Systems. Curran Associates, Inc., 1097--1105","author":"Krizhevsky A.","unstructured":"A. Krizhevsky , I. Sutskever , and G. Hinton . 2012. ImageNet classification with deep convolutional neural networks . In Proceedings of the 25th International Conference on Neural Information Processing Systems. Curran Associates, Inc., 1097--1105 . A. Krizhevsky, I. Sutskever, and G. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems. Curran Associates, Inc., 1097--1105."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10844-012-0196-5"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-014-0361-2"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339579"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the IEEE International Conference on Data Mining.","author":"Lines J.","unstructured":"J. Lines , S. Taylor , and A. Bagnall . 2016. HIVE-COTE: The hierarchical vote collective of transformation-based ensembles for time series classification . In Proceedings of the IEEE International Conference on Data Mining. J. Lines, S. Taylor, and A. Bagnall. 2016. HIVE-COTE: The hierarchical vote collective of transformation-based ensembles for time series classification. In Proceedings of the IEEE International Conference on Data Mining."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.76"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 5th SIAM International Conference on Data Mining (SDM\u201905)","author":"Ratanamahatana C.","unstructured":"C. Ratanamahatana and E. Keogh . 2005. Three myths about dynamic time warping data mining . In Proceedings of the 5th SIAM International Conference on Data Mining (SDM\u201905) . C. Ratanamahatana and E. Keogh. 2005. Three myths about dynamic time warping data mining. In Proceedings of the 5th SIAM International Conference on Data Mining (SDM\u201905)."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.211"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-014-0377-7"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.88"},{"key":"e_1_2_1_41_1","volume-title":"Theano: A python framework for fast computation of mathematical expressions. arXiv e-prints abs\/1605.02688.","author":"Team Theano Development","year":"2016","unstructured":"Theano Development Team . 2016 . Theano: A python framework for fast computation of mathematical expressions. arXiv e-prints abs\/1605.02688. Theano Development Team. 2016. Theano: A python framework for fast computation of mathematical expressions. arXiv e-prints abs\/1605.02688."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065716500374"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007659514849"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-010-0179-5"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3182382","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3182382","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:41:20Z","timestamp":1750282880000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3182382"}},"subtitle":["The Hierarchical Vote Collective of Transformation-Based Ensembles"],"short-title":[],"issued":{"date-parts":[[2018,7,5]]},"references-count":44,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2018,10,31]]}},"alternative-id":["10.1145\/3182382"],"URL":"https:\/\/doi.org\/10.1145\/3182382","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,5]]},"assertion":[{"value":"2017-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-07-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}