{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T09:06:45Z","timestamp":1784624805429,"version":"3.55.0"},"reference-count":95,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,4,19]],"date-time":"2024-04-19T00:00:00Z","timestamp":1713484800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,19]],"date-time":"2024-04-19T00:00:00Z","timestamp":1713484800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","award":["EP\/W030756\/1"],"award-info":[{"award-number":["EP\/W030756\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","award":["EP\/W030756\/1"],"award-info":[{"award-number":["EP\/W030756\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Data Min Knowl Disc"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In 2017, a research paper\u00a0(Bagnall et al. Data Mining and Knowledge Discovery 31(3):606-660. 2017) compared 18 Time Series Classification (TSC) algorithms on 85 datasets from the University of California, Riverside (UCR) archive. This study, commonly referred to as a \u2018bake off\u2019, identified that only nine algorithms performed significantly better than the Dynamic Time Warping (DTW) and Rotation Forest benchmarks that were used. The study categorised each algorithm by the type of feature they extract from time series data, forming a taxonomy of five main algorithm types. This categorisation of algorithms alongside the provision of code and accessible results for reproducibility has helped fuel an increase in popularity of the TSC field. Over six years have passed since this bake off, the UCR archive has expanded to 112 datasets and there have been a large number of new algorithms proposed. We revisit the bake off, seeing how each of the proposed categories have advanced since the original publication, and evaluate the performance of newer algorithms against the previous best-of-category using an expanded UCR archive. We extend the taxonomy to include three new categories to reflect recent developments. Alongside the originally proposed distance, interval, shapelet, dictionary and hybrid based algorithms, we compare newer convolution and feature based algorithms as well as deep learning approaches. We introduce 30 classification datasets either recently donated to the archive or reformatted to the TSC format, and use these to further evaluate the best performing algorithm from each category. Overall, we find that two recently proposed algorithms, MultiROCKET+Hydra\u00a0(Dempster et\u00a0al. 2022) and HIVE-COTEv2\u00a0(Middlehurst et al. Mach Learn 110:3211-3243. 2021), perform significantly better than other approaches on both the current and new TSC problems.<\/jats:p>","DOI":"10.1007\/s10618-024-01022-1","type":"journal-article","created":{"date-parts":[[2024,4,19]],"date-time":"2024-04-19T06:01:20Z","timestamp":1713506480000},"page":"1958-2031","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":155,"title":["Bake off redux: a review and experimental evaluation of recent time series classification algorithms"],"prefix":"10.1007","volume":"38","author":[{"given":"Matthew","family":"Middlehurst","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick","family":"Sch\u00e4fer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anthony","family":"Bagnall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,4,19]]},"reference":[{"issue":"2","key":"1022_CR1","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1007\/s10618-018-0596-4","volume":"33","author":"A Abanda","year":"2019","unstructured":"Abanda A, Mori U, Lozano J (2019) A review on distance based time series classification. Data Mining and Knowledge Discovery 33(2):378\u2013412","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR2","doi-asserted-by":"crossref","first-page":"2522","DOI":"10.1109\/TKDE.2015.2416723","volume":"27","author":"A Bagnall","year":"2015","unstructured":"Bagnall A, Lines J, Hills J et al (2015) Time-series classification with COTE: The collective of transformation-based ensembles. IEEE Trans Knowl Data Eng 27:2522\u20132535","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"3","key":"1022_CR3","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1007\/s10618-016-0483-9","volume":"31","author":"A Bagnall","year":"2017","unstructured":"Bagnall A, Lines J, Bostrom A et al (2017) The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Mining and Knowledge Discovery 31(3):606\u2013660","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR4","unstructured":"Bagnall A, Bostrom A, Cawley G et\u00a0al (2018) Is rotation forest the best classifier for problems with continuous features? ArXiv e-prints arXiv:1809.06705"},{"key":"1022_CR5","unstructured":"Bagnall A, Flynn M, Large J et\u00a0al (2020) On the usage and performance of HIVE-COTE v1.0. In: proceedings of the 5th Workshop on Advanced Analytics and Learning on Temporal Data"},{"key":"1022_CR6","unstructured":"Bagnall A, Southam P, Large J et\u00a0al (2020) Detecting electric devices in 3d images of bags. arXiv:2005.02163"},{"issue":"2","key":"1022_CR7","doi-asserted-by":"crossref","first-page":"2793","DOI":"10.1093\/mnras\/stac1515","volume":"514","author":"NH Barbara","year":"2022","unstructured":"Barbara NH, Bedding TR, Fulcher BD et al (2022) Classifying Kepler light curves for 12000 A and F stars using supervised feature-based machine learning. Monthly Notices of the Royal Astronomical Society 514(2):2793\u20132804","journal-title":"Monthly Notices of the Royal Astronomical Society"},{"issue":"3","key":"1022_CR8","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1007\/s10618-013-0312-3","volume":"28","author":"G Batista","year":"2014","unstructured":"Batista G, Keogh E, Tataw O et al (2014) CID: an efficient complexity-invariant distance measure for time series. Data Mining and Knowledge Discovery 28(3):634\u2013669","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"2","key":"1022_CR9","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1007\/s10618-015-0425-y","volume":"30","author":"M Baydogan","year":"2016","unstructured":"Baydogan M, Runger G (2016) Time series representation and similarity based on local autopatterns. Data Mining and Knowledge Discovery 30(2):476\u2013509","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"11","key":"1022_CR10","doi-asserted-by":"crossref","first-page":"2796","DOI":"10.1109\/TPAMI.2013.72","volume":"25","author":"M Baydogan","year":"2013","unstructured":"Baydogan M, Runger G, Tuv E (2013) A bag-of-features framework to classify time series. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(11):2796\u20132802","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"1022_CR11","first-page":"1","volume":"17","author":"A Benavoli","year":"2016","unstructured":"Benavoli A, Corani G, Mangili F (2016) Should we really use post-hoc tests based on mean-ranks? J Mach Learn Res 17:1\u201310","journal-title":"J Mach Learn Res"},{"key":"1022_CR12","doi-asserted-by":"crossref","unstructured":"Benjamini Y, Yekutieli D (2001) The control of the false discovery rate in multiple testing under dependency. Annals of statistics pp 1165\u20131188","DOI":"10.1214\/aos\/1013699998"},{"key":"1022_CR13","first-page":"24","volume":"32","author":"A Bostrom","year":"2017","unstructured":"Bostrom A, Bagnall A (2017) Binary shapelet transform for multiclass time series classification. Transactions on Large-Scale Data and Knowledge Centered Systems 32:24\u201346","journal-title":"Transactions on Large-Scale Data and Knowledge Centered Systems"},{"key":"1022_CR14","unstructured":"Bostrom A, Bagnall A, Lines J (2016) Evaluating improvements to the shapelet transform. in Workshop on Mining and Learning from Time Series"},{"issue":"1","key":"1022_CR15","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Machine Learning 45(1):5\u201332","journal-title":"Machine Learning"},{"key":"1022_CR16","doi-asserted-by":"crossref","unstructured":"Cabello N, Naghizade E, Qi J, et\u00a0al (2020) Fast and accurate time series classification through supervised interval search. In: IEEE International Conference on Data Mining","DOI":"10.1109\/ICDM50108.2020.00107"},{"key":"1022_CR17","unstructured":"Cabello N, Naghizade E, Qi J, et\u00a0al (2021) Fast, accurate and interpretable time series classification through randomization. arXiv:2105.14876"},{"key":"1022_CR18","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.neucom.2018.03.067","volume":"307","author":"M Christ","year":"2018","unstructured":"Christ M, Braun N, Neuffer J et al (2018) Time series feature extraction on basis of scalable hypothesis tests (tsfresh-a python package). Neurocomputing 307:72\u201377","journal-title":"Neurocomputing"},{"issue":"6","key":"1022_CR19","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1109\/JAS.2019.1911747","volume":"6","author":"H Dau","year":"2019","unstructured":"Dau H, Bagnall A, Kamgar K et al (2019) The UCR time series archive. IEEE\/CAA Journal of Automatica Sinica 6(6):1293\u20131305","journal-title":"IEEE\/CAA Journal of Automatica Sinica"},{"key":"1022_CR20","doi-asserted-by":"crossref","first-page":"1454","DOI":"10.1007\/s10618-020-00701-z","volume":"34","author":"A Dempster","year":"2020","unstructured":"Dempster A, Petitjean F, Webb G (2020) ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernels. Data Mining and Knowledge Discovery 34:1454\u20131495","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR21","doi-asserted-by":"crossref","unstructured":"Dempster A, Schmidt D, Webb G (2021) Minirocket: A very fast (almost) deterministic transform for time series classification. In: proceedings of the 27th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","DOI":"10.1145\/3447548.3467231"},{"key":"1022_CR22","doi-asserted-by":"crossref","unstructured":"Dempster A, Schmidt DF, Webb GI (2022) HYDRA: Competing convolutional kernels for fast and accurate time series classification. arXiv:2203.13652","DOI":"10.1007\/s10618-023-00939-3"},{"key":"1022_CR23","doi-asserted-by":"crossref","unstructured":"Dempster A, Schmidt DF, Webb GI (2023) Quant: A minimalist interval method for time series classification. arXiv:2308.00928","DOI":"10.1007\/s10618-024-01036-9"},{"key":"1022_CR24","unstructured":"Dem\u0161ar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1\u201330"},{"key":"1022_CR25","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.ins.2013.02.030","volume":"239","author":"H Deng","year":"2013","unstructured":"Deng H, Runger G, Tuv E et al (2013) A time series forest for classification and feature extraction. Inf Sci 239:142\u2013153","journal-title":"Inf Sci"},{"issue":"4","key":"1022_CR26","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1007\/s10618-019-00619-1","volume":"33","author":"H Fawaz","year":"2019","unstructured":"Fawaz H, Forestier G, Weber J et al (2019) Deep learning for time series classification: a review. Data Mining and Knowledge Discovery 33(4):917\u2013963","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"6","key":"1022_CR27","doi-asserted-by":"crossref","first-page":"1936","DOI":"10.1007\/s10618-020-00710-y","volume":"34","author":"H Fawaz","year":"2020","unstructured":"Fawaz H, Lucas B, Forestier G et al (2020) InceptionTime: finding AlexNet for time series classification. Data Mining and Knowledge Discovery 34(6):1936\u20131962","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"1","key":"1022_CR28","doi-asserted-by":"crossref","first-page":"87","DOI":"10.2307\/2340521","volume":"85","author":"RA Fisher","year":"1922","unstructured":"Fisher RA (1922) On the interpretation of $$\\chi $$ 2 from contingency tables, and the calculation of p. Journal of the Royal Statistical Society 85(1):87\u201394","journal-title":"Journal of the Royal Statistical Society"},{"key":"1022_CR29","doi-asserted-by":"crossref","unstructured":"Flynn M, Bagnall A (2019) Classifying flies based on reconstructed audio signals. In: proceedings of the Intelligent Data Engineering and Automated Learning, Lecture Notes in Computer Science, vol 11872. Springer, p 249\u2013258","DOI":"10.1007\/978-3-030-33617-2_26"},{"key":"1022_CR30","doi-asserted-by":"crossref","unstructured":"Flynn M, Large J, Bagnall A (2019) The contract random interval spectral ensemble (c-RISE): The effect of contracting a classifier on accuracy. In: proceedings of the Hybrid Artificial Intelligence Systems, Lecture Notes in Computer Science, vol 11734. Springer, p 381\u2013392","DOI":"10.1007\/978-3-030-29859-3_33"},{"key":"1022_CR31","unstructured":"Foumani N, Miller L, Tan C, et\u00a0al (2023) Deep learning for time series classification and extrinsic regression: A current survey. arXiv:2302.02515"},{"key":"1022_CR32","unstructured":"Freund Y, Schapire R (1996) Experiments with a new boosting algorithm. In: Proc. International Conference on Machine Learning, pp 148\u2013156"},{"issue":"4","key":"1022_CR33","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/BF00344251","volume":"36","author":"K Fukushima","year":"1980","unstructured":"Fukushima K (1980) Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics 36(4):193\u2013202","journal-title":"Biological Cybernetics"},{"issue":"5","key":"1022_CR34","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1016\/j.cels.2017.10.001","volume":"5","author":"B Fulcher","year":"2017","unstructured":"Fulcher B, Jones N (2017) hctsa: A computational framework for automated time-series phenotyping using massive feature extraction. Cell Systems 5(5):527\u2013531","journal-title":"Cell Systems"},{"key":"1022_CR35","first-page":"2677","volume":"9","author":"S Garc\u00eda","year":"2008","unstructured":"Garc\u00eda S, Herrera F (2008) An extension on \u201cstatistical comparisons of classifiers over multiple data sets\" for all pairwise comparisons. J Mach Learn Res 9:2677\u20132694","journal-title":"J Mach Learn Res"},{"issue":"1","key":"1022_CR36","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10994-006-6226-1","volume":"63","author":"P Geurts","year":"2006","unstructured":"Geurts P, Ernst D, Wehenkel L (2006) Extremely randomised trees. Mach Learn 63(1):3\u201342","journal-title":"Mach Learn"},{"issue":"2","key":"1022_CR37","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1007\/s10618-012-0251-4","volume":"26","author":"T G\u00f3recki","year":"2013","unstructured":"G\u00f3recki T, \u0141uczak M (2013) Using derivatives in time series classification. Data Mining and Knowledge Discovery 26(2):310\u2013331","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR38","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.knosys.2014.02.011","volume":"61","author":"T G\u00f3recki","year":"2014","unstructured":"G\u00f3recki T, \u0141uczak M (2014) Non-isometric transforms in time series classification using DTW. Knowledge-Based Systems 61:98\u2013108","journal-title":"Knowledge-Based Systems"},{"key":"1022_CR39","doi-asserted-by":"crossref","unstructured":"Grabocka J, Schilling N, Wistuba M, et\u00a0al (2014) Learning time-series shapelets. In: proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","DOI":"10.1145\/2623330.2623613"},{"key":"1022_CR40","doi-asserted-by":"crossref","unstructured":"Guillaume A, Vrain C, Elloumi W (2022) Random dilated shapelet transform: A new approach for time series shapelets. In: ICPRAI","DOI":"10.1007\/978-3-031-09037-0_53"},{"key":"1022_CR41","doi-asserted-by":"crossref","unstructured":"Guti\u00e9rrez-Fragoso K, Acosta-Mesa G, Cruz-Ram\u00edrez N, Hern\u00e1ndez-Jim\u00e9nez R (2017) Optimization of classification strategies of acetowhite temporal patterns towards improving diagnostic performance of colposcopy. Computational and Mathematical Methods in Medicine 4","DOI":"10.1155\/2017\/5989105"},{"issue":"4","key":"1022_CR42","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1007\/s10618-013-0322-1","volume":"28","author":"J Hills","year":"2014","unstructured":"Hills J, Lines J, Baranauskas E et al (2014) Classification of time series by shapelet transformation. Data Mining and Knowledge Discovery 28(4):851\u2013881","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR43","doi-asserted-by":"crossref","unstructured":"Holder C, Middlehurst M, Bagnall A (2022) A review and evaluation of elastic distance functions for time series clustering. arXiv preprint arXiv:2205.15181","DOI":"10.1007\/s10115-023-01952-0"},{"key":"1022_CR44","doi-asserted-by":"crossref","unstructured":"Ismail-Fawaz A, Devanne M, Weber J, et\u00a0al (2022) Deep learning for time series classification using new hand-crafted convolution filters. In: 2022 IEEE International Conference on Big Data (Big Data), IEEE, pp 972\u2013981","DOI":"10.1109\/BigData55660.2022.10020496"},{"key":"1022_CR45","unstructured":"Ismail-Fawaz A, Dempster A, Tan CW et\u00a0al (2023) An approach to multiple comparison benchmark evaluations that is stable under manipulation of the comparate set. arXiv:2305.11921"},{"key":"1022_CR46","doi-asserted-by":"crossref","unstructured":"Ismail-Fawaz A, Devanne M, Berretti S et\u00a0al (2023) Lite: Light inception with boosting techniques for time series classification. In: 2023 IEEE 10th International Conference on Data Science and Advanced Analytics (DSAA), IEEE, pp 1\u201310","DOI":"10.1109\/DSAA60987.2023.10302569"},{"key":"1022_CR47","doi-asserted-by":"crossref","first-page":"2231","DOI":"10.1016\/j.patcog.2010.09.022","volume":"44","author":"Y Jeong","year":"2011","unstructured":"Jeong Y, Jeong M, Omitaomu O (2011) Weighted dynamic time warping for time series classification. Pattern Recognition 44:2231\u20132240","journal-title":"Pattern Recognition"},{"issue":"5","key":"1022_CR48","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1007\/s10618-016-0473-y","volume":"30","author":"I Karlsson","year":"2016","unstructured":"Karlsson I, Papapetrou P, Bostr\u00f6m H (2016) Generalized random shapelet forests. Data Mining and Knowledge Discovery 30(5):1053\u20131085","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"2","key":"1022_CR49","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1007\/s10618-015-0418-x","volume":"30","author":"R Kate","year":"2016","unstructured":"Kate R (2016) Using dynamic time warping distances as features for improved time series classification. Data Mining and Knowledge Discovery 30(2):283\u2013312","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR50","doi-asserted-by":"crossref","unstructured":"Kendall MG (1938) A new measure of rank correlation. Biometrika 30(1\/2):81\u201393","DOI":"10.1093\/biomet\/30.1-2.81"},{"issue":"5","key":"1022_CR51","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.3233\/IDA-184333","volume":"23","author":"J Large","year":"2019","unstructured":"Large J, Bagnall A, Malinowski S et al (2019) On time series classification with dictionary-based classifiers. Intelligent Data Analysis 23(5):1073\u20131089","journal-title":"Intelligent Data Analysis"},{"issue":"6","key":"1022_CR52","doi-asserted-by":"crossref","first-page":"1674","DOI":"10.1007\/s10618-019-00638-y","volume":"33","author":"J Large","year":"2019","unstructured":"Large J, Lines J, Bagnall A (2019) A probabilistic classifier ensemble weighting scheme based on cross validated accuracy estimates. Data Mining and Knowledge Discovery 33(6):1674\u20131709","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR53","doi-asserted-by":"crossref","unstructured":"Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: proceeding of the IEEE conference on computer vision and pattern recognition, IEEE, pp 2169\u20132178","DOI":"10.1109\/CVPR.2006.68"},{"issue":"2","key":"1022_CR54","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s10618-007-0064-z","volume":"15","author":"J Lin","year":"2007","unstructured":"Lin J, Keogh E, Wei L et al (2007) Experiencing SAX: a novel symbolic representation of time series. Data Mining and Knowledge Discovery 15(2):107\u2013144","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"2","key":"1022_CR55","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1007\/s10844-012-0196-5","volume":"39","author":"J Lin","year":"2012","unstructured":"Lin J, Khade R, Li Y (2012) Rotation-invariant similarity in time series using bag-of-patterns representation. Journal of Intelligent Information Systems 39(2):287\u2013315","journal-title":"Journal of Intelligent Information Systems"},{"key":"1022_CR56","doi-asserted-by":"crossref","unstructured":"Lines J, Bagnall A (2014) Ensembles of elastic distance measures for time series classification. In: proceedings of the 14th SIAM International Conference on Data Mining","DOI":"10.1137\/1.9781611973440.60"},{"key":"1022_CR57","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1007\/s10618-014-0361-2","volume":"29","author":"J Lines","year":"2015","unstructured":"Lines J, Bagnall A (2015) Time series classification with ensembles of elastic distance measures. Data Mining and Knowledge Discovery 29:565\u2013592","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"5","key":"1022_CR58","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3182382","volume":"12","author":"J Lines","year":"2018","unstructured":"Lines J, Taylor S, Bagnall A (2018) Time series classification with HIVE-COTE: The hierarchical vote collective of transformation-based ensembles. ACM Transactions Knowledge Discovery from Data 12(5):1\u201336","journal-title":"ACM Transactions Knowledge Discovery from Data"},{"issue":"6","key":"1022_CR59","doi-asserted-by":"crossref","first-page":"1821","DOI":"10.1007\/s10618-019-00647-x","volume":"33","author":"C Lubba","year":"2019","unstructured":"Lubba C, Sethi S, Knaute P et al (2019) catch22: canonical time-series characteristics. Data Mining and Knowledge Discovery 33(6):1821\u20131852","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"3","key":"1022_CR60","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1007\/s10618-019-00617-3","volume":"33","author":"B Lucas","year":"2019","unstructured":"Lucas B, Shifaz A, Pelletier C et al (2019) Proximity forest: an effective and scalable distance-based classifier for time series. Data Mining and Knowledge Discovery 33(3):607\u2013635","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR61","doi-asserted-by":"crossref","unstructured":"Mahato V, Obeidi MA, Brabazon D et\u00a0al (2020) Detecting voids in 3d printing using melt pool time series data. J Intell Manuf","DOI":"10.1007\/s10845-020-01694-8"},{"issue":"2","key":"1022_CR62","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1109\/TPAMI.2008.76","volume":"31","author":"P Marteau","year":"2009","unstructured":"Marteau P (2009) Time warp edit distance with stiffness adjustment for time series matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(2):306\u2013318","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"253","key":"1022_CR63","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1080\/01621459.1951.10500769","volume":"46","author":"FJ Massey Jr","year":"1951","unstructured":"Massey FJ Jr (1951) The kolmogorov-smirnov test for goodness of fit. Journal of the American statistical Association 46(253):68\u201378","journal-title":"Journal of the American statistical Association"},{"key":"1022_CR64","doi-asserted-by":"crossref","unstructured":"Middlehurst M, Bagnall A (2022) The freshprince: A simple transformation based pipeline time series classifier. In: International Conference on Pattern Recognition and Artificial Intelligence, Springer, pp 150\u2013161","DOI":"10.1007\/978-3-031-09282-4_13"},{"key":"1022_CR65","doi-asserted-by":"crossref","unstructured":"Middlehurst M, Bagnall A (2023) Extracting features from random subseries: A hybrid pipeline for time series classification and extrinsic regression. In: proceedings of the 8th Workshop on Advanced Analytics and Learning on Temporal Data","DOI":"10.1007\/978-3-031-49896-1_8"},{"key":"1022_CR66","doi-asserted-by":"crossref","unstructured":"Middlehurst M, Vickers W, Bagnall A (2019) Scalable dictionary classifiers for time series classification. In: proceedings of the Intelligent Data Engineering and Automated Learning, Lecture Notes in Computer Science, vol 11871. Springer, p 11\u201319","DOI":"10.1007\/978-3-030-33607-3_2"},{"key":"1022_CR67","doi-asserted-by":"crossref","unstructured":"Middlehurst M, Large J, Bagnall A (2020) The canonical interval forest (CIF) classifier for time series classification. In: IEEE International Conference on Big Data, pp 188\u2013195","DOI":"10.1109\/BigData50022.2020.9378424"},{"key":"1022_CR68","doi-asserted-by":"crossref","unstructured":"Middlehurst M, Large J, Cawley G et\u00a0al (2020) The temporal dictionary ensemble (TDE) classifier for time series classification. In: proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, pp 660\u2013676","DOI":"10.1007\/978-3-030-67658-2_38"},{"key":"1022_CR69","doi-asserted-by":"crossref","first-page":"3211","DOI":"10.1007\/s10994-021-06057-9","volume":"110","author":"M Middlehurst","year":"2021","unstructured":"Middlehurst M, Large J, Flynn M et al (2021) HIVE-COTE 2.0: a new meta ensemble for time series classification. Mach Learn 110:3211\u20133243","journal-title":"Mach Learn"},{"key":"1022_CR70","unstructured":"Morrill J, Fermanian A, Kidger P, et\u00a0al (2020) A generalised signature method for multivariate time series feature extraction. arXiv preprint arXiv:2006.00873"},{"key":"1022_CR71","doi-asserted-by":"crossref","unstructured":"Nguyen TL, Ifrim G (2022) Fast time series classification with random symbolic subsequences. In: proceedings of the 7th Workshop on Advanced Analytics and Learning on Temporal Data","DOI":"10.1007\/978-3-031-24378-3_4"},{"key":"1022_CR72","doi-asserted-by":"crossref","unstructured":"Nguyen TL, Gsponer S, Ifrim G (2017) Time series classification by sequence learning in all-subsequence space. In: proceedings of the 33rd IEEE International Conference on Data Engineering, pp 947\u2013958","DOI":"10.1109\/ICDE.2017.142"},{"issue":"4","key":"1022_CR73","doi-asserted-by":"crossref","first-page":"1183","DOI":"10.1007\/s10618-019-00633-3","volume":"33","author":"TL Nguyen","year":"2019","unstructured":"Nguyen TL, Gsponer S, Ilie I et al (2019) Interpretable time series classification using linear models and multi-resolution multi-domain symbolic representations. Data Mining and Knowledge Discovery 33(4):1183\u20131222","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR74","doi-asserted-by":"crossref","unstructured":"Oastler G, Lines J (2019) A significantly faster elastic-ensemble for time-series classification. In: proceedings of the Intelligent Data Engineering and Automated Learning, Lecture Notes in Computer Science, vol 11871. Springer, p 446\u2013453","DOI":"10.1007\/978-3-030-33607-3_48"},{"issue":"11","key":"1022_CR75","doi-asserted-by":"crossref","first-page":"1762","DOI":"10.14778\/3342263.3342648","volume":"12","author":"J Paparrizos","year":"2019","unstructured":"Paparrizos J, Franklin MJ (2019) Grail: efficient time-series representation learning. Proceedings of the VLDB Endowment 12(11):1762\u20131777","journal-title":"Proceedings of the VLDB Endowment"},{"issue":"3","key":"1022_CR76","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1023\/A:1024099825458","volume":"52","author":"F Provost","year":"2003","unstructured":"Provost F, Domingos P (2003) Tree induction for probability-based ranking. Machine Learning 52(3):199\u2013215","journal-title":"Machine Learning"},{"key":"1022_CR77","doi-asserted-by":"crossref","unstructured":"Rakthanmanon T, Keogh E (2013) Fast-shapelets: A fast algorithm for discovering robust time series shapelets. In: proceedings of the 13th SIAM International Conference on Data Mining","DOI":"10.1137\/1.9781611972832.74"},{"key":"1022_CR78","doi-asserted-by":"crossref","unstructured":"Rakthanmanon T, Bilson J, Campana L, et\u00a0al (2013) Addressing big data time series: Mining trillions of time series subsequences under dynamic time warping. ACM Transactions on Knowledge Discovery from Data 7(3)","DOI":"10.1145\/2500489"},{"issue":"10","key":"1022_CR79","doi-asserted-by":"crossref","first-page":"1619","DOI":"10.1109\/TPAMI.2006.211","volume":"28","author":"J Rodriguez","year":"2006","unstructured":"Rodriguez J, Kuncheva L, Alonso C (2006) Rotation forest: A new classifier ensemble method. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(10):1619\u20131630","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"2","key":"1022_CR80","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/s10618-020-00727-3","volume":"35","author":"AP Ruiz","year":"2021","unstructured":"Ruiz AP, Flynn M, Large J et al (2021) The great multivariate time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Mining and Knowledge Discovery 35(2):401\u2013449","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"6","key":"1022_CR81","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1007\/s10618-014-0377-7","volume":"29","author":"P Sch\u00e4fer","year":"2015","unstructured":"Sch\u00e4fer P (2015) The BOSS is concerned with time series classification in the presence of noise. Data Mining and Knowledge Discovery 29(6):1505\u20131530","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR82","doi-asserted-by":"crossref","unstructured":"Sch\u00e4fer P, H\u00f6gqvist M (2012) SFA: a symbolic Fourier approximation and index for similarity search in high dimensional datasets. In: proceedings of the 15th International Conference on Extending Database Technology, pp 516\u2013527","DOI":"10.1145\/2247596.2247656"},{"key":"1022_CR83","doi-asserted-by":"crossref","unstructured":"Sch\u00e4fer P, Leser U (2017) Fast and accurate time series classification with WEASEL. In: proceedings of the ACM Conference on Information and Knowledge Management, pp 637\u2013646","DOI":"10.1145\/3132847.3132980"},{"key":"1022_CR84","doi-asserted-by":"crossref","first-page":"4763","DOI":"10.1007\/s10994-023-06395-w","volume":"11","author":"P Sch\u00e4fer","year":"2023","unstructured":"Sch\u00e4fer P, Leser U (2023) WEASEL 2.0: a random dilated dictionary transform for fast, accurate and memory constrained time series classification. Machine Learning 11:4763\u20134788","journal-title":"Machine Learning"},{"key":"1022_CR85","doi-asserted-by":"crossref","unstructured":"Senin P, Malinchik S (2013) SAX-VSM: interpretable time series classification using sax and vector space model. In: proceedings of the 13th IEEE International Conference on Data Mining","DOI":"10.1109\/ICDM.2013.52"},{"issue":"3","key":"1022_CR86","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1007\/s10618-020-00679-8","volume":"34","author":"A Shifaz","year":"2020","unstructured":"Shifaz A, Pelletier C, Petitjean F et al (2020) TS-CHIEF: a scalable and accurate forest algorithm for time series classification. Data Mining and Knowledge Discovery 34(3):742\u2013775","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR87","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.engappai.2018.06.003","volume":"74","author":"V Souza","year":"2018","unstructured":"Souza V (2018) Asphalt pavement classification using smartphone accelerometer and complexity invariant distance. Engineering Applications of Artificial Intelligence 74:198\u2013211","journal-title":"Engineering Applications of Artificial Intelligence"},{"issue":"6","key":"1022_CR88","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1109\/TKDE.2012.88","volume":"25","author":"A Stefan","year":"2013","unstructured":"Stefan A, Athitsos V, Das G (2013) The Move-Split-Merge metric for time series. IEEE Transactions on Knowledge and Data Engineering 25(6):1425\u20131438","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"1022_CR89","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, et\u00a0al (2015) Going deeper with convolutions. In: proceeding of the IEEE Conference on Computer Vision and Pattern Recognition","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"1022_CR90","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10618-019-00653-z","volume":"34","author":"CW Tan","year":"2020","unstructured":"Tan CW, Petitjean F, Webb G (2020) FastEE: Fast ensembles of elastic distances for time series classification. Data Mining and Knowledge Discovery 34:1\u201342","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR91","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1007\/s10618-021-00745-9","volume":"35","author":"CW Tan","year":"2021","unstructured":"Tan CW, Bergmeir C, Petitjean F et al (2021) Time series extrinsic regression. Data Mining and Knowledge Discovery 35:1032\u20131060","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR92","doi-asserted-by":"crossref","first-page":"1623","DOI":"10.1007\/s10618-022-00844-1","volume":"36","author":"CW Tan","year":"2022","unstructured":"Tan CW, Dempster A, Bergmeir C et al (2022) MultiRocket: multiple pooling operators and transformations for fast and effective time series classification. Data Mining and Knowledge Discovery 36:1623\u20131646","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR93","doi-asserted-by":"crossref","unstructured":"Wang Z, Yan W, Oates T (2017) Time series classification from scratch with deep neural networks: a strong baseline. In: proceedings of the IEEE International Joint Conference on Neural Networks, pp 1578\u20131585","DOI":"10.1109\/IJCNN.2017.7966039"},{"issue":"1\u20132","key":"1022_CR94","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/s10618-010-0179-5","volume":"22","author":"L Ye","year":"2011","unstructured":"Ye L, Keogh E (2011) Time series shapelets: a novel technique that allows accurate, interpretable and fast classification. Data Mining and Knowledge Discovery 22(1\u20132):149\u2013182","journal-title":"Data Mining and Knowledge Discovery"},{"key":"1022_CR95","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.patcog.2017.09.020","volume":"74","author":"J Zhao","year":"2019","unstructured":"Zhao J, Itti L (2019) shapeDTW: Shape dynamic time warping. Pattern Recognition 74:171\u2013184","journal-title":"Pattern Recognition"}],"updated-by":[{"DOI":"10.1007\/s10618-024-01040-z","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2024,7,4]],"date-time":"2024-07-04T00:00:00Z","timestamp":1720051200000}}],"container-title":["Data Mining and Knowledge Discovery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-024-01022-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10618-024-01022-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-024-01022-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T10:37:14Z","timestamp":1722335834000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10618-024-01022-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,19]]},"references-count":95,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["1022"],"URL":"https:\/\/doi.org\/10.1007\/s10618-024-01022-1","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s10618-024-01040-z","asserted-by":"object"}]},"ISSN":["1384-5810","1573-756X"],"issn-type":[{"value":"1384-5810","type":"print"},{"value":"1573-756X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,19]]},"assertion":[{"value":"16 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2024","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s10618-024-01040-z","URL":"https:\/\/doi.org\/10.1007\/s10618-024-01040-z","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"There are no conflicts of interest\/competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest\/Competing interests"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"All data used is freely available for scientific use.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"The authors of this paper give our consent for the publication of identifiable details, which can include photograph(s) and\/or videos and\/or case history and\/or details within the text.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}