{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T03:55:10Z","timestamp":1780458910340,"version":"3.54.1"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:p>Time series forecasting, that predicts events through a sequence of time, has received increasing attention in past decades. The diverse range of time series forecasting models presents a challenge for selecting the most suitable model for a given dataset. As such, the Alibaba Cloud database monitoring system must address the issue of selecting an optimal forecasting model for a single time series data. While several model selection frameworks, including AutoAI-TS, have been developed to predict a dataset, their effectiveness may be limited as they may not adapt well to all types of time series, resulting in reduced prediction accuracy. Alternatively, models such as AutoForecast, which train on individual data points, may offer better adaptability but are limited by longer training time required.<\/jats:p>\n          <jats:p>In this paper, we introduce SimpleTS, a versatile framework for time series forecasting that exhibits high efficiency and accuracy across all types of time series data. When performing an online prediction task, SimpleTS first classifies input time series into one type, and then efficiently selects the most suitable prediction model for this type. To optimize performance, SimpleTS (i) clusters models with similar performance to improve the efficiency of classification; (ii) uses soft labeling and weighted representation learning to achieve higher classification accuracy for different time series types. Extensive experiments on 3 private datasets and 52 public datasets show that SimpleTS outperforms the state-of-the-art toolkits in terms of both training time and prediction accuracy.<\/jats:p>","DOI":"10.14778\/3611540.3611561","type":"journal-article","created":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T11:32:37Z","timestamp":1694777557000},"page":"3741-3753","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["SimpleTS: An Efficient and Universal Model Selection Framework for Time Series Forecasting"],"prefix":"10.14778","volume":"16","author":[{"given":"Yuanyuan","family":"Yao","sequence":"first","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dimeng","family":"Li","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hailiang","family":"Jie","sequence":"additional","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hailiang","family":"Jie","sequence":"additional","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tianyi","family":"Li","sequence":"additional","affiliation":[{"name":"Aalborg University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Chen","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiaqi","family":"Wang","sequence":"additional","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feifei","family":"Li","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunjun","family":"Gao","sequence":"additional","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,8]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"https:\/\/docs.aws.amazon.com\/managedservices\/latest\/userguide\/forecast.html","author":"AWS","year":"2022","unstructured":"2020. AWS Auto-ML. https:\/\/docs.aws.amazon.com\/managedservices\/latest\/userguide\/forecast.html. 2022.11.01."},{"key":"e_1_2_1_2_1","volume-title":"Exponential Smoothing ETS Algorithm. https:\/\/docs.aws.amazon.com\/forecast\/latest\/dg\/aws-forecast-recipe-ets.html","year":"2022","unstructured":"2020. Exponential Smoothing ETS Algorithm. https:\/\/docs.aws.amazon.com\/forecast\/latest\/dg\/aws-forecast-recipe-ets.html. 2022.11.01."},{"key":"e_1_2_1_3_1","volume-title":"https:\/\/ai.googleblog.com\/2020\/12\/using-automl-for-time-series-forecasting.html","author":"Google","year":"2022","unstructured":"2020. Google Auto-ML. https:\/\/ai.googleblog.com\/2020\/12\/using-automl-for-time-series-forecasting.html. 2022.11.01."},{"key":"e_1_2_1_4_1","volume-title":"https:\/\/otexts.com\/fpp2\/holt-winters.html","year":"2022","unstructured":"2020. Holt-Winters. https:\/\/otexts.com\/fpp2\/holt-winters.html. 2022.11.12."},{"key":"e_1_2_1_5_1","volume-title":"https:\/\/docs.aws.amazon.com\/forecast\/latest\/dg\/aws-forecast-recipe-npts.html","author":"NPTS.","year":"2022","unstructured":"2020. NPTS. https:\/\/docs.aws.amazon.com\/forecast\/latest\/dg\/aws-forecast-recipe-npts.html. 2022.11.01."},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Mustafa Abdallah Ryan A. Rossi Kanak Mahadik Sungchul Kim Handong Zhao and Saurabh Bagchi. 2022. AutoForecast: Automatic Time-Series Forecasting Model Selection. In CIKM Mohammad Al Hasan and Li Xiong (Eds.). 5--14.","DOI":"10.1145\/3511808.3557241"},{"key":"e_1_2_1_7_1","volume-title":"Model selection in reconciling hierarchical time series. CoRR abs\/2010.10742","author":"Abolghasemi Mahdi","year":"2020","unstructured":"Mahdi Abolghasemi, Rob J. Hyndman, Evangelos Spiliotis, and Christoph Bergmeir. 2020. Model selection in reconciling hierarchical time series. CoRR abs\/2010.10742 (2020)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Giorgio Corani Alessio Benavoli and Marco Zaffalon. 2021. Time Series Forecasting with Gaussian Processes Needs Priors. In ECML PKDD. 103--117.","DOI":"10.1007\/978-3-030-86514-6_7"},{"key":"e_1_2_1_9_1","first-page":"721","article-title":"DeepFactors: Real-Time Probabilistic Dense Monocular SLAM","volume":"5","author":"Czarnowski Jan","year":"2020","unstructured":"Jan Czarnowski, Tristan Laidlow, Ronald Clark, and Andrew J. Davison. 2020. DeepFactors: Real-Time Probabilistic Dense Monocular SLAM. IEEE 5, 2 (2020), 721--728.","journal-title":"IEEE"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/324"},{"key":"e_1_2_1_11_1","first-page":"3209","article-title":"Forecasting Big Time Series: Theory and Practice","volume":"2019","author":"Faloutsos Christos","year":"2019","unstructured":"Christos Faloutsos, Valentin Flunkert, Jan Gasthaus, Tim Januschowski, and Yuyang Wang. 2019. Forecasting Big Time Series: Theory and Practice. In KDD 2019. 3209--3210.","journal-title":"KDD"},{"key":"e_1_2_1_12_1","volume-title":"The Next Generation. CoRR abs\/2007.04074","author":"Feurer Matthias","year":"2020","unstructured":"Matthias Feurer, Katharina Eggensperger, Stefan Falkner, Marius Lindauer, and Frank Hutter. 2020. Auto-Sklearn 2.0: The Next Generation. CoRR abs\/2007.04074 (2020)."},{"key":"e_1_2_1_13_1","volume-title":"Manuel Blum, and Frank Hutter.","author":"Feurer Matthias","year":"2019","unstructured":"Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Tobias Springenberg, Manuel Blum, and Frank Hutter. 2019. Auto-sklearn: Efficient and Robust Automated Machine Learning. 113--134."},{"key":"e_1_2_1_14_1","unstructured":"Valentin Flunkert David Salinas and Jan Gasthaus. 2017. DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks. CoRR abs\/1704.04110 (2017)."},{"key":"e_1_2_1_15_1","volume-title":"SOM-VAE: Interpretable Discrete Representation Learning on Time Series. In ICLR","author":"Fortuin Vincent","year":"2019","unstructured":"Vincent Fortuin, Matthias H\u00fcser, Francesco Locatello, Heiko Strathmann, and Gunnar R\u00e4tsch. 2019. SOM-VAE: Interpretable Discrete Representation Learning on Time Series. In ICLR 2019. OpenReview.net."},{"key":"e_1_2_1_16_1","first-page":"6894","article-title":"SimCSE","volume":"2021","author":"Gao Tianyu","year":"2021","unstructured":"Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021. SimCSE: Simple Contrastive Learning of Sentence Embeddings. In EMNLP 2021. 6894--6910.","journal-title":"Simple Contrastive Learning of Sentence Embeddings. In EMNLP"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i14.17529"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/3583140.3583155"},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Xin He Kaiyong Zhao and Xiaowen Chu. 2021. AutoML: A survey of the state-of-the-art. Knowl. Based Syst. (2021) 106622.","DOI":"10.1016\/j.knosys.2020.106622"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.14778\/3494124.3494147"},{"key":"e_1_2_1_21_1","volume-title":"NIPS","author":"Hochreiter Sepp","year":"1996","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1996. LSTM can Solve Hard Long Time Lag Problems. In NIPS 1996. MIT Press, 473--479."},{"key":"e_1_2_1_22_1","volume-title":"Adaptive Stream Resource Management Using Kalman Filters","author":"Jain Ankur","unstructured":"Ankur Jain, Edward Y. Chang, and Yuan-Fang Wang. 2004. Adaptive Stream Resource Management Using Kalman Filters. In SIGMOD, Gerhard Weikum, Arnd Christian K\u00f6nig, and Stefan De\u00dfloch (Eds.). ACM, 11--22."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.14778\/3450980.3450987"},{"key":"e_1_2_1_24_1","volume-title":"Yunjun Gao, and Jilin Hu.","author":"Li Tianyi","year":"2022","unstructured":"Tianyi Li, Lu Chen, Christian S Jensen, Torben Bach Pedersen, Yunjun Gao, and Jilin Hu. 2022. Evolutionary Clustering of Moving Objects. In ICDE. IEEE, 2399--2411."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.14778\/3384345.3384353"},{"key":"e_1_2_1_26_1","volume-title":"Imminence Monitoring of Critical Events: A Representation Learning Approach. In SIGMOD '21","author":"Li Yan","year":"2021","unstructured":"Yan Li and Tingjian Ge. 2021. Imminence Monitoring of Critical Events: A Representation Learning Approach. In SIGMOD '21. 1103--1115."},{"key":"e_1_2_1_27_1","volume-title":"lightgbm. https:\/\/lightgbm.readthedocs.io\/","year":"2022","unstructured":"lightgbm. 2019. lightgbm. https:\/\/lightgbm.readthedocs.io\/. 2022.11.15."},{"key":"e_1_2_1_28_1","volume-title":"ESANN 2017","author":"Malhotra Pankaj","year":"2017","unstructured":"Pankaj Malhotra, Vishnu TV, Lovekesh Vig, Puneet Agarwal, and Gautam Shroff. 2017. TimeNet: Pre-trained deep recurrent neural network for time series classification. In ESANN 2017, Bruges, Belgium, April 26--28, 2017."},{"key":"e_1_2_1_29_1","first-page":"1","article-title":"On Model Discovery For Hosted Data Science Projects","volume":"2017","author":"Miao Hui","year":"2017","unstructured":"Hui Miao, Ang Li, Larry S. Davis, and Amol Deshpande. 2017. On Model Discovery For Hosted Data Science Projects. In SIGMOD, 2017. 6:1--6:4.","journal-title":"SIGMOD"},{"key":"e_1_2_1_30_1","volume-title":"Hinton","author":"M\u00fcller Rafael","year":"2019","unstructured":"Rafael M\u00fcller, Simon Kornblith, and Geoffrey E. Hinton. 2019. When does label smoothing help?. In NeurIPS, December 8--14, 2019, Vancouver, BC, Canada."},{"key":"e_1_2_1_31_1","volume-title":"Adaptive Deep Reuse: Accelerating CNN Training on the Fly","author":"Ning Lin","unstructured":"Lin Ning, Hui Guan, and Xipeng Shen. 2019. Adaptive Deep Reuse: Accelerating CNN Training on the Fly. In ICDE. IEEE, 1538--1549."},{"key":"e_1_2_1_32_1","unstructured":"Boris N. Oreshkin Dmitri Carpov Nicolas Chapados and Yoshua Bengio. 2020. N-BEATS: Neural basis expansion analysis for interpretable time series forecasting. OpenReview.net."},{"key":"e_1_2_1_33_1","first-page":"397","article-title":"A Ranking Stability Measure for Quantifying the Robustness of Anomaly Detection Methods","volume":"1323","author":"Perini Lorenzo","year":"2020","unstructured":"Lorenzo Perini, Connor Galvin, and Vincent Vercruyssen. 2020. A Ranking Stability Measure for Quantifying the Robustness of Anomaly Detection Methods. In ECML PKDD, Vol. 1323. 397--408.","journal-title":"ECML PKDD"},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Alireza Pooya Morteza Pakdaman and Lotfi Tadj. 2019. Exact and approximate solution for optimal inventory control of two-stock with reworking and forecasting of demand. (2019) 333--346.","DOI":"10.1007\/s12351-017-0297-6"},{"key":"e_1_2_1_35_1","volume-title":"NeurIPS","author":"Rangapuram Syama Sundar","year":"2018","unstructured":"Syama Sundar Rangapuram, Matthias W. Seeger, Jan Gasthaus, Lorenzo Stella, Yuyang Wang, and Tim Januschowski. 2018. Deep State Space Models for Time Series Forecasting. In NeurIPS 2018. 7796--7805."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3457557"},{"key":"e_1_2_1_37_1","volume-title":"Towards Benchmarking Feature Type Inference for AutoML Platforms. In SIGMOD '21","author":"Shah Vraj","year":"2021","unstructured":"Vraj Shah, Jonathan Lacanlale, Premanand Kumar, Kevin Yang, and Arun Kumar. 2021. Towards Benchmarking Feature Type Inference for AutoML Platforms. In SIGMOD '21. 1584--1596."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3319863"},{"key":"e_1_2_1_39_1","volume-title":"Automated Machine Learning: State-of-The-Art and Open Challenges. CoRR abs\/1906.02287","author":"Shawi Radwa El","year":"2019","unstructured":"Radwa El Shawi, Mohamed Maher, and Sherif Sakr. 2019. Automated Machine Learning: State-of-The-Art and Open Challenges. CoRR abs\/1906.02287 (2019)."},{"key":"e_1_2_1_40_1","volume-title":"randomforest. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.ensemble.RandomForestClassifier.html#sklearn.ensemble.RandomForestClassifier\/","year":"2022","unstructured":"sklearn. 2019. randomforest. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.ensemble.RandomForestClassifier.html#sklearn.ensemble.RandomForestClassifier\/. 2022.11.15."},{"key":"e_1_2_1_41_1","volume-title":"sklearn.knn. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.neighbors.KNeighborsClassifier.html#sklearn.neighbors.KNeighborsClassifier","year":"2022","unstructured":"sklearn. 2019. sklearn.knn. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.neighbors.KNeighborsClassifier.html#sklearn.neighbors.KNeighborsClassifier. 2022.11.15."},{"key":"e_1_2_1_42_1","volume-title":"sklearn.svm. https:\/\/scikit-learn.org\/stable\/modules\/classes.html#module-sklearn.svm","year":"2022","unstructured":"sklearn. 2019. sklearn.svm. https:\/\/scikit-learn.org\/stable\/modules\/classes.html#module-sklearn.svm. 2022.11.15."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.7287\/peerj.preprints.3190v1"},{"key":"e_1_2_1_44_1","volume-title":"Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding. In ICLR","author":"Tonekaboni Sana","year":"2021","unstructured":"Sana Tonekaboni, Danny Eytan, and Anna Goldenberg. 2021. Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding. In ICLR 2021."},{"key":"e_1_2_1_45_1","volume-title":"Reed","author":"Tran Nancy","year":"2004","unstructured":"Nancy Tran and Daniel A. Reed. 2004. Automatic ARIMA Time Series Modeling for Adaptive I\/O Prefetching. IEEE (2004), 362--377."},{"key":"e_1_2_1_46_1","volume-title":"AutoTS: Automatic Time Series Forecasting Model Design Based on Two-Stage Pruning. CoRR abs\/2203.14169","author":"Wang Chunnan","year":"2022","unstructured":"Chunnan Wang, Xingyu Chen, Chengyue Wu, and Hongzhi Wang. 2022. AutoTS: Automatic Time Series Forecasting Model Design Based on Two-Stage Pruning. CoRR abs\/2203.14169 (2022)."},{"key":"e_1_2_1_47_1","volume-title":"Dense Contrastive Learning for Self-Supervised Visual Pre-Training. In CVPR","author":"Wang Xinlong","year":"2021","unstructured":"Xinlong Wang, Rufeng Zhang, Chunhua Shen, Tao Kong, and Lei Li. 2021. Dense Contrastive Learning for Self-Supervised Visual Pre-Training. In CVPR 2021. 3024--3033."},{"key":"e_1_2_1_48_1","doi-asserted-by":"crossref","unstructured":"Qingsong Wen Kai He Liang Sun Yingying Zhang Min Ke and Huan Xu. 2021. RobustPeriod: Robust Time-Frequency Mining for Multiple Periodicity Detection. In SIGMOD. 2328--2337.","DOI":"10.1145\/3448016.3452779"},{"key":"e_1_2_1_49_1","volume-title":"Transformers in Time Series: A Survey. CoRR abs\/2202.07125","author":"Wen Qingsong","year":"2022","unstructured":"Qingsong Wen, Tian Zhou, Chaoli Zhang, Weiqi Chen, Ziqing Ma, Junchi Yan, and Liang Sun. 2022. Transformers in Time Series: A Survey. CoRR abs\/2202.07125 (2022)."},{"key":"e_1_2_1_50_1","volume-title":"xgboost. https:\/\/xgboost.ai\/about","year":"2022","unstructured":"xgboost. 2019. xgboost. https:\/\/xgboost.ai\/about. 2022.11.15."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP39728.2021.9414641"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i8.20881"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467401"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3611540.3611561","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,10]],"date-time":"2025-09-10T22:34:21Z","timestamp":1757543661000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3611540.3611561"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8]]},"references-count":53,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["10.14778\/3611540.3611561"],"URL":"https:\/\/doi.org\/10.14778\/3611540.3611561","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2023,8]]},"assertion":[{"value":"2023-08-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}