{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T10:48:32Z","timestamp":1779360512334,"version":"3.51.4"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2021,11]]},"abstract":"<jats:p>With the sweeping digitalization of societal, medical, industrial, and scientific processes, sensing technologies are being deployed that produce increasing volumes of time series data, thus fueling a plethora of new or improved applications. In this setting, outlier detection is frequently important, and while solutions based on neural networks exist, they leave room for improvement in terms of both accuracy and efficiency. With the objective of achieving such improvements, we propose a diversity-driven, convolutional ensemble. To improve accuracy, the ensemble employs multiple basic outlier detection models built on convolutional sequence-to-sequence autoencoders that can capture temporal dependencies in time series. Further, a novel diversity-driven training method maintains diversity among the basic models, with the aim of improving the ensemble's accuracy. To improve efficiency, the approach enables a high degree of parallelism during training. In addition, it is able to transfer some model parameters from one basic model to another, which reduces training time. We report on extensive experiments using real-world multivariate time series that offer insight into the design choices underlying the new approach and offer evidence that it is capable of improved accuracy and efficiency.<\/jats:p>","DOI":"10.14778\/3494124.3494142","type":"journal-article","created":{"date-parts":[[2022,2,5]],"date-time":"2022-02-05T00:31:46Z","timestamp":1644021106000},"page":"611-623","source":"Crossref","is-referenced-by-count":47,"title":["Unsupervised time series outlier detection with diversity-driven convolutional ensembles"],"prefix":"10.14778","volume":"15","author":[{"given":"David","family":"Campos","sequence":"first","affiliation":[{"name":"Aalborg University, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tung","family":"Kieu","sequence":"additional","affiliation":[{"name":"Aalborg University, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chenjuan","family":"Guo","sequence":"additional","affiliation":[{"name":"Aalborg University, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Feiteng","family":"Huang","sequence":"additional","affiliation":[{"name":"Huawei Cloud Database Innovation Lab, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kai","family":"Zheng","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bin","family":"Yang","sequence":"additional","affiliation":[{"name":"Aalborg University, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian S.","family":"Jensen","sequence":"additional","affiliation":[{"name":"Aalborg University, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,2,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/2436823"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/3103589"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2188395"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018054314350"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335388"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2019.107164"},{"key":"e_1_2_1_7_1","volume-title":"Turaga","author":"Chen Jinghui","year":"2017","unstructured":"Jinghui Chen , Saket Sathe , Charu C. Aggarwal , and Deepak S . Turaga . 2017 . Outlier Detection with Autoencoder Ensembles. In SDM. 90--98. Jinghui Chen, Saket Sathe, Charu C. Aggarwal, and Deepak S. Turaga. 2017. Outlier Detection with Autoencoder Ensembles. In SDM. 90--98."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3269310"},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Razvan-Gabriel Cirstea Tung Kieu Chenjuan Guo Bin Yang and Sinno Jialin Pan. 2021. EnhanceNet: Plugin Neural Networks for Enhancing Correlated Time Series Forecasting.. In ICDE. 1739--1750. Razvan-Gabriel Cirstea Tung Kieu Chenjuan Guo Bin Yang and Sinno Jialin Pan. 2021. EnhanceNet: Plugin Neural Networks for Enhancing Correlated Time Series Forecasting.. In ICDE. 1739--1750.","DOI":"10.1109\/ICDE51399.2021.00153"},{"key":"e_1_2_1_10_1","unstructured":"Razvan-Gabriel Cirstea Bin Yang and Chenjuan Guo. 2019. Graph Attention Recurrent Neural Networks for Correlated Time Series Forecasting.. In MileTS19@KDD. Razvan-Gabriel Cirstea Bin Yang and Chenjuan Guo. 2019. Graph Attention Recurrent Neural Networks for Correlated Time Series Forecasting.. In MileTS19@KDD."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305381.3305478"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"e_1_2_1_13_1","volume-title":"Michael Tschannen, Laurent Itti, and Anima Anandkumar.","author":"Furlanello Tommaso","year":"2018","unstructured":"Tommaso Furlanello , Zachary Chase Lipton , Michael Tschannen, Laurent Itti, and Anima Anandkumar. 2018 . Born-Again Neural Networks. In ICML. 1602--1611. Tommaso Furlanello, Zachary Chase Lipton, Michael Tschannen, Laurent Itti, and Anima Anandkumar. 2018. Born-Again Neural Networks. In ICML. 1602--1611."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305381.3305510"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-020-00608-7"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.184"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/646111.679466"},{"key":"e_1_2_1_18_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR. 770--778. Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR. 770--778."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455690"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-018-0494-9"},{"key":"e_1_2_1_22_1","unstructured":"Jilin Hu Bin Yang Chenjuan Guo Christian S. Jensen and Hui Xiong. 2020. Stochastic Origin-Destination Matrix Forecasting Using Dual-Stage Graph Convolutional Recurrent Neural Networks. In ICDE. 1417--1428. Jilin Hu Bin Yang Chenjuan Guo Christian S. Jensen and Hui Xiong. 2020. Stochastic Origin-Destination Matrix Forecasting Using Dual-Stage Graph Convolutional Recurrent Neural Networks. In ICDE. 1417--1428."},{"key":"e_1_2_1_23_1","unstructured":"Renjun Hu Charu C. Aggarwal Shuai Ma and Jinpeng Huai. 2016. An embedding approach to anomaly detection. In ICDE. 385--396. Renjun Hu Charu C. Aggarwal Shuai Ma and Jinpeng Huai. 2016. An embedding approach to anomaly detection. In ICDE. 385--396."},{"key":"e_1_2_1_24_1","first-page":"14","volume-title":"Weinberger","author":"Huang Gao","year":"2017","unstructured":"Gao Huang , Yixuan Li , Geoff Pleiss , Zhuang Liu , John E. Hopcroft , and Kilian Q . Weinberger . 2017 . Snapshot Ensembles : Train 1, Get M for Free. In ICLR. pp. 14 . Gao Huang, Yixuan Li, Geoff Pleiss, Zhuang Liu, John E. Hopcroft, and Kilian Q. Weinberger. 2017. Snapshot Ensembles: Train 1, Get M for Free. In ICLR. pp. 14."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219845"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271762"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/3367243.3367418"},{"key":"e_1_2_1_28_1","volume-title":"Jensen","author":"Kieu Tung","year":"2018","unstructured":"Tung Kieu , Bin Yang , and Christian S . Jensen . 2018 . Outlier Detection for Multidimensional Time Series Using Deep Neural Networks. In MDM. 125--134. Tung Kieu, Bin Yang, and Christian S. Jensen. 2018. Outlier Detection for Multidimensional Time Series Using Deep Neural Networks. In MDM. 125--134."},{"key":"e_1_2_1_29_1","first-page":"15","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba . 2015 . Adam: a Method for Stochastic Optimization. In ICLR. pp. 15 . Diederik P. Kingma and Jimmy Ba. 2015. Adam: a Method for Stochastic Optimization. In ICLR. pp. 15."},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Kim-Hung Le and Paolo Papotti. 2020. User-driven Error Detection for Time Series with Events. In ICDE. 745--757. Kim-Hung Le and Paolo Papotti. 2020. User-driven Error Detection for Time Series with Events. In ICDE. 745--757.","DOI":"10.1109\/ICDE48307.2020.00070"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_32_1","volume-title":"Kai Ming Ting, and Zhi-Hua Zhou","author":"Liu Fei Tony","year":"2008","unstructured":"Fei Tony Liu , Kai Ming Ting, and Zhi-Hua Zhou . 2008 . Isolation Forest. In ICDM. 413--422. Fei Tony Liu, Kai Ming Ting, and Zhi-Hua Zhou. 2008. Isolation Forest. In ICDM. 413--422."},{"key":"e_1_2_1_33_1","unstructured":"Huiping Liu Cheqing Jin Bin Yang and Aoying Zhou. 2018. Finding Top-k Optimal Sequenced Routes. In ICDE. 569--580. Huiping Liu Cheqing Jin Bin Yang and Aoying Zhou. 2018. Finding Top-k Optimal Sequenced Routes. In ICDE. 569--580."},{"key":"e_1_2_1_34_1","volume-title":"Manning","author":"Luong Thang","year":"2015","unstructured":"Thang Luong , Hieu Pham , and Christopher D . Manning . 2015 . Effective Approaches to Attention-based Neural Machine Translation. In EMNLP. 1412--1421. Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective Approaches to Attention-based Neural Machine Translation. In EMNLP. 1412--1421."},{"key":"e_1_2_1_35_1","volume-title":"LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection. In ICML Anomaly Detection Workshop. 5.","author":"Malhotra Pankaj","unstructured":"Pankaj Malhotra , Anusha Ramakrishnan , Gaurangi Anand , Lovekesh Vig , Puneet Agarwal , and Gautam M. Shroff . 2016 . LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection. In ICML Anomaly Detection Workshop. 5. Pankaj Malhotra, Anusha Ramakrishnan, Gaurangi Anand, Lovekesh Vig, Puneet Agarwal, and Gautam M. Shroff. 2016. LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection. In ICML Anomaly Detection Workshop. 5."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/2095931"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.14778\/3397230.3397248"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-019-00585-6"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2689746.2689747"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/3153490"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976600300015565"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/3009657.3009740"},{"key":"e_1_2_1_43_1","volume-title":"Variational Inference for On-line Anomaly Detection in High-Dimensional Time Series. CoRR abs\/1602.07109","author":"Soelch Maximilian","year":"2016","unstructured":"Maximilian Soelch , Justin Bayer , Marvin Ludersdorfer , and Patrick van der Smagt . 2016. Variational Inference for On-line Anomaly Detection in High-Dimensional Time Series. CoRR abs\/1602.07109 ( 2016 ), 4. Maximilian Soelch, Justin Bayer, Marvin Ludersdorfer, and Patrick van der Smagt. 2016. Variational Inference for On-line Anomaly Detection in High-Dimensional Time Series. CoRR abs\/1602.07109 (2016), 4."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330672"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.14778\/3425879.3425885"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Shuo Wang Huanhuan Chen and Xin Yao. 2010. Negative correlation learning for classification ensembles. In IJCNN. 1--8. Shuo Wang Huanhuan Chen and Xin Yao. 2010. Negative correlation learning for classification ensembles. In IJCNN. 1--8.","DOI":"10.1109\/IJCNN.2010.5596702"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(05)80023-1"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3185996"},{"key":"e_1_2_1_50_1","doi-asserted-by":"crossref","unstructured":"Sean Bin Yang Chenjuan Guo Jilin Hu Jian Tang and Bin Yang. 2021. Unsupervised Path Representation Learning with Curriculum Negative Sampling. In IJCAI. 3286--3292. Sean Bin Yang Chenjuan Guo Jilin Hu Jian Tang and Bin Yang. 2021. Unsupervised Path Representation Learning with Curriculum Negative Sampling. In IJCAI. 3286--3292.","DOI":"10.24963\/ijcai.2021\/452"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2020.3025024"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.14778\/3342263.3342269"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.14778\/3115404.3115410"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33011409"},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Wentao Zhang Jiawei Jiang Yingxia Shao and Bin Cui. 2020. Efficient Diversity-Driven Ensemble for Deep Neural Networks. In ICDE. 73--84. Wentao Zhang Jiawei Jiang Yingxia Shao and Bin Cui. 2020. Efficient Diversity-Driven Ensemble for Deep Neural Networks. In ICDE. 73--84.","DOI":"10.1109\/ICDE48307.2020.00014"},{"key":"e_1_2_1_56_1","volume-title":"Salcic","author":"Zhang Xuyun","year":"2017","unstructured":"Xuyun Zhang , Wan-Chun Dou , Qiang He , Rui Zhou , Christopher Leckie , Kotagiri Ramamohanarao , and Zoran A . Salcic . 2017 . LSHiForest: A Generic Framework for Fast Tree Isolation Based Ensemble Anomaly Analysis. In ICDE. 983--994. Xuyun Zhang, Wan-Chun Dou, Qiang He, Rui Zhou, Christopher Leckie, Kotagiri Ramamohanarao, and Zoran A. Salcic. 2017. LSHiForest: A Generic Framework for Fast Tree Isolation Based Ensemble Anomaly Analysis. In ICDE. 983--994."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3494124.3494142","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,17]],"date-time":"2024-09-17T22:34:53Z","timestamp":1726612493000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3494124.3494142"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11]]},"references-count":56,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,11]]}},"alternative-id":["10.14778\/3494124.3494142"],"URL":"https:\/\/doi.org\/10.14778\/3494124.3494142","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2021,11]]}}}