{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T06:53:16Z","timestamp":1791528796208,"version":"4.3.4"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T00:00:00Z","timestamp":1702944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62120106008, 62106262, 61976077, 62076085, and 91746209"],"award-info":[{"award-number":["62120106008, 62106262, 61976077, 62076085, and 91746209"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Program for Chang Jiang Scholars and Innovative Research Team in University (PCSIRT) of the Ministry of Education","award":["IRT17R32"],"award-info":[{"award-number":["IRT17R32"]}]},{"name":"Provincial Postgraduate Innovation and Entrepreneurship Project","award":["2022cxcysj020"],"award-info":[{"award-number":["2022cxcysj020"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2024,2,29]]},"abstract":"<jats:p>Time series data are ubiquitous in a variety of disciplines. Early classification of time series, which aims to predict the class label of a time series as early and accurately as possible, is a significant but challenging task in many time-sensitive applications. Existing approaches mainly utilize heuristic stopping rules to capture stopping signals from the prediction results of time series classifiers. However, heuristic stopping rules can only capture obvious stopping signals, which makes these approaches give either correct but late predictions or early but incorrect predictions. To tackle the problem, we propose a novel second-order confidence network for early classification of time series, which can automatically learn to capture implicit stopping signals in early time series in a unified framework. The proposed model leverages deep neural models to capture temporal patterns and outputs second-order confidence to reflect the implicit stopping signals. Specifically, our model exploits the data not only from a time step but also from the probability sequence to capture stopping signals. By combining stopping signals from the classifier output and the second-order confidence, we design a more robust trigger to decide whether or not to request more observations from future time steps. Experimental results show that our approach can achieve superior results in early classification compared to state-of-the-art approaches.<\/jats:p>","DOI":"10.1145\/3631531","type":"journal-article","created":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T22:18:43Z","timestamp":1698963523000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Second-order Confidence Network for Early Classification of Time Series"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2141-3325","authenticated-orcid":false,"given":"Junwei","family":"Lv","sequence":"first","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data (Hefei University of Technology), China, and Hefei University of Technology, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2953-2657","authenticated-orcid":false,"given":"Yuqi","family":"Chu","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1277-6802","authenticated-orcid":false,"given":"Jun","family":"Hu","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9142-448X","authenticated-orcid":false,"given":"Peipei","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data (Hefei University of Technology), China, and Hefei University of Technology, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5421-6171","authenticated-orcid":false,"given":"Xuegang","family":"Hu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data (Hefei University of Technology), China and Hefei University of Technology, China and Anhui Province Key Laboratory of Industry Safety and Emergency Technology, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,12,19]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-016-0483-9"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM50108.2020.00107"},{"key":"e_1_3_2_4_2","unstructured":"Yanping Chen Eamonn Keogh Bing Hu Nurjahan Begum Anthony Bagnall Abdullah Mueen and Gustavo Batista. [n.d.]. The UCR Time Series Classification Archive. http:\/\/www.cs.ucr.edu\/eamonn\/time_series_data\/"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3439870"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397850"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-020-00701-z"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330896"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/640"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-020-00710-y"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623694"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2020.3027279"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2019.2957325"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2020.2973616"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557460"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIEL.2013.6613134"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.07.056"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2019.11.060"},{"issue":"4","key":"e_1_3_2_19_2","first-page":"23:1\u201323:19","article-title":"mSIMPAD: Efficient and robust mining of successive similar patterns of multiple lengths in time series","volume":"1","author":"Li Chun-Tung","year":"2020","unstructured":"Chun-Tung Li, Jiannong Cao, Xue Liu, and Milos Stojmenovic. 2020. mSIMPAD: Efficient and robust mining of successive similar patterns of multiple lengths in time series. ACM Trans. Comput. Heal. 1, 4 (2020), 23:1\u201323:19.","journal-title":"ACM Trans. Comput. Heal."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MASS52906.2021.00014"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445033"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-18038-0_16"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2929644"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICBK.2019.00031"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData50022.2020.9378424"},{"key":"e_1_3_2_26_2","series-title":"Machine Learning and Knowledge Discovery in Databases - European Conference (ECML PKDD\u201920), Proceedings, Part I","first-page":"660","volume":"12457","author":"Middlehurst Matthew","year":"2020","unstructured":"Matthew Middlehurst, James Large, Gavin C. Cawley, and Anthony J. Bagnall. 2020. The temporal dictionary ensemble (TDE) classifier for time series classification. In Machine Learning and Knowledge Discovery in Databases - European Conference (ECML PKDD\u201920), Proceedings, Part I (Lecture Notes in Computer Science, Vol. 12457). Springer, 660\u2013676."},{"key":"e_1_3_2_27_2","series-title":"Proceedings of the 37th International Conference on Machine Learning (ICML\u201920)","first-page":"7034","volume":"119","author":"Moon Jooyoung","year":"2020","unstructured":"Jooyoung Moon, Jihyo Kim, Younghak Shin, and Sangheum Hwang. 2020. Confidence-aware learning for deep neural networks. In Proceedings of the 37th International Conference on Machine Learning (ICML\u201920) (Proceedings of Machine Learning Research, Vol. 119). PMLR, 7034\u20137044."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2764939"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-016-0462-1"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2019.04.024"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298640"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-021-00781-5"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.5555\/2567709.2627671"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1097\/CCM.0000000000004145"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(19)32989-7"},{"key":"e_1_3_2_36_2","article-title":"Early classification for agricultural monitoring from satellite time series","volume":"1908","author":"Ru\u00dfwurm Marc","year":"2019","unstructured":"Marc Ru\u00dfwurm, Romain Tavenard, S\u00e9bastien Lef\u00e8vre, and Marco K\u00f6rner. 2019. Early classification for agricultural monitoring from satellite time series. CoRR abs\/1908.10283 (2019).","journal-title":"CoRR"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-020-00690-z"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1703058"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIE.2019.2949542"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-020-00679-8"},{"key":"e_1_3_2_41_2","first-page":"5998","volume-title":"Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017. 5998\u20136008."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2017.7966039"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271794"},{"key":"e_1_3_2_44_2","first-page":"1297","volume-title":"Proceedings of the 21st International Joint Conference on Artificial Intelligence (IJCAI\u201909)","author":"Xing Zhengzheng","year":"2009","unstructured":"Zhengzheng Xing, Jian Pei, and Philip S. Yu. 2009. Early prediction on time series: A nearest neighbor approach. In Proceedings of the 21st International Joint Conference on Artificial Intelligence (IJCAI\u201909). 1297\u20131302."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-011-0400-x"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972818.22"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-020-00820-z"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-010-0179-5"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2017.66"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0179"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357822"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i8.20881"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i12.17325"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631531","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3631531","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:53Z","timestamp":1750291433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631531"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,19]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2,29]]}},"alternative-id":["10.1145\/3631531"],"URL":"https:\/\/doi.org\/10.1145\/3631531","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,19]]},"assertion":[{"value":"2022-08-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}