{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T03:53:56Z","timestamp":1768967636546,"version":"3.49.0"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,1,23]],"date-time":"2019-01-23T00:00:00Z","timestamp":1548201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"MOE project of Humanities and Social Science","award":["18YJCZH072"],"award-info":[{"award-number":["18YJCZH072"]}]},{"name":"Academic Team Building Plan for Young Scholars fromWuhan University","award":["Whu2016012"],"award-info":[{"award-number":["Whu2016012"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["1203-410500077\/413000031"],"award-info":[{"award-number":["1203-410500077\/413000031"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Research Foundation Singapore under its AI Singapore","award":["AISG-RP-2018-001"],"award-info":[{"award-number":["AISG-RP-2018-001"]}]},{"name":"NRF Prime Minister?s Office, Singapore under its International Research Centres in Singapore Funding Initiative"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2019,2,28]]},"abstract":"<jats:p>Kernel-based regression represents an important family of learning techniques for solving challenging regression tasks with non-linear patterns. Despite being studied extensively, most of the existing work suffers from two major drawbacks as follows: (i) they are often designed for solving regression tasks in a batch learning setting, making them not only computationally inefficient and but also poorly scalable in real-world applications where data arrives sequentially; and (ii) they usually assume that a fixed kernel function is given prior to the learning task, which could result in poor performance if the chosen kernel is inappropriate. To overcome these drawbacks, this work presents a novel scheme of Online Multiple Kernel Regression (OMKR), which sequentially learns the kernel-based regressor in an online and scalable fashion, and dynamically explore a pool of multiple diverse kernels to avoid suffering from a single fixed poor kernel so as to remedy the drawback of manual\/heuristic kernel selection. The OMKR problem is more challenging than regular kernel-based regression tasks since we have to on-the-fly determine both the optimal kernel-based regressor for each individual kernel and the best combination of the multiple kernel regressors. We propose a family of OMKR algorithms for regression and discuss their application to time series prediction tasks including application to AR, ARMA, and ARIMA time series. We develop novel approaches to make OMKR scalable for large datasets, to counter the problems arising from an unbounded number of support vectors. We also explore the effect of kernel combination at prediction level and at the representation level. Finally, we conduct extensive experiments to evaluate the empirical performance on both real-world regression and times series prediction tasks.<\/jats:p>","DOI":"10.1145\/3299875","type":"journal-article","created":{"date-parts":[[2019,1,23]],"date-time":"2019-01-23T19:15:02Z","timestamp":1548270902000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":29,"title":["Large Scale Online Multiple Kernel Regression with Application to Time-Series Prediction"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4367-5852","authenticated-orcid":false,"given":"Doyen","family":"Sahoo","sequence":"first","affiliation":[{"name":"Singapore Management University, Singapore"}]},{"given":"Steven C. H.","family":"Hoi","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore"}]},{"given":"Bin","family":"Li","sequence":"additional","affiliation":[{"name":"Wuhan University, Wuhan, P. R. China"}]}],"member":"320","published-online":{"date-parts":[[2019,1,23]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"172","article-title":"Online learning for time series prediction","volume":"30","author":"Anava Oren","year":"2013","journal-title":"COLT"},{"key":"e_1_2_1_2_1","volume-title":"International Conference on Machine Learning. 2191--2199","author":"Anava Oren","year":"2015"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0097539701398375"},{"key":"e_1_2_1_4_1","volume-title":"Herrmann","author":"Bousquet Olivier","year":"2003"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11265-010-0514-5"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-007-5003-0"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","volume-title":"Prediction, Learning, and Games","author":"Cesa-Bianchi Nicolo","DOI":"10.1017\/CBO9780511546921"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2011.2178446"},{"key":"e_1_2_1_9_1","article-title":"Online passive-aggressive algorithms","author":"Crammer Koby","year":"2006","journal-title":"Journal of Machine Learning Research 7"},{"key":"e_1_2_1_10_1","volume-title":"Advances in NIPS","author":"Crammer Koby"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1137\/060666998"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390190"},{"key":"e_1_2_1_13_1","volume-title":"Schapire","author":"Freund Yoav","year":"1995"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2523813"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2021071"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISDA.2006.229"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273542"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/2429619.2429651"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150426"},{"key":"e_1_2_1_20_1","unstructured":"Steven C. H. Hoi Doyen Sahoo Jing Lu and Peilin Zhao. 2018. Online learning: A comprehensive survey. arXiv:1802.02871.  Steven C. H. Hoi Doyen Sahoo Jing Lu and Peilin Zhao. 2018. Online learning: A comprehensive survey. arXiv:1802.02871."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2627450"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-004-2340-z"},{"key":"e_1_2_1_23_1","volume-title":"Algorithmic Learning Theory","author":"Jin Rong"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.3662552"},{"key":"e_1_2_1_25_1","first-page":"321","article-title":"Marginalized kernels between labeled graphs","volume":"3","author":"Kashima Hisashi","year":"2003","journal-title":"ICML"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2004.830991"},{"key":"e_1_2_1_27_1","volume-title":"Tsang","author":"Kwok James T.","year":"2003"},{"key":"e_1_2_1_28_1","article-title":"Learning the kernel matrix with semidefinite programming","author":"Lanckriet Gert R. G.","year":"2004","journal-title":"Journal of Machine Learning Research 5"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/SFCS.1989.63487"},{"key":"e_1_2_1_30_1","volume-title":"13th AAAI Conference on Artificial Intelligence.","author":"Liu Chenghao","year":"2016"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2007.907881"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.2946692"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3156684"},{"key":"e_1_2_1_34_1","volume-title":"Hoi","author":"Lu Jing","year":"2016"},{"key":"e_1_2_1_35_1","volume-title":"2002 International Joint Conference on Neural Networks (IJCNN\u201902)","volume":"1","author":"Lu Weizhen","year":"2002"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. 507--515","author":"Martins Andr\u00e9 F. T."},{"key":"e_1_2_1_37_1","unstructured":"Edward Moroshko and Koby Crammer. 2013. A last-step regression algorithm for non-stationary online learning. Artificial Intelligence and Statistics 451--462.  Edward Moroshko and Koby Crammer. 2013. A last-step regression algorithm for non-stationary online learning. Artificial Intelligence and Statistics 451--462."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/646257.685538"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/3172077.3172242"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.23919\/EUSIPCO.2017.8081478"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390247"},{"key":"e_1_2_1_42_1","volume-title":"Optimum Signal Processing: An Introduction","author":"Orfanidis Sophocles J."},{"key":"e_1_2_1_43_1","unstructured":"Ali Rahimi and Benjamin Recht. 2008. Random features for large-scale kernel machines. In Advances in Neural Information Processing Systems. 1177--1184.   Ali Rahimi and Benjamin Recht. 2008. Random features for large-scale kernel machines. In Advances in Neural Information Processing Systems. 1177--1184."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0042519"},{"key":"e_1_2_1_45_1","volume-title":"Fourier Analysis on Groups","author":"Rudin W."},{"key":"e_1_2_1_46_1","volume-title":"Asian Conference on Machine Learning. 65--80","author":"Sahoo Doyen","year":"2016"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623712"},{"key":"e_1_2_1_48_1","volume-title":"27th International Joint Conference on Artificial Intelligence (IJCAI\u201918)","author":"Sahoo Doyen"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2009.932254"},{"key":"e_1_2_1_50_1","volume-title":"Smola","author":"Sch\u00f6lkopf Bernhard","year":"2002"},{"key":"e_1_2_1_51_1","volume-title":"Shaojun Wang, and Terry Caelli.","author":"Li Cheng S. V.","year":"2007"},{"key":"e_1_2_1_53_1","doi-asserted-by":"crossref","volume-title":"Kernel Methods for Pattern Analysis","author":"Shawe-Taylor John","DOI":"10.1017\/CBO9780511809682"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:STCO.0000035301.49549.88"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248604"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0305-0483(01)00026-3"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7439(03)00111-4"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSP-SPE.2013.6642587"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/225298.225304"},{"key":"e_1_2_1_60_1","volume-title":"Hoff","author":"Bernard","year":"1960"},{"key":"e_1_2_1_61_1","volume-title":"Williams and Matthias Seeger","author":"Christopher K.","year":"2001"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939794"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2017.03.077"},{"key":"e_1_2_1_64_1","volume-title":"Lyu","author":"Xu Zenglin","year":"2008"},{"key":"e_1_2_1_65_1","volume-title":"Lyu","author":"Yang Haiqin","year":"2010"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the 29th International Conference on Machine Learning. Omnipress, 1075--1082","author":"Zhao Peilin"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2021043"},{"key":"e_1_2_1_68_1","volume-title":"20th International Conference on International Conference on Machine Learning.","author":"Zinkevich Martin","year":"2003"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3299875","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3299875","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:38Z","timestamp":1750204418000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3299875"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,23]]},"references-count":67,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,2,28]]}},"alternative-id":["10.1145\/3299875"],"URL":"https:\/\/doi.org\/10.1145\/3299875","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,23]]},"assertion":[{"value":"2007-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}