{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:16:52Z","timestamp":1760710612833,"version":"3.41.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,6,8]],"date-time":"2021-06-08T00:00:00Z","timestamp":1623110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61572240, U19B2038"],"award-info":[{"award-number":["61572240, U19B2038"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2020AAA0105702"],"award-info":[{"award-number":["2020AAA0105702"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>In this article, a novel ensemble model, called Multiple Kernel Ensemble Learning (MKEL), is developed by introducing a unified ensemble loss. Different from the previous multiple kernel learning (MKL) methods, which attempt to seek a linear combination of basis kernels as a unified kernel, our MKEL model aims to find multiple solutions in corresponding Reproducing Kernel Hilbert Spaces (RKHSs) simultaneously. To achieve this goal, multiple individual kernel losses are integrated into a unified ensemble loss. Therefore, each model can co-optimize to learn its optimal parameters by minimizing a unified ensemble loss in multiple RKHSs. Furthermore, we apply our proposed ensemble loss into the deep network paradigm and take the sub-network as a kernel mapping from the original input space into a feature space, named Deep-MKEL (D-MKEL). Our D-MKEL model can utilize the diversified deep individual sub-networks into a whole unified network to improve the classification performance. With this unified loss design, our D-MKEL model can make our network much wider than other traditional deep kernel networks and more parameters are learned and optimized. Experimental results on several mediate UCI classification and computer vision datasets demonstrate that our MKEL model can achieve the best classification performance among comparative MKL methods, such as Simple MKL, GMKL, Spicy MKL, and Matrix-Regularized MKL. On the contrary, experimental results on large-scale CIFAR-10 and SVHN datasets concretely show the advantages and potentialities of the proposed D-MKEL approach compared to state-of-the-art deep kernel methods.<\/jats:p>","DOI":"10.1145\/3457217","type":"journal-article","created":{"date-parts":[[2021,6,8]],"date-time":"2021-06-08T18:22:54Z","timestamp":1623176574000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["MKEL: Multiple Kernel Ensemble Learning via Unified Ensemble Loss for Image Classification"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3359-8972","authenticated-orcid":false,"given":"Xiangjun","family":"Shen","sequence":"first","affiliation":[{"name":"School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang, Jiangsu, China"}]},{"given":"Kou","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang, Jiangsu, China"}]},{"given":"Sumet","family":"Mehta","sequence":"additional","affiliation":[{"name":"School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang, Jiangsu, China"}]},{"given":"Jianming","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang, Jiangsu, China"}]},{"given":"Weifeng","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Control Science and Engineering, China University of Petroleum (East China), China"}]},{"given":"Jianping","family":"Fan","sequence":"additional","affiliation":[{"name":"AI Lab at Lenovo Research, Beijing, P.R. China"}]},{"given":"Zhengjun","family":"Zha","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, University of Science and Technology of China, Hefei, China"}]}],"member":"320","published-online":{"date-parts":[[2021,6,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.11.078"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/1390681.1390721"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015424"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/2976040.2976050"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2020.100057"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.63"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2017.2675998"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2017.2783902"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/2968618.2968687"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/345662"},{"key":"e_1_2_1_11_1","volume-title":"International Conference on Machine Learning. PMLR, 1528\u20131537","author":"Dao Tri","year":"2019","unstructured":"Tri Dao , Albert Gu , Alexander Ratner , Virginia Smith , Chris De Sa , and Christopher R\u00e9 . 2019 . A kernel theory of modern data augmentation . In International Conference on Machine Learning. PMLR, 1528\u20131537 . Tri Dao, Albert Gu, Alexander Ratner, Virginia Smith, Chris De Sa, and Christopher R\u00e9. 2019. A kernel theory of modern data augmentation. In International Conference on Machine Learning. PMLR, 1528\u20131537."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459169"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2021071"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2015.2514161"},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","first-page":"486","DOI":"10.1109\/TNNLS.2016.2635151","article-title":"Localized multiple kernel learning with dynamical clustering and matrix regularization","volume":"29","author":"Han Yina","year":"2016","unstructured":"Yina Han , Kunde Yang , Yixin Yang , and Yuanliang Ma . 2016 . Localized multiple kernel learning with dynamical clustering and matrix regularization . IEEE Transactions on Neural Networks and Learning Systems 29 , 2 (2016), 486 \u2013 499 . Yina Han, Kunde Yang, Yixin Yang, and Yuanliang Ma. 2016. Localized multiple kernel learning with dynamical clustering and matrix regularization. IEEE Transactions on Neural Networks and Learning Systems 29, 2 (2016), 486\u2013499.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2785329"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 370\u2013377","author":"Hussain Zakria","year":"2011","unstructured":"Zakria Hussain and John Shawe-Taylor . 2011 . Improved loss bounds for multiple kernel learning . In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 370\u2013377 . Zakria Hussain and John Shawe-Taylor. 2011. Improved loss bounds for multiple kernel learning. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 370\u2013377."},{"key":"e_1_2_1_18_1","volume-title":"A note on improved loss bounds for multiple kernel learning. arXiv preprint arXiv:1106.6258 15","author":"Hussain Zakria","year":"2004","unstructured":"Zakria Hussain and John Shawe-Taylor . 2011. A note on improved loss bounds for multiple kernel learning. arXiv preprint arXiv:1106.6258 15 , 2004 (2011), 1\u201311. Zakria Hussain and John Shawe-Taylor. 2011. A note on improved loss bounds for multiple kernel learning. arXiv preprint arXiv:1106.6258 15, 2004 (2011), 1\u201311."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339648"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/3104482.3104503"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/2984093.2984206"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2021033"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1888305.1888311"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2020.107194"},{"key":"e_1_2_1_25_1","unstructured":"Yunwen Lei Alexander Binder Dogan and Marius Kloft. 2015. Theory and algorithms for the localized setting of learning kernels. In Feature Extraction: Modern Questions and Challenges. 173\u2013195.  Yunwen Lei Alexander Binder Dogan and Marius Kloft. 2015. Theory and algorithms for the localized setting of learning kernels. In Feature Extraction: Modern Questions and Challenges. 173\u2013195."},{"key":"e_1_2_1_26_1","volume-title":"The 22nd International Conference on Artificial Intelligence and Statistics. PMLR","author":"Li Chun-Liang","year":"2019","unstructured":"Chun-Liang Li , Wei-Cheng Chang , Youssef Mroueh , Yiming Yang , and Barnab\u00e1s P\u00f3czos . 2019 . Implicit kernel learning . In The 22nd International Conference on Artificial Intelligence and Statistics. PMLR , 2007\u20132016. Chun-Liang Li, Wei-Cheng Chang, Youssef Mroueh, Yiming Yang, and Barnab\u00e1s P\u00f3czos. 2019. Implicit kernel learning. In The 22nd International Conference on Artificial Intelligence and Statistics. PMLR, 2007\u20132016."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00060"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2017.05.010"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2017.19"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2021038"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/1965992.1966048"},{"key":"e_1_2_1_32_1","unstructured":"Alain Rakotomamonjy Francis R. Bach St\u00e9phane Canu and Yves Grandvalet. 2008. SimpleMKL. Journal of Machine Learning Research 9 (2008) 2491\u20132521.  Alain Rakotomamonjy Francis R. Bach St\u00e9phane Canu and Yves Grandvalet. 2008. SimpleMKL. Journal of Machine Learning Research 9 (2008) 2491\u20132521."},{"volume-title":"International Conference on Recent Advances and Trends in Nonparametric Statistics. 3\u201317","author":"Sch\u00f6lkopf B.","key":"e_1_2_1_33_1","unstructured":"B. Sch\u00f6lkopf , Michael G. Akritas , and Dimitris N. Politis . 2003. An introduction to support vector machines . In International Conference on Recent Advances and Trends in Nonparametric Statistics. 3\u201317 . B. Sch\u00f6lkopf, Michael G. Akritas, and Dimitris N. Politis. 2003. An introduction to support vector machines. In International Conference on Recent Advances and Trends in Nonparametric Statistics. 3\u201317."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/559923"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2019.107023"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2020.107587"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2324290"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248604"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2013.84"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/1125826.1716363"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2013.04.003"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-011-5252-9"},{"key":"e_1_2_1_43_1","volume-title":"Deep learning using linear support vector machines. arXiv: Learning","author":"Tang Yichuan","year":"2013","unstructured":"Yichuan Tang . 2013. Deep learning using linear support vector machines. arXiv: Learning ( 2013 ). Yichuan Tang. 2013. Deep learning using linear support vector machines. arXiv: Learning (2013)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2009.2030111"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.3053506"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553510"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00136"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2020.107593"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2018.2862899"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2018.2864987"},{"key":"e_1_2_1_51_1","volume-title":"Xing","author":"Wilson Andrew Gordon","year":"2016","unstructured":"Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , and Eric P . Xing . 2016 . Deep kernel learning. arXiv preprint arXiv:1511.02222.370\u2013378. Andrew Gordon Wilson, Zhiting Hu, Ruslan Salakhutdinov, and Eric P. Xing. 2016. Deep kernel learning. arXiv preprint arXiv:1511.02222.370\u2013378."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.89"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5555\/3172077.3172329"},{"key":"e_1_2_1_54_1","first-page":"2398","article-title":"Robust deep co-saliency detection with group semantic and pyramid attention","volume":"31","author":"Zha Zheng-Jun","year":"2020","unstructured":"Zheng-Jun Zha , Chong Wang , Dong Liu , Hongtao Xie , and Yongdong Zhang . 2020 . Robust deep co-saliency detection with group semantic and pyramid attention . IEEE Transactions on Neural Networks and Learning Systems 31 , 7 (2020), 2398 \u2013 2408 . Zheng-Jun Zha, Chong Wang, Dong Liu, Hongtao Xie, and Yongdong Zhang. 2020. Robust deep co-saliency detection with group semantic and pyramid attention. IEEE Transactions on Neural Networks and Learning Systems 31, 7 (2020), 2398\u20132408.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2325784"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/1949994.1950023"},{"volume-title":"Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 909\u2013917","author":"Zhuang Jinfeng","key":"e_1_2_1_57_1","unstructured":"Jinfeng Zhuang , Ivor W. Tsang , and Steven C.H. Hoi . 2011. Two-layer multiple kernel learning . In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 909\u2013917 . Jinfeng Zhuang, Ivor W. Tsang, and Steven C.H. Hoi. 2011. Two-layer multiple kernel learning. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 909\u2013917."}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3457217","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3457217","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:19Z","timestamp":1750191439000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3457217"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,8]]},"references-count":57,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3457217"],"URL":"https:\/\/doi.org\/10.1145\/3457217","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2021,6,8]]},"assertion":[{"value":"2020-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-06-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}