{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:49:44Z","timestamp":1750308584634,"version":"3.41.0"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2017,10,23]],"date-time":"2017-10-23T00:00:00Z","timestamp":1508716800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["61379098 and 61673377"],"award-info":[{"award-number":["61379098 and 61673377"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2018,3,31]]},"abstract":"<jats:p>Nonlinear classifiers (i.e., kernel support vector machines (SVMs)) are effective for nonlinear data classification. However, nonlinear classifiers are usually prohibitively expensive when dealing with large nonlinear data. Ensembles of linear classifiers have been proposed to address this inefficiency, which is called the ensemble linear classifiers for nonlinear data problem. In this article, a new iterative learning approach is introduced that involves two steps at each iteration: partitioning the data into clusters according to Gaussian mixture models with local consistency and then training basic classifiers (i.e., linear SVMs) for each cluster. The two divide-and-conquer steps are combined into a graphical model. Meanwhile, with training, each classifier is regarded as a task; clustered multitask learning is employed to capture the relatedness among different tasks and avoid overfitting in each task. In addition, two novel extensions are introduced based on the proposed approach. First, the approach is extended for quality-aware web data classification. In this problem, the types of web data vary in terms of information quality. The ignorance of the variations of information quality of web data leads to poor classification models. The proposed approach can effectively integrate quality-aware factors into web data classification. Second, the approach is extended for listwise learning to rank to construct an ensemble of linear ranking models, whereas most existing listwise ranking methods construct a solely linear ranking model. Experimental results on benchmark datasets show that our approach outperforms state-of-the-art algorithms. During prediction for nonlinear classification, it also obtains comparable classification performance to kernel SVMs, with much higher efficiency.<\/jats:p>","DOI":"10.1145\/3122802","type":"journal-article","created":{"date-parts":[[2017,10,23]],"date-time":"2017-10-23T19:19:16Z","timestamp":1508786356000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Iteratively Divide-and-Conquer Learning for Nonlinear Classification and Ranking"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8060-7739","authenticated-orcid":false,"given":"Ou","family":"Wu","sequence":"first","affiliation":[{"name":"Center for Applied Mathematics, Tianjin University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xue","family":"Mao","sequence":"additional","affiliation":[{"name":"NLPR, Institute of Automation, Chinese Academy of Sciences"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiming","family":"Hu","sequence":"additional","affiliation":[{"name":"NLPR, Institute of Automation, Chinese Academy of Sciences"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,10,23]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"K. Bache and M. Lichman. 2013. UCI Machine Learning Repository. Retrieved September 8 2017 from http:\/\/archive.ics.uci.edu\/ml.  K. Bache and M. Lichman. 2013. UCI Machine Learning Repository. Retrieved September 8 2017 from http:\/\/archive.ics.uci.edu\/ml."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/IGARSS.2006.1008"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2012.2187307"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273513"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022627411411"},{"key":"e_1_2_1_8_1","volume-title":"ECCV Workshops on Statistical Learning in Computer Vision 1--22","author":"Csurka Gabriella","year":"2004","unstructured":"Gabriella Csurka , Christopher R. Dance , Lixin Fan , Jutta Willamowski , and Cdric Bray . 2004 . Visual categorization with bags of keypoints . ECCV Workshops on Statistical Learning in Computer Vision 1--22 . Gabriella Csurka, Christopher R. Dance, Lixin Fan, Jutta Willamowski, and Cdric Bray. 2004. Visual categorization with bags of keypoints. ECCV Workshops on Statistical Learning in Computer Vision 1--22."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1014052.1014067"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/1390681.1442794"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2010.2080319"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 16th International Conference on Artificial Intelligence and Statistics (AISTATS\u201913)","author":"Gu Quanquan","year":"2013","unstructured":"Quanquan Gu and Jiawei Han . 2013 . Clustered support vector machines . In Proceedings of the 16th International Conference on Artificial Intelligence and Statistics (AISTATS\u201913) . 307--315. Quanquan Gu and Jiawei Han. 2013. Clustered support vector machines. In Proceedings of the 16th International Conference on Artificial Intelligence and Statistics (AISTATS\u201913). 307--315."},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"T. Hastie R. Tibshirani and J. Friedman. 2001. The Elements of Statistical Learning. Springer New York.  T. Hastie R. Tibshirani and J. Friedman. 2001. The Elements of Statistical Learning. Springer New York.","DOI":"10.1007\/978-0-387-21606-5"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1133"},{"key":"e_1_2_1_16_1","unstructured":"Laurent Jacob Francis Bach and Jean-Philippe Vert. 2008. Clustered multi-task learning: A convex formulation. In Advances in Neural Information Processing Systems (NIPS). 745--752.   Laurent Jacob Francis Bach and Jean-Philippe Vert. 2008. Clustered multi-task learning: A convex formulation. In Advances in Neural Information Processing Systems (NIPS). 745--752."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248602"},{"key":"e_1_2_1_18_1","first-page":"653903","article-title":"Quality dependent fusion of intramodal and multimodal biometric experts","volume":"6539","author":"Kittler J.","year":"2007","unstructured":"J. Kittler , N. Poh , and K. Kryszczuk . 2007 . Quality dependent fusion of intramodal and multimodal biometric experts . Proceedings of SPIE - The International Society for Optical Engineering 6539 , 653903 -- 653903 --14. J. Kittler, N. Poh, and K. Kryszczuk. 2007. Quality dependent fusion of intramodal and multimodal biometric experts. Proceedings of SPIE - The International Society for Optical Engineering 6539, 653903--653903--14.","journal-title":"Proceedings of SPIE - The International Society for Optical Engineering"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 28th International Conference on Machine Learning (ICML\u201911)","author":"Ladick\u00fd Lubor","year":"2011","unstructured":"Lubor Ladick\u00fd and Philip Torr . 2011 . Locally linear support vector machines . In Proceedings of the 28th International Conference on Machine Learning (ICML\u201911) . 985--992. Lubor Ladick\u00fd and Philip Torr. 2011. Locally linear support vector machines. In Proceedings of the 28th International Conference on Machine Learning (ICML\u201911). 985--992."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of Association for the Advancement of Artificial Intelligence (AAAI\u201910)","author":"Liu Jialu","year":"2010","unstructured":"Jialu Liu , Deng Cai , and Xiaofei He . 2010 . Gaussian mixture model with local consistency . In Proceedings of Association for the Advancement of Artificial Intelligence (AAAI\u201910) . 512--517. Jialu Liu, Deng Cai, and Xiaofei He. 2010. Gaussian mixture model with local consistency. In Proceedings of Association for the Advancement of Artificial Intelligence (AAAI\u201910). 512--517."},{"volume-title":"Learning to Rank for Information Retrieval","author":"Liu Tie-Yan","key":"e_1_2_1_21_1","unstructured":"Tie-Yan Liu . 2009. Learning to Rank for Information Retrieval . Now Publishers . 423--434 pages. Tie-Yan Liu. 2009. Learning to Rank for Information Retrieval. Now Publishers. 423--434 pages."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2218825"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1109\/TIP.2015.2495116","article-title":"Large margin multi-modal multi-task feature extraction for image classification","volume":"25","author":"Luo Yong","year":"2015","unstructured":"Yong Luo , Yonggang Wen , Dacheng Tao , and Jie Gui . 2015 . Large margin multi-modal multi-task feature extraction for image classification . IEEE Transactions on Image Processing 25 , 1, 414 -- 427 . Yong Luo, Yonggang Wen, Dacheng Tao, and Jie Gui. 2015. Large margin multi-modal multi-task feature extraction for image classification. IEEE Transactions on Image Processing 25, 1, 414--427.","journal-title":"IEEE Transactions on Image Processing"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661829.2662068"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718507"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70796"},{"key":"e_1_2_1_28_1","unstructured":"Hidekazu Oiwa and Ryohei Fujimaki. 2014. Partition-wise linear models. In Advances in Neural Information Processing Systems. 3527--3535.   Hidekazu Oiwa and Ryohei Fujimaki. 2014. Partition-wise linear models. In Advances in Neural Information Processing Systems. 3527--3535."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871758"},{"volume-title":"International Conference on Machine Learning. 205--213","author":"Pele O.","key":"e_1_2_1_30_1","unstructured":"O. Pele , B. Taskar , A. Globerson , and M. Werman . 2013. The pairwise piecewise-linear embedding for efficient non-linear classification . In International Conference on Machine Learning. 205--213 . O. Pele, B. Taskar, A. Globerson, and M. Werman. 2013. The pairwise piecewise-linear embedding for efficient non-linear classification. In International Conference on Machine Learning. 205--213."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487591"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.102"},{"key":"e_1_2_1_33_1","volume-title":"Conference on Neural Information Processing Systems","author":"Qin Tao","year":"2008","unstructured":"Tao Qin , Tie Yan Liu , Xu Dong Zhang , De Sheng Wang , and Hang Li . 2008 . Global ranking using continuous conditional random fields . In Conference on Neural Information Processing Systems , Vancouver, British Columbia, Canada, December. 1281--1288. Tao Qin, Tie Yan Liu, Xu Dong Zhang, De Sheng Wang, and Hang Li. 2008. Global ranking using continuous conditional random fields. In Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December. 1281--1288."},{"key":"e_1_2_1_34_1","first-page":"1177","article-title":"Random features for large-scale kernel machines","volume":"20","author":"Rahimi Ali","year":"2007","unstructured":"Ali Rahimi and Benjamin Recht . 2007 . Random features for large-scale kernel machines . Advances in Neural Information Processing Systems 20 , 1177 -- 1184 . Ali Rahimi and Benjamin Recht. 2007. Random features for large-scale kernel machines. Advances in Neural Information Processing Systems 20, 1177--1184.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_35_1","unstructured":"Peter Sollich. 2000. Probabilistic methods for support vector machines. In Advances in Neural Information Processing Systems (NIPS). 349--355.   Peter Sollich. 2000. Probabilistic methods for support vector machines. In Advances in Neural Information Processing Systems (NIPS). 349--355."},{"volume-title":"Proceedings of British Machine Vision Conference. 1--11","author":"Vempati S.","key":"e_1_2_1_36_1","unstructured":"S. Vempati , A. Vedaldi , A. Zisserman , and C. V. Jawahar . 2010. Generalized RBF feature maps for efficient detection . In Proceedings of British Machine Vision Conference. 1--11 . S. Vempati, A. Vedaldi, A. Zisserman, and C. V. Jawahar. 2010. Generalized RBF feature maps for efficient detection. In Proceedings of British Machine Vision Conference. 1--11."},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Yinjuan Wang Nianhua Xie Weiming Hu and Jinfeng Yang. 2011. Multi-modal multiple-instance learning with the application to the cannabis webpage recognition. In Pattern Recognition. 105--109.  Yinjuan Wang Nianhua Xie Weiming Hu and Jinfeng Yang. 2011. Multi-modal multiple-instance learning with the application to the cannabis webpage recognition. In Pattern Recognition. 105--109.","DOI":"10.1109\/ACPR.2011.6166680"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2007.901808"},{"key":"e_1_2_1_39_1","volume-title":"AAAI Conference on Artificial Intelligence. 194--200","author":"Wu Ou","year":"2014","unstructured":"Ou Wu , Ruiguang Hu , Xue Mao , and Weiming Hu . 2014 . Quality-based learning for web data classification . In AAAI Conference on Artificial Intelligence. 194--200 . Ou Wu, Ruiguang Hu, Xue Mao, and Weiming Hu. 2014. Quality-based learning for web data classification. In AAAI Conference on Artificial Intelligence. 194--200."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2535214"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390306"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102479"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.301"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS\u201910)","author":"Zhang Yu","year":"2010","unstructured":"Yu Zhang and Dit-Yan Yeung . 2010 . Multi-task learning using generalized t process . In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS\u201910) . 964--971. Yu Zhang and Dit-Yan Yeung. 2010. Multi-task learning using generalized t process. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS\u201910). 964--971."},{"key":"e_1_2_1_45_1","unstructured":"Jiayu Zhou Jianhui Chen and Jieping Ye. 2011a. Clustered multi-task learning via alternating structure optimization. In Advances in Neural Information Processing Systems (NIPS). 702--710.   Jiayu Zhou Jianhui Chen and Jieping Ye. 2011a. Clustered multi-task learning via alternating structure optimization. In Advances in Neural Information Processing Systems (NIPS). 702--710."},{"key":"e_1_2_1_46_1","volume-title":"MALSAR: Multi-tAsk Learning via StructurAl Regularization","author":"Zhou J.","year":"2011","unstructured":"J. Zhou , J. Chen , and J. Ye . 2011 b. MALSAR: Multi-tAsk Learning via StructurAl Regularization . Arizona State University . Retrieved September 8, 2017 from http:\/\/www.public.asu.edu\/ jye02\/Software\/MALSAR. J. Zhou, J. Chen, and J. Ye. 2011b. MALSAR: Multi-tAsk Learning via StructurAl Regularization. Arizona State University. Retrieved September 8, 2017 from http:\/\/www.public.asu.edu\/ jye02\/Software\/MALSAR."},{"key":"e_1_2_1_47_1","volume-title":"Xing","author":"Zhu Jun","year":"2011","unstructured":"Jun Zhu , Ning Chen , and Eric P . Xing . 2011 . Infinite SVM: A Dirichlet process mixture of large-margin kernel machines. In ICML. 617--624. Jun Zhu, Ning Chen, and Eric P. Xing. 2011. Infinite SVM: A Dirichlet process mixture of large-margin kernel machines. In ICML. 617--624."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772887"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3122802","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3122802","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:08Z","timestamp":1750273508000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3122802"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,23]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,3,31]]}},"alternative-id":["10.1145\/3122802"],"URL":"https:\/\/doi.org\/10.1145\/3122802","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2017,10,23]]},"assertion":[{"value":"2017-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-10-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}