{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T03:10:21Z","timestamp":1779160221827,"version":"3.51.4"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2015,7,22]],"date-time":"2015-07-22T00:00:00Z","timestamp":1437523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"crossref","award":["61272374 and 61300190"],"award-info":[{"award-number":["61272374 and 61300190"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2015,7,27]]},"abstract":"<jats:p>Traditional clustering algorithms deal with a single clustering task on a single dataset. However, there are many related tasks in the real world, which motivates multitask clustering. Recently some multitask clustering algorithms have been proposed, and among them multitask Bregman clustering (MBC) is a very applicable method. MBC alternatively updates clusters and learns relationships between clusters of different tasks, and the two phases boost each other. However, the boosting does not always have positive effects on improving the clustering performance, it may also cause negative effects. Another issue of MBC is that it cannot deal with nonlinear separable data. In this article, we show that in MBC, the process of using cluster relationship to boost the cluster updating phase may cause negative effects, that is, cluster centroids may be skewed under some conditions. We propose a smart multitask Bregman clustering (S-MBC) algorithm which can identify the negative effects of the boosting and avoid the negative effects if they occur. We then propose a multitask kernel clustering (MKC) framework for nonlinear separable data by using a similar framework like MBC in the kernel space. We also propose a specific optimization method, which is quite different from that of MBC, to implement the MKC framework. Since MKC can also cause negative effects like MBC, we further extend the framework of MKC to a smart multitask kernel clustering (S-MKC) framework in a similar way that S-MBC is extended from MBC. We conduct experiments on 10 real world multitask clustering datasets to evaluate the performance of S-MBC and S-MKC. The results on clustering accuracy show that: (1) compared with the original MBC algorithm MBC, S-MBC and S-MKC perform much better; (2) compared with the convex discriminative multitask relationship clustering (DMTRC) algorithms DMTRC-L and DMTRC-R which also avoid negative transfer, S-MBC and S-MKC perform worse in the (ideal) case in which different tasks have the same cluster number and the empirical label marginal distribution in each task distributes evenly, but better or comparable in other (more general) cases. Moreover, S-MBC and S-MKC can work on the datasets in which different tasks have different number of clusters, violating the assumptions of DMTRC-L and DMTRC-R. The results on efficiency show that S-MBC and S-MKC consume more computational time than MBC and less computational time than DMTRC-L and DMTRC-R. Overall S-MBC and S-MKC are competitive compared with the state-of-the-art multitask clustering algorithms in synthetical terms of accuracy, efficiency and applicability.<\/jats:p>","DOI":"10.1145\/2747879","type":"journal-article","created":{"date-parts":[[2015,7,22]],"date-time":"2015-07-22T18:49:50Z","timestamp":1437590990000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Smart Multitask Bregman Clustering and Multitask Kernel Clustering"],"prefix":"10.1145","volume":"10","author":[{"given":"Xianchao","family":"Zhang","sequence":"first","affiliation":[{"name":"Dalian University of Technology, Dalian, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaotong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Han","family":"Liu","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,7,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1194905"},{"key":"e_1_2_1_2_1","volume-title":"Advances in Neural Information Processing Systems 19.","author":"Argyriou Andreas","unstructured":"Andreas Argyriou , Theodoros Evgeniou , and Massimiliano Pontil . 2006. Multi-task feature learning . In Advances in Neural Information Processing Systems 19. Vancouver, British Columbia, Canada , 41--48. Andreas Argyriou, Theodoros Evgeniou, and Massimiliano Pontil. 2006. Multi-task feature learning. In Advances in Neural Information Processing Systems 19. Vancouver, British Columbia, Canada, 41--48."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1335998.1336050"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244304322765658"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1194902"},{"key":"e_1_2_1_6_1","volume-title":"Williams","author":"Bonilla Edwin V.","year":"2007","unstructured":"Edwin V. Bonilla , Kian Ming A. Chai , and Christopher K. I . Williams . 2007 . Multi-task gaussian process prediction. In Advances in Neural Information Processing Systems 20. Vancouver, British Columbia, Canada , 153C160. Edwin V. Bonilla, Kian Ming A. Chai, and Christopher K. I. Williams. 2007. Multi-task gaussian process prediction. In Advances in Neural Information Processing Systems 20. Vancouver, British Columbia, Canada, 153C160."},{"key":"e_1_2_1_7_1","volume-title":"Convex Optimization","author":"Boyd Stephen","unstructured":"Stephen Boyd and Lieven Vandenberghe . 2004. Convex Optimization . Cambridge University Press , New York, NY, USA . Stephen Boyd and Lieven Vandenberghe. 2004. Convex Optimization. Cambridge University Press, New York, NY, USA."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/0041-5553(67)90040-7"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007379606734"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553392"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281192.1281218"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273521"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390182"},{"key":"e_1_2_1_14_1","volume-title":"Dhillon and Suvrit Sra","author":"Inderjit","year":"2005","unstructured":"Inderjit S. Dhillon and Suvrit Sra . 2005 . Generalized nonnegative matrix approximations with bregman divergences. In Advances in Neural Information Processing Systems 18. Vancouver, British Columbia, Canada Inderjit S. Dhillon and Suvrit Sra. 2005. Generalized nonnegative matrix approximations with bregman divergences. In Advances in Neural Information Processing Systems 18. Vancouver, British Columbia, Canada"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.277"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1088693"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1014052.1014067"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-012-0543-4"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/2900423.2900481"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2009.32"},{"key":"e_1_2_1_21_1","volume-title":"Advances in Neural Information Processing Systems 21.","author":"Jacob Laurent","unstructured":"Laurent Jacob , Francis Bach , and Jean-Philippe Vert . 2008. Clustered multi-task learning: A convex formulation . In Advances in Neural Information Processing Systems 21. Vancouver, British Columbia, Canada , 745--752. Laurent Jacob, Francis Bach, and Jean-Philippe Vert. 2008. Clustered multi-task learning: A convex formulation. In Advances in Neural Information Processing Systems 21. Vancouver, British Columbia, Canada, 745--752."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/3120007.3120069"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015382"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102415"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401951"},{"key":"e_1_2_1_26_1","volume-title":"Micchelli and Massimiliano Pontil","author":"Charles","year":"2004","unstructured":"Charles A. Micchelli and Massimiliano Pontil . 2004 . Kernels for Multi-task Learning. In Advances in Neural Information Processing Systems 17. Vancouver, British Columbia, Canada . Charles A. Micchelli and Massimiliano Pontil. 2004. Kernels for Multi-task Learning. In Advances in Neural Information Processing Systems 17. Vancouver, British Columbia, Canada."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the Nineteenth International Symposium on Methodologies for Intelligent Systems","author":"Nguyen Thach Huy","year":"2011","unstructured":"Thach Huy Nguyen , Hao Shao , Bin Tong , and Einoshin Suzuki . 2011 . A compression-based dissimilarity measure for multi-task clustering . In Proceedings of the Nineteenth International Symposium on Methodologies for Intelligent Systems . Warsaw, Poland, 123--132. Thach Huy Nguyen, Hao Shao, Bin Tong, and Einoshin Suzuki. 2011. A compression-based dissimilarity measure for multi-task clustering. In Proceedings of the Nineteenth International Symposium on Methodologies for Intelligent Systems. Warsaw, Poland, 123--132."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-012-0550-5"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2009.2018176"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence","author":"Pan Sinno Jialin","year":"2008","unstructured":"Sinno Jialin Pan , James T. Kwok , and Qiang Yang . 2008 . Transfer learning via dimensionality reduction . In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence . Chicago, Illinois, USA, 677--682. Sinno Jialin Pan, James T. Kwok, and Qiang Yang. 2008. Transfer learning via dimensionality reduction. In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence. Chicago, Illinois, USA, 677--682."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273592"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics. La Palma, Canary Islands, 951--959","author":"Romera-Paredes Bernardino","year":"2012","unstructured":"Bernardino Romera-Paredes , Andreas Argyriou , Nadia Berthouze , and Massimiliano Pontil . 2012 . Exploiting unrelated tasks in multi-task learning . In Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics. La Palma, Canary Islands, 951--959 . Bernardino Romera-Paredes, Andreas Argyriou, Nadia Berthouze, and Massimiliano Pontil. 2012. Exploiting unrelated tasks in multi-task learning. In Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics. La Palma, Canary Islands, 951--959."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the Sixth International Conference on Computer Vision","author":"Rubner Yossi","unstructured":"Yossi Rubner , Carlo Tomasi , and Leonidas J. Guibas . 1998. A metric for distributions with applications to image databases . In Proceedings of the Sixth International Conference on Computer Vision . Bombay, India, 59--66. Yossi Rubner, Carlo Tomasi, and Leonidas J. Guibas. 1998. A metric for distributions with applications to image databases. In Proceedings of the Sixth International Conference on Computer Vision. Bombay, India, 59--66."},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics","author":"Saha Avishek","year":"2011","unstructured":"Avishek Saha , Piyush Rai , Hal Daum\u00e9 III, and Suresh Venkatasubramanian . 2011 . Online learning of multiple tasks and their relationships . In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics . Fort Lauderdale, USA, 643--651. Avishek Saha, Piyush Rai, Hal Daum\u00e9 III, and Suresh Venkatasubramanian. 2011. Online learning of multiple tasks and their relationships. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. Fort Lauderdale, USA, 643--651."},{"key":"e_1_2_1_38_1","volume-title":"Kernel Methods for Pattern Analysis","author":"Shawe-Taylor John","unstructured":"John Shawe-Taylor and Nello Cristianini . 2004. Kernel Methods for Pattern Analysis . Cambridge University Press . I--XIV, 1--462 pages. John Shawe-Taylor and Nello Cristianini. 2004. Kernel Methods for Pattern Analysis. Cambridge University Press. I--XIV, 1--462 pages."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015436"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the Twenty-First International Conference on Pattern Recognition","author":"Xie Saining","year":"2012","unstructured":"Saining Xie , Hongtao Lu , and Yangcheng He . 2012 . Multi-task co-clustering via nonnegative matrix factorization . In Proceedings of the Twenty-First International Conference on Pattern Recognition . Tsukuba, Japan, 2954--2958. Saining Xie, Hongtao Lu, and Yangcheng He. 2012. Multi-task co-clustering via nonnegative matrix factorization. In Proceedings of the Twenty-First International Conference on Pattern Recognition. Tsukuba, Japan, 2954--2958."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860485"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/2898607.2898713"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2011.02.004"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2343221"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/2891460.2891604"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/3023549.3023636"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/3119933.3119994"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168752.2168768"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538028"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.05.011"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/945365.964287"},{"key":"e_1_2_1_53_1","unstructured":"Jiayu Zhou Jianhui Chen and Jieping Ye. 2011. Clustered multi-task learning via alternating structure optimization. In Advances in Neural Information Processing Systems 24. Granada Spain 702--710.  Jiayu Zhou Jianhui Chen and Jieping Ye. 2011. Clustered multi-task learning via alternating structure optimization. In Advances in Neural Information Processing Systems 24. Granada Spain 702--710."}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2747879","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2747879","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:17:01Z","timestamp":1750227421000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2747879"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,22]]},"references-count":50,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2015,7,27]]}},"alternative-id":["10.1145\/2747879"],"URL":"https:\/\/doi.org\/10.1145\/2747879","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,7,22]]},"assertion":[{"value":"2014-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-07-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}