{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T08:32:56Z","timestamp":1778661176110,"version":"3.51.4"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2010,5,1]],"date-time":"2010-05-01T00:00:00Z","timestamp":1272672000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000145","name":"Division of Information and Intelligent Systems","doi-asserted-by":"publisher","award":["IIS-0612069IIS-0812551CCF-0811790"],"award-info":[{"award-number":["IIS-0612069IIS-0812551CCF-0811790"]}],"id":[{"id":"10.13039\/100000145","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NGA","award":["HM1582-08-1-0016"],"award-info":[{"award-number":["HM1582-08-1-0016"]}]},{"DOI":"10.13039\/100000143","name":"Division of Computing and Communication Foundations","doi-asserted-by":"publisher","award":["IIS-0612069IIS-0812551CCF-0811790"],"award-info":[{"award-number":["IIS-0612069IIS-0812551CCF-0811790"]}],"id":[{"id":"10.13039\/100000143","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01-HG002516"],"award-info":[{"award-number":["R01-HG002516"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2010,5]]},"abstract":"<jats:p>Multi-label problems arise in various domains such as multi-topic document categorization, protein function prediction, and automatic image annotation. One natural way to deal with such problems is to construct a binary classifier for each label, resulting in a set of independent binary classification problems. Since multiple labels share the same input space, and the semantics conveyed by different labels are usually correlated, it is essential to exploit the correlation information contained in different labels. In this paper, we consider a general framework for extracting shared structures in multi-label classification. In this framework, a common subspace is assumed to be shared among multiple labels. We show that the optimal solution to the proposed formulation can be obtained by solving a generalized eigenvalue problem, though the problem is nonconvex. For high-dimensional problems, direct computation of the solution is expensive, and we develop an efficient algorithm for this case. One appealing feature of the proposed framework is that it includes several well-known algorithms as special cases, thus elucidating their intrinsic relationships. We further show that the proposed framework can be extended to the kernel-induced feature space. We have conducted extensive experiments on multi-topic web page categorization and automatic gene expression pattern image annotation tasks, and results demonstrate the effectiveness of the proposed formulation in comparison with several representative algorithms.<\/jats:p>","DOI":"10.1145\/1754428.1754431","type":"journal-article","created":{"date-parts":[[2010,6,1]],"date-time":"2010-06-01T12:21:35Z","timestamp":1275394895000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":120,"title":["A shared-subspace learning framework for multi-label classification"],"prefix":"10.1145","volume":"4","author":[{"given":"Shuiwang","family":"Ji","sequence":"first","affiliation":[{"name":"Arizona State University, Tempe, AZ"}]},{"given":"Lei","family":"Tang","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, AZ"}]},{"given":"Shipeng","family":"Yu","sequence":"additional","affiliation":[{"name":"Siemens Medical Solutions"}]},{"given":"Jieping","family":"Ye","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, AZ"}]}],"member":"320","published-online":{"date-parts":[[2010,5,28]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273499"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Andersen E. D. and Andersen K. D. 2000. The MOSEK interior point optimizer for linear programming: An implementation of the homogeneous algorithm. In High Performance Optimization. Kluwer Academic Publishers 197--232. Andersen E. D. and Andersen K. D. 2000. The MOSEK interior point optimizer for linear programming: An implementation of the homogeneous algorithm. In High Performance Optimization. Kluwer Academic Publishers 197--232.","DOI":"10.1007\/978-1-4757-3216-0_8"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1194905"},{"key":"e_1_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Arenas-Garc\u00eda J. Petersen K. B. and Hansen L. K. 2007. Sparse kernel orthonormalized PLS for feature extraction in large data sets. Adv. Neural Inform. Proces. Syst. 19. 33--40. Arenas-Garc\u00eda J. Petersen K. B. and Hansen L. K. 2007. Sparse kernel orthonormalized PLS for feature extraction in large data sets. Adv. Neural Inform. Proces. Syst. 19. 33--40.","DOI":"10.7551\/mitpress\/7503.003.0212"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases. 71--85","author":"Argyriou A.","unstructured":"Argyriou , A. , Maurer , A. , and Pontil , M . 2008. An algorithm for transfer learning in a heterogeneous environment . In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases. 71--85 . Argyriou, A., Maurer, A., and Pontil, M. 2008. An algorithm for transfer learning in a heterogeneous environment. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases. 71--85."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244304322765658"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944965"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btk048"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.61"},{"key":"e_1_2_1_10_1","volume-title":"-J","author":"Chang C.-C.","year":"2001","unstructured":"Chang , C.-C. and Lin , C . -J . 2001 . LIBSVM : A Library for Support Vector Machines . http:\/\/www.csie.ntu.edu.tw\/~cjlin\/libsvm. Chang, C.-C. and Lin, C.-J. 2001. LIBSVM: A Library for Support Vector Machines. http:\/\/www.csie.ntu.edu.tw\/~cjlin\/libsvm."},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Elisseeff A. and Weston J. 2002. A kernel method for multi-labelled classification. Adv. Neural Inform. Proces. Syst. 14. 681--687. Elisseeff A. and Weston J. 2002. A kernel method for multi-labelled classification. Adv. Neural Inform. Proces. Syst. 14. 681--687.","DOI":"10.7551\/mitpress\/1120.003.0092"},{"key":"e_1_2_1_12_1","volume-title":"-J","author":"Fan R.-E.","year":"2007","unstructured":"Fan , R.-E. and Lin , C . -J . 2007 . A study on threshold selection for multi-label classification. Tech. rep., Department of Computer Science and Information Engineering, National Taiwan University . Fan, R.-E. and Lin, C.-J. 2007. A study on threshold selection for multi-label classification. Tech. rep., Department of Computer Science and Information Engineering, National Taiwan University."},{"key":"e_1_2_1_13_1","volume-title":"Introduction to Statistical Pattern Recognition","author":"Fukunaga K.","unstructured":"Fukunaga , K. 1990. Introduction to Statistical Pattern Recognition 2 nd Ed. Academic Press Professional . Fukunaga, K. 1990. Introduction to Statistical Pattern Recognition 2nd Ed. Academic Press Professional.","edition":"2"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-005-0463-6"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1099554.1099591"},{"key":"e_1_2_1_16_1","volume-title":"Matrix Computations","author":"Golub G. H.","unstructured":"Golub , G. H. and Van Loan , C. F. 1996. Matrix Computations 3 rd Ed. The Johns Hopkins University Press . Golub, G. H. and Van Loan, C. F. 1996. Matrix Computations 3rd Ed. The Johns Hopkins University Press.","edition":"3"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Grauman K. and Darrell T. 2006. Approximate correspondences in high dimensions. Adv. Neural Inform. Proces. Syst. 19. 505--512. Grauman K. and Darrell T. 2006. Approximate correspondences in high dimensions. Adv. Neural Inform. Proces. Syst. 19. 505--512.","DOI":"10.7551\/mitpress\/7503.003.0068"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248659.1248685"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.2307\/1271436"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/28.3-4.321"},{"key":"e_1_2_1_21_1","volume-title":"-P","author":"Jacob L.","year":"2009","unstructured":"Jacob , L. , Bach , F. , and Vert , J . -P . 2009 . Clustered multi-task learning: A convex formulation. Adv. Neural Inform. Proces. Syst. 21, D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, Eds . 745--752. Jacob, L., Bach, F., and Vert, J.-P. 2009. Clustered multi-task learning: A convex formulation. Adv. Neural Inform. Proces. Syst. 21, D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, Eds. 745--752."},{"key":"e_1_2_1_22_1","first-page":"1","article-title":"A bag-of-words approach for Drosophila gene expression pattern annotation","volume":"10","author":"Ji S.","year":"2009","unstructured":"Ji , S. , Li , Y.-X. , Zhou , Z.-H. , Kumar , S. , and Ye , J. 2009 a. A bag-of-words approach for Drosophila gene expression pattern annotation . Bioinformatics 10 , 1 , 119. Ji, S., Li, Y.-X., Zhou, Z.-H., Kumar, S., and Ye, J. 2009a. A bag-of-words approach for Drosophila gene expression pattern annotation. Bioinformatics 10, 1, 119.","journal-title":"Bioinformatics"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btn347"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1077--1082","author":"Ji S.","unstructured":"Ji , S. and Ye , J . 2009. Linear dimensionality reduction for multi-label classification . In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1077--1082 . Ji, S. and Ye, J. 2009. Linear dimensionality reduction for multi-label classification. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1077--1082."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1557019.1557068"},{"key":"e_1_2_1_26_1","unstructured":"Jin R. and Ghahramani Z. 2002. Learning with multiple labels. Adv. Neural Inform. Proces. Syst. 15. 897--904. Jin R. and Ghahramani Z. 2002. Learning with multiple labels. Adv. Neural Inform. Proces. Syst. 15. 897--904."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/645326.649721"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102399"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150429"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.90"},{"key":"e_1_2_1_31_1","unstructured":"Kazawa H. Izumitani T. Taira H. and Maeda E. 2005. Maximal margin labeling for multi-topic text categorization. Adv. Neural Inform. Proces. Syst. 17. 649--656. Kazawa H. Izumitani T. Taira H. and Maeda E. 2005. Maximal margin labeling for multi-topic text categorization. Adv. Neural Inform. Proces. Syst. 17. 649--656."},{"key":"e_1_2_1_32_1","unstructured":"Kim S. Sohn K.-A. and Xing E. P. 2008. A multivariate regression approach to association analysis of quantitative trait network. Tech. rep. CMU-ML-08-113 Carnegie Mellon University. Kim S. Sohn K.-A. and Xing E. P. 2008. A multivariate regression approach to association analysis of quantitative trait network. Tech. rep. CMU-ML-08-113 Carnegie Mellon University."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1093\/genetics\/162.4.2037"},{"key":"e_1_2_1_34_1","unstructured":"Larsen R. M. 2000. Computing the SVD for large and sparse matrices. http:\/\/soi.stanford.edu\/~rmunk\/PROPAC. Larsen R. M. 2000. Computing the SVD for large and sparse matrices. http:\/\/soi.stanford.edu\/~rmunk\/PROPAC."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/1005332.1005345"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70847"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1445--1450","author":"Li Y.-X.","unstructured":"Li , Y.-X. , Ji , S. , Kumar , S. , Ye , J. , and Zhou , Z . -H. 2009. Drosophila gene expression pattern annotation through multi-instance multi-label learning . In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1445--1450 . Li, Y.-X., Ji, S., Kumar, S., Ye, J., and Zhou, Z.-H. 2009. Drosophila gene expression pattern annotation through multi-instance multi-label learning. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1445--1450."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the AAAI Workshop on Text Learning.","author":"McCallum A.","year":"1999","unstructured":"McCallum , A. 1999 . Multi-label text classification with a mixture model trained by EM . In Proceedings of the AAAI Workshop on Text Learning. McCallum, A. 1999. Multi-label text classification with a mixture model trained by EM. In Proceedings of the AAAI Workshop on Text Learning."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.188"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1097"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026039313770"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/1005332.1005336"},{"key":"e_1_2_1_43_1","first-page":"S12","article-title":"Improved functional prediction of proteins by learning kernel combinations in multilabel settings","volume":"8","author":"Roth V.","year":"2007","unstructured":"Roth , V. and Fischer , B. 2007 . Improved functional prediction of proteins by learning kernel combinations in multilabel settings . Bioinformatics 8 , S12 . Roth, V. and Fischer, B. 2007. Improved functional prediction of proteins by learning kernel combinations in multilabel settings. Bioinformatics 8, S12.","journal-title":"Bioinformatics"},{"key":"e_1_2_1_44_1","volume-title":"Kernels: Support Vector Machines, Regularization, Optimization and Beyond","author":"Sch\u00f6lkopf S.","year":"2002","unstructured":"Sch\u00f6lkopf , S. and Smola , A . 2002 . Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond . MIT Press . Sch\u00f6lkopf, S. and Smola, A. 2002. Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401971"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390285"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1230--1235","author":"Sun L.","unstructured":"Sun , L. , Ji , S. , and Ye , J . 2009. On the equivalence between canonical correlation analysis and orthonormalized partial least squares . In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1230--1235 . Sun, L., Ji, S., and Ye, J. 2009. On the equivalence between canonical correlation analysis and orthonormalized partial least squares. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1230--1235."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 21st International Joint Conference on Artificial Intelligence.","author":"Tang L.","unstructured":"Tang , L. , Chen , J. , and Ye , J . 2009. On multiple kernel learning with multiple labels . In Proceedings of the 21st International Joint Conference on Artificial Intelligence. Tang, L., Chen, J., and Ye, J. 2009. On multiple kernel learning with multiple labels. In Proceedings of the 21st International Joint Conference on Artificial Intelligence."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526738"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2002-3-12-research0088"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2007-8-7-r145"},{"key":"e_1_2_1_52_1","unstructured":"Ueda N. and Saito K. 2002a. Parametric mixture models for multi-labeled text. Adv. Neural Inform. Proces. Syst. 15. 721--728. Ueda N. and Saito K. 2002a. Parametric mixture models for multi-labeled text. Adv. Neural Inform. Proces. Syst. 15. 721--728."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775140"},{"key":"e_1_2_1_54_1","volume-title":"Estimation of principal components and related models by iterative least squares","author":"Wold H.","unstructured":"Wold , H. 1966. Estimation of principal components and related models by iterative least squares . P. R. Krishnaiah, Ed., Multivariate Analysis. Academic Press , New York, 391--420. Wold, H. 1966. Estimation of principal components and related models by iterative least squares. P. R. Krishnaiah, Ed., Multivariate Analysis. Academic Press, New York, 391--420."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281192.1281281"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 14th International Conference on Machine Learning. 412--420","author":"Yang Y.","unstructured":"Yang , Y. and Pedersen , J. O . 1997. A comparative study on feature selection in text categorization . In Proceedings of the 14th International Conference on Machine Learning. 412--420 . Yang, Y. and Pedersen, J. O. 1997. A comparative study on feature selection in text categorization. In Proceedings of the 14th International Conference on Machine Learning. 412--420."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1088689"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273633"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076080"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-9794-4"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2006.162"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2006.12.019"},{"key":"e_1_2_1_63_1","volume-title":"-L","author":"Zhou Z.-H.","year":"2007","unstructured":"Zhou , Z.-H. and Zhang , M . -L . 2007 . Multi-instance multi-label learning with application to scene classification. Adv. Neural Inform. Process. Syst . 19. 1609--1616. Zhou, Z.-H. and Zhang, M.-L. 2007. Multi-instance multi-label learning with application to scene classification. Adv. Neural Inform. Process. Syst. 19. 1609--1616."}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1754428.1754431","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1754428.1754431","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:22:50Z","timestamp":1750245770000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1754428.1754431"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,5]]},"references-count":63,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2010,5]]}},"alternative-id":["10.1145\/1754428.1754431"],"URL":"https:\/\/doi.org\/10.1145\/1754428.1754431","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,5]]},"assertion":[{"value":"2008-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-05-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}