{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T19:52:18Z","timestamp":1778961138902,"version":"3.51.4"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,10]],"date-time":"2024-02-10T00:00:00Z","timestamp":1707523200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,10]],"date-time":"2024-02-10T00:00:00Z","timestamp":1707523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005047","name":"Natural Science Foundation of Liaoning Province","doi-asserted-by":"publisher","award":["2020-MS-281"],"award-info":[{"award-number":["2020-MS-281"]}],"id":[{"id":"10.13039\/501100005047","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Process Lett"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Extreme multi-label text classification (XMTC) annotates related labels for unknown text from large-scale label sets. Transformer-based methods have become the dominant approach for solving the XMTC task due to their effective text representation capabilities. However, the existing Transformer-based methods fail to effectively exploit the correlation between labels in the XMTC task. To address this shortcoming, we propose a novel model called TLC-XML, i.e., a Transformer with label correlation for extreme multi-label text classification. TLC-XML comprises three modules: Partition, Matcher and Ranker. In the Partition module, we exploit the semantic and co-occurrence information of labels to construct the label correlation graph, and further partition the strongly correlated labels into the same cluster. In the Matcher module, we propose cluster correlation learning, which uses the graph convolutional network (GCN) to extract the correlation between clusters. We then introduce these valuable correlations into the classifier to match related clusters. In the Ranker module, we propose label interaction learning, which aggregates the raw label prediction with the information of the neighboring labels. The experimental results on benchmark datasets show that TLC-XML significantly outperforms state-of-the-art XMTC methods.<\/jats:p>","DOI":"10.1007\/s11063-024-11460-z","type":"journal-article","created":{"date-parts":[[2024,2,10]],"date-time":"2024-02-10T11:02:10Z","timestamp":1707562930000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["TLC-XML: Transformer with Label Correlation for Extreme Multi-label Text Classification"],"prefix":"10.1007","volume":"56","author":[{"given":"Fei","family":"Zhao","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qing","family":"Ai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiangna","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenhui","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingyun","family":"Gao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yichun","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,2,10]]},"reference":[{"key":"11460_CR1","doi-asserted-by":"crossref","unstructured":"McAuley, J.J., Pandey, R., Leskovec, J.: Inferring networks of substitutable and complementary products. In Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, pp 785-794 (2015)","DOI":"10.1145\/2783258.2783381"},{"issue":"4","key":"11460_CR2","doi-asserted-by":"publisher","first-page":"4047","DOI":"10.1007\/s10489-022-03655-5","volume":"53","author":"G Jung","year":"2023","unstructured":"Jung G, Shin J, Lee S (2023) Impact of preprocessing and word embedding on extreme multi-label patent classification tasks. Applied Intelligence 53(4):4047\u20134062","journal-title":"Applied Intelligence"},{"key":"11460_CR3","doi-asserted-by":"crossref","unstructured":"Jain, H., Balasubramanian, V., Chunduri, B., Varma, M.: Slice: Scalable linear extreme classifiers trained on 100 million labels for related searches. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp 528-536 (2019)","DOI":"10.1145\/3289600.3290979"},{"key":"11460_CR4","unstructured":"Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: BERT: Pre-training of deep bidirectional transformers for Language understanding. arXiv preprint arXiv:1810.04805 (2018)"},{"key":"11460_CR5","unstructured":"Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., Soricut, R.: ALBERT: A lite BERT for self-supervised learning of language representations. International Conference on Learning Representations, pp. 25-32 (2020)"},{"key":"11460_CR6","unstructured":"Yang, Z., Dai, Z., Yang, Y., Carbonell, J.G., Salakhutdinov, R., Le, Q.V.: Xlnet: Generalized autoregressive pretraining for language understanding. In Advances in neural information processing systems, pp 5754-5764 (2019)"},{"key":"11460_CR7","doi-asserted-by":"crossref","unstructured":"Chang, W.-C., Yu, H.-F., Zhong, K., Yang, Y., Dhillon, I.S.: Taming pretrained transformers for extreme multi-label text classification. In 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp 3163-3171 (2020)","DOI":"10.1145\/3394486.3403368"},{"key":"11460_CR8","unstructured":"Ye, H., Chen, Z., Wang, D.-H., Davison, B.: Pretrained generalized autoregressive model with adaptive probabilistic label clusters for extreme multi-label text classification. In International Conference on Machine Learning, pp 10809-10819 (2020)"},{"key":"11460_CR9","doi-asserted-by":"crossref","unstructured":"Jiang, T., Wang, D., Sun, L., Yang, H., Zhao, Z., Zhuang, F.: Lightxml: Transformer with dynamic negative sampling for high-performance extreme multi-label text classification. In Proceedings of the AAAI Conference on Artificial Intelligence, pp 7987-7994 (2021)","DOI":"10.1609\/aaai.v35i9.16974"},{"key":"11460_CR10","unstructured":"Zhang, J., Chang, W.-C., Yu, H.-F., Dhillon, I.: Fast multi-resolution transformer fine-tuning for extreme multi-label text classification. In Advances in Neural Information Processing Systems, pp 7267-7280 (2021)"},{"key":"11460_CR11","doi-asserted-by":"crossref","unstructured":"Xun, G., Jha, K., Sun, J., Zhang, A.: Correlation networks for extreme multi-label text classification. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 1074-1082 (2020)","DOI":"10.1145\/3394486.3403151"},{"issue":"7","key":"11460_CR12","first-page":"6698","volume":"35","author":"D Zong","year":"2023","unstructured":"Zong D, Sun S (2023) Bgnn-xml: Bilateral graph neural networks for extreme multi-label text classification. IEEE Transactions on Knowledge and Data Engineering 35(7):6698\u20136709","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"11460_CR13","doi-asserted-by":"crossref","unstructured":"Yen, I.E.-H., Huang, X., Ravikumar, P., Zhong, K., Dhillon, I.: Pd-sparse: A primal and dual sparse approach to extreme multiclass and multilabel classification. In International conference on machine learning, pp 3069-3077 (2016)","DOI":"10.1145\/3097983.3098083"},{"key":"11460_CR14","doi-asserted-by":"crossref","unstructured":"Babbar, R., Sch\u00f6lkopf, B.: Dismec: Distributed sparse machines for extreme multi-label classification. In Proceedings of the tenth ACM international conference on web search and data mining, pp 721-729 (2017)","DOI":"10.1145\/3018661.3018741"},{"issue":"11","key":"11460_CR15","doi-asserted-by":"publisher","first-page":"3953","DOI":"10.1007\/s10994-022-06228-2","volume":"111","author":"E Schultheis","year":"2022","unstructured":"Schultheis E, Babbar R (2022) Speeding-up one-versus-all training for extreme classification via mean-separating initialization. Machine Learning 111(11):3953\u20133976","journal-title":"Machine Learning"},{"key":"11460_CR16","unstructured":"Bhatia, K., Jain, H., Kar, P., Varma, M., Jain, P.: Sparse local embeddings for extreme multi-label classification. In Advances in neural information processing systems, pp 730-738 (2015)"},{"key":"11460_CR17","doi-asserted-by":"crossref","unstructured":"Tagami, Y.: Annexml: Approximate nearest neighbor search for extreme multi-label classification. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pp 455-464 (2017)","DOI":"10.1145\/3097983.3097987"},{"key":"11460_CR18","doi-asserted-by":"crossref","unstructured":"Prabhu, Y., Kag, A., Harsola, S., Agrawal, R., Varma, M.: Parabel: Partitioned label trees for extreme classification with application to dynamic search advertising. In Proceedings of the 2018 World Wide Web Conference, pp 993-1002 (2018)","DOI":"10.1145\/3178876.3185998"},{"issue":"11","key":"11460_CR19","doi-asserted-by":"publisher","first-page":"2099","DOI":"10.1007\/s10994-020-05888-2","volume":"109","author":"S Khandagale","year":"2020","unstructured":"Khandagale S, Xiao H, Babbar R (2020) Bonsai: diverse and shallow trees for extreme multi-label classification, machine learning. Machine Learning 109(11):2099\u20132119","journal-title":"Machine Learning"},{"key":"11460_CR20","first-page":"452","volume":"2022","author":"PA Etter","year":"2022","unstructured":"Etter PA, Zhong K, Yu H-F, Ying L, Dhillon I (2022) Enterprise-Scale Search: Accelerating Inference for Sparse Extreme Multi-Label Ranking Trees. In Proceedings of the ACM Web Conference 2022:452\u2013461","journal-title":"In Proceedings of the ACM Web Conference"},{"key":"11460_CR21","doi-asserted-by":"crossref","unstructured":"Liu, J., Chang, W.-C., Wu, Y., Yang, Y.: Deep learning for extreme multi-label text classification. In Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 115-124 (2017)","DOI":"10.1145\/3077136.3080834"},{"key":"11460_CR22","unstructured":"You, R., Zhang, Z., Wang, Z., Dai, S., Mamitsuka, H., Zhu, S.: AttentionXML: label tree-based attention-aware deep model for high-performance extreme multi-label text classification. In Advances in neural information processing systems, pp 5820-5830 (2019)"},{"issue":"6","key":"11460_CR23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.70.066111","volume":"70","author":"A Clauset","year":"2004","unstructured":"Clauset A, Newman ME, Moore C (2004) Finding community structure in very large networks. Physical review E 70(6):066111","journal-title":"Physical review E"},{"key":"11460_CR24","doi-asserted-by":"crossref","unstructured":"Chen, Z.-M., Wei, X.-S., Wang, P., Guo, Y.: Multi-label image recognition with graph convolutional networks. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 5177-5186 (2019)","DOI":"10.1109\/CVPR.2019.00532"},{"issue":"17","key":"11460_CR25","doi-asserted-by":"publisher","first-page":"11107","DOI":"10.1007\/s00521-020-05650-8","volume":"33","author":"K Xie","year":"2021","unstructured":"Xie K, Wei Z, Huang L, Qin Q, Zhang W (2021) Graph convolutional networks with attention for multi-label weather recognition. Neural Computing and Applications 33(17):11107\u201311123","journal-title":"Neural Computing and Applications"},{"key":"11460_CR26","doi-asserted-by":"crossref","unstructured":"Tang, P., Jiang, M., Xia, B.N., Pitera, J.W., Welser, J., Chawla, N.V.: Multi-label patent categorization with non-local attention-based graph convolutional network. In Proceedings of the AAAI Conference on Artificial Intelligence, pp 9024-9031 (2020)","DOI":"10.1609\/aaai.v34i05.6435"},{"issue":"12","key":"11460_CR27","doi-asserted-by":"publisher","first-page":"14759","DOI":"10.1007\/s10489-022-04106-x","volume":"53","author":"H-T Vu","year":"2023","unstructured":"Vu H-T, Nguyen M-T, Nguyen V-C, Pham M-H, Nguyen V-Q, Nguyen V-H (2023) Label-representative graph convolutional network for multi-label text classification. Applied Intelligence 53(12):14759\u201314774","journal-title":"Applied Intelligence"},{"issue":"12","key":"11460_CR28","doi-asserted-by":"publisher","first-page":"9860","DOI":"10.1109\/TPAMI.2021.3136592","volume":"44","author":"J-Y Hang","year":"2021","unstructured":"Hang J-Y, Zhang M-L (2021) Collaborative learning of label semantics and deep label-specific features for multi-label classification. IEEE Trans Pattern Anal Mach Intell 44(12):9860\u20139871","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"11460_CR29","doi-asserted-by":"publisher","first-page":"1696","DOI":"10.1109\/TMM.2020.3002185","volume":"23","author":"J Xu","year":"2021","unstructured":"Xu J, Tian H, Wang Z, Wang Y, Kang W, Chen F (2021) Joint input and output space learning for multi-label image classification. IEEE Transactions on Multimedia 23:1696\u20131707","journal-title":"IEEE Transactions on Multimedia"},{"key":"11460_CR30","unstructured":"Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)"},{"key":"11460_CR31","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770-778 (2016)","DOI":"10.1109\/CVPR.2016.90"},{"issue":"4","key":"11460_CR32","first-page":"361","volume":"5","author":"DD Lewis","year":"2004","unstructured":"Lewis DD, Yang Y, Russell-Rose T, Li F (2004) Rcv1: A new benchmark collection for text categorization research. Journal of machine learning research 5(4):361\u2013397","journal-title":"Journal of machine learning research"},{"key":"11460_CR33","doi-asserted-by":"crossref","unstructured":"Loza\u00a0Menc\u00eda, E., F\u00fcrnkranz, J.: Efficient Pairwise Multilabel Classification for Large-Scale Problems in the Legal Domain. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp 50-65 (2008)","DOI":"10.1007\/978-3-540-87481-2_4"},{"key":"11460_CR34","unstructured":"Yang, P., Sun, X., Li, W., Ma, S., Wu, W., Wang, H.: SGM: Sequence Generation Model for Multi-label Classification. In Proceedings of the 27th International Conference on Computational Linguistics, pp 3915-3926 (2018)"},{"key":"11460_CR35","doi-asserted-by":"crossref","unstructured":"McAuley, J., Leskovec, J.: Hidden factors and hidden topics: understanding rating dimensions with review text. In Proceedings of the 7th ACM conference on Recommender systems, pp 165-172 (2013)","DOI":"10.1145\/2507157.2507163"},{"key":"11460_CR36","doi-asserted-by":"crossref","unstructured":"Prabhu, Y., Varma, M.: Fastxml: A fast, accurate and stable tree-classifier for extreme multi-label learning. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 263-272 (2014)","DOI":"10.1145\/2623330.2623651"},{"key":"11460_CR37","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar J (2006) Statistical comparisons of classifiers over multiple data sets. Journal of machine learning research 7:1\u201330","journal-title":"Journal of machine learning research"}],"container-title":["Neural Processing Letters"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11063-024-11460-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11063-024-11460-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11063-024-11460-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T20:13:54Z","timestamp":1709237634000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11063-024-11460-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,10]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["11460"],"URL":"https:\/\/doi.org\/10.1007\/s11063-024-11460-z","relation":{},"ISSN":["1573-773X"],"issn-type":[{"value":"1573-773X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,10]]},"assertion":[{"value":"25 October 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"25"}}