{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:47:56Z","timestamp":1760150876056,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T00:00:00Z","timestamp":1643587200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"ministry of higher education Malaysia","award":["FRGS\/1\/2020\/ICT02\/UKM\/02\/1"],"award-info":[{"award-number":["FRGS\/1\/2020\/ICT02\/UKM\/02\/1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>In multilabel classification, each sample can be allocated to multiple class labels at the same time. However, one of the prominent problems of multilabel classification is missing labels (incomplete labels) in multilabel text. The multilabel classification performance is reduced significantly with the presence of missing labels. In order to address the incomplete or missing label problem, this study proposes two methods: an aggregated feature and label graph-based missing label handling method (GB-AS), and a unified graph-based missing label propagation method (UG-MLP). GB-AS is used to obtain an initial label matrix based on the similarity of both document levels: feature-based weighting representation and label-based weighting representation. On the other hand, UG-MLP is introduced to construct a mixed graph that combines GB-AS and label correlations into a single groundwork. A high-order label correlation is learned from the incomplete training data and applied to supplement the missing label matrix, which guides the creation of multilabel classification models. The combination of the mixed graphs by UG-MLP is aimed to obtain the benefits of both graphs to increase the classification performance. To evaluate UG-MLP, the metrics of precision, recall and F-measure were used on three benchmark datasets, namely, the Reuters-21578, Bibtex and Enron datasets. The experimental results show that UG-MLP outperformed GB-AS as well as other state-of-the-art approaches. Therefore, we can infer from the findings that by plotting a unified graph based on joining aggregated feature and label weightings together with the label correlation, the performance of multilabel classification can be improved.<\/jats:p>","DOI":"10.3390\/sym14020286","type":"journal-article","created":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T08:20:29Z","timestamp":1643617229000},"page":"286","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Unified Graph-Based Missing Label Propagation Method for Multilabel Text Classification"],"prefix":"10.3390","volume":"14","author":[{"given":"Adil Yaseen","family":"Taha","sequence":"first","affiliation":[{"name":"Center for Artificial Intelligence Technology, Universiti Kebangsaan Malaysia, Hulu Langat 43100, Malaysia"}]},{"given":"Sabrina","family":"Tiun","sequence":"additional","affiliation":[{"name":"Center for Artificial Intelligence Technology, Universiti Kebangsaan Malaysia, Hulu Langat 43100, Malaysia"}]},{"given":"Abdul Hadi Abd","family":"Rahman","sequence":"additional","affiliation":[{"name":"Center for Artificial Intelligence Technology, Universiti Kebangsaan Malaysia, Hulu Langat 43100, Malaysia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5157-7921","authenticated-orcid":false,"given":"Masri","family":"Ayob","sequence":"additional","affiliation":[{"name":"Center for Artificial Intelligence Technology, Universiti Kebangsaan Malaysia, Hulu Langat 43100, Malaysia"}]},{"given":"Ali Sabah","family":"Abdulameer","sequence":"additional","affiliation":[{"name":"Center for Artificial Intelligence Technology, Universiti Kebangsaan Malaysia, Hulu Langat 43100, Malaysia"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,31]]},"reference":[{"key":"ref_1","unstructured":"Braytee, A. (2018). Robust Classification of High Dimensional Unbalanced Single and Multi-Label Datasets. [Ph.D. Thesis, University of Technology]."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"71219","DOI":"10.1109\/ACCESS.2020.2987922","article-title":"A Structure-Induced Framework for Multi-Label Feature Selection with Highly Incomplete Labels","volume":"8","author":"Xu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.neucom.2017.04.033","article-title":"Semi-supervised multi-label classification using incomplete label information","volume":"260","author":"Tan","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.ins.2019.04.021","article-title":"Improving multi-label classification with missing labels by learning label-specific features","volume":"492","author":"Huang","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.knosys.2017.09.005","article-title":"Multi-Label Low-dimensional Embedding with Missing Labels","volume":"137","author":"Ma","year":"2017","journal-title":"Knowledge-Based Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2138","DOI":"10.1109\/TNNLS.2018.2874434","article-title":"Topic-based algorithm for multilabel learning with missing labels","volume":"30","author":"Ma","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MMUL.2020.3022068","article-title":"Multilabel Text Classification with Incomplete Labels: A Safe Generative Model with Label Manifold Regularization and Confidence Constraint","volume":"27","author":"Guan","year":"2020","journal-title":"IEEE MultiMedia"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1007\/s11263-018-1085-3","article-title":"Multi-label learning with missing labels using mixed dependency graphs","volume":"126","author":"Wu","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ibrahim, K.M., Epure, E.V., Peeters, G., and Richard, G. (2020, January 8\u201311). Confidence-based Weighted Loss for Multi-label Classification with Missing Labels. Proceedings of the 2020 International Conference on Multimedia Retrieval, Dublin, Ireland.","DOI":"10.1145\/3372278.3390728"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.knosys.2018.08.018","article-title":"Joint multi-label classification and label correlations with missing labels and feature selection","volume":"163","author":"He","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pal, A., Selvakumar, M., and Sankarasubbu, M. (2020, January 22\u201324). MAGNET: Multi-Label Text Classification using Attention-based Graph Neural Network. Proceedings of the 12th International Conference on Agents and Artificial Intelligence, Valletta, Malta.","DOI":"10.5220\/0008940304940505"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1016\/j.patcog.2017.09.036","article-title":"Multi-label feature selection with missing labels","volume":"74","author":"Zhu","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.neunet.2019.04.011","article-title":"Label-specific feature selection and two-level label recovery for multi-label classification with missing labels","volume":"118","author":"Ma","year":"2019","journal-title":"Neural Netw."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3027","DOI":"10.1007\/s10489-019-01431-6","article-title":"Feature selection for multi-label learning with missing labels","volume":"49","author":"Wang","year":"2019","journal-title":"Appl. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"113024","DOI":"10.1016\/j.eswa.2019.113024","article-title":"MGFS: A multi-label graph-based feature selection algorithm via PageRank centrality","volume":"142","author":"Hashemi","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_16","unstructured":"Zhao, F., and Guo, Y. (2015, January 27). Semi-Supervised Multi-Label Learning with Incomplete Labels. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina."},{"key":"ref_17","unstructured":"Song, R., Chen, X., Liu, Z., An, H., Zhang, Z., Wang, X., and Xu, H. (2021). Label Mask for Multi-Label Text Classification. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1651","DOI":"10.1007\/s11063-020-10331-7","article-title":"Label Embedding for Multi-label Classification Via Dependence Maximization","volume":"52","author":"Li","year":"2020","journal-title":"Neural Process. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"012037","DOI":"10.1088\/1742-6596\/1621\/1\/012037","article-title":"Enhancing Deep Learning-Based Multi-label Text Classification with Capsule Network","volume":"1621","author":"Yan","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"988","DOI":"10.1109\/TKDE.2011.86","article-title":"Clustering with Multiviewpoint-Based Similarity Measure","volume":"24","author":"Nguyen","year":"2012","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_21","unstructured":"Baeza-Yates, R., and Ribeiro-Neto, B. (1999). Modern Information Retrieval, ACM Press."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fallahpour, A., Wong, K.Y., Rajoo, S., Fathollahi-Fard, A.M., Antucheviciene, J., and Nayeri, S. (2021). An integrated approach for a sustainable supplier selection based on Industry 4.0 concept. Environ. Sci. Pollut. Res., 1\u201319.","DOI":"10.1007\/s11356-021-17445-y"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.ins.2017.12.034","article-title":"Multi-label classification using a fuzzy rough neighborhood consensus","volume":"433","author":"Vluymans","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"124724","DOI":"10.1016\/j.jclepro.2020.124724","article-title":"Scheme selection of design for disas-sembly (DFD) based on sustainability: A novel hybrid of interval 2-tuple linguistic intuitionistic fuzzy numbers and regret theory","volume":"281","author":"Wang","year":"2021","journal-title":"J. Clean. Prod."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Fallahpour, A., Nayeri, S., Sheikhalishahi, M., Wong, K.Y., Tian, G., and Fathollahi-Fard, A.M. (2021). A hyper-hybrid fuzzy decision-making framework for the sustainable-resilient supplier selection problem: A case study of Malaysian Palm oil industry. Environ. Sci. Pollut. Res., 1\u201321.","DOI":"10.1007\/s11356-021-12491-y"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.neunet.2018.01.011","article-title":"Manifold regularized matrix completion for multi-label learning with ADMM","volume":"101","author":"Liu","year":"2018","journal-title":"Neural Netw."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Manna, S., and Pati, S.K. (2020). Missing Value Imputation Using Correlation Coefficient. Computational Intelligence in Pattern Recognition, Springer.","DOI":"10.1007\/978-981-15-2449-3_47"},{"key":"ref_28","unstructured":"Mudiyanselage, D.L. (2018). Multi-Label Classification Using Higher-Order Label Clusters. [Ph.D. Thesis, University of Nebraska at Omaha]."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Taha, A.Y., Tiun, S., Abd Rahman, A.H., Ayob, M., and Sabah, A. (2020). A Dynamic Two-Layers MI and Clustering-based Ensemble Feature Selection for Multi-Labels Text Classification. Int. J. Adv. Comput. Sci. Appl., 11.","DOI":"10.14569\/IJACSA.2020.0110764"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Pant, P., Sabitha, A.S., Choudhury, T., and Dhingra, P. (2019). Multi-label Classification Trending Challenges and Approaches. Emerging Trends in Expert Applications and Security, Springer.","DOI":"10.1007\/978-981-13-2285-3_51"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1016\/j.eswa.2018.07.024","article-title":"Feature ranking for enhancing boosting-based multi-label text categorization","volume":"113","author":"Ayob","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Tsoumakas, G., Katakis, I., and Vlahavas, I. (2009). Mining multi-label data. Data Mining and Knowledge Discovery Handbook, Springer.","DOI":"10.1007\/978-0-387-09823-4_34"},{"key":"ref_33","first-page":"178","article-title":"Feature selection method based on statistics of compound words for arabic text classification","volume":"16","author":"Adel","year":"2019","journal-title":"Int. Arab J. Inf. Technol."},{"key":"ref_34","first-page":"423","article-title":"Multilabel Over-sampling and Under-sampling with Class Alignment for Imbalanced Multilabel Text Classification","volume":"20","author":"Taha","year":"2021","journal-title":"J. Inf. Commun. Technol."},{"key":"ref_35","first-page":"414","article-title":"Binary Relevance (BR) Method Classifier of Multi-Label Classification for Arabic Text","volume":"84","author":"Taha","year":"2016","journal-title":"J. Theor. Appl. Inf. Technol."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/2\/286\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:11:44Z","timestamp":1760134304000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/2\/286"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,31]]},"references-count":35,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["sym14020286"],"URL":"https:\/\/doi.org\/10.3390\/sym14020286","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2022,1,31]]}}}