{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T10:47:49Z","timestamp":1768906069851,"version":"3.49.0"},"reference-count":53,"publisher":"Wiley","license":[{"start":{"date-parts":[[2024,4,13]],"date-time":"2024-04-13T00:00:00Z","timestamp":1712966400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["P2-0103"],"award-info":[{"award-number":["P2-0103"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["612944"],"award-info":[{"award-number":["612944"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["101059682"],"award-info":[{"award-number":["101059682"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["101120237"],"award-info":[{"award-number":["101120237"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["101057499"],"award-info":[{"award-number":["101057499"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["101057014"],"award-info":[{"award-number":["101057014"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["952215"],"award-info":[{"award-number":["952215"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Research Program Knowledge Technologies","award":["P2-0103"],"award-info":[{"award-number":["P2-0103"]}]},{"name":"Research Program Knowledge Technologies","award":["612944"],"award-info":[{"award-number":["612944"]}]},{"name":"Research Program Knowledge Technologies","award":["101059682"],"award-info":[{"award-number":["101059682"]}]},{"name":"Research Program Knowledge Technologies","award":["101120237"],"award-info":[{"award-number":["101120237"]}]},{"name":"Research Program Knowledge Technologies","award":["101057499"],"award-info":[{"award-number":["101057499"]}]},{"name":"Research Program Knowledge Technologies","award":["101057014"],"award-info":[{"award-number":["101057014"]}]},{"name":"Research Program Knowledge Technologies","award":["952215"],"award-info":[{"award-number":["952215"]}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["P2-0103"],"award-info":[{"award-number":["P2-0103"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["612944"],"award-info":[{"award-number":["612944"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["101059682"],"award-info":[{"award-number":["101059682"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["101120237"],"award-info":[{"award-number":["101120237"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["101057499"],"award-info":[{"award-number":["101057499"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["101057014"],"award-info":[{"award-number":["101057014"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["952215"],"award-info":[{"award-number":["952215"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["International Journal of Intelligent Systems"],"published-print":{"date-parts":[[2024,4,13]]},"abstract":"<jats:p>Semi-supervised learning (SSL) is a common approach to learning predictive models using not only labeled, but also unlabeled examples. While SSL for the simple tasks of classification and regression has received much attention from the research community, this is not the case for complex prediction tasks with structurally dependent variables, such as multi-label classification and hierarchical multi-label classification. These tasks may require additional information, possibly coming from the underlying distribution in the descriptive space provided by unlabeled examples, to better face the challenging task of simultaneously predicting multiple class labels. In this paper, we investigate this aspect and propose a (hierarchical) multi-label classification method based on semi-supervised learning of predictive clustering trees, which we also extend towards ensemble learning. Extensive experimental evaluation conducted on 24 datasets shows significant advantages of the proposed method and its extension with respect to their supervised counterparts. Moreover, the method preserves interpretability of classical tree-based models.<\/jats:p>","DOI":"10.1155\/2024\/5610291","type":"journal-article","created":{"date-parts":[[2024,4,13]],"date-time":"2024-04-13T19:20:09Z","timestamp":1713036009000},"page":"1-21","source":"Crossref","is-referenced-by-count":6,"title":["Semi-Supervised Predictive Clustering Trees for (Hierarchical) Multi-Label Classification"],"prefix":"10.1155","volume":"2024","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4025-051X","authenticated-orcid":true,"given":"Jurica","family":"Levati\u0107","sequence":"first","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"},{"name":"Jo\u017eef Stefan International Postgraduate School, Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6690-7583","authenticated-orcid":true,"given":"Michelangelo","family":"Ceci","sequence":"additional","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"},{"name":"Department of Computer Science, University of Bari, Bari, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0687-0878","authenticated-orcid":true,"given":"Dragi","family":"Kocev","sequence":"additional","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"},{"name":"Jo\u017eef Stefan International Postgraduate School, Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2363-712X","authenticated-orcid":true,"given":"Sa\u0161o","family":"D\u017eeroski","sequence":"additional","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"},{"name":"Jo\u017eef Stefan International Postgraduate School, Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9780262033589.001.0001","volume-title":"Semi-supervised Learning","author":"O. Chapelle","year":"2006"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-019-05855-6"},{"key":"3","first-page":"10758","article-title":"Consistency-based semi-supervised learning for object detection","volume-title":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019","author":"J. Jeong","year":"2019"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2009.03.004"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113569"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1145\/3620677"},{"key":"7","first-page":"751","article-title":"Semi-supervised spam filtering using aggressive consistency learning","author":"M. Mojdeh"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.09.023"},{"key":"9","first-page":"355","article-title":"Semi-supervised multi-label classification-A simultaneous large-margin, subspace learning approach","volume-title":"Machine Learning and Knowledge Discovery in Databases-European Conference, ECML PKDD 2012, Bristol, UK, September 24-28, 2012. Proceedings, Part II","author":"Y. Guo","year":"2012"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1109\/tkde.2011.141"},{"key":"11","first-page":"1141","article-title":"Semi-supervised multi-label learning from crowds via deep sequential generative model","volume-title":"KDD \u201920: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","author":"W. Shi","year":"2020"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2014.03.052"},{"key":"13","first-page":"55","article-title":"Top-down induction of clustering trees","volume-title":"Proceeding of the 15th International Conference on Machine Learning","author":"H. Blockeel","year":"1998"},{"key":"14","first-page":"6227","article-title":"Dual relation semi-supervised multi-label learning","volume-title":"The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020","author":"L. Wang","year":"2020"},{"key":"15","first-page":"4062","article-title":"Semi-supervised multi-label learning with incomplete labels","volume-title":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015, Buenos Aires, Argentina","author":"F. Zhao","year":"2015"},{"key":"16","first-page":"1723","article-title":"Semi-supervised multi-label learning for graph-structured data","volume-title":"CIKM \u201921: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1 - 5, 2021","author":"Z. Song","year":"2021"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1007\/s40747-021-00611-7"},{"key":"18","article-title":"Semi-supervised predictive clustering trees for (hierarchical) multi-label classification","author":"J. Levati\u0107","year":"2022"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2017.02.014"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2018.03.033"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2023.101526"},{"key":"22","volume-title":"C4.5: Programs for Machine Learning","author":"R. J. Quinlan","year":"1993","edition":"1st"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1023\/a:1007515423169"},{"key":"24","unstructured":"ClareA.Machine learning and data mining for Yeast functional genomics2003Aberystwyth, UKUniversity of WalesPh.D. thesis"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-008-5077-3"},{"key":"26","volume-title":"Classification and Regression Trees","author":"L. Breiman","year":"1984"},{"key":"27","first-page":"1","article-title":"k-nearest neighbour classifiers","volume":"34","author":"P. Cunningham","year":"2007","journal-title":"Multiple Classifier Systems"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1023\/a:1010933404324"},{"key":"29","volume-title":"Data Mining: Practical Machine Learning Tools and Techniques","author":"I. H. Witten","year":"2005"},{"key":"30","article-title":"Multi-label text classification for automated tag suggestion","volume-title":"Proceedings of the ECML\/PKDD 2008 Discovery Challenge","author":"I. Katakis","year":"2008"},{"key":"31","first-page":"1","article-title":"The 9th annual MLSP competition: new methods for acoustic classification of multiple simultaneous bird species in a noisy environment","author":"F. Briggs"},{"key":"32","first-page":"325","article-title":"Multi-label classification of music into emotions","author":"K. Trohidis"},{"key":"33","volume-title":"Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary","author":"P. Duygulu","year":"2002"},{"key":"34","first-page":"217","article-title":"The Enron corpus: a new dataset for email classification research","volume-title":"Lecture Notes in Computer Science","author":"B. Klimt","year":"2004"},{"key":"35","first-page":"448","article-title":"Protein classification with multiple algorithms","volume-title":"Advances in Informatics, 10th Panhellenic Conference on Informatics, PCI 2005, Volos, Greece, November 11-13, 2005, Proceedings","author":"S. Diplaris","year":"2005"},{"issue":"3","key":"36","first-page":"357","article-title":"Insights offered by data-mining when analyzing media space data","volume":"25","author":"M. Skrjanc","year":"2001","journal-title":"Informatica"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-011-5256-5"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2004.03.009"},{"key":"39","first-page":"152","article-title":"Modelling pollen dispersal of genetically modified oilseed rape within the field","author":"D. Dem\u0161ar"},{"issue":"1","key":"40","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1008323212047","article-title":"Predicting chemical parameters of river water quality from bioindicator data","volume":"13","author":"S. Dzeroski","year":"2000","journal-title":"Applied Intelligence"},{"key":"41","first-page":"681","article-title":"A kernel method for multi-labelled classification","volume-title":"Advances in Neural Information Processing Systems 14 [Neural Information Processing Systems: Natural and Synthetic, NIPS 2001, December 3-8, 2001, Vancouver, British Columbia, Canada]","author":"A. Elisseeff","year":"2001"},{"key":"42","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecolmodel.2005.08.017"},{"key":"43","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.03.026"},{"key":"44","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecoinf.2011.09.001"},{"key":"45","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","author":"J. Demsar","year":"2006","journal-title":"Journal of Machine Learning Research"},{"key":"46","doi-asserted-by":"publisher","DOI":"10.2307\/3001968"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-022-06181-0"},{"key":"48","doi-asserted-by":"publisher","DOI":"10.1023\/a:1007692713085"},{"key":"49","first-page":"327","article-title":"Unlabeled data can degrade classification performance of generative classifiers","author":"F. Cozman"},{"key":"50","doi-asserted-by":"publisher","DOI":"10.1109\/tkde.2007.190644"},{"key":"51","first-page":"186","article-title":"An extensive empirical study on semi-supervised learning","volume-title":"ICDM 2010, the 10th IEEE International Conference on Data Mining, Sydney, Australia, 14-17 December 2010","author":"Y. Guo","year":"2010"},{"key":"52","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1509"},{"key":"53","unstructured":"\u017denkoB.Learning predictive clustering rules2007Ljubljana, SloveniaUniversity of LjubljanaPh.D. thesis"}],"container-title":["International Journal of Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/ijis\/2024\/5610291.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/ijis\/2024\/5610291.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/ijis\/2024\/5610291.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,13]],"date-time":"2024-04-13T19:20:32Z","timestamp":1713036032000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/ijis\/2024\/5610291\/"}},"subtitle":[],"editor":[{"given":"Vasudevan","family":"Rajamohan","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,4,13]]},"references-count":53,"alternative-id":["5610291","5610291"],"URL":"https:\/\/doi.org\/10.1155\/2024\/5610291","relation":{},"ISSN":["1098-111X","0884-8173"],"issn-type":[{"value":"1098-111X","type":"electronic"},{"value":"0884-8173","type":"print"}],"subject":[],"published":{"date-parts":[[2024,4,13]]}}}