{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T10:29:53Z","timestamp":1775730593156,"version":"3.50.1"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,3,16]],"date-time":"2019-03-16T00:00:00Z","timestamp":1552694400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>During the last decades, intensive efforts have been devoted to the extraction of useful knowledge from large volumes of medical data employing advanced machine learning and data mining techniques. Advances in digital chest radiography have enabled research and medical centers to accumulate large repositories of classified (labeled) images and mostly of unclassified (unlabeled) images from human experts. Machine learning methods such as semi-supervised learning algorithms have been proposed as a new direction to address the problem of shortage of available labeled data, by exploiting the explicit classification information of labeled data with the information hidden in the unlabeled data. In the present work, we propose a new ensemble semi-supervised learning algorithm for the classification of lung abnormalities from chest X-rays based on a new weighted voting scheme. The proposed algorithm assigns a vector of weights on each component classifier of the ensemble based on its accuracy on each class. Our numerical experiments illustrate the efficiency of the proposed ensemble methodology against other state-of-the-art classification methods.<\/jats:p>","DOI":"10.3390\/a12030064","type":"journal-article","created":{"date-parts":[[2019,3,18]],"date-time":"2019-03-18T12:18:53Z","timestamp":1552911533000},"page":"64","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["A Weighted Voting Ensemble Self-Labeled Algorithm for the Detection of Lung Abnormalities from X-Rays"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3996-3301","authenticated-orcid":false,"given":"Ioannis E.","family":"Livieris","sequence":"first","affiliation":[{"name":"Department of Computer &amp; Informatics Engineering (DISK Lab), Technological Educational Institute of Western Greece, GR 263-34 Antirion, Greece"}]},{"given":"Andreas","family":"Kanavos","sequence":"additional","affiliation":[{"name":"Department of Computer &amp; Informatics Engineering (DISK Lab), Technological Educational Institute of Western Greece, GR 263-34 Antirion, Greece"}]},{"given":"Vassilis","family":"Tampakas","sequence":"additional","affiliation":[{"name":"Department of Computer &amp; Informatics Engineering (DISK Lab), Technological Educational Institute of Western Greece, GR 263-34 Antirion, Greece"}]},{"given":"Panagiotis","family":"Pintelas","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of Patras, GR 265-00 Patras, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.media.2005.02.002","article-title":"Segmentation of anatomical structures in chest radiographs using supervised methods: A comparative study on a public database","volume":"10","author":"Stegmann","year":"2006","journal-title":"Medical Image Anal."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Livieris, I., Kanavos, A., Tampakas, V., and Pintelas, P. (2018). An ensemble SSL algorithm for efficient chest X-ray image classification. J. Imaging, 4.","DOI":"10.3390\/jimaging4070095"},{"key":"ref_3","first-page":"1","article-title":"Introduction to semi-supervised learning","volume":"3","author":"Zhu","year":"2009","journal-title":"Synth. Lect. Artif. Intell. Mach. Learn."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1109\/TNN.2009.2015974","article-title":"Semi-supervised learning","volume":"20","author":"Chapelle","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_5","first-page":"173","article-title":"Semi-supervised learning for quantitative structure-activity modeling","volume":"37","author":"Levatic","year":"2013","journal-title":"Informatica"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1007\/s10844-017-0457-4","article-title":"Semi-supervised classification trees","volume":"49","author":"Ceci","year":"2017","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Livieris, I., Kanavos, A., Tampakas, V., and Pintelas, P. (2018). An auto-adjustable semi-supervised self-training algorithm. Algorithm, 11.","DOI":"10.3390\/a11090139"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Livieris, I., Kiriakidou, N., Kanavos, A., Tampakas, V., and Pintelas, P. (2018). On ensemble SSL algorithms for credit scoring problem. Informatics, 5.","DOI":"10.3390\/informatics5040040"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s10115-013-0706-y","article-title":"Self-labeled techniques for semi-supervised learning: Taxonomy, software and empirical study","volume":"42","author":"Triguero","year":"2015","journal-title":"Knowl. Inf. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yarowsky, D. (1995, January 26\u201330). Unsupervised word sense disambiguation rivaling supervised methods. Proceedings of the 33rd Annual Meeting of the Association For Computational Linguistics, Cambridge, MA, USA.","DOI":"10.3115\/981658.981684"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Blum, A., and Mitchell, T. (1998, January 24\u201326). Combining labeled and unlabeled data with co-training. Proceedings of the 11th Annual Conference on Computational Learning Theory, Madison, WI, USA.","DOI":"10.1145\/279943.279962"},{"key":"ref_12","unstructured":"Zhou, Y., and Goldman, S. (2014, January 15\u201317). Democratic co-learning. Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI), Boca Raton, FL, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1109\/TKDE.2005.186","article-title":"Tri-training: Exploiting unlabeled data using three classifiers","volume":"17","author":"Zhou","year":"2005","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1109\/TSMCA.2007.904745","article-title":"Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples","volume":"37","author":"Li","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1007\/s11390-010-9357-6","article-title":"Combining committee-based semi-supervised learning and active learning","volume":"25","author":"Hady","year":"2010","journal-title":"J. Comput. Sci. Technol."},{"key":"ref_16","unstructured":"Livieris, I., Kotsilieris, T., Anagnostopoulos, I., and Tampakas, V. (2018). DTCo: An ensemble SSL algorithm for X-rays classification. Advances in Experimental Medicine and Biology, Springer."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Livieris, I., Kanavos, A., and Pintelas, P. (2019). Detecting lung abnormalities from X-rays using and improved SSL algorithm. Electron. Notes Theor. Comput. Sci., accepted for publication.","DOI":"10.1016\/j.entcs.2019.04.008"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Livieris, I. (2018). A new ensemble self-labeled semi-supervised algorithm. Informatica, accepted for publication.","DOI":"10.31449\/inf.v43i2.2217"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1109\/TMI.2013.2284099","article-title":"Automatic tuberculosis screening using chest radiographs","volume":"33","author":"Jaeger","year":"2014","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1109\/TMI.2014.2350539","article-title":"A novel multiple-instance learning-based approach to computer-aided detection of tuberculosis on chest X-rays","volume":"34","author":"Melendez","year":"2015","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Alam, J., Alam, S., and Hossan, A. (2018, January 8\u20139). Multi-Stage Lung Cancer Detection and Prediction Using Multi-class SVM Classifier. Proceedings of the 2018 International Conference on Computer, Communication, Chemical, Material and Electronic Engineering, Rajshahi, Bangladesh.","DOI":"10.1109\/IC4ME2.2018.8465593"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Madani, A., Moradi, M., Karargyris, A., and Syeda-Mahmood, T. (2018, January 4\u20137). Semi-supervised learning with generative adversarial networks for chest X-ray classification with ability of data domain adaptation. Proceedings of the 15th IEEE International Symposium on Biomedical Imaging, Washington, DC, USA.","DOI":"10.1109\/ISBI.2018.8363749"},{"key":"ref_23","unstructured":"Guan, Q., and Huang, Y. (2018). Multi-label chest X-ray image classification via category-wise residual attention learning. Pattern Recognit. Lett."},{"key":"ref_24","first-page":"1","article-title":"Ensemble methods in machine learning","volume":"Volume 1857","author":"Kittler","year":"2001","journal-title":"Multiple Classifier Systems"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rokach, L. (2010). Pattern Classification Using Ensemble Methods, World Scientific Publishing Company.","DOI":"10.1142\/9789814271073"},{"key":"ref_26","first-page":"37","article-title":"Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Mach. Learn. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","article-title":"The WEKA data mining software: An update","volume":"11","author":"Hall","year":"2009","journal-title":"SIGKDD Explor. Newsl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","article-title":"Identifying medical diagnoses and treatable diseases by image-based deep learning","volume":"172","author":"Kermany","year":"2018","journal-title":"Cell"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Stirenko, S., Kochura, Y., Alienin, O., Rokovyi, O., Gang, P., Zeng, W., and Gordienko, Y. (arXiv, 2018). Chest X-ray analysis of tuberculosis by deep learning with segmentation and augmentation, arXiv.","DOI":"10.1109\/ELNANO.2018.8477564"},{"key":"ref_30","unstructured":"Albertina, B., Watson, M., Holback, C., Jarosz, R., Kirk, S., Lee, Y., and Lemmerman, J. (2016). Radiology data from the cancer Genome Atlas Lung Adenocarcinoma [TCGA-LUAD] collection. Cancer Imaging Arch."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1007\/s10278-013-9622-7","article-title":"The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository","volume":"26","author":"Clark","year":"2013","journal-title":"J. Digit. Imaging"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1016\/j.knosys.2010.03.012","article-title":"Semi-supervised learning based on nearest neighbor rule and cut edges","volume":"23","author":"Wang","year":"2010","journal-title":"Knowl.-Based Syst."},{"key":"ref_33","unstructured":"Platt, J. (1998). Advances in Kernel Methods\u2014Support Vector Learning, MIT Press."},{"key":"ref_34","unstructured":"Quinlan, J. (1993). C4.5: Programs for Machine Learning, Morgan Kaufmann."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Aha, D. (1997). Lazy Learning, Kluwer Academic Publishers.","DOI":"10.1007\/978-94-017-2053-3"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10115-007-0114-2","article-title":"Top 10 algorithms in data mining","volume":"14","author":"Wu","year":"2008","journal-title":"Knowl. Inf. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1214\/aoms\/1177704575","article-title":"Rank methods for combination of independent experiments in analysis of variance","volume":"33","author":"Hodges","year":"1962","journal-title":"Ann. Math. Stat."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1080\/01621459.1993.10476358","article-title":"On a monotonicity problem in step-down multiple test procedures","volume":"88","author":"Finner","year":"1993","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_39","unstructured":"Li, S., Wang, Z., Zhou, G., and Lee, S. (2011, January 16\u201322). Semi-supervised learning for imbalanced sentiment classification. Proceedings of the IJCAI Proceedings-International Joint Conference on Artificial Intelligence, Barcelona, Catalonia, Spain."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Jeni, L.A., Cohn, J.F., and De La Torre, F. (2013, January 2\u20135). Facing imbalanced data\u2014Recommendations for the use of performance metrics. Proceedings of the Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva, Switzerland.","DOI":"10.1109\/ACII.2013.47"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.knosys.2017.02.014","article-title":"Self-training for multi-target regression with tree ensembles","volume":"123","author":"Ceci","year":"2017","journal-title":"Knowl.-Based Syst."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1007\/s10844-014-0347-y","article-title":"The importance of the label hierarchy in hierarchical multi-label classification","volume":"45","author":"Kocev","year":"2015","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.ins.2018.03.033","article-title":"Semi-supervised trees for multi-target regression","volume":"450","author":"Kocev","year":"2018","journal-title":"Inf. Sci."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/3\/64\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:38:23Z","timestamp":1760186303000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/3\/64"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,16]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["a12030064"],"URL":"https:\/\/doi.org\/10.3390\/a12030064","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,16]]}}}