{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T05:06:48Z","timestamp":1764133608839,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,20]],"date-time":"2022-12-20T00:00:00Z","timestamp":1671494400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union","award":["T1EDK - 03110"],"award-info":[{"award-number":["T1EDK - 03110"]}]},{"name":"Greek national funds","award":["T1EDK - 03110"],"award-info":[{"award-number":["T1EDK - 03110"]}]},{"name":"Operational Program Competitiveness, Entrepreneurship, and Innovation","award":["T1EDK - 03110"],"award-info":[{"award-number":["T1EDK - 03110"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Multiclass image classification is a complex task that has been thoroughly investigated in the past. Decomposition-based strategies are commonly employed to address it. Typically, these methods divide the original problem into smaller, potentially simpler problems, allowing the application of numerous well-established learning algorithms that may not apply directly to the original task. This work focuses on the efficiency of decomposition-based methods and proposes several improvements to the meta-learning level. In this paper, four methods for optimizing the ensemble phase of multiclass classification are introduced. The first demonstrates that employing a mixture of experts scheme can drastically reduce the number of operations in the training phase by eliminating redundant learning processes in decomposition-based techniques for multiclass problems. The second technique for combining learner-based outcomes relies on Bayes\u2019 theorem. Combining the Bayes rule with arbitrary decompositions reduces training complexity relative to the number of classifiers even further. Two additional methods are also proposed for increasing the final classification accuracy by decomposing the initial task into smaller ones and ensembling the output of the base learners along with that of a multiclass classifier. Finally, the proposed novel meta-learning techniques are evaluated on four distinct datasets of varying classification difficulty. In every case, the proposed methods present a substantial accuracy improvement over existing traditional image classification techniques.<\/jats:p>","DOI":"10.3390\/s23010009","type":"journal-article","created":{"date-parts":[[2022,12,20]],"date-time":"2022-12-20T03:29:20Z","timestamp":1671506960000},"page":"9","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Novel Meta-Learning Techniques for the Multiclass Image Classification Problem"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1756-4502","authenticated-orcid":false,"given":"Antonios","family":"Vogiatzis","sequence":"first","affiliation":[{"name":"School of ECE, Technical University of Crete, 731 00 Chania, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0767-9488","authenticated-orcid":false,"given":"Stavros","family":"Orfanoudakis","sequence":"additional","affiliation":[{"name":"School of ECE, Technical University of Crete, 731 00 Chania, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0716-2972","authenticated-orcid":false,"given":"Georgios","family":"Chalkiadakis","sequence":"additional","affiliation":[{"name":"School of ECE, Technical University of Crete, 731 00 Chania, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4826-6388","authenticated-orcid":false,"given":"Konstantia","family":"Moirogiorgou","sequence":"additional","affiliation":[{"name":"School of ECE, Technical University of Crete, 731 00 Chania, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0705-631X","authenticated-orcid":false,"given":"Michalis","family":"Zervakis","sequence":"additional","affiliation":[{"name":"School of ECE, Technical University of Crete, 731 00 Chania, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ciregan, D., Meier, U., and Schmidhuber, J. (2012, January 16\u201321). Multi-column deep neural networks for image classification. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248110"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1023\/A:1007692713085","article-title":"Text Classification from Labeled and Unlabeled Documents using EM","volume":"39","author":"Nigam","year":"2000","journal-title":"Mach. Learn."},{"key":"ref_3","unstructured":"Kim, D., Goo Lee, S., Chun, J., and Lee, J. (2004, January 9). A semantic classification model for e-catalogs. Proceedings of the IEEE International Conference on e-Commerce Technology (CEC 2004), San Diego, CA, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"030133","DOI":"10.1063\/1.4991237","article-title":"Application of machine learning on brain cancer multiclass classification","volume":"1862","author":"Panca","year":"2017","journal-title":"Aip Conf. Proc."},{"key":"ref_5","unstructured":"Nilsson, N.J., Sejnowski, T.J., White, H., Sejnowski, T.J., and White, H. (1965). Learning Machines: Foundations of Trainable Pattern-Classifying Systems, McGraw-Hill."},{"key":"ref_6","unstructured":"Jordan, M., Kearns, M., and Solla, S. Classification by Pairwise Coupling. Proceedings of the Advances in Neural Information Processing Systems."},{"key":"ref_7","first-page":"101","article-title":"In Defense of One-Vs-All Classification","volume":"5","author":"Rifkin","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"105922","DOI":"10.1016\/j.knosys.2020.105922","article-title":"A hybrid scheme-based one-vs-all decision trees for multi-class classification tasks","volume":"198","author":"Yan","year":"2020","journal-title":"Knowl. Based Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"107528","DOI":"10.1016\/j.patcog.2020.107528","article-title":"One-vs-One classification for deep neural networks","volume":"108","author":"Pawara","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1761","DOI":"10.1016\/j.patcog.2011.01.017","article-title":"An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes","volume":"44","author":"Galar","year":"2011","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vogiatzis, A., Chalkiadakis, G., Moirogiorgou, K., Livanos, G., Papadogiorgaki, M., and Zervakis, M. (2021, January 24\u201326). Dual-Branch CNN for the Identification of Recyclable Materials. Proceedings of the 2021 IEEE International Conference on Imaging Systems and Techniques (IST), Kaohsiung, Taiwan.","DOI":"10.1109\/IST50367.2021.9651347"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tsellou, A., Moirogiorgou, K., Plokamakis, G., Livanos, G., Kalaitzakis, K., and Zervakis, M. (2022, January 21\u201323). Aerial video inspection of Greek power lines structures using machine learning techniques. Proceedings of the 2022 IEEE International Conference on Imaging Systems and Techniques (IST), Kaohsiung, Taiwan.","DOI":"10.1109\/IST55454.2022.9827761"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5966","DOI":"10.1109\/TNNLS.2021.3072041","article-title":"Memory Efficient Class-Incremental Learning for Image Classification","volume":"33","author":"Zhao","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Vogiatzis, A., Chalkiadakis, G., Moirogiorgou, K., and Zervakis, M. (2021, January 24\u201326). A Novel One-vs-Rest Classification Framework for Mutually Supported Decisions by Independent Parallel Classifiers. Proceedings of the 2021 IEEE International Conference on Imaging Systems and Techniques (IST), Kaohsiung, Taiwan.","DOI":"10.1109\/IST50367.2021.9651468"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yi, Y., Chen, K.Y., and Gu, H.Y. (2019, January 18\u201321). Mixture of CNN Experts from Multiple Acoustic Feature Domain for Music Genre Classification. Proceedings of the 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Lanzhou, China.","DOI":"10.1109\/APSIPAASC47483.2019.9023314"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhang, L., Huang, S., Liu, W., and Tao, D. (November, January 27). Learning a Mixture of Granularity-Specific Experts for Fine-Grained Categorization. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00842"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e1249","DOI":"10.1002\/widm.1249","article-title":"Ensemble learning: A survey","volume":"8","author":"Sagi","year":"2018","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.inffus.2017.02.004","article-title":"Ensemble learning for data stream analysis: A survey","volume":"37","author":"Krawczyk","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1007\/s11704-019-8208-z","article-title":"A survey on ensemble learning","volume":"14","author":"Dong","year":"2019","journal-title":"Front. Comput. Sci."},{"key":"ref_20","unstructured":"Dietterich, T.G. Ensemble Methods in Machine Learning. Proceedings of the Multiple Classifier Systems."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gandhi, I., and Pandey, M. (2015, January 8\u201310). Hybrid Ensemble of classifiers using voting. Proceedings of the 2015 International Conference on Green Computing and Internet of Things (ICGCIoT), Greater Noida, India.","DOI":"10.1109\/ICGCIoT.2015.7380496"},{"key":"ref_22","unstructured":"Ueda, N., and Nakano, R. (1996, January 3\u20136). Generalization error of ensemble estimators. Proceedings of the International Conference on Neural Networks (ICNN\u201996), Washington, DC, USA."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhou, Z.H. (2012). Ensemble Methods: Foundations and Algorithms, Chapman & Hall\/CRC. [1st ed.].","DOI":"10.1201\/b12207"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","article-title":"Stacked Generalization","volume":"5","author":"Wolpert","year":"1992","journal-title":"Neural Netw."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"48980","DOI":"10.1109\/ACCESS.2021.3064040","article-title":"Research on Application of Classification Model Based on Stack Generalization in Staging of Cervical Tissue Pathological Images","volume":"9","author":"Zhang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_26","unstructured":"Samyukta, B., Sreekumar, A., HariVarshanS, R., Navaneeth, P., and Vaishnavi (2021). Possibilities of Auto ML in Microsoft Replacing the Jobs of Data Scientists. J. Inf. Technol. Softw. Eng., 1\u20134."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1006\/jcss.1997.1543","article-title":"On the boosting ability of top-down decision tree learning algorithms","volume":"58","author":"Kearns","year":"1996","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Moirogiorgou, K., Raptopoulos, F., Livanos, G., Orfanoudakis, S., Papadogiorgaki, M., Zervakis, M., and Maniadakis, M. (2022, January 21\u201323). Intelligent robotic system for urban waste recycling. Proceedings of the 2022 IEEE International Conference on Imaging Systems and Techniques (IST), Kaohsiung, Taiwan.","DOI":"10.1109\/IST55454.2022.9827769"},{"key":"ref_29","unstructured":"Hirata, D., and Takahashi, N. (2020). Ensemble learning in CNN augmented with fully connected subnetworks. arXiv."},{"key":"ref_30","unstructured":"Shazeer, N.M., Mirhoseini, A., Maziarz, K., Davis, A., Le, Q.V., Hinton, G.E., and Dean, J. (2017). Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. arXiv."},{"key":"ref_31","unstructured":"Hogan, B., Park, J., and Lutio, R. (2022, December 15). Herbarium 2022-FGVC9. Available online: https:\/\/kaggle.com\/competitions\/herbarium-2022-fgvc9."},{"key":"ref_32","unstructured":"Zhifei, Z., Yang, S., and Hairong, Q. (2017, January 21\u201326). Age Progression\/Regression by Conditional Adversarial Autoencoder. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kumsetty, N.V., Nekkare, A.B., and Kamath, S. (2022, January 27\u201329). TrashBox: Trash Detection and Classification using Quantum Transfer Learning. Proceedings of the 2022 31st Conference of Open Innovations Association (FRUCT), Helsinki, Finland.","DOI":"10.23919\/FRUCT54823.2022.9770922"},{"key":"ref_34","unstructured":"Thung, G., and Yang, M. (2022, December 15). Classification of Trash for Recyclability Status. CS229 Project Report 2016. Available online: https:\/\/cs229.stanford.edu\/proj2016\/report\/ThungYang-ClassificationOfTrashForRecyclabilityStatus-report.pdf."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_36","unstructured":"Kingma, D., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. Int. Conf. Learn. Represent. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.ipm.2009.03.002","article-title":"A systematic analysis of performance measures for classification tasks","volume":"45","author":"Sokolova","year":"2009","journal-title":"Inf. Process. Manag."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/9\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:44:28Z","timestamp":1760147068000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,20]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010009"],"URL":"https:\/\/doi.org\/10.3390\/s23010009","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,12,20]]}}}