{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T08:57:54Z","timestamp":1772096274394,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,2,5]],"date-time":"2021-02-05T00:00:00Z","timestamp":1612483200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The Ministry of Small and Medium-sized Enterprises(SMEs) and Startups(MSS)","award":["S2855401"],"award-info":[{"award-number":["S2855401"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Image segmentation plays a central role in a broad range of applications, such as medical image analysis, autonomous vehicles, video surveillance and augmented reality. Portrait segmentation, which is a subset of semantic image segmentation, is widely used as a preprocessing step in multiple applications such as security systems, entertainment applications, video conferences, etc. A substantial amount of deep learning-based portrait segmentation approaches have been developed, since the performance and accuracy of semantic image segmentation have improved significantly due to the recent introduction of deep learning technology. However, these approaches are limited to a single portrait segmentation model. In this paper, we propose a novel approach using an ensemble method by combining multiple heterogeneous deep-learning based portrait segmentation models to improve the segmentation performance. The Two-Models ensemble and Three-Models ensemble, using a simple soft voting method and weighted soft voting method, were experimented. Intersection over Union (IoU) metric, IoU standard deviation and false prediction rate were used to evaluate the performance. Cost efficiency was calculated to analyze the efficiency of segmentation. The experiment results show that the proposed ensemble approach can perform with higher accuracy and lower errors than single deep-learning-based portrait segmentation models. The results also show that the ensemble of deep-learning models typically increases the use of memory and computing power, although it also shows that the ensemble of deep-learning models can perform more efficiently than a single model with higher accuracy using less memory and less computing power.<\/jats:p>","DOI":"10.3390\/e23020197","type":"journal-article","created":{"date-parts":[[2021,2,7]],"date-time":"2021-02-07T14:04:13Z","timestamp":1612706653000},"page":"197","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Portrait Segmentation Using Ensemble of Heterogeneous Deep-Learning Models"],"prefix":"10.3390","volume":"23","author":[{"given":"Yong-Woon","family":"Kim","sequence":"first","affiliation":[{"name":"Centre for Digital Innovation, CHRIST (Deemed to be University), Bangalore, Karnataka 560029, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1107-9941","authenticated-orcid":false,"given":"Yung-Cheol","family":"Byun","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Jeju National University, 102 Jejudaehak-ro, Jeju-si 63243, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Addapalli V. N.","family":"Krishna","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, CHRIST (Deemed to be University), Bangalore, Karnataka 560029, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s13735-017-0141-z","article-title":"A review of semantic segmentation using deep neural networks","volume":"7","author":"Guo","year":"2018","journal-title":"Int. J. Multimed. Inf. Retr."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/S0734-189X(85)90153-7","article-title":"Image segmentation techniques","volume":"29","author":"Haralick","year":"1985","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Minaee, S., Boykov, Y., Porikli, F., Plaza, A., Kehtarnavaz, N., and Terzopoulos, D. (2020). Image Segmentation Using Deep Learning: A Survey. arXiv, Available online: http:\/\/arxiv.org\/abs\/2001.05566.","DOI":"10.1109\/TPAMI.2021.3059968"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Aly, A.A., Deris, S.B., and Zaki, N. (2011). Research Review For Digital Image Segmentation Techniques. International Journal of Computer Science & Information Technology. Int. J. Comput. Sci. Inform. Technol., 3.","DOI":"10.5121\/ijcsit.2011.3509"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"89","DOI":"10.7763\/IJFCC.2014.V3.274","article-title":"A survey: Image segmentation techniques","volume":"3","author":"Khan","year":"2014","journal-title":"Int. J. Future Comput. Commun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"040901","DOI":"10.1117\/1.JEI.21.4.040901","article-title":"Survey of contemporary trends in color image segmentation","volume":"21","author":"Vantaram","year":"2012","journal-title":"J. Electron. Imaging"},{"key":"ref_7","first-page":"20","article-title":"Image segmentation, available techniques, developments and open issues","volume":"2","author":"Zuva","year":"2011","journal-title":"Can. J. Image. Proc. Comput. Vis."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1302","DOI":"10.1109\/TGRS.2011.2164085","article-title":"Unsupervised polarimetric SAR image segmentation and classification using region growing with edge penalty","volume":"50","author":"Yu","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","first-page":"22","article-title":"Medical image segmentation: A review","volume":"2","author":"Patil","year":"2013","journal-title":"Int. J. Comput. Sci. Mob. Comput."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TPAMI.2010.161","article-title":"Contour detection and hierarchical image segmentation","volume":"33","author":"Arbelaez","year":"2011","journal-title":"IEEE Trans. Pattern. Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1109\/TPAMI.1984.4767596","article-title":"Stochastic relaxation, Gibbs distribution, and Bayesian restoration of images","volume":"6","author":"Geman","year":"1984","journal-title":"IEEE Trans. Pattern. Anal. Mach. Intell."},{"key":"ref_12","first-page":"259","article-title":"Edge detection techniques for image segmentation","volume":"3","author":"Muthukrishnan","year":"2011","journal-title":"Int. J. Comput. Sci. Inform. Technol."},{"key":"ref_13","unstructured":"Milan, S., Vaclav, H., and Roger, B. (2013). Image Processing, Analysis, and Machine Vision, Cengage Learning. [4th ed.]."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., and Garcia-Rodriguez, J. (2017). A Review on Deep Learning Techniques Applied to Semantic Segmentation. arXiv.","DOI":"10.1016\/j.asoc.2018.05.018"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"167585","DOI":"10.1109\/ACCESS.2020.3023746","article-title":"Human Segmentation Based on Compressed Deep Convolutional Neural Network","volume":"8","author":"Miao","year":"2020","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s11633-017-1053-3","article-title":"A survey on deep learning-based fine-grained object classification and semantic segmentation","volume":"14","author":"Zhao","year":"2017","journal-title":"Int. J. Autom. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-009-9124-7","article-title":"Ensemble-based classifiers","volume":"33","author":"Rokach","year":"2010","journal-title":"Artif. Intell. Rev."},{"key":"ref_18","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press. Available online: http:\/\/www.deeplearningbook.org."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/BF00117832","article-title":"Stacked regressions","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1109\/TMI.2004.828354","article-title":"Simultaneous Truth and Performance Level Estimation (STAPLE): An algorithm for the Vaidation of Image Segmentation","volume":"23","author":"Warfield","year":"2004","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_21","first-page":"838","article-title":"Shape-based averaging for combination of multiple segmentations","volume":"3750","author":"Rohlfing","year":"2005","journal-title":"Med. Image Comput. Comput. Interv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/34.58871","article-title":"Neural Network Ensembles","volume":"12","author":"Hansen","year":"1990","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s10994-009-5158-y","article-title":"Ensemble clustering using semidefinite programming with applications","volume":"79","author":"Singh","year":"2010","journal-title":"Mach. Learn."},{"key":"ref_24","unstructured":"Zuo, Y., and Drummond, T. (2017, January 13\u201315). Fast Residual Forests: Rapid Ensemble Learning for Semantic Segmentation. Proceedings of the 1st Annual Conference on Robot Learning (CoRL 2017), Mountain View, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.cviu.2017.05.004","article-title":"Speedup of deep learning ensembles for semantic segmentation using a model compression technique","volume":"164","author":"Holliday","year":"2017","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Nigam, I., Huang, C., and Ramanan, D. (2018, January 12\u201315). Ensemble Knowledge Transfer for Semantic Segmentation. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00168"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"473","DOI":"10.5194\/isprs-annals-III-3-473-2016","article-title":"Semantic Segmentation of Aerial Images with an Ensemble of Cnns","volume":"III-3","author":"Marmanis","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_28","unstructured":"Koren, Y. (2020, October 10). The BellKor Solution to the Netflix Grand Prize. Available online: https:\/\/netflixprize.com\/assets\/GrandPrize2009_BPC_BellKor.pdf."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kim, Y.W., Rose, J.I., and Krishna, A.V.N. (2020, January 26\u201327). Accuracy Enhancement of Portrait Segmentation by Ensembling Deep Learning Models. Proceedings of the 2020 Fifth International Conference on Research in Computational Intelligence and Communication Net-works (ICRCICN), Bangalore, India.","DOI":"10.1109\/ICRCICN50933.2020.9296196"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1007\/s10462-018-9641-3","article-title":"Recent progress in semantic image segmentation","volume":"52","author":"Liu","year":"2019","journal-title":"Artif. Intell. Rev."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Du, X., Wang, X., Li, D., Zhu, J., Tasci, S., Upright, C., Walsh, S., and Davis, L. (2019, January 11). Boundary-sensitive network for portrait segmentation. Proceedings of the 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition, Lille, France.","DOI":"10.1109\/FG.2019.8756516"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.asoc.2018.05.018","article-title":"A survey on deep learning techniques for image and video semantic segmentation","volume":"70","author":"Oprea","year":"2018","journal-title":"Appl. Soft Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.cag.2019.03.007","article-title":"PortraitNet: Real-time portrait segmentation network for mobile device","volume":"80","author":"Zhang","year":"2019","journal-title":"Comput. Graph."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Park, H., Sj\u00f6sund, L.L., Yoo, Y., Monet, N., Bang, J., and Kwak, N. (2020, January 1\u20135). SINet: Extreme Lightweight Portrait Segmentation Networks with Spatial Squeeze Modules and Information Blocking Decoder. Proceedings of the 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093588"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully Convolutional Networks for Semantic Segmentation","volume":"39","author":"Shelhamer","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201323). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_37","unstructured":"Howard, A., Sandler, M., Chu, G., Chen, L.-C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_38","unstructured":"Yang, J., Price, B., Cohen, S., Lee, H., and Yang, M.H. (July, January 26). Object contour detection with a fully convolutional encoder-decoder network. Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_39","unstructured":"Park, H., Sj\u00f6sund, L.L., Yoo, Y., Bang, J., and Kwak, N. (2019). ExtremeC3Net: Extreme Lightweight Portrait Segmentation Networks Using Advanced C3-Modules. arXiv, Available online: https:\/\/arxiv.org\/abs\/1908.03093."},{"key":"ref_40","unstructured":"Chen, L.-C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv, Available online: https:\/\/arxiv.org\/abs\/1706.05587."},{"key":"ref_41","unstructured":"Chen, X., Qi, D., and Shen, J. (2019). Boundary-Aware Network for Fast and High-Accuracy Portrait Segmentation. arXiv, Available online: https:\/\/arxiv.org\/abs\/1901.03814."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhou, Z.-H. (2012). Ensemble Methods, Foundations and Algorithms, Chapman and Hall\/CRC.","DOI":"10.1201\/b12207"},{"key":"ref_43","unstructured":"(2020, July 29). AISegment.com\u2014Matting Human Datasets|Kaggle. Available online: https:\/\/www.kaggle.com\/laurentmih\/aisegmentcom-matting-human-datasets."},{"key":"ref_44","unstructured":"(2020, August 25). EG1800.zip_Free High-Speed Download|Baidu Netdisk-Share Unlimited. Available online: https:\/\/pan.baidu.com\/s\/1myEBdEmGz6ufniU3i1e6Uw."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","article-title":"Stacked generalization","volume":"5","author":"Wolpert","year":"1992","journal-title":"Neural Netw."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1023\/A:1007511322260","article-title":"Linearly combining density estimators via stacking","volume":"36","author":"Smyth","year":"1999","journal-title":"Mach. Learn."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Talbi, F., Alim, F., Seddiki, S., Mezzah, I., and Hachemi, B. (2015, January 20\u201322). Separable convolution Gaussian smoothing filters on a xilinx FPGA platform. Proceedings of the Fifth International Conference on the Innovative Computing Technology (INTECH 2015), Pontevedra, Spain.","DOI":"10.1109\/INTECH.2015.7173372"},{"key":"ref_48","first-page":"514","article-title":"FPGA implementation of filtered image using 2D Gaussian filter","volume":"7","author":"Kabbai","year":"2016","journal-title":"Int. J. Adv. Comput. Sci. Appl."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/2\/197\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:20:16Z","timestamp":1760160016000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/2\/197"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,5]]},"references-count":48,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["e23020197"],"URL":"https:\/\/doi.org\/10.3390\/e23020197","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,5]]}}}