{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:21:56Z","timestamp":1760239316311,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,11,1]],"date-time":"2020-11-01T00:00:00Z","timestamp":1604188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61573087","61573088"],"award-info":[{"award-number":["61573087","61573088"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Real-time semantic segmentation plays a crucial role in industrial applications, such as autonomous driving, the beauty industry, and so on. It is a challenging problem to balance the relationship between speed and segmentation performance. To address such a complex task, this paper introduces an efficient convolutional neural network (CNN) architecture named HLNet for devices with limited resources. Based on high-quality design modules, HLNet better integrates high-dimensional and low-dimensional information while obtaining sufficient receptive fields, which achieves remarkable results on three benchmark datasets. To our knowledge, the accuracy of skin tone classification is usually unsatisfactory due to the influence of external environmental factors such as illumination and background impurities. Therefore, we use HLNet to obtain accurate face regions, and further use color moment algorithm to extract its color features. Specifically, for a 224\u00d7224 input, using our HLNet, we achieve 78.39% mean IoU on Figaro1k dataset at over 17 FPS in the case of the CPU environment. We further use the masked color moment for skin tone grade evaluation and approximate 80% classification accuracy demonstrate the feasibility of the proposed method.<\/jats:p>","DOI":"10.3390\/sym12111812","type":"journal-article","created":{"date-parts":[[2020,11,1]],"date-time":"2020-11-01T20:05:25Z","timestamp":1604261125000},"page":"1812","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["HLNet: A Unified Framework for Real-Time Segmentation and Facial Skin Tones Evaluation"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8732-8601","authenticated-orcid":false,"given":"Xinglong","family":"Feng","sequence":"first","affiliation":[{"name":"College of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xianwen","family":"Gao","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0766-1325","authenticated-orcid":false,"given":"Ling","family":"Luo","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Rousset, C., and Coulon, P.Y. (2008, January 12\u201315). Frequential and color analysis for hair mask segmentation. Proceedings of the 2008 15th IEEE International Conference on Image Processing, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4712245"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"748634","DOI":"10.1155\/2014\/748634","article-title":"Image based hair segmentation algorithm for the application of automatic facial caricature synthesis","volume":"2014","author":"Shen","year":"2014","journal-title":"Sci. World J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e27","DOI":"10.1111\/j.1600-0846.2011.00603.x","article-title":"A feature-preserving hair removal algorithm for dermoscopy images","volume":"19","author":"Abbas","year":"2013","journal-title":"Skin Res. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Borza, D., Ileni, T., and Darabant, A. (2018, January 24\u201327). A deep learning approach to hair segmentation and color extraction from facial images. Proceedings of the International Conference on Advanced Concepts for Intelligent Vision Systems, Poitiers, France.","DOI":"10.1007\/978-3-030-01449-0_37"},{"key":"ref_5","unstructured":"Wen, S., Dong, M., Yang, Y., Zhou, P., Huang, T., and Chen, Y. (2019). End-to-end detection-segmentation system for face labeling. IEEE Trans. Emerg. Top. Comput. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Luo, L., Xue, D., and Feng, X. (2020). EHANet: An Effective Hierarchical Aggregation Network for Face Parsing. Appl. Sci., 10.","DOI":"10.3390\/app10093135"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.imavis.2018.02.001","article-title":"Hair detection, segmentation, and hairstyle classification in the wild","volume":"71","author":"Muhammad","year":"2018","journal-title":"Image Vis. Comput."},{"key":"ref_8","first-page":"640","article-title":"Fully convolutional networks for semantic segmentation","volume":"39","author":"Long","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2017, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany."},{"key":"ref_10","unstructured":"Yu, F., and Koltun, V. (2016, April 30). Multi-Scale Context Aggregation by Dilated Convolutions. Available online: https:\/\/arxiv.org\/abs\/1511.07122."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., and Torr, P.H. (2015, January 11\u201318). Conditional random fields as recurrent neural networks. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.179"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., and Sang, N. (2018, January 8\u201314). Bisenet: Bilateral segmentation network for real-time semantic segmentation. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01261-8_20"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Stricker, M.A., and Orengo, M. (1995, January 23). Similarity of color images. Proceedings of the International Society for Optics and Photonics, San Jose, CA, USA.","DOI":"10.1117\/12.205308"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1080\/01431160412331269698","article-title":"Random forest classifier for remote sensing classification","volume":"26","author":"Pal","year":"2005","journal-title":"Int. J. Remote Sens."},{"key":"ref_15","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017, December 05). Rethinking Atrous Convolution for Semantic Image Segmentation. Available online: https:\/\/arxiv.xilesou.top\/abs\/1706.05587."},{"key":"ref_16","unstructured":"Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., and Torr, P.H. (2017, January 21\u201327). The one hundred layers tiramisu: Fully convolutional densenets for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lin, G., Milan, A., Shen, C., and Reid, I. (2017, January 21\u201326). Refinenet: Multi-path refinement networks for high-resolution semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.549"},{"key":"ref_19","unstructured":"Paszke, A., Chaurasia, A., Kim, S., and Culurciello, E. (2016, June 07). Enet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation. Available online: https:\/\/arxiv.xilesou.top\/abs\/1606.02147."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhao, H., Qi, X., Shen, X., Shi, J., and Jia, J. (2018, January 8\u201314). Icnet for real-time semantic segmentation on high-resolution images. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01219-9_25"},{"key":"ref_21","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017, April 17). Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications. Available online: https:\/\/arxiv.xilesou.top\/abs\/1704.04861."},{"key":"ref_22","unstructured":"Poudel, R.P., Liwicki, S., and Cipolla, R. (2019, February 12). Fast-SCNN: Fast Semantic Segmentation Network. Available online: https:\/\/arxiv.xilesou.top\/abs\/1902.04502."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Li, H., Xiong, P., Fan, H., and Sun, J. (2019, January 16\u201320). Dfanet: Deep feature aggregation for real-time semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Los Angeles, CA, USA.","DOI":"10.1109\/CVPR.2019.00975"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, Y., Zhou, Q., Liu, J., Xiong, J., Gao, G., Wu, X., and Latecki, L.J. (2019, May 13). LEDNet: A Lightweight Encoder-Decoder Network for Real-Time Semantic Segmentation. Available online: https:\/\/arxiv.xilesou.top\/abs\/1905.02423.","DOI":"10.1109\/ICIP.2019.8803154"},{"key":"ref_25","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, CA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhang, H., Dana, K., Shi, J., Zhang, Z., Wang, X., Tyagi, A., and Agrawal, A. (2018, January 19\u201321). Context encoding for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00747"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 16\u201320). Dual attention network for scene segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Los Angeles, CA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_28","unstructured":"Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2016, June 07). Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected Crfs. Available online: https:\/\/arxiv.xilesou.top\/abs\/1412.7062."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Levinshtein, A., Chang, C., Phung, E., Kezele, I., Guo, W., and Aarabi, P. (2018, January 8\u201310). Real-time deep hair matting on mobile devices. Proceedings of the Conference on Computer and Robot Vision, Toronto, ON, Canada.","DOI":"10.1109\/CRV.2018.00011"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sun, K., Xiao, B., Liu, D., and Wang, J. (2019, February 25). Deep High-Resolution Representation Learning for Human Pose Estimation. Available online: https:\/\/arxiv.xilesou.top\/abs\/1902.09212.","DOI":"10.1109\/CVPR.2019.00584"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 19\u201321). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_33","unstructured":"Ioffe, S., and Szegedy, C. (2015, March 02). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Available online: https:\/\/arxiv.xilesou.top\/abs\/1502.03167."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tian, Z., Shen, C., Chen, H., and He, T. (2019, August 20). FCOS: Fully Convolutional One-Stage Object Detection. Available online: https:\/\/arxiv.xilesou.top\/abs\/1904.01355.","DOI":"10.1109\/ICCV.2019.00972"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sudre, C.H., Li, W., Vercauteren, T., Ourselin, S., and Cardoso, M.J. (2017, January 14). Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. Proceedings of the Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Qu\u00e9bec City, QC, Canada.","DOI":"10.1007\/978-3-319-67558-9_28"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, K., Sun, J., and Tang, X. (2010, January 5\u201311). Guided image filtering. Proceedings of the European Conference on Computer Vision, Crete, Greece.","DOI":"10.1007\/978-3-642-15549-9_1"},{"key":"ref_37","unstructured":"He, K., and Sun, J. (2015, May 05). Fast Guided Filter. Available online: https:\/\/arxiv.xilesou.top\/abs\/1505.00996."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TPAMI.2007.1177","article-title":"A closed-form solution to natural image matting","volume":"30","author":"Levin","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kae, A., Sohn, K., Lee, H., and Learned-Miller, E. (2013, January 1\u20138). Augmenting CRFs with Boltzmann machine shape priors for image labeling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Sydney, Australia.","DOI":"10.1109\/CVPR.2013.263"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yang, S., Luo, P., Loy, C.C., and Tang, X. (2015, January 11\u201318). From facial parts responses to face detection: A deep learning approach. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.419"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Svanera, M., Muhammad, U.R., Leonardi, R., and Benini, S. (2016, January 25\u201328). Figaro, hair detection and segmentation in the wild. Proceedings of the IEEE International Conference on Image Processing, Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7532494"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","article-title":"Joint face detection and alignment using multitask cascaded convolutional networks","volume":"23","author":"Zhang","year":"2016","journal-title":"IEEE. Signal. Process. Lett."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/11\/1812\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:27:56Z","timestamp":1760178476000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/11\/1812"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,1]]},"references-count":42,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["sym12111812"],"URL":"https:\/\/doi.org\/10.3390\/sym12111812","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2020,11,1]]}}}