{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T03:23:43Z","timestamp":1782098623963,"version":"3.54.5"},"reference-count":45,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2020,8,10]],"date-time":"2020-08-10T00:00:00Z","timestamp":1597017600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Facial beauty prediction (FBP) is a burgeoning issue for attractiveness evaluation, which aims to make assessment consistent with human opinion. Since FBP is a regression problem, to handle this issue, there are data-driven methods for finding the relations between facial features and beauty assessment. Recently, deep learning methods have shown its amazing capacity for feature representation and analysis. Convolutional neural networks (CNNs) have shown tremendous performance on facial recognition and comprehension, which are proved as an effective method for facial feature exploration. Lately, there are well-designed networks with efficient structures investigated for better representation performance. However, these designs concentrate on the effective block but do not build an efficient information transmission pathway, which led to a sub-optimal capacity for feature representation. Furthermore, these works cannot find the inherent correlations of feature maps, which also limits the performance. In this paper, an elaborate network design for FBP issue is proposed for better performance. A residual-in-residual (RIR) structure is introduced to the network for passing the gradient flow deeper, and building a better pathway for information transmission. By applying the RIR structure, a deeper network can be established for better feature representation. Besides the RIR network design, an attention mechanism is introduced to exploit the inner correlations among features. We investigate a joint spatial-wise and channel-wise attention (SCA) block to distribute the importance among features, which finds a better representation for facial information. Experimental results show our proposed network can predict facial beauty closer to a human\u2019s assessment than state-of-the-arts.<\/jats:p>","DOI":"10.3390\/info11080391","type":"journal-article","created":{"date-parts":[[2020,8,10]],"date-time":"2020-08-10T05:07:23Z","timestamp":1597036043000},"page":"391","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Deep Learning for Facial Beauty Prediction"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4053-7166","authenticated-orcid":false,"given":"Kerang","family":"Cao","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Shenyang University of Chemical Technology, Shenyang 110000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kwang-nam","family":"Choi","sequence":"additional","affiliation":[{"name":"NTIS Center, Korea Institute of Science and Technology Information, Seoul 34113, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7607-1126","authenticated-orcid":false,"given":"Hoekyung","family":"Jung","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Paichai University, Daejeon 35345, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lini","family":"Duan","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Shenyang University of Chemical Technology, Shenyang 110000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1049\/cje.2020.01.009","article-title":"Facial Beauty Prediction Based on Lighted Deep Convolution Neural Network with Feature Extraction Strengthened","volume":"29","author":"Gan","year":"2020","journal-title":"Chin. J. Electron."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1049\/cje.2016.10.020","article-title":"Unconstrained Facial Beauty Prediction Based on Multi-scale K-Means","volume":"26","author":"Gan","year":"2017","journal-title":"Chin. J. Electron."},{"key":"ref_3","unstructured":"Gunes, H., Piccardi, M., and Jan, T. (2004, January 10\u201313). Comparative beauty classification for pre-surgery planning. Proceedings of the 2004 IEEE International Conference on Systems, Man and Cybernetics, The Hague, The Netherlands."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wassermann, S., Seufert, M., Casas, P., Gang, L., and Li, K. (2019, January 19\u201321). Let me Decrypt your Beauty: Real-time Prediction of Video Resolution and Bitrate for Encrypted Video Streaming. Proceedings of the 2019 Network Traffic Measurement and Analysis Conference (TMA), Paris, France.","DOI":"10.23919\/TMA.2019.8784589"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Workman, S., Souvenir, R., and Jacobs, N. (2017, January 22\u201329). Understanding and Mapping Natural Beauty. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.596"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1109\/TAFFC.2016.2599534","article-title":"Data-Driven Facial Beauty Analysis: Prediction, Retrieval and Manipulation","volume":"9","author":"Chen","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Shi, S., Gao, F., Meng, X., Xu, X., and Zhu, J. (2019, January 12\u201317). Improving Facial Attractiveness Prediction via Co-attention Learning. Proceedings of the 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8683112"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"20245","DOI":"10.1109\/ACCESS.2020.2968837","article-title":"2M BeautyNet: Facial Beauty Prediction Based on Multi-Task Transfer Learning","volume":"8","author":"Gan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liang, L., Lin, L., Jin, L., Xie, D., and Li, M. (2018, January 20\u201324). SCUT-FBP5500: A Diverse Benchmark Dataset for Multi-Paradigm Facial Beauty Prediction. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.","DOI":"10.1109\/ICPR.2018.8546038"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yu, Z., and Raschka, S. (2020). Looking Back to Lower-Level Information in Few-Shot Learning. Information, 11.","DOI":"10.3390\/info11070345"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gibson, J., and Oh, H. (2020). Mutual Information Loss in Pyramidal Image Processing. Information, 11.","DOI":"10.3390\/info11060322"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Susilo, B., and Sari, R. (2020). Intrusion Detection in IoT Networks Using Deep Learning Algorithm. Information, 11.","DOI":"10.3390\/info11050279"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Ding, W., and Liu, C. (2019, January 17\u201319). Summary of Convolutional Neural Network Compression Technology. Proceedings of the 2019 IEEE International Conference on Unmanned Systems (ICUS), Beijing, China.","DOI":"10.1109\/ICUS48101.2019.8995969"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Devi, N., and Borah, B. (2018, January 21\u201323). Cascaded pooling for Convolutional Neural Networks. Proceedings of the 2018 Fourteenth International Conference on Information Processing (ICINPRO), Bangalore, India.","DOI":"10.1109\/ICINPRO43533.2018.9096860"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, Y., Li, Y., Song, Y., and Rong, X. (2019). Facial Expression Recognition Based on Random Forest and Convolutional Neural Network. Information, 10.","DOI":"10.3390\/info10120375"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Almakky, I., Palade, V., and Ruiz-Garcia, A. (2019, January 14\u201319). Deep Convolutional Neural Networks for Text Localisation in Figures From Biomedical Literature. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852353"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wan, S., Gong, C., Zhong, P., Pan, S., Li, G., and Yang, J. (2020). Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2020.2994205"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"117","DOI":"10.23919\/JCC.2020.02.010","article-title":"Face image recognition based on convolutional neural network","volume":"17","author":"Lou","year":"2020","journal-title":"China Commun."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Stephen, O., Maduh, U.J., Ibrokhimov, S., Hui, K.L., Abdulhakim Al-Absi, A., and Sain, M. (2019, January 17\u201320). A Multiple-Loss Dual-Output Convolutional Neural Network for Fashion Class Classification. Proceedings of the 2019 21st International Conference on Advanced Communication Technology (ICACT), PyeongChang, Korea.","DOI":"10.23919\/ICACT.2019.8701958"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yu, D., and Sun, S. (2020). A Systematic Exploration of Deep Neural Networks for EDA-Based Emotion Recognition. Information, 11.","DOI":"10.3390\/info11040212"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xiang, Z., Dong, X., Li, Y., Yu, F., Xu, X., and Wu, H. (2020). Bimodal Emotion Recognition Model for Minnan Songs. Information, 11.","DOI":"10.3390\/info11030145"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cheng, Y., Liu, Z., and Morimoto, Y. (2020). Attention-Based SeriesNet: An Attention-Based Hybrid Neural Network Model for Conditional Time Series Forecasting. Information, 11.","DOI":"10.3390\/info11060305"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nascimento, J.C., and Carneiro, G. (2019). One shot segmentation: Unifying rigid detection and non-rigid segmentation using elastic regularization. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2019.2922959"},{"key":"ref_24","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS), Lake Tahoe, Nevada."},{"key":"ref_25","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated Residual Transformations for Deep Neural Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. (2016). Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. arXiv.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_29","unstructured":"Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Zhang, Z., Lin, H., Sun, Y., He, T., Mueller, J., and Manmatha, R. (2020). ResNeSt: Split-Attention Networks. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, X., Wang, W., Hu, X., and Yang, J. (2019, January 18\u201323). Selective Kernel Networks. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2019.00060"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"177734","DOI":"10.1109\/ACCESS.2019.2958030","article-title":"Deformable Non-Local Network for Video Super-Resolution","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lin, K., Jia, C., Zhao, Z., Wang, L., Wang, S., Ma, S., and Gao, W. (2019, January 12\u201315). Residual in Residual Based Convolutional Neural Network In-loop Filter for AVS3. Proceedings of the 2019 Picture Coding Symposium (PCS), Ningbo, China.","DOI":"10.1109\/PCS48520.2019.8954561"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xie, W., Zhang, J., Lu, Z., Cao, M., and Zhao, Y. (2020, January 4\u20138). Non-Local Nested Residual Attention Network for Stereo Image Super-Resolution. Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9054687"},{"key":"ref_35","unstructured":"Okaishi, W.A., Zaarzne, A., Slimani, I., Atouf, I., and Benrabh, M. (2019, January 12\u201313). A Traffic Surveillance System in Real-Time to Detect and Classify Vehicles by Using Convolutional Neural Network. Proceedings of the 2019 International Conference on Systems of Collaboration Big Data, Internet of Things Security (SysCoBIoTS), Casablanca, Morocco."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Pak, J., and Kim, M. (2019, January 11\u201313). Convolutional Neural Network Approach for Aircraft Noise Detection. Proceedings of the 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan.","DOI":"10.1109\/ICAIIC.2019.8669006"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Lu, S., Feng, J., and Wu, J. (2019, January 3\u20135). A Time Weight Convolutional Neural Network for Positioning Internal Detector. Proceedings of the 2019 Chinese Control And Decision Conference (CCDC), Nanchang, China.","DOI":"10.1109\/CCDC.2019.8832794"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sun, G., Wang, Y., and Sun, C. (2019, January 2\u20135). Fault Diagnosis of Planetary Gearbox Based on Signal Denoising and Convolutional Neural Network. Proceedings of the 2019 Prognostics and System Health Management Conference (PHM-Paris), Paris, France.","DOI":"10.1109\/PHM-Paris.2019.00024"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lee, K., Chae, S., and Park, H. (2019, January 24\u201328). Optimal Time-Window Derivation for Human-Activity Recognition Based on Convolutional Neural Networks of Repeated Rehabilitation Motions. Proceedings of the 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR), Toronto, ON, Canada.","DOI":"10.1109\/ICORR.2019.8779475"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Guha, S.R., and Haque, S.R. (2019, January 24\u201325). Convolutional Neural Network Based Skin Lesion Analysis for Classifying Melanoma. Proceedings of the 2019 International Conference on Sustainable Technologies for Industry 4.0 (STI), Dhaka, Bangladesh.","DOI":"10.1109\/STI47673.2019.9067979"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Alani, A. (2017). Arabic Handwritten Digit Recognition Based on Restricted Boltzmann Machine and Convolutional Neural Networks. Information, 8.","DOI":"10.3390\/info8040142"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yu, Y., Lin, H., Meng, J., Wei, X., and Zhao, Z. (2017). Assembling Deep Neural Networks for Medical Compound Figure Detection. Information, 8.","DOI":"10.3390\/info8020048"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Peng, M., Wang, C., Chen, T., and Liu, G. (2016). NIRFaceNet: A Convolutional Neural Network for Near-Infrared Face Identification. Information, 7.","DOI":"10.3390\/info7040061"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_45","unstructured":"Lin, L., Liang, L., and Jin, L. (2019). Regression Guided by Relative Ranking Using Convolutional Neural Network (R3CNN) for Facial Beauty Prediction. IEEE Trans. Affect. Comput., 1."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/8\/391\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:58:32Z","timestamp":1760176712000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/8\/391"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,10]]},"references-count":45,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["info11080391"],"URL":"https:\/\/doi.org\/10.3390\/info11080391","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,10]]}}}