{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T10:54:31Z","timestamp":1775732071780,"version":"3.50.1"},"reference-count":32,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,12]],"date-time":"2021-02-12T00:00:00Z","timestamp":1613088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The automatic assessment of the aesthetic quality of a photo is a challenging and extensively studied problem. Most of the existing works focus on the aesthetic quality assessment of photos regardless of the depicted subject and mainly use features extracted from the entire image. It has been observed that the performance of generic content aesthetic assessment methods significantly decreases when it comes to images depicting faces. This paper introduces a method for evaluating the aesthetic quality of images with faces by encoding both the properties of the entire image and specific aspects of the face. Three different convolutional neural networks are exploited to encode information regarding perceptual quality, global image aesthetics, and facial attributes; then, a model is trained to combine these features to explicitly predict the aesthetics of images containing faces. Experimental results show that our approach outperforms existing methods for both binary, i.e., low\/high, and continuous aesthetic score prediction on four different image databases in the state-of-the-art.<\/jats:p>","DOI":"10.3390\/s21041307","type":"journal-article","created":{"date-parts":[[2021,2,12]],"date-time":"2021-02-12T18:45:00Z","timestamp":1613155500000},"page":"1307","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Genetic Algorithm to Combine Deep Features for the Aesthetic Assessment of Images Containing Faces"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5925-2646","authenticated-orcid":false,"given":"Luigi","family":"Celona","sequence":"first","affiliation":[{"name":"Department of Informatics, Systems and Communication, University of Milano-Bicocca, viale Sarca, 336, 20126 Milano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7461-1451","authenticated-orcid":false,"given":"Raimondo","family":"Schettini","sequence":"additional","affiliation":[{"name":"Department of Informatics, Systems and Communication, University of Milano-Bicocca, viale Sarca, 336, 20126 Milano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Li, C., Loui, A.C., and Chen, T. (2010, January 25\u201329). Towards aesthetics: A photo quality assessment and photo selection system. Proceedings of the 18th ACM International Conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1874089"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2609","DOI":"10.1109\/TMM.2017.2699859","article-title":"A Probabilistic Approach to People-Centric Photo Selection and Sequencing","volume":"19","author":"Vonikakis","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bhattacharya, S., Sukthankar, R., and Shah, M. (2010, January 25\u201329). A framework for photo-quality assessment and enhancement based on visual aesthetics. Proceedings of the 18th ACM International Conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1873990"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1622","DOI":"10.1109\/TCE.2007.4429261","article-title":"Self-Adaptive Image Cropping for Small Displays","volume":"53","author":"Ciocca","year":"2007","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2801126","article-title":"User Preferences Modeling and Learning for Pleasing Photo Collage Generation","volume":"12","author":"Bianco","year":"2015","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Jin, B., Segovia, M.V.O., and S\u00fcsstrunk, S. (2016, January 25\u201328). Image aesthetic predictors based on weighted CNNs. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7532767"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bianco, S., Celona, L., Napoletano, P., and Schettini, R. (2016). Predicting Image Aesthetics with Deep Learning. International Conference on Advanced Concepts for Intelligent Vision Systems (ACIVS), Springer.","DOI":"10.1007\/978-3-319-48680-2_11"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.1109\/TIP.2017.2651399","article-title":"Deep Aesthetic Quality Assessment With Semantic Information","volume":"26","author":"Kao","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Freeman, M. (2007). The Photographer\u2019s Eye: Composition and Design for Better Digital Photos, CRC Press.","DOI":"10.4324\/9780080556161"},{"key":"ref_10","unstructured":"Luo, W., Wang, X., and Tang, X. (2011, January 6\u201313). Content based photo quality assessment. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2021","DOI":"10.1109\/TMM.2015.2477040","article-title":"Rating image aesthetics using deep learning","volume":"17","author":"Lu","year":"2015","journal-title":"IEEE Trans. Multimed."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Roy, H., Yamasaki, T., and Hashimoto, T. (2018, January 11). Predicting Image Aesthetics Using Objects in the Scene. Proceedings of the 2018 International Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia, Yokohama, Japan.","DOI":"10.1145\/3209693.3209698"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1109\/TPAMI.2013.2297710","article-title":"Adaptive color constancy using faces","volume":"36","author":"Bianco","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bakhshi, S., Shamma, D.A., and Gilbert, E. (2014, January 26\u201330). Faces engage us: Photos with faces attract more likes and comments on instagram. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada.","DOI":"10.1145\/2556288.2557403"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1109\/TMM.2013.2269899","article-title":"Content based photo quality assessment","volume":"15","author":"Tang","year":"2013","journal-title":"IEEE Trans. Multimed."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Redi, M., Rasiwasia, N., Aggarwal, G., and Jaimes, A. (2015, January 4\u20138). The beauty of capturing faces: Rating the quality of digital portraits. Proceedings of the 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Ljubljana, Slovenia.","DOI":"10.1109\/FG.2015.7163086"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kalayeh, M.M., Seifu, M., LaLanne, W., and Shah, M. (2015, January 26\u201330). How to take a good selfie?. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806365"},{"key":"ref_18","unstructured":"Males, M., Hedi, A., and Grgic, M. (2013, January 25\u201327). Aesthetic quality assessment of headshots. Proceedings of the ELMAR-2013, Zadar, Croatia."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1016\/j.image.2015.04.002","article-title":"How to predict the global instantaneous feeling induced by a facial picture?","volume":"39","author":"Lienhard","year":"2015","journal-title":"Signal Process. Image Commun."},{"key":"ref_20","unstructured":"Kairanbay, M., See, J., and Wong, L.K. (2016). Aesthetic Evaluation of Facial Portraits Using Compositional Augmentation for Deep CNNs. Asian Computer Vision Conference (ACCV), Springer."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, C., Gallagher, A., Loui, A.C., and Chen, T. (2010, January 26\u201329). Aesthetic quality assessment of consumer photos with faces. Proceedings of the 2010 IEEE International Conference on Image Processing, Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5651833"},{"key":"ref_22","unstructured":"Lienhard, A., Reinhard, M., Caplier, A., and Ladret, P. (2014, January 5\u20138). Photo rating of facial pictures based on image segmentation. Proceedings of the 2014 International Conference on Computer Vision Theory and Applications (VISAPP), Lisbon, Portugal."},{"key":"ref_23","first-page":"1","article-title":"Virtual portraitist: An intelligent tool for taking well-posed selfies","volume":"15","author":"Hu","year":"2019","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl. (TOMM)"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bianco, S., Celona, L., and Schettini, R. (2018, January 7\u201310). Aesthetics Assessment of Images Containing Faces. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451368"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Ververas, E., Kotsia, I., and Zafeiriou, S. (2020, January 16\u201318). RetinaFace: Single-Shot Multi-Level Face Localisation in the Wild. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Online.","DOI":"10.1109\/CVPR42600.2020.00525"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1007\/s11760-017-1166-8","article-title":"On the use of deep learning for blind image quality assessment","volume":"12","author":"Bianco","year":"2018","journal-title":"Signal Image Video Process."},{"key":"ref_27","unstructured":"Celona, L., and Schettini, R. (2020, January 6\u20137). CNN based image quality assessment of consumer photographs. Proceedings of the LIM 2020: London Imaging Meeting 2020, London, UK."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Murray, N., Marchesotti, L., and Perronnin, F. (2012, January 16\u201321). AVA: A large-scale database for aesthetic visual analysis. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247954"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"G\u00fcnther, M., Rozsa, A., and Boult, T.E. (2017, January 1\u20134). AFFACT\u2014Alignment Free Facial Attribute Classification Technique. Proceedings of the 2017 IEEE International Joint Conference on Biometrics (IJCB), Denver, CO, USA.","DOI":"10.1109\/BTAS.2017.8272686"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, D., Jiang, T., and Jiang, M. (2020, January 12\u201316). Norm-in-norm loss with faster convergence and better performance for image quality assessment. Proceedings of the 28th ACM International Conference on Multimedia, New York, NY, USA.","DOI":"10.1145\/3394171.3413804"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chen, Y.L., Huang, T.W., Chang, K.H., Tsai, Y.C., Chen, H.T., and Chen, B.Y. (2017, January 24\u201331). Quantitative analysis of automatic image cropping algorithms: A dataset and comparative study. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.32"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1862","DOI":"10.1109\/TPAMI.2019.2899857","article-title":"Exploiting unlabeled data in cnns by self-supervised learning to rank","volume":"41","author":"Liu","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1307\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:23:12Z","timestamp":1760160192000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,12]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21041307"],"URL":"https:\/\/doi.org\/10.3390\/s21041307","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,12]]}}}