{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T23:09:57Z","timestamp":1768777797534,"version":"3.49.0"},"reference-count":46,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,10,23]],"date-time":"2021-10-23T00:00:00Z","timestamp":1634947200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100011698","name":"Regional Government of Castile-La Mancha","doi-asserted-by":"publisher","award":["SBPLY\/17\/180501\/000493"],"award-info":[{"award-number":["SBPLY\/17\/180501\/000493"]}],"id":[{"id":"10.13039\/501100011698","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministerio de Ciencia e Innovaci\u00f3n - Agencia Estatal de  Investigaci\u00f3n","award":["PID2019-106758GB-C33"],"award-info":[{"award-number":["PID2019-106758GB-C33"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Automatic aesthetic quality assessment is a computer vision problem in which we quantify the attractiveness or the appealingness of a photograph. This is especially useful in social networks, where the amount of images generated each day requires automation for processing. This work presents Aesthetic Selector, an application able to identify images of high aesthetic quality, showing also relevant information about the decisions and providing the use of the most appropriate filters to enhance a given image. We then analyzed the main proposals in the aesthetic quality field, describing their strengths and weaknesses in order to determine the filters to be included in the application Aesthetic Selector. This proposed application was tested, giving good results, in three different scenarios: image selection, image finding, and filter selection. Besides, we carried out a study of distinct visualization tools to better understand the models\u2019 behavior. These techniques also allow detecting which areas are more relevant within the images when models perform classification. The application also includes this interpretability module. Aesthetic Selector is an innovative and original program, because in the field of aesthetic quality in photography, there are no applications that identify high-quality images and also because it offers the capability of showing information about which parts of the image have affected this decision.<\/jats:p>","DOI":"10.3390\/e23111389","type":"journal-article","created":{"date-parts":[[2021,10,24]],"date-time":"2021-10-24T22:06:16Z","timestamp":1635113176000},"page":"1389","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["An Application for Aesthetic Quality Assessment in Photography with Interpretability Features"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2573-2200","authenticated-orcid":false,"given":"Fernando","family":"Rubio Perona","sequence":"first","affiliation":[{"name":"Departamento de Sistemas Inform\u00e1ticos, Universidad de Castilla-La Mancha (UCLM), 02071 Albacete, Spain"},{"name":"Intelligent Systems and Data Mining Research Group, Albacete Research Institute of Informatics (I3A), Universidad de Castilla-La Mancha (UCLM), 02071 Albacete, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6956-3184","authenticated-orcid":false,"given":"Mar\u00eda Julia","family":"Flores Gallego","sequence":"additional","affiliation":[{"name":"Departamento de Sistemas Inform\u00e1ticos, Universidad de Castilla-La Mancha (UCLM), 02071 Albacete, Spain"},{"name":"Intelligent Systems and Data Mining Research Group, Albacete Research Institute of Informatics (I3A), Universidad de Castilla-La Mancha (UCLM), 02071 Albacete, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jos\u00e9 Miguel","family":"Puerta Callej\u00f3n","sequence":"additional","affiliation":[{"name":"Departamento de Sistemas Inform\u00e1ticos, Universidad de Castilla-La Mancha (UCLM), 02071 Albacete, Spain"},{"name":"Intelligent Systems and Data Mining Research Group, Albacete Research Institute of Informatics (I3A), Universidad de Castilla-La Mancha (UCLM), 02071 Albacete, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A fast learning algorithm for deep belief nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neural Comput."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_3","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, NIPS."},{"key":"ref_4","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015). Going deeper with convolutions. arXiv.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_7","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the Computer Vision and Pattern Recognition, CVPR 2009, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Datta, R., Li, J., and Wang, J.Z. (2008, January 12\u201315). Algorithmic inferencing of aesthetics and emotion in natural images: An exposition. Proceedings of the 15th IEEE International Conference on Image Processing, ICIP 2008, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4711702"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Murray, N., Marchesotti, L., and Perronnin, F. (2012, January 16\u201321). AVA: A large-scale database for aesthetic visual analysis. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247954"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Datta, R., Joshi, D., Li, J., and Wang, J.Z. (2006, January 7\u201313). Studying aesthetics in photographic images using a computational approach. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744078_23"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1109\/CVPR.2006.303","article-title":"The design of high-level features for photo quality assessment","volume":"Volume 1","author":"Ke","year":"2006","journal-title":"Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1023\/A:1011139631724","article-title":"Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope","volume":"42","author":"Oliva","year":"2001","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"233","DOI":"10.3390\/make2030013","article-title":"Attributed relational sift-based regions graph: Concepts and applications","volume":"2","author":"Manzo","year":"2020","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Marchesotti, L., Perronnin, F., Larlus, D., and Csurka, G. (2011, January 6\u201313). Assessing the aesthetic quality of photographs using generic image descriptors. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126444"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Dong, Z., and Tian, X. (2014, January 5\u20138). Effective and efficient photo quality assessment. Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), San Diego, CA, USA.","DOI":"10.1109\/SMC.2014.6974363"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lu, X., Lin, Z., Jin, H., Yang, J., and Wang, J.Z. (2014, January 3\u20137). Rapid: Rating pictorial aesthetics using deep learning. Proceedings of the 22nd ACM international conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654927"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/MSP.2017.2696576","article-title":"Image aesthetic assessment: An experimental survey","volume":"34","author":"Deng","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3998","DOI":"10.1109\/TIP.2018.2831899","article-title":"Nima: Neural image assessment","volume":"27","author":"Talebi","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","unstructured":"Hou, L., Yu, C., and Samaras, D. (2016). Squared Earth Mover\u2019s Distance-based Loss for Training Deep Neural Networks. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning deep features for discriminative localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chattopadhay, A., Sarkar, A., Howlader, P., and Balasubramanian, V.N. (2018, January 12\u201315). Grad-cam++: Generalized gradient-based visual explanations for deep convolutional networks. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00097"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, H., Wang, Z., Du, M., Yang, F., Zhang, Z., Ding, S., Mardziel, P., and Hu, X. (2020, January 14\u201319). Score-CAM: Score-weighted visual explanations for convolutional neural networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00020"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kao, Y., He, R., and Huang, K. (2017, January 5\u20139). Automatic image cropping with aesthetic map and gradient energy map. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.","DOI":"10.1109\/ICASSP.2017.7952503"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sherashiya, S., Shikkenawis, G., and Mitra, S.K. (2020, January 10\u201312). Image aesthetic assessment: A deep learning approach using class activation map. Proceedings of the International Conference on Computer Vision and Image Processing, Chongqing, China.","DOI":"10.1007\/978-981-16-1092-9_8"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"114349","DOI":"10.1109\/ACCESS.2019.2936289","article-title":"Property-specific aesthetic assessment with unsupervised aesthetic property discovery","volume":"7","author":"Lee","year":"2019","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.image.2018.05.006","article-title":"Visual aesthetic understanding: Sample-specific aesthetic classification and deep activation map visualization","volume":"67","author":"Zhang","year":"2018","journal-title":"Signal Process. Image Commun."},{"key":"ref_30","unstructured":"Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., and Darrell, T. (2014, January 21\u201326). Decaf: A deep convolutional activation feature for generic visual recognition. Proceedings of the International Conference on Machine Learning, Beijing, China."},{"key":"ref_31","unstructured":"Nielsen, T.D., and Jensen, F.V. (2009). Bayesian Networks and Decision Graphs, Springer Science & Business Media."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kao, Y., Wang, C., and Huang, K. (2015, January 27\u201330). Visual aesthetic quality assessment with a regression model. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7351067"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Fu, X., Yan, J., and Fan, C. (2018, January 7\u201310). Image aesthetics assessment using composite features from off-the-shelf deep models. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451133"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Dong, Z., Shen, X., Li, H., and Tian, X. (2015, January 5\u20137). Photo quality assessment with DCNN that understands image well. Proceedings of the International Conference on Multimedia Modeling, Sydney, NSW, Australia.","DOI":"10.1007\/978-3-319-14442-9_57"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lv, H., and Tian, X. (2016, January 4\u20136). Learning relative aesthetic quality with a pairwise approach. Proceedings of the International Conference on Multimedia Modeling, Miami, FL, USA.","DOI":"10.1007\/978-3-319-27671-7_41"},{"key":"ref_37","unstructured":"Rubio, F., Flores, M.J., and Puerta, J.M. (2018, January 13\u201315). Drawing a baseline in aesthetic quality assessment. Proceedings of the Tenth International Conference on Machine Vision (ICMV 2017), Vienna, Austria."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/s10462-013-9405-z","article-title":"Extreme learning machine: Algorithm, theory and applications","volume":"44","author":"Ding","year":"2015","journal-title":"Artif. Intell. Rev."},{"key":"ref_39","unstructured":"Chollet, F. (2021, October 19). Keras. Available online: https:\/\/keras.io."},{"key":"ref_40","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2021, October 19). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: https:\/\/tensorflow.org."},{"key":"ref_41","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ma, S., Liu, J., and Wen Chen, C. (2017, January 21\u201326). A-lamp: Adaptive layout-aware multi-patch deep convolutional neural network for photo aesthetic assessment. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.84"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1548","DOI":"10.1109\/TIP.2019.2941778","article-title":"A unified probabilistic formulation of image aesthetic assessment","volume":"29","author":"Zeng","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Sheng, K., Dong, W., Ma, C., Mei, X., Huang, F., and Hu, B.G. (2018, January 22\u201326). Attention-based multi-patch aggregation for image aesthetic assessment. Proceedings of the 26th ACM International Conference on Multimedia, Seoul, Korea.","DOI":"10.1145\/3240508.3240554"},{"key":"ref_45","unstructured":"Sundararajan, M., Taly, A., and Yan, Q. (2017, January 6\u201311). Axiomatic attribution for deep networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_46","unstructured":"Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017). A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems 30, Curran Associates, Inc."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/11\/1389\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:21:50Z","timestamp":1760167310000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/11\/1389"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,23]]},"references-count":46,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["e23111389"],"URL":"https:\/\/doi.org\/10.3390\/e23111389","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,23]]}}}