{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,15]],"date-time":"2025-11-15T17:24:11Z","timestamp":1763227451617,"version":"3.41.2"},"reference-count":51,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T00:00:00Z","timestamp":1727308800000},"content-version":"vor","delay-in-days":269,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010801","name":"Xunta de Galicia","doi-asserted-by":"publisher","award":["XUGA-PGIDIT-10TIC105008-PR"],"award-info":[{"award-number":["XUGA-PGIDIT-10TIC105008-PR"]}],"id":[{"id":"10.13039\/501100010801","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p>In recent years, the development of metrics to evaluate image aesthetics and photographic quality has proliferated. However, validating these metrics presents challenges due to the inherently subjective nature of aesthetics and photographic quality, which can be influenced by cultural contexts and individual preferences that evolve over time. This article presents a novel validation methodology utilizing a dataset assessed by individuals from two distinct nationalities: the United States and Spain. Evaluation criteria include photographic quality and aesthetic value, with the dataset comprising images previously rated on the DPChallenge photographic portal. We analyze the correlation between these values and provide the dataset for future research endeavors. Our investigation encompasses several metrics, including BRISQUE for assessing photographic quality, NIMA aesthetic and NIMA technical for evaluating both aesthetic and technical aspects, Diffusion Aesthetics (employed in Stable Diffusion), and PhotoILike for gauging the commercial appeal of real estate images. Our findings reveal a significant correlation between the Diffusion Aesthetics metric and aesthetic measures, as well as with the NIMA aesthetics metric, suggesting them as good potential candidates to capture aesthetic value.<\/jats:p>","DOI":"10.1155\/2024\/8223586","type":"journal-article","created":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T13:50:51Z","timestamp":1727358651000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Towards Robust Evaluation of Aesthetic and Photographic Quality Metrics: Insights from a Comprehensive Dataset"],"prefix":"10.1155","volume":"2024","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4910-3890","authenticated-orcid":false,"given":"Iria","family":"Santos","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2273-8052","authenticated-orcid":false,"given":"Miguel A.","family":"Casal","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5562-1996","authenticated-orcid":false,"given":"Jo\u00e3o","family":"Correia","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5774-927X","authenticated-orcid":false,"given":"\u00c1lvaro","family":"Torrente-Pati\u00f1o","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6308-6484","authenticated-orcid":false,"given":"Penousal","family":"Machado","sequence":"additional","affiliation":[]},{"given":"Juan","family":"Romero","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2024,9,26]]},"reference":[{"key":"e_1_2_14_1_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2017.00604"},{"key":"e_1_2_14_2_2","doi-asserted-by":"publisher","DOI":"10.55083\/irjeas.2022.v10i02005"},{"key":"e_1_2_14_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05565-4"},{"key":"e_1_2_14_4_2","unstructured":"RameshA. PavlovM. GohG. GrayS. VossC. RadfordA. ChenM. andSutskeverI. Zero-shot text-to-image generation Proceedings of the International Conference on Machine Learning September 2021 Hangzhou China 8821\u20138831."},{"key":"e_1_2_14_5_2","unstructured":"RombachR. BlattmannA. LorenzD. EsserP. andOmmerB. High-resolution image synthesis with latent diffusion models 2021 https:\/\/arxiv.org\/abs\/2112.10752."},{"key":"e_1_2_14_6_2","doi-asserted-by":"publisher","DOI":"10.3390\/e24010103"},{"key":"e_1_2_14_7_2","doi-asserted-by":"crossref","unstructured":"MachadoP.andCardosoA. Computing aesthetics Proceedings of the Brazilian Symposium on Artificial Intelligence November 1998 Berlin Heidelberg Springer 219\u2013228.","DOI":"10.1007\/10692710_23"},{"key":"e_1_2_14_8_2","doi-asserted-by":"crossref","unstructured":"DattaR. JoshiD. JiaL. andWangJ. Z. Studying aesthetics in photographic images using a computational approach Proceedings of the European Conference on Computer Vision May 2006 Graz Austria Springer 288\u2013301.","DOI":"10.1007\/11744078_23"},{"key":"e_1_2_14_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.12.106"},{"key":"e_1_2_14_10_2","doi-asserted-by":"crossref","unstructured":"KeY. TangX. andJingF. The design of high-level features for photo quality assessment 1 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906) June 2006 New York NY USA 419\u2013426.","DOI":"10.1109\/CVPR.2006.303"},{"key":"e_1_2_14_11_2","unstructured":"WongL.-K.andLowK.-L. Saliency-enhanced image aesthetics class prediction Proceedings of the 2009 16th IEEE International Conference on Image Processing (ICIP) November 2009 Cairo Egypt IEEE 997\u20131000."},{"key":"e_1_2_14_12_2","doi-asserted-by":"crossref","unstructured":"DattaR. JiaL. andWangJ. Z. Algorithmic inferencing of aesthetics and emotion in natural images: an exposition Proceedings of the 2008 15th IEEE International Conference on Image Processing October 2008 San Diego CA USA IEEE 105\u2013108.","DOI":"10.1109\/ICIP.2008.4711702"},{"key":"e_1_2_14_13_2","doi-asserted-by":"crossref","unstructured":"LuoW. WangX. andTangX. Content-based photo quality assessment Proceedings of the 2011 International Conference on Computer Vision November 2011 Barcelona Spain IEEE 2206\u20132213.","DOI":"10.1109\/ICCV.2011.6126498"},{"key":"e_1_2_14_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2651399"},{"key":"e_1_2_14_15_2","doi-asserted-by":"crossref","unstructured":"ShengK. DongW. MaC. MeiX. HuangF. andHuB.-G. Attention-based multi-patch aggregation for image aesthetic assessment Proceedings of the 26th ACM International Conference on Multimedia November 2018 Tokyo Japan 879\u2013886.","DOI":"10.1145\/3240508.3240554"},{"key":"e_1_2_14_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46448-0_40"},{"key":"e_1_2_14_17_2","doi-asserted-by":"crossref","unstructured":"JinX. WuL. LiX. ChenS. PengS. ChiJ. GeS. SongC. andZhaoG. Predicting aesthetic score distribution through cumulative jensen-shannon divergence 32 Proceedings of the AAAI Conference on Artificial Intelligence February 2018 New Orleans LI USA.","DOI":"10.1609\/aaai.v32i1.11286"},{"key":"e_1_2_14_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2015.06.005"},{"key":"e_1_2_14_19_2","doi-asserted-by":"crossref","unstructured":"XueW. ZhangL. andMouX. Learning without human scores for blind image quality assessment Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition June 2013 Portland OR USA 995\u20131002.","DOI":"10.1109\/CVPR.2013.133"},{"key":"e_1_2_14_20_2","doi-asserted-by":"crossref","unstructured":"KangLe YeP. YiL. andDoermannD. Convolutional neural networks for no-reference image quality assessment Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition June 2014 Columbus OH USA 1733\u20131740.","DOI":"10.1109\/CVPR.2014.224"},{"key":"e_1_2_14_21_2","doi-asserted-by":"crossref","unstructured":"BosseS. ManiryD. WiegandT. andSamekW. A deep neural network for image quality assessment Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP) September 2016 Phoenix AZ USA IEEE 3773\u20133777.","DOI":"10.1109\/ICIP.2016.7533065"},{"key":"e_1_2_14_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11760-017-1166-8"},{"key":"e_1_2_14_23_2","doi-asserted-by":"crossref","unstructured":"LuX. LinZ. ShenX. MechR. andWangJ. Z. Deep multi-patch aggregation network for image style aesthetics and quality estimation Proceedings of the IEEE International Conference on Computer Vision December 2015 Santiago Chile 990\u2013998.","DOI":"10.1109\/ICCV.2015.119"},{"key":"e_1_2_14_24_2","doi-asserted-by":"crossref","unstructured":"KaoY. WangC. andHuangK. Visual aesthetic quality assessment with a regression model Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP) September 2015 Quebec City Quebec Canada IEEE 1583\u20131587.","DOI":"10.1109\/ICIP.2015.7351067"},{"key":"e_1_2_14_25_2","doi-asserted-by":"crossref","unstructured":"MaiL. JinH. andLiuF. Composition-preserving deep photo aesthetics assessment Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition June 2016 Las Vegas NV USA 497\u2013506.","DOI":"10.1109\/CVPR.2016.60"},{"key":"e_1_2_14_26_2","doi-asserted-by":"crossref","unstructured":"JinB. SegoviaM. V. O. andS\u00fcsstrunkS. Image aesthetic predictors based on weighted cnns Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP) September 2016 Phoenix AZ USA 2291\u20132295.","DOI":"10.1109\/ICIP.2016.7532767"},{"key":"e_1_2_14_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2831899"},{"key":"e_1_2_14_28_2","doi-asserted-by":"publisher","DOI":"10.5201\/ipol.2011.llmps-scb"},{"key":"e_1_2_14_29_2","doi-asserted-by":"crossref","unstructured":"WangG. LiL. LiQ. GuK. LuZ. andQianJ. Perceptual evaluation of single-image super-resolution reconstruction Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP) September 2017 Beijing China IEEE 3145\u20133149.","DOI":"10.1109\/ICIP.2017.8296862"},{"key":"e_1_2_14_30_2","unstructured":"LennanC. NguyenH. andTranD. Image quality assessment 2018 https:\/\/github.com\/idealo\/image-quality-assessment."},{"key":"e_1_2_14_31_2","doi-asserted-by":"crossref","unstructured":"MurrayN. MarchesottiL. andPerronninF. Ava: a large-scale database for aesthetic visual analysis Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition June 2012 Providence RI USA IEEE 2408\u20132415.","DOI":"10.1109\/CVPR.2012.6247954"},{"key":"e_1_2_14_32_2","unstructured":"SchuhmannC. BeaumontR. VencuR. GordonC. WightmanR. ChertiM. CoombesT. KattaA. MullisC. WortsmanM. SchramowskiP. KundurthyS. CrowsonK. SchmidtL. KaczmarczykR. andJitsevJ. Laion-5b: an open large-scale dataset for training next generation image-text models 2022."},{"key":"e_1_2_14_33_2","doi-asserted-by":"publisher","DOI":"10.3390\/app12042212"},{"key":"e_1_2_14_34_2","doi-asserted-by":"publisher","DOI":"10.3390\/e24010103"},{"key":"e_1_2_14_35_2","doi-asserted-by":"crossref","unstructured":"ChenQ. ZhangW. ZhouN. PengL. XuY. ZhengY. andFanJ. Adaptive fractional dilated convolution network for image aesthetics assessment Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition June 2020 Seattle WA USA 14114\u201314123.","DOI":"10.1109\/CVPR42600.2020.01412"},{"key":"e_1_2_14_36_2","article-title":"Dataset for the aesthetic value automatic prediction","volume":"21","author":"Rodriguez-Fernandez N.","year":"2019","journal-title":"Multidisciplinary Digital Publishing Institute Proceedings"},{"key":"e_1_2_14_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2269899"},{"key":"e_1_2_14_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_29"},{"key":"e_1_2_14_39_2","unstructured":"Adrian Carballal DPChallenge aesthetic dataset 2018 https:\/\/figshare.com\/articles\/dataset\/DPChallengeAestheticDataset\/6127295."},{"key":"e_1_2_14_40_2","doi-asserted-by":"crossref","unstructured":"WangZ. LiuD. ChangS. DolcosF. BeckD. andHuangT. Image aesthetics assessment using deep chatterjee\u2019s machine Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN) May 2017 Anchorage AK USA IEEE 941\u2013948.","DOI":"10.1109\/IJCNN.2017.7965953"},{"key":"e_1_2_14_41_2","unstructured":"Iria Santos Dataset 1.000 images DPChallenge 2023 https:\/\/figshare.com\/articles\/dataset\/dataset-aest-qual-completocsv\/21836589."},{"key":"e_1_2_14_42_2","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/4659809"},{"key":"e_1_2_14_43_2","doi-asserted-by":"crossref","unstructured":"ChenS.-F. HuC.-S. ZhuZ.-A. andChiangC.-K. Automatic photographic composition based on convolutional neural network Proceedings of the 2017 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW) June 2017 Taipei Taiwan IEEE 183\u2013184.","DOI":"10.1109\/ICCE-China.2017.7991056"},{"key":"e_1_2_14_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2022.108341"},{"key":"e_1_2_14_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2018.2809752"},{"key":"e_1_2_14_46_2","doi-asserted-by":"crossref","unstructured":"GhosalK. RanaA. andSmolicA. Aesthetic image captioning from weakly-labelled photographs Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops November 2019 Seoul South Korea.","DOI":"10.1109\/ICCVW.2019.00556"},{"key":"e_1_2_14_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-6436-0"},{"key":"e_1_2_14_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2014.03.003"},{"key":"e_1_2_14_49_2","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.1487"},{"key":"e_1_2_14_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72877-1_18"},{"key":"e_1_2_14_51_2","doi-asserted-by":"crossref","unstructured":"MachadoP. CorreiaJ. andRomeroJ. Expression-based evolution of faces Proceedings of the International Conference on Evolutionary and Biologically Inspired Music and Art April 2012 M\u00e1laga Spain Springer 187\u2013198.","DOI":"10.1007\/978-3-642-29142-5_17"}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2024\/8223586","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,28]],"date-time":"2024-11-28T19:18:27Z","timestamp":1732821507000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2024\/8223586"}},"subtitle":[],"editor":[{"given":"Siew Ann","family":"Cheong","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":51,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.1155\/2024\/8223586"],"URL":"https:\/\/doi.org\/10.1155\/2024\/8223586","archive":["Portico"],"relation":{},"ISSN":["1076-2787","1099-0526"],"issn-type":[{"type":"print","value":"1076-2787"},{"type":"electronic","value":"1099-0526"}],"subject":[],"published":{"date-parts":[[2024,1]]},"assertion":[{"value":"2024-03-18","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"8223586"}}