{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T01:34:06Z","timestamp":1769304846839,"version":"3.49.0"},"reference-count":46,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T00:00:00Z","timestamp":1669248000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018YFC0825803"],"award-info":[{"award-number":["2018YFC0825803"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Neurosci."],"abstract":"<jats:p>The increase of remote sensing images in recent decades has resulted in their use in non-scientific fields such as environmental protection, education, and art. In this situation, we need to focus on the aesthetic assessment of remote sensing, which has received little attention in research. While according to studies on human brain\u2019s attention mechanism, certain areas of an image can trigger visual stimuli during aesthetic evaluation. Inspired by this, we used convolutional neural network (CNN), a deep learning model resembling the human neural system, for image aesthetic assessment. So we propose an interpretable approach for automatic aesthetic assessment of remote sensing images. Firstly, we created the Remote Sensing Aesthetics Dataset (RSAD). We collected remote sensing images from Google Earth, designed the four evaluation criteria of remote sensing image aesthetic quality\u2014color harmony, light and shadow, prominent theme, and visual balance\u2014and then labeled the samples based on expert photographers\u2019 judgment on the four evaluation criteria. Secondly, we feed RSAD into the ResNet-18 architecture for training. Experimental results show that the proposed method can accurately identify visually pleasing remote sensing images. Finally, we provided a visual explanation of aesthetic assessment by adopting Gradient-weighted Class Activation Mapping (Grad-CAM) to highlight the important image area that influenced model\u2019s decision. Overall, this paper is the first to propose and realize automatic aesthetic assessment of remote sensing images, contributing to the non-scientific applications of remote sensing and demonstrating the interpretability of deep-learning based image aesthetic evaluation.<\/jats:p>","DOI":"10.3389\/fncom.2022.1077439","type":"journal-article","created":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T10:47:21Z","timestamp":1669286841000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["An interpretable approach for automatic aesthetic assessment of remote sensing images"],"prefix":"10.3389","volume":"16","author":[{"given":"Jingru","family":"Tong","sequence":"first","affiliation":[]},{"given":"Guo","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Peijie","family":"Kong","sequence":"additional","affiliation":[]},{"given":"Yu","family":"Rao","sequence":"additional","affiliation":[]},{"given":"Zhengkai","family":"Wei","sequence":"additional","affiliation":[]},{"given":"Hao","family":"Cui","sequence":"additional","affiliation":[]},{"given":"Qing","family":"Guan","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2022,11,24]]},"reference":[{"key":"B1","author":"Arnheim","year":"1956","journal-title":"Art and visual perception: A psychology of the creative eye."},{"key":"B2","first-page":"2","article-title":"Aesthetics and usability: A look at color and balance.","volume":"5","author":"Brady","year":"2003","journal-title":"Usability News"},{"key":"B3","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1002\/col.20317","article-title":"Camera color gamut: Spray-painting the invisible definition.","volume":"32","author":"Brill","year":"2007","journal-title":"Color Res. Appl."},{"key":"B4","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1002\/col.10004","article-title":"Color harmony.","volume":"27","author":"Burchett","year":"2002","journal-title":"Color Res. Appl."},{"key":"B5","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/j.pneurobio.2011.03.003","article-title":"The neural foundations of aesthetic appreciation.","volume":"94","author":"Cela-Conde","year":"2011","journal-title":"Progress Neurobiol."},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2019.00014","article-title":"Emotional responses to visual art and commercial stimuli: Implications for creativity and aesthetics.","volume":"10","author":"Cheung","year":"2019","journal-title":"Front. Psychol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1145\/1743384.1743457","article-title":"Acquine: Aesthetic quality inference engine-real-time automatic rating of photo aesthetics","author":"Datta","year":"2010","journal-title":"Proceedings of the international conference on Multimedia information retrieval"},{"key":"B8","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1007\/11744078_23","article-title":"Studying aesthetics in photographic images using a computational approach","author":"Datta","year":"2006","journal-title":"Proceedings of the European conference on computer vision."},{"key":"B9","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1109\/MSP.2017.2696576","article-title":"Image aesthetic assessment: An experimental survey.","volume":"34","author":"Deng","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"B10","doi-asserted-by":"publisher","first-page":"1657","DOI":"10.1109\/CVPR.2011.5995467","article-title":"High level describable attributes for predicting aesthetics and interestingness","author":"Dhar","year":"2011","journal-title":"2011 IEEE conference on computer vision and pattern recognition (CVPR) Cvpr 2011."},{"key":"B11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1130\/2012.2492(01)","article-title":"Channel widths, landslides, faults, and beyond: The new world order of high-spatial resolution Google Earth imagery in the study of earth surface processes.","volume":"492","author":"Fisher","year":"2012","journal-title":"Geol. Soc. Am. Spec. Pap."},{"key":"B12","author":"Freeman","year":"2007","journal-title":"The complete guide to light &amp; lighting in digital photography."},{"key":"B13","author":"Grayson","year":"2016","journal-title":"An artist\u2019s surreal view of Australia \u2013 created from satellite data captured 700km above Earth"},{"key":"B14","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","author":"He","year":"2016","journal-title":"Proceedings of the IEEE conference on computer vision and pattern recognition"},{"key":"B15","author":"Itten","year":"1975","journal-title":"Design and form: The basic course at the Bauhaus and later."},{"key":"B16","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.jenvman.2014.02.009","article-title":"Consensus in landscape preference judgments: The effects of landscape visual aesthetic quality and respondents\u2019 characteristics.","volume":"137","author":"Kalivoda","year":"2014","journal-title":"J. Environ. Manag."},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.5244\/C.28.122","article-title":"Recognizing image style.","author":"Karayev","year":"2013","journal-title":"arXiv"},{"key":"B18","doi-asserted-by":"publisher","first-page":"867","DOI":"10.1145\/2566486.2567996","article-title":"What makes an image popular?","author":"Khosla","year":"2014","journal-title":"Proceedings of the 23rd international conference on World wide web"},{"key":"B19","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1109\/TAFFC.2018.2809752","article-title":"Objectivity and subjectivity in aesthetic quality assessment of digital photographs.","volume":"11","author":"Kim","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"B20","author":"Krages","year":"2005","journal-title":"The art of composition."},{"key":"B21","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1109\/JSTSP.2009.2015077","article-title":"Aesthetic visual quality assessment of paintings.","volume":"3","author":"Li","year":"2009","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"B22","doi-asserted-by":"publisher","first-page":"3221","DOI":"10.1109\/ICIP.2010.5651833","article-title":"Aesthetic quality assessment of consumer photos with faces","author":"Li","year":"2010","journal-title":"Proceedings of the 2010 IEEE international conference on image processing."},{"key":"B23","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3236386.3241340","article-title":"The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery.","volume":"16","author":"Lipton","year":"2018","journal-title":"Queue"},{"key":"B24","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/j.neucom.2019.01.090","article-title":"A novel scene classification model combining ResNet based transfer learning and data augmentation with a filter.","volume":"338","author":"Liu","year":"2019","journal-title":"Neurocomputing"},{"key":"B25","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1145\/964442.964462","article-title":"Evaluation of visual balance for automated layout","author":"Lok","year":"2004","journal-title":"Proceedings of the 9th international conference on intelligent user interfaces"},{"key":"B26","author":"London","year":"2011","journal-title":"Photography."},{"key":"B27","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1145\/2647868.2654927","article-title":"Rapid: Rating pictorial aesthetics using deep learning","author":"Lu","year":"2014","journal-title":"Proceedings of the 22nd ACM international conference on multimedia"},{"key":"B28","doi-asserted-by":"publisher","first-page":"2206","DOI":"10.1109\/ICCV.2011.6126498","article-title":"Content-based photo quality assessment","author":"Luo","year":"2011","journal-title":"Proceedings of the 2011 international conference on computer vision."},{"key":"B29","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1007\/978-3-540-88690-7_29","article-title":"Photo and video quality evaluation: Focusing on the subject","author":"Luo","year":"2008","journal-title":"Proceedings of the European conference on computer vision."},{"key":"B30","first-page":"13","article-title":"Recurrent models of visual attention.","volume":"27","author":"Mnih","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"B31","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1007\/978-3-642-10520-3_9","article-title":"Diverging color maps for scientific visualization","author":"Moreland","year":"2009","journal-title":"Proceedings of the international symposium on visual computing."},{"key":"B32","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1146\/annurev-psych-120710-100504","article-title":"Visual aesthetics and human preference.","volume":"64","author":"Palmer","year":"2013","journal-title":"Annu. Rev. Psychol."},{"key":"B33","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1109\/ICCV.2017.74","article-title":"Grad-cam: Visual explanations from deep networks via gradient-based localization","author":"Selvaraju","year":"2017","journal-title":"Proceedings of the IEEE international conference on computer vision"},{"key":"B34","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/j.fss.2019.02.014","article-title":"Modeling aesthetic preferences: Color coordination and fuzzy sets.","volume":"395","author":"Shamoi","year":"2020","journal-title":"Fuzzy Sets Syst."},{"key":"B35","first-page":"165","article-title":"Boredom, repetition, inertia: Contemporary photography and the aesthetics of the banal.","volume":"37","author":"Shinkle","year":"2004","journal-title":"Mosaic Interdiscip. Crit. J."},{"key":"B36","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1177\/1745691619897963","article-title":"A farewell to art: Aesthetics as a topic in psychology and neuroscience.","volume":"15","author":"Skov","year":"2020","journal-title":"Perspect. Psychol. Sci."},{"key":"B37","doi-asserted-by":"publisher","first-page":"2035","DOI":"10.1109\/TMM.2015.2479916","article-title":"Query-dependent aesthetic model with deep learning for photo quality assessment.","volume":"17","author":"Tian","year":"2015","journal-title":"IEEE Trans. Multimed."},{"key":"B38","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1068\/p260807","article-title":"Effects of texture, illumination, and surface reflectance on stereoscopic shape perception.","volume":"26","author":"Todd","year":"1997","journal-title":"Perception"},{"key":"B39","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1016\/j.ufug.2016.09.005","article-title":"Consensus in visual preferences: The effects of aesthetic quality and landscape types.","volume":"20","author":"Wang","year":"2016","journal-title":"Urban For. Urban Green."},{"key":"B40","doi-asserted-by":"publisher","first-page":"1531","DOI":"10.1109\/TPAMI.2018.2840724","article-title":"A deep network solution for attention and aesthetics aware photo cropping.","volume":"41","author":"Wang","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"B41","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1109\/ICIP.2009.5413825","article-title":"Saliency-enhanced image aesthetics class prediction","author":"Wong","year":"2009","journal-title":"Proceedings of the 2009 16th IEEE international conference on image processing (Icip)."},{"key":"B42","doi-asserted-by":"publisher","first-page":"211028","DOI":"10.1109\/ACCESS.2020.3039715","article-title":"Product design award prediction modeling: Design visual aesthetic quality assessment via Dcnns.","volume":"8","author":"Wu","year":"2020","journal-title":"IEEE Access"},{"key":"B43","first-page":"20","article-title":"Visual psychological analysis of photographic composition balance.","volume":"4","author":"Xia","year":"2020","journal-title":"Hubei Inst. Fine Arts J."},{"key":"B44","doi-asserted-by":"publisher","first-page":"Iv","DOI":"10.1109\/IGARSS.2009.5417404","article-title":"Characteristics of shadow and removal of its effects for remote sensing imagery","author":"Yamazaki","year":"2009","journal-title":"Proceedings of the 2009 IEEE international geoscience and remote sensing symposium."},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.3390\/rs14143271","article-title":"Optimizing local alignment along the seamline for parallax-tolerant orthoimage mosaicking.","volume":"14","author":"Yin","year":"2022","journal-title":"Remote Sens."},{"key":"B46","doi-asserted-by":"publisher","first-page":"1333","DOI":"10.1016\/j.renene.2021.03.047","article-title":"A solar azimuth formula that renders circumstantial treatment unnecessary without compromising mathematical rigor: Mathematical setup, application and extension of a formula based on the subsolar point and atan2 function.","volume":"172","author":"Zhang","year":"2021","journal-title":"Renew. Energy"}],"container-title":["Frontiers in Computational Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2022.1077439\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T10:47:27Z","timestamp":1669286847000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2022.1077439\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,24]]},"references-count":46,"alternative-id":["10.3389\/fncom.2022.1077439"],"URL":"https:\/\/doi.org\/10.3389\/fncom.2022.1077439","relation":{},"ISSN":["1662-5188"],"issn-type":[{"value":"1662-5188","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,24]]},"article-number":"1077439"}}