{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,5]],"date-time":"2026-09-05T04:25:35Z","timestamp":1788582335092,"version":"build-2803163510"},"reference-count":37,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2017,4,28]],"date-time":"2017-04-28T00:00:00Z","timestamp":1493337600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"973 project in China","award":["2012CB719901"],"award-info":[{"award-number":["2012CB719901"]}]},{"name":"National Science &amp; Technology Pillar Program","award":["2012BAI32B07"],"award-info":[{"award-number":["2012BAI32B07"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41421001"],"award-info":[{"award-number":["41421001"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Image quality assessment plays an important role in image processing applications. In many image applications, e.g., image denoising, deblurring, and fusion, a reference image is rarely available for comparison with the enhanced image. Thus, the quality of enhanced images must be evaluated blindly without references. In recent years, many no-reference image quality metrics (IQMs) have been proposed for assessing digital image quality. In this paper, we first review 21 commonly employed no-reference IQMs. Second, we apply these measures to Quickbird images with three different types of general content (urban, rural, and harbor) subjected to three types of degradation (average filtering, Gaussian white noise, and linear motion degradation), each with 40 degradation levels. We evaluate the robustness of the IQMs based on the criteria of prediction accuracy, prediction monotonicity, and prediction consistency. Then, we perform factor analysis on those IQMs deemed robust, and cluster them into several components. We then select the IQM with the highest loading coefficient as the representative IQM for that component. Experimental results suggest that different measures perform differently for images with different contents and subjected to different types of degradation. Generally, the degradation method has a stronger effect than the image content on the evaluation results of an IQM. The same IQM can provide opposite dependences on the level of degradation for different degradation types, and an IQM that performed well with one type of degradation may not perform well with another type. The training-based measures are not appropriate for remote sensing images because the results are highly dependent on the samples employed for training. Only seven of the 21 IQMs were found to fulfill the requirements of robustness. Edge intensity (EI) and just noticeable distortion (JND) are suggested for evaluating the quality of images subjected to average filter degradation. EI, blind image quality assessment through anisotropy (BIQAA), and mean metric (MM) are suggested for evaluating the quality of images subjected to Gaussian white noise degradation. Laplacian derivative (LD), JND, and standard deviation (SD) are suggested for evaluating the quality of images subjected to linear motion. Finally, EI is suggested for evaluating the quality of an image subjected to an unknown type of degradation.<\/jats:p>","DOI":"10.3390\/ijgi6050133","type":"journal-article","created":{"date-parts":[[2017,4,28]],"date-time":"2017-04-28T11:57:04Z","timestamp":1493380624000},"page":"133","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Statistical Evaluation of No-Reference Image Quality Assessment Metrics for Remote Sensing Images"],"prefix":"10.3390","volume":"6","author":[{"given":"Shuang","family":"Li","sequence":"first","affiliation":[{"name":"International School of Software, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zewei","family":"Yang","sequence":"additional","affiliation":[{"name":"International School of Software, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongsheng","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,4,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/s11760-009-0117-4","article-title":"No-reference assessment of blur and noise impacts on image quality","volume":"4","author":"Cohen","year":"2010","journal-title":"Signal Image Video Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-031-02238-8","article-title":"Modern image quality assessment","volume":"2","author":"Wang","year":"2006","journal-title":"Synth. Lect. Image Video Multimed. Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1109\/TIP.2008.2011760","article-title":"A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)","volume":"18","author":"Ferzli","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"905685","DOI":"10.1155\/2013\/905685","article-title":"Seven challenges in image quality assessment: Past, present, and future research","volume":"2013","author":"Chandler","year":"2013","journal-title":"ISRN Signal Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/MSP.2008.930649","article-title":"Mean squared error: Love it or leave it? A new look at signal fidelity measures","volume":"26","author":"Wang","year":"2009","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1117\/1.1455011","article-title":"Statistical evaluation of image quality measures","volume":"11","author":"Ismail","year":"2002","journal-title":"J. Electron. Imaging"},{"key":"ref_7","unstructured":"Ong, E., Lin, W., Lu, Z., Yao, S., Yang, X., and Jiang, L. (2003, January 6\u20139). No-reference JPEG-2000 image quality metric. Proceedings of the International Conference on Multimedia and Expo, Baltimore, MD, USA."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cohen, E., and Yitzhaky, Y. (2007, January 26). Blind image quality assessment considering blur, noise, and JPEG compression distortions. Proceedings of the Applications of Digital Image Processing XXX, San Diego, CA, USA.","DOI":"10.1117\/12.736048"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, Z., and Simoncelli, E.P. (2005, January 17\u201320). Reduced-reference image quality assessment using a wavelet-domain natural image statistic model. Proceedings of the Society of Photo-optical Instrumentation Engineers, Human Vision and Electronic Imaging, San Jose, CA, USA.","DOI":"10.1117\/12.597306"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.image.2008.02.003","article-title":"Objective quality assessment of color images based on a generic perceptual reduced reference","volume":"23","author":"Carnec","year":"2008","journal-title":"Signal Process. Image Commun."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2959","DOI":"10.1109\/26.477498","article-title":"Image quality measures and their performance","volume":"43","author":"Eskicioglu","year":"1995","journal-title":"IEEE Trans. Commun."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, M.J., and Bovik, A.C. (2011). No-reference image blur assessment using multiscale gradient. EURASIP J. Image Video Process.","DOI":"10.1186\/1687-5281-2011-3"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1109\/TIP.2010.2053549","article-title":"No-reference blur assessment of digital pictures based on multifeature classifiers","volume":"20","author":"Ciancio","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"7491","DOI":"10.3390\/rs6087491","article-title":"Blind Restoration of Remote Sensing Images by a Combination of Automatic Knife-Edge Detection and Alternating Minimization","volume":"6","author":"Shen","year":"2014","journal-title":"Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9821","DOI":"10.1016\/j.eswa.2012.02.171","article-title":"Toward reducing failure risk in an integrated vehicle health maintenance system: A fuzzy multi-sensor data fusion Kalman filter approach for IVHMS","volume":"3","author":"Rodger","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.image.2008.03.005","article-title":"No reference image quality assessment for JPEG2000 based on spatial features","volume":"23","author":"Sazzad","year":"2008","journal-title":"Signal Process. Image Commun."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1334","DOI":"10.1016\/j.cnsns.2005.12.001","article-title":"Fusion of multi-spectral and panchromatic images using fuzzy rule","volume":"12","author":"Yang","year":"2007","journal-title":"Commun. Nonlinear Sci. Numer. Simul."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1109\/LSP.2010.2043888","article-title":"A two-step framework for constructing blind image quality indices","volume":"17","author":"Moorthy","year":"2010","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"B42","DOI":"10.1364\/JOSAA.24.000B42","article-title":"Blind image quality assessment through anisotropy","volume":"24","author":"Gabarda","year":"2007","journal-title":"JOSA A"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/LSP.2010.2045550","article-title":"A DCT statistics-based blind image quality index","volume":"17","author":"Saad","year":"2010","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Crete, F., Dolmiere, T., Ladret, P., and Nicolas, M. (2007, January 28). The blur effect: Perception and estimation with a new no-reference perceptual blur metric. Proceedings of the Human Vision and Electronic Imaging XII, San Jose, CA, USA.","DOI":"10.1117\/12.702790"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4695","DOI":"10.1109\/TIP.2012.2214050","article-title":"No-reference image quality assessment in the spatial domain","volume":"21","author":"Mittal","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2678","DOI":"10.1109\/TIP.2011.2131660","article-title":"A no-reference image blur metric based on the cumulative probability of blur detection (CPBD)","volume":"20","author":"Narvekar","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1109\/83.841940","article-title":"Image quality assessment based on a degradation model","volume":"9","author":"Kite","year":"2000","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2309","DOI":"10.1080\/01431160600606890","article-title":"A comparison study on fusion methods using evaluation indicators","volume":"28","author":"Karathanassi","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1109\/LSP.2012.2199980","article-title":"A fast wavelet-based algorithm for global and local image sharpness estimation","volume":"19","author":"Vu","year":"2012","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1016\/j.image.2005.04.001","article-title":"Just noticeable distortion model and its applications in video coding","volume":"20","author":"Yang","year":"2005","journal-title":"Signal Process. Image Commun."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1109\/TCSVT.2009.2013518","article-title":"Spatio-temporal just noticeable distortion profile for grey scale image\/video in DCT domain","volume":"19","author":"Wei","year":"2009","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.image.2003.08.002","article-title":"A new sharpness metric based on local kurtosis, edge and energy information","volume":"19","author":"Caviedes","year":"2004","journal-title":"Signal Process. Image Commun."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.image.2010.11.003","article-title":"Kurtosis-based no-reference quality assessment of JPEG2000 images","volume":"26","author":"Zhang","year":"2011","journal-title":"Signal Process. Image Commun."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a \u201cCompletely Blind\u201d Image Quality Analyzer","volume":"20","author":"Mittal","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Xue, W., Zhang, L., and Mou, X. (2013, January 23\u201328). Learning without Human Scores for Blind Image Quality Assessment. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.133"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1109\/LSP.2013.2248711","article-title":"A Perceptual Image Sharpness Metric Based on Local Edge Gradient Analysis","volume":"20","author":"Feichtenhofer","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1080\/19479830903562009","article-title":"Multivariate statistical analysis of measures for assessing the quality of image fusion","volume":"1","author":"Li","year":"2010","journal-title":"Int. J. Image Data Fusion"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/BF02294017","article-title":"A comparison of factor analysis programs in SPSS, BMDP, and SAS","volume":"48","author":"MacCallum","year":"1983","journal-title":"Psychometrika"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kim, J.O., and Mueller, C.W. (1978). Introduction to Factor Analysis: What It Is and How to Do It, Sage.","DOI":"10.4135\/9781412984652"}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/6\/5\/133\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:34:07Z","timestamp":1760207647000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/6\/5\/133"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,4,28]]},"references-count":37,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2017,5]]}},"alternative-id":["ijgi6050133"],"URL":"https:\/\/doi.org\/10.3390\/ijgi6050133","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,4,28]]}}}