{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:11:59Z","timestamp":1760127119037,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2023,5,6]],"date-time":"2023-05-06T00:00:00Z","timestamp":1683331200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Science and Innovation (MICINN)","award":["RTC2019-007434-7"],"award-info":[{"award-number":["RTC2019-007434-7"]}]},{"DOI":"10.13039\/501100003329","name":"European Union within the framework of FEDER RETOS-Collaboration of the State Program of Research","doi-asserted-by":"publisher","award":["RTC2019-007434-7"],"award-info":[{"award-number":["RTC2019-007434-7"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The latest advances in super-resolution have been tested with general-purpose images such as faces, landscapes and objects, but mainly unused for the task of super-resolving earth observation images. In this research paper, we benchmark state-of-the-art SR algorithms for distinct EO datasets using both full-reference and no-reference image quality assessment metrics. We also propose a novel Quality Metric Regression Network (QMRNet) that is able to predict the quality (as a no-reference metric) by training on any property of the image (e.g., its resolution, its distortions, etc.) and also able to optimize SR algorithms for a specific metric objective. This work is part of the implementation of the framework IQUAFLOW, which has been developed for the evaluation of image quality and the detection and classification of objects as well as image compression in EO use cases. We integrated our experimentation and tested our QMRNet algorithm on predicting features such as blur, sharpness, snr, rer and ground sampling distance and obtained validation medRs below 1.0 (out of N = 50) and recall rates above 95%. The overall benchmark shows promising results for LIIF, CAR and MSRN and also the potential use of QMRNet as a loss for optimizing SR predictions. Due to its simplicity, QMRNet could also be used for other use cases and image domains, as its architecture and data processing is fully scalable.<\/jats:p>","DOI":"10.3390\/rs15092451","type":"journal-article","created":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T02:03:31Z","timestamp":1683511411000},"page":"2451","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["QMRNet: Quality Metric Regression for EO Image Quality Assessment and Super-Resolution"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7543-2770","authenticated-orcid":false,"given":"David","family":"Berga","sequence":"first","affiliation":[{"name":"Eurecat, Centre Tecnol\u00f2gic de Catalunya, Tecnologies Multim\u00e8dia, 08005 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pau","family":"Gall\u00e9s","sequence":"additional","affiliation":[{"name":"Satellogic Inc., Davidson, NC 28036, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katalin","family":"Tak\u00e1ts","sequence":"additional","affiliation":[{"name":"Satellogic Inc., Davidson, NC 28036, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eva","family":"Mohedano","sequence":"additional","affiliation":[{"name":"Satellogic Inc., Davidson, NC 28036, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laura","family":"Riordan-Chen","sequence":"additional","affiliation":[{"name":"Satellogic Inc., Davidson, NC 28036, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Clara","family":"Garcia-Moll","sequence":"additional","affiliation":[{"name":"Satellogic Inc., Davidson, NC 28036, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Vilaseca","sequence":"additional","affiliation":[{"name":"Satellogic Inc., Davidson, NC 28036, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Javier","family":"Mar\u00edn","sequence":"additional","affiliation":[{"name":"Satellogic Inc., Davidson, NC 28036, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,6]]},"reference":[{"key":"ref_1","unstructured":"Leachtenauer, J.C., and Driggers, R.G. (2001). Surveillance and Reconnaissance Imaging Systems: Modeling and Performance Prediction, Artech House Optoelectronics Library."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image Super-Resolution Using Deep Convolutional Networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","unstructured":"Yamanaka, J., Kuwashima, S., and Kurita, T. (2017). Neural Information Processing, Springer International Publishing."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"M\u00fcller, M.U., Ekhtiari, N., Almeida, R.M., and Rieke, C. (2020). Super-resolution of multispectral satellite images using convolutional neural networks. arXiv.","DOI":"10.5194\/isprs-annals-V-1-2020-33-2020"},{"key":"ref_5","unstructured":"Li, J., Fang, F., Mei, K., and Zhang, G. (2018). Proceedings of the European Conference on Computer Vision (ECCV), Springer International Publishing."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_7","unstructured":"Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., and Loy, C.C. (2019). Workshop of the European Conference on Computer Vision (ECCV), Springer International Publishing."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2340","DOI":"10.1109\/TIP.2021.3051462","article-title":"EnlightenGAN: Deep Light Enhancement Without Paired Supervision","volume":"30","author":"Jiang","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27\u201330). Accurate Image Super-Resolution Using Very Deep Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.182"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4027","DOI":"10.1109\/TIP.2020.2970248","article-title":"Learned image downscaling for upscaling using content adaptive resampler","volume":"29","author":"Sun","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, Y., Liu, S., and Wang, X. (2020). Learning Continuous Image Representation with Local Implicit Image Function. arXiv.","DOI":"10.1109\/CVPR46437.2021.00852"},{"key":"ref_12","unstructured":"Pradham, P., Younan, N.H., and King, R.L. (2008). Image Fusion, Elsevier."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1049\/el:20080522","article-title":"Scope of validity of PSNR in image\/video quality assessment","volume":"44","author":"Ghanbari","year":"2008","journal-title":"Electron. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.image.2017.11.001","article-title":"A Haar wavelet-based perceptual similarity index for image quality assessment","volume":"61","author":"Reisenhofer","year":"2018","journal-title":"Signal Process. Image Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"684","DOI":"10.1109\/TIP.2013.2293423","article-title":"Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index","volume":"23","author":"Xue","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5579","DOI":"10.1109\/ACCESS.2016.2604042","article-title":"Mean Deviation Similarity Index: Efficient and Reliable Full-Reference Image Quality Evaluator","volume":"4","author":"Nafchi","year":"2016","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Varga, D. (2022). Full-Reference Image Quality Assessment Based on an Optimal Linear Combination of Quality Measures Selected by Simulated Annealing. J. Imaging, 8.","DOI":"10.3390\/jimaging8080224"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"359","DOI":"10.5194\/isprs-archives-XLII-4-359-2018","article-title":"Analysis of UAV image quality using edge analysis","volume":"42","author":"Lim","year":"2018","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a \u201cCompletely Blind\u201d Image Quality Analyzer","volume":"20","author":"Mittal","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Venkatanath, N., Praneeth, D., Bh, M.C., Channappayya, S.S., and Medasani, S.S. (March, January 27). Blind image quality evaluation using perception based features. Proceedings of the 2015 Twenty First National Conference on Communications (NCC), Mumbai, India.","DOI":"10.1109\/NCC.2015.7084843"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"8322","DOI":"10.1364\/AO.36.008322","article-title":"General Image-Quality Equation: GIQE","volume":"36","author":"Leachtenauer","year":"1997","journal-title":"Appl. Opt."},{"key":"ref_23","unstructured":"ur Rahman, Z., Reichenbach, S.E., and Neifeld, M.A. (2008). Visual Information Processing XVII, SPIE."},{"key":"ref_24","first-page":"1","article-title":"Image-based Estimation and Validation of Niirs for High-resolution Satellite Images","volume":"37","author":"Kim","year":"2008","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4409","DOI":"10.3390\/rs6054409","article-title":"Estimation of the Image Interpretability of ZY-3 Sensor Corrected Panchromatic Nadir Data","volume":"6","author":"Li","year":"2014","journal-title":"Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.actaastro.2018.07.035","article-title":"Evaluating super-resolution reconstruction of satellite images","volume":"153","author":"Benecki","year":"2018","journal-title":"Acta Astronaut."},{"key":"ref_27","unstructured":"Johnson, J., Alahi, A., and Fei-Fei, L. (2016). Computer Vision\u2013ECCV 2016, Springer International Publishing."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18\u201322). The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"ref_29","unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019). Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_30","unstructured":"Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., and Garnett, R. (2016). Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Liu, J., Zhou, W., Li, X., Xu, J., and Chen, Z. (IEEE Trans. Multimed., 2022). LIQA: Lifelong Blind Image Quality Assessment, IEEE Trans. Multimed., Early Access.","DOI":"10.1109\/TMM.2022.3190700"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1109\/TIP.2020.3036752","article-title":"ProxIQA: A Proxy Approach to Perceptual Optimization of Learned Image Compression","volume":"30","author":"Chen","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3339","DOI":"10.1109\/TIP.2012.2191563","article-title":"Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain","volume":"21","author":"Saad","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4695","DOI":"10.1109\/TIP.2012.2214050","article-title":"No-reference image quality assessment in the spatial domain","volume":"21","author":"Mittal","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","unstructured":"Ye, P., Kumar, J., Kang, L., and Doermann, D. (2012, January 16\u201321). Unsupervised feature learning framework for no-reference image quality assessment. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4444","DOI":"10.1109\/TIP.2016.2585880","article-title":"Blind Image Quality Assessment Based on High Order Statistics Aggregation","volume":"25","author":"Xu","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, X., van de Weijer, J., and Bagdanov, A.D. (2017, January 22\u201329). RankIQA: Learning From Rankings for No-Reference Image Quality Assessment. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.118"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1109\/TIP.2017.2760518","article-title":"Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment","volume":"27","author":"Bosse","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"8934","DOI":"10.1109\/ACCESS.2018.2802498","article-title":"No Reference Image Quality Assessment based on Multi-Expert Convolutional Neural Networks","volume":"6","author":"Fan","year":"2018","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhu, H., Li, L., Wu, J., Dong, W., and Shi, G. (2020, January 13\u201319). MetaIQA: Deep Meta-Learning for No-Reference Image Quality Assessment. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01415"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Sun, S., Yu, T., Xu, J., Zhou, W., and Chen, Z. (IEEE Trans. Multimed., 2022). Graphiqa: Learning distortion graph representations for blind image quality assessment, IEEE Trans. Multimed., Early Access.","DOI":"10.1109\/TMM.2022.3152942"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhou, W., and Wang, Z. (2022). Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelity. arXiv.","DOI":"10.1145\/3503161.3547899"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2279","DOI":"10.1109\/TIP.2022.3154588","article-title":"Single Image Super-Resolution Quality Assessment: A Real-World Dataset, Subjective Studies, and an Objective Metric","volume":"31","author":"Jiang","year":"2022","journal-title":"IEEE Trans. Image Process."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.ins.2020.04.030","article-title":"Blind quality assessment for image superresolution using deep two-stream convolutional networks","volume":"528","author":"Zhou","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Maggiori, E., Tarabalka, Y., Charpiat, G., and Alliez, P. (2017, January 23\u201328). Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127684"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"e6227","DOI":"10.7717\/peerj.6227","article-title":"Individual tree crown delineation and tree species classification with hyperspectral and LiDAR data","volume":"6","author":"Dalponte","year":"2019","journal-title":"PeerJ"},{"key":"ref_47","unstructured":"Gall\u00e9s, P., Tak\u00e1ts, K., Hern\u00e1ndez-Cabronero, M., Berga, D., Pega, L., Riordan-Chen, L., Garcia-Moll, C., Becker, G., Garriga, A., and Bukva, A. (2022). iquaflow: A new framework to measure image quality. arXiv."},{"key":"ref_48","unstructured":"Gall\u00e9s, P., Tak\u00e1ts, K., and Mar\u00edn, J. (2023). Object Detection Performance Variation on Compressed Satellite Image Datasets with Iquaflow. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Carvalho, M., Cad\u00e8ne, R., Picard, D., Soulier, L., Thome, N., and Cord, M. (2018, January 8\u201312). Cross-Modal Retrieval in the Cooking Context. Proceedings of the The 41st International ACM SIGIR Conference on Research Development in Information Retrieval, Ann Arbor, MI, USA.","DOI":"10.1145\/3209978.3210036"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Salvador, A., Hynes, N., Aytar, Y., Marin, J., Ofli, F., Weber, I., and Torralba, A. (2017, January 21\u201326). Learning Cross-Modal Embeddings for Cooking Recipes and Food Images. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.327"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/9\/2451\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:30:39Z","timestamp":1760124639000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/9\/2451"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,6]]},"references-count":50,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["rs15092451"],"URL":"https:\/\/doi.org\/10.3390\/rs15092451","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,5,6]]}}}