{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T15:35:09Z","timestamp":1777390509507,"version":"3.51.4"},"reference-count":46,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,3,9]],"date-time":"2020-03-09T00:00:00Z","timestamp":1583712000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Quantifying information content in remote-sensing images is fundamental for information-theoretic characterization of remote sensing information processes, with the images being usually information sources. Information-theoretic methods, being complementary to conventional statistical methods, enable images and their derivatives to be described and analyzed in terms of information as defined in information theory rather than data per se. However, accurately quantifying images\u2019 information content is nontrivial, as information redundancy due to spectral and spatial dependence needs to be properly handled. There has been little systematic research on this, hampering wide applications of information theory. This paper seeks to fill this important research niche by proposing a strategy for quantifying information content in multispectral images based on information theory, geostatistics, and image transformations, by which interband spectral dependence, intraband spatial dependence, and additive noise inherent to multispectral images are effectively dealt with. Specifically, to handle spectral dependence, independent component analysis (ICA) is performed to transform a multispectral image into one with statistically independent image bands (not spectral bands of the original image). The ICA-transformed image is further normal-transformed to facilitate computation of information content based on entropy formulas for Gaussian distributions. Normal transform facilitates straightforward incorporation of spatial dependence in entropy computation for the aforementioned double-transformed image bands with inter-pixel spatial correlation modeled via variograms. Experiments were undertaken using Landsat ETM+ and TM image subsets featuring different dominant land cover types (i.e., built-up, agricultural, and hilly). The experimental results confirm that the proposed methods provide more objective estimates of information content than otherwise when spectral dependence, spatial dependence, or non-normality is not accommodated properly. The differences in information content between image subsets obtained with ETM+ and TM were found to be about 3.6 bits\/pixel, indicating the former\u2019s greater information content. The proposed methods can be adapted for information-theoretic analyses of remote sensing information processes.<\/jats:p>","DOI":"10.3390\/rs12050880","type":"journal-article","created":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T11:59:36Z","timestamp":1583841576000},"page":"880","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Quantifying Information Content in Multispectral Remote-Sensing Images Based on Image Transforms and Geostatistical Modelling"],"prefix":"10.3390","volume":"12","author":[{"given":"Ying","family":"Zhang","sequence":"first","affiliation":[{"name":"College of Geo-Exploration Science and Technology, Jilin University, Changchun 130026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingxiong","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenjing","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Geography and Environment, Shandong Normal University, Jinan 250358, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, J., Atkinson, P.M., and Goodchild, M.F. (2014). Scale in Spatial Information and Analysis, CRC Press.","DOI":"10.1201\/b16751"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_3","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, John Wiley & Sons Inc.. [2nd ed.]."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Duckham, M., Goodchild, M.F., and Worboys, M.F. (2003). The Nature and Value of Geographic Information. Foundations of Geographic Information Science, Taylor & Francis.","DOI":"10.1201\/9780203009543"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2193","DOI":"10.1098\/rsta.1996.0098","article-title":"An information theory of visual communication","volume":"354","author":"Huck","year":"1996","journal-title":"Philos. Trans. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/18.720533","article-title":"Information-theoretic image formation","volume":"44","author":"Blahut","year":"1998","journal-title":"IEEE Trans. Inf. Theory."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1109\/TPAMI.2005.159","article-title":"Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy","volume":"27","author":"Peng","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3412","DOI":"10.1016\/j.patcog.2010.04.013","article-title":"Information theoretic combination of pattern classifiers","volume":"43","author":"Meynet","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1109\/JPROC.2012.2229082","article-title":"Feature mining for hyperspectral image classification","volume":"101","author":"Jia","year":"2013","journal-title":"Proc. IEEE."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/s00521-013-1368-0","article-title":"A Review of feature selection methods based on mutual information","volume":"24","author":"Vergara","year":"2014","journal-title":"Neural Comput. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5864","DOI":"10.1109\/TGRS.2017.2716187","article-title":"An information theory-based scheme for efficient classification of remote sensing data","volume":"55","author":"Marinoni","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","unstructured":"Bell, M.R. (1988). Information Theory and Radar: Mutual Information and the Design and Analysis of Radar Waveforms and Systems. [Ph.D. Thesis, California Institute of Technology]."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1078\/0030-4026-00219","article-title":"Information capacity and resolution in three-dimensional imaging","volume":"113","author":"Sheppard","year":"2003","journal-title":"Optik"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4969","DOI":"10.1109\/TIT.2012.2201335","article-title":"Rate distortion behavior of sparse sources","volume":"58","author":"Weidmann","year":"2012","journal-title":"IEEE Trans. Inf. Theory."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1109\/LGRS.2014.2381641","article-title":"How many parameters can be maximally estimated from a set of measurements?","volume":"12","author":"Konings","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5171","DOI":"10.3390\/e17085171","article-title":"Information-theoretic characterization and undersampling ratio determination for compressive radar imaging in a simulated environment","volume":"17","author":"Zhang","year":"2015","journal-title":"Entropy"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chil\u00e8s, J.P., and Delfiner, P. (2012). Geostatistics: Modeling Spatial Uncertainty, John Wiley & Sons Inc.. [2nd ed.].","DOI":"10.1002\/9781118136188"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1109\/TGRS.1987.289862","article-title":"Information content analysis of landsat image data for compression","volume":"25","author":"Chen","year":"1987","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1109\/LSP.2009.2016834","article-title":"Lossless compression of hyperspectral images using multiband lookup tables","volume":"16","author":"Aiazzi","year":"2009","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1109\/TAES.1983.309378","article-title":"The information content of synthetic aperture radar images of terrain","volume":"5","author":"Frost","year":"1983","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1088\/0022-3727\/26\/9\/004","article-title":"Information content of coherent images","volume":"26","author":"Blacknell","year":"1993","journal-title":"J. Phys. D Appl. Phys."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1109\/TGRS.1984.350621","article-title":"Comparison of the information-content of data from the landsat-4 thematic mapper and the multispectral scanner","volume":"3","author":"Price","year":"1984","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1080\/01431168608954695","article-title":"Forestry information content of thematic mapper data","volume":"7","author":"Horler","year":"1985","journal-title":"Int. J. Remote Sens."},{"key":"ref_24","unstructured":"Nielsen, A.A., and Larsen, R. (1994, January 11\u201315). Restoration of geris data using the maximum noise fractions transform. Proceedings of the International Airborne Remote Sensing Conference and Exhibition, Strasbourg, France."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/36.3001","article-title":"A Transformation for ordering multispectral data in terms of image quality with implications for noise removal","volume":"26","author":"Green","year":"1988","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2629","DOI":"10.1109\/TIP.2009.2029988","article-title":"Computation of image spatial entropy using quadrilateral markov random field","volume":"18","author":"Razlighi","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1109\/36.469492","article-title":"Spectral and spatial decorrelation of landsat-TM data for lossless compression","volume":"33","author":"Wang","year":"1995","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1117\/1.1447547","article-title":"Estimating noise and information of multispectral imagery","volume":"41","author":"Aiazzi","year":"2002","journal-title":"Opt. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/72.761722","article-title":"Fast and robust fixed-point algorithms for independent component analysis","volume":"10","year":"1999","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2183","DOI":"10.1109\/JSTARS.2014.2329792","article-title":"A Study on the effectiveness of different independent component analysis algorithms for hyperspectral image classification","volume":"7","author":"Falco","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.cageo.2015.09.002","article-title":"Geostatistical independent simulation of spatially correlated soil Variables","volume":"85","author":"Boluwade","year":"2015","journal-title":"Comput. Geosci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1080\/13658810210149416","article-title":"Quantitative measures for spatial information of maps","volume":"16","author":"Li","year":"2002","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.isprsjprs.2009.05.004","article-title":"An evaluation of measures for quantifying map information","volume":"65","author":"Harrie","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1007\/BF00893695","article-title":"To be or not to be\u2026 stationary? That is the question","volume":"21","author":"Myers","year":"1989","journal-title":"Math. Geol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1080\/00224065.1998.11979832","article-title":"Transforming nonnormal data to normality in statistical process-control","volume":"30","author":"Chou","year":"1998","journal-title":"J. Qual. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5003","DOI":"10.1002\/2014WR015874","article-title":"Estimating information entropy for hydrological data: One-dimensional case","volume":"50","author":"Gong","year":"2014","journal-title":"Water Resour. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1007\/BF01032109","article-title":"Fitting Variogram models by weighted least-squares","volume":"17","author":"Cressie","year":"1985","journal-title":"J. Int. Assoc. Math. Geol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/0034-4257(88)90108-3","article-title":"The use of variograms in remote sensing: I. Scene models and simulated images","volume":"25","author":"Woodcock","year":"1988","journal-title":"Remote Sens. Environ."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/0034-4257(88)90109-5","article-title":"The use of variograms in remote sensing: II. Real digital images","volume":"25","author":"Woodcock","year":"1988","journal-title":"Remote Sens. Environ."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1080\/01431160902922888","article-title":"Geostatistically estimated image noise is a function of variance in the underlying signal","volume":"31","author":"Asmat","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Phiri, D., and Morgenroth, J. (2017). Developments in landsat land cover classification methods: A review. Remote Sens., 9.","DOI":"10.3390\/rs9090967"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"20","DOI":"10.32614\/RJ-2014-002","article-title":"A Multiscale test of spatial stationarity for textured images in R","volume":"6","author":"Nunes","year":"2014","journal-title":"R J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1007\/s11004-006-9031-2","article-title":"The necessity of a multiple-point prior model","volume":"38","author":"Journel","year":"2006","journal-title":"Math. Geol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/s11004-013-9482-1","article-title":"Comparing training-image based algorithms using an analysis of distance","volume":"46","author":"Tan","year":"2014","journal-title":"Math. Geosci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2956","DOI":"10.1109\/TGRS.2014.2367022","article-title":"Mutual-information-based semi-supervised hyperspectral band selection with high discrimination, high information, and low redundancy","volume":"53","author":"Feng","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/S1361-8415(03)00040-9","article-title":"Statistical shape analysis using non-euclidean metrics","volume":"7","author":"Larsen","year":"2003","journal-title":"Med. Image Anal."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/5\/880\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:05:32Z","timestamp":1760173532000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/5\/880"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,9]]},"references-count":46,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["rs12050880"],"URL":"https:\/\/doi.org\/10.3390\/rs12050880","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,9]]}}}