{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T15:57:53Z","timestamp":1776441473646,"version":"3.51.2"},"reference-count":33,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,4,30]],"date-time":"2022-04-30T00:00:00Z","timestamp":1651276800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Measuring the predictability and complexity of 2D data (image) series using entropy is an essential tool for evaluation of systems\u2019 irregularity and complexity in remote sensing and geophysical mapping. However, the existing methods have some drawbacks related to their strong dependence on method parameters and image rotation. To overcome these difficulties, this study proposes a new method for estimating two-dimensional neural network entropy (NNetEn2D) for evaluating the regularity or predictability of images using the LogNNet neural network model. The method is based on an algorithm for converting a 2D kernel into a 1D data series followed by NNetEn2D calculation. An artificial test image was created for the study. We demonstrate the advantage of using circular instead of square kernels through comparison of the invariance of the NNetEn2D distribution after image rotation. Highest robustness was observed for circular kernels with a radius of R = 5 and R = 6 pixels, with a NNetEn2D calculation error of no more than 10%, comparable to the distortion of the initial 2D data. The NNetEn2D entropy calculation method has two main geometric parameters (kernel radius and its displacement step), as well as two neural network hyperparameters (number of training epochs and one of six reservoir filling techniques). We evaluated our method on both remote sensing and geophysical mapping images. Remote sensing imagery (Sentinel-2) shows that brightness of the image does not affect results, which helps keep a rather consistent appearance of entropy maps over time without saturation effects being observed. Surfaces with little texture, such as water bodies, have low NNetEn2D values, while urban areas have consistently high values. Application to geophysical mapping of rocks to the northwest of southwest Australia is characterized by low to medium entropy and highlights aspects of the geology. These results indicate the success of NNetEn2D in providing meaningful entropy information for 2D in remote sensing and geophysical applications.<\/jats:p>","DOI":"10.3390\/rs14092166","type":"journal-article","created":{"date-parts":[[2022,5,2]],"date-time":"2022-05-02T07:08:58Z","timestamp":1651475338000},"page":"2166","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["NNetEn2D: Two-Dimensional Neural Network Entropy in Remote Sensing Imagery and Geophysical Mapping"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9341-1831","authenticated-orcid":false,"given":"Andrei","family":"Velichko","sequence":"first","affiliation":[{"name":"Institute of Physics and Technology, Petrozavodsk State University, 185910 Petrozavodsk, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias P.","family":"Wagner","sequence":"additional","affiliation":[{"name":"Panopterra, 64293 Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alireza","family":"Taravat","sequence":"additional","affiliation":[{"name":"Deimos Space, Oxford OX11 0QR, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bruce","family":"Hobbs","sequence":"additional","affiliation":[{"name":"CSIRO Earth Sciences and Resource Engineering, Bentley, WA 6102, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alison","family":"Ord","sequence":"additional","affiliation":[{"name":"Centre for Exploration Targeting, School of Earth Sciences, The University of Western Australia, Crawley, WA 6009, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MGRS.2017.2762307","article-title":"Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources","volume":"5","author":"Zhu","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e2021RG000742","DOI":"10.1029\/2021RG000742","article-title":"Deep Learning for Geophysics: Current and Future Trends","volume":"59","author":"Yu","year":"2021","journal-title":"Rev. Geophys."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated Residual Transformations for Deep Neural Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3349","DOI":"10.1109\/TPAMI.2020.2983686","article-title":"Deep High-Resolution Representation Learning for Visual Recognition","volume":"43","author":"Wang","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Minaee, S., Boykov, Y.Y., Porikli, F., Plaza, A.J., Kehtarnavaz, N., and Terzopoulos, D. (2021). Image Segmentation Using Deep Learning: A Survey. IEEE Trans. Pattern Anal. Mach. Intell., 1.","DOI":"10.1109\/TPAMI.2021.3059968"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/TPAMI.2019.2938758","article-title":"Res2Net: A New Multi-Scale Backbone Architecture","volume":"43","author":"Gao","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Fu, K., Li, Y., Sun, H., Yang, X., Xu, G., Li, Y., and Sun, X. (2018). A Ship Rotation Detection Model in Remote Sensing Images Based on Feature Fusion Pyramid Network and Deep Reinforcement Learning. Remote Sens., 10.","DOI":"10.3390\/rs10121922"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dr\u00f6nner, J., Korfhage, N., Egli, S., M\u00fchling, M., Thies, B., Bendix, J., Freisleben, B., and Seeger, B. (2018). Fast Cloud Segmentation Using Convolutional Neural Networks. Remote Sens., 10.","DOI":"10.3390\/rs10111782"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/s40808-019-00686-9","article-title":"Integration of remote sensing, GIS, and Shannon\u2019s entropy approach to conduct trend analysis of the dynamics change in urban\/built-up areas in the Upper Citarum River Basin, West Java, Indonesia","volume":"6","author":"Yulianto","year":"2020","journal-title":"Model. Earth Syst. Environ."},{"key":"ref_10","first-page":"293","article-title":"The Use of GIS, Remote Sensing and Shannon\u2019s Entropy Statistical Techniques to Analyze and Monitor the Spatial and Temporal Patterns of Urbanization and Sprawl in Zarqa City, Jordan","volume":"8","author":"Mashagbah","year":"2016","journal-title":"J. Geogr. Inf. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3129","DOI":"10.12785\/amis\/080654","article-title":"Maximum entropy for image segmentation based on an adaptive particle swarm optimization","volume":"8","author":"Qi","year":"2014","journal-title":"Appl. Math. Inf. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gao, T., Zheng, L., Xu, W., Piao, Y., Feng, R., Chen, X., and Zhou, T. (2021). An Automatic Exposure Method of Plane Array Remote Sensing Image Based on Two-Dimensional Entropy. Sensors, 21.","DOI":"10.3390\/s21103306"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"13007","DOI":"10.1117\/1.3534855","article-title":"Using image entropy maximum for auto exposure","volume":"20","author":"Rahman","year":"2011","journal-title":"J. Electron. Imaging"},{"key":"ref_14","unstructured":"Sun, W., Chen, H., Tang, H., and Liu, Y. (2010, January 4\u20136). Unsupervised image change detection means based on 2-D entropy. Proceedings of the 2nd International Conference on Information Science and Engineering, Hangzhou, China."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.nrjag.2017.12.006","article-title":"Texture analysis of aeromagnetic data for enhancing geologic features using co-occurrence matrices in Elallaqi area, South Eastern Desert of Egypt","volume":"7","author":"Eldosouky","year":"2018","journal-title":"NRIAG J. Astron. Geophys."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1071\/EG995209","article-title":"Textural Filtering of Aeromagnetic Data","volume":"26","author":"Dentith","year":"1995","journal-title":"Explor. Geophys."},{"key":"ref_17","first-page":"1","article-title":"Towards understanding the influence of data-richness on interpretational confidence in image interpretation","volume":"2013","author":"Aitken","year":"2013","journal-title":"ASEG Ext. Abstr."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.oregeorev.2011.11.002","article-title":"Identifying structural complexity in aeromagnetic data: An image analysis approach to greenfields gold exploration","volume":"46","author":"Holden","year":"2012","journal-title":"Ore Geol. Rev."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, B., Liu, B., Guo, K., Li, C., and Wang, B. (2019). Application of a Maximum Entropy Model for Mineral Prospectivity Maps. Minerals, 9.","DOI":"10.3390\/min9090556"},{"key":"ref_20","unstructured":"Hassan, H. (2012). Texture Analysis of High Resolution Aeromagnetic Data to Delineate Geological Features in the Horn River Basin, NE British Columbia, Canadian Society of Exploration Geophysicists."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hobbs, B., and Ord, A. (2015). Chapter 7\u2014Introduction. Structural Geology: The Mechanics of Deforming Metamorphic Rocks, Elsevier.","DOI":"10.1016\/B978-0-12-407820-8.02001-4"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.image.2019.04.013","article-title":"Two-dimensional dispersion entropy: An information-theoretic method for irregularity analysis of images","volume":"75","author":"Azami","year":"2019","journal-title":"Signal Process. Image Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"45002","DOI":"10.1088\/2057-1976\/2\/4\/045002","article-title":"Two-dimensional sample entropy: Assessing image texture through irregularity","volume":"2","author":"Silva","year":"2016","journal-title":"Biomed. Phys. Eng. Express"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ribeiro, H.V., Zunino, L., Lenzi, E.K., Santoro, P.A., and Mendes, R.S. (2012). Complexity-Entropy Causality Plane as a Complexity Measure for Two-Dimensional Patterns. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0040689"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"6092","DOI":"10.1088\/1361-6560\/aa75b0","article-title":"The approximate entropy concept extended to three dimensions for calibrated, single parameter structural complexity interrogation of volumetric images","volume":"62","author":"Moore","year":"2017","journal-title":"Phys. Med. Biol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural Features for Image Classification","volume":"SMC-3","author":"Haralick","year":"1973","journal-title":"IEEE Trans. Syst. Man. Cybern."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Velichko, A. (2020). Neural network for low-memory IoT devices and MNIST image recognition using kernels based on logistic map. Electronics, 9.","DOI":"10.3390\/electronics9091432"},{"key":"ref_28","unstructured":"LeCun, Y., Cortes, C., and Burges, C. (2018, November 09). MNIST Handwritten Digit Database. Available online: http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Velichko, A., and Heidari, H. (2021). A Method for Estimating the Entropy of Time Series Using Artificial Neural Networks. Entropy, 23.","DOI":"10.3390\/e23111432"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Heidari, H., and Velichko, A. (2022). Novel techniques for improvement the NNetEn entropy calculation for short and noisy time series. arXiv.","DOI":"10.1007\/s11071-023-08298-w"},{"key":"ref_31","unstructured":"Whitaker, A.J., and Bastrakova, I.V. (2022, February 20). Yilgarn Craton Aeromagnetic Interpretation Map 1:1,500,000 Scale, Available online: http:\/\/pid.geoscience.gov.au\/dataset\/ga\/39935."},{"key":"ref_32","unstructured":"(2022, February 20). Geological Survey of Western Australia e-News\u2014Department of Mines and Petroleum, Available online: http:\/\/www.dmp.wa.gov.au\/gswa_enews\/edition_41\/index.aspx."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1073\/pnas.88.6.2297","article-title":"Approximate entropy as a measure of system complexity","volume":"88","author":"Pincus","year":"1991","journal-title":"Proc. Natl. Acad. Sci. USA"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/9\/2166\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:05:17Z","timestamp":1760137517000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/9\/2166"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,30]]},"references-count":33,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["rs14092166"],"URL":"https:\/\/doi.org\/10.3390\/rs14092166","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,30]]}}}