{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T15:25:34Z","timestamp":1768404334266,"version":"3.49.0"},"reference-count":59,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,8,2]],"date-time":"2022-08-02T00:00:00Z","timestamp":1659398400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61771470"],"award-info":[{"award-number":["61771470"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["XDA19010401"],"award-info":[{"award-number":["XDA19010401"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Strategic Priority Research Program of the Chinese Academy of Sciences","award":["61771470"],"award-info":[{"award-number":["61771470"]}]},{"name":"Strategic Priority Research Program of the Chinese Academy of Sciences","award":["XDA19010401"],"award-info":[{"award-number":["XDA19010401"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Clouds in optical remote sensing images are an unavoidable existence that greatly affect the utilization of these images. Therefore, accurate and effective cloud detection is an indispensable step in image preprocessing. To date, most researchers have tried to use deep-learning methods for cloud detection. However, these studies generally use computer vision technology to improve the performances of the models, without considering the unique spectral feature information in remote sensing images. Moreover, due to the complex and changeable shapes of clouds, accurate cloud-edge detection is also a difficult problem. In order to solve these problems, we propose a deep-learning cloud detection network that uses the haze-optimized transformation (HOT) index and the edge feature extraction module for optical remote sensing images (CD_HIEFNet). In our model, the HOT index feature image is used to add the unique spectral feature information from clouds into the network for accurate detection, and the edge feature extraction (EFE) module is employed to refine cloud edges. In addition, we use ConvNeXt as the backbone network, and we improved the decoder to enhance the details of the detection results. We validated CD_HIEFNet using the Landsat-8 (L8) Biome dataset and compared it with the Fmask, FCN8s, U-Net, SegNet, DeepLabv3+ and CloudNet methods. The experimental results showed that our model has excellent performance, even in complex cloud scenarios. Moreover, according to the extended experimental results for the other L8 dataset and the Gaofen-1 data, CD_HIEFNet has strong performance in terms of robustness and generalization, thus helping to provide new ideas for cloud detection-related work.<\/jats:p>","DOI":"10.3390\/rs14153701","type":"journal-article","created":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T00:15:26Z","timestamp":1659485726000},"page":"3701","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["CD_HIEFNet: Cloud Detection Network Using Haze Optimized Transformation Index and Edge Feature for Optical Remote Sensing Imagery"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5954-2179","authenticated-orcid":false,"given":"Qing","family":"Guo","sequence":"first","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8777-6263","authenticated-orcid":false,"given":"Lianzi","family":"Tong","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Xudong","family":"Yao","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Yewei","family":"Wu","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Guangtong","family":"Wan","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Liu, P., Di, L., Du, Q., and Wang, L. (2018). Remote sensing big data: Theory, methods and applications. Remote Sens., 10.","DOI":"10.3390\/rs10050711"},{"key":"ref_2","first-page":"30","article-title":"Research on the application of remote sensing big data in urban and rural planning","volume":"17","author":"Zhang","year":"2020","journal-title":"Urb. Arch."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Yi\u011fit, \u0130.O. (2020, January 22\u201324). Overview of big data applications in remote sensing. Proceedings of the 2020 4th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Istanbul, Turkey.","DOI":"10.1109\/ISMSIT50672.2020.9255244"},{"key":"ref_4","first-page":"100789","article-title":"The role of remote sensing during a global disaster: COVID-19 pandemic as case study","volume":"27","author":"Louw","year":"2022","journal-title":"Remote Sens. Appl. Soc. Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1016\/j.apr.2020.09.003","article-title":"Air quality predictions with a semi-supervised bidirectional LSTM neural network","volume":"12","author":"Zhang","year":"2021","journal-title":"Atmos. Pollut. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.rse.2019.03.039","article-title":"A cloud detection algorithm for satellite imagery based on deep learning","volume":"229","author":"Jeppesen","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Rossow, W.B., Lacis, A.A., Oinas, V., and Mishchenko, M.I. (2004). Calculation of radiative fluxes from the surface to top of atmosphere based on ISCCP and other global data sets: Refinements of the radiative transfer model and the input data. J. Geophys. Res., 109.","DOI":"10.1029\/2003JD004457"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.rse.2014.06.012","article-title":"Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: An algorithm designed specifically for monitoring land cover change","volume":"152","author":"Zhu","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.isprsjprs.2021.09.013","article-title":"Towards a novel approach for Sentinel-3 synergistic OLCI\/SLSTR cloud and cloud shadow detection based on stereo cloud-top height estimation","volume":"181","author":"Alonso","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_10","first-page":"689","article-title":"Research progress of cloud measurement methods","volume":"40","author":"Lu","year":"2012","journal-title":"Meteorol. Sci. Technol."},{"key":"ref_11","first-page":"2053","article-title":"Research on cloud detection method of GF-5 DPC data","volume":"25","author":"Wei","year":"2021","journal-title":"J. Remote Sens."},{"key":"ref_12","first-page":"100417","article-title":"CloudX-net: A robust encoder-decoder architecture for cloud detection from satellite remote sensing images","volume":"20","author":"Kanu","year":"2020","journal-title":"Remote Sens. Appl. Soc. Environ."},{"key":"ref_13","first-page":"6","article-title":"Research progress on cloud detection methods in remote sensing images","volume":"29","author":"Liu","year":"2017","journal-title":"Remote Sens. Land Resour."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Singh, P., and Komodakis, N. (2018, January 22\u201327). Cloud-Gan: Cloud removal for Sentinel-2 imagery using a cyclic consistent generative adversarial networks. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519033"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.isprsjprs.2018.12.013","article-title":"Cloud removal in remote sensing images using nonnegative matrix factorization and error correction","volume":"148","author":"Li","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_16","first-page":"68","article-title":"A survey of cloud detection methods in remote sensing images","volume":"11","author":"Hou","year":"2014","journal-title":"Space Electron. Technol."},{"key":"ref_17","unstructured":"Zhang, J. (2020). Research on Remote Sensing Image Cloud Detection Method Based on Deep Learning. [Master\u2019s Thesis, University of Chinese Academy of Sciences]."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"111446","DOI":"10.1016\/j.rse.2019.111446","article-title":"Cloud detection algorithm for multi-modal satellite imagery using convolutional neural-networks (CNN)","volume":"237","author":"Li","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Jedlovec, G. (2009). Automated detection of clouds in satellite imagery. Advances in Geoscience and Remote Sensing, IntechOpen.","DOI":"10.5772\/8326"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.14358\/PERS.72.10.1179","article-title":"Characterization of the Landsat-7 ETM+ automated cloud-cover assessment (ACCA) algorithm","volume":"72","author":"Irish","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.rse.2011.10.028","article-title":"Object-based cloud and cloud shadow detection in Landsat imagery","volume":"118","author":"Zhu","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_22","first-page":"234","article-title":"A method for automatic cloud detection using TM images","volume":"39","author":"Qin","year":"2014","journal-title":"Geomat. Inf. Sci. Wuhan Univ."},{"key":"ref_23","first-page":"376","article-title":"Improvement of dynamic threshold cloud detection algorithm and its application on high-resolution satellites","volume":"38","author":"Wang","year":"2018","journal-title":"Acta Opt. Sin."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1109\/TGRS.1985.289471","article-title":"Contextual pattern recognition applied to cloud detection and identification","volume":"GE-23","author":"Kittler","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","first-page":"661","article-title":"A method for cloud detection in satellite remote sensing images based on texture features","volume":"28","author":"Cao","year":"2007","journal-title":"Acta Aeronaut. Astronaut. Sin."},{"key":"ref_26","first-page":"263","article-title":"Remote sensing image cloud detection based on edge features and AdaBoost classification","volume":"28","author":"Wang","year":"2013","journal-title":"Remote Sens. Technol. Appl."},{"key":"ref_27","first-page":"1061","article-title":"MODIS cloud detection algorithm combining Kmeans clustering and multispectral thresholding","volume":"31","author":"Wang","year":"2011","journal-title":"Spectrosc. Spect. Anal."},{"key":"ref_28","unstructured":"Liou, R.J., Azimi-Sadjadi, M.R., Reinke, D.L., Vonder-Haar, T.H., and Eis, K.E. (July, January 28). Detection and classification of cloud data from geostationary satellite using artificial neural networks. Proceedings of the IEEE World Congress on IEEE International Conference on Neural Networks, Orlando, FL, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Latry, C., Panem, C., and Dejean, P. (2007, January 23\u201328). Cloud detection with SVM technique. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Barcelona, Spain.","DOI":"10.1109\/IGARSS.2007.4422827"},{"key":"ref_30","first-page":"61","article-title":"FY-2G cloud detection method based on random forest","volume":"3","author":"Fu","year":"2019","journal-title":"Bull. Surv. Map"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mohajerani, S., Krammer, T.A., and Saeedi, P. (2018, January 29\u201331). Cloud detection algorithm for remote sensing images using fully convolutional neural networks. Proceedings of the IEEE 20th International Workshop on Multimedia Signal Processing (MMSP), Vancouver, BC, Canada.","DOI":"10.1109\/MMSP.2018.8547095"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"87323","DOI":"10.1109\/ACCESS.2019.2925565","article-title":"P_SegNet and NP_SegNet: New neural network architectures for cloud recognition of remote sensing images","volume":"7","author":"Lu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_34","first-page":"1169","article-title":"Research on generalization performance of remote sensing image cloud detection network: Taking DeepLabv3+ as an example","volume":"25","author":"Peng","year":"2021","journal-title":"J. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1785","DOI":"10.1109\/LGRS.2017.2735801","article-title":"Distinguishing Cloud and Snow in Satellite Images via Deep Convolutional Network","volume":"14","author":"Zhan","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Mohajerani, S., and Saeedi, P. (August, January 28). Cloud-Net: An End-To-End Cloud Detection Algorithm for Landsat 8 Imagery. Proceedings of the IGARSS 2019\u20142019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8898776"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhang, J., Zhou, Q., Wang, H., Wang, Y., and Li, Y. (October, January 26). Cloud Detection Using Gabor Filters and Attention-Based Convolutional Neural Network for Remote Sensing Images. Proceedings of the IGARSS 2020\u20142020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA.","DOI":"10.1109\/IGARSS39084.2020.9323082"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"9743","DOI":"10.1109\/JSTARS.2021.3114171","article-title":"ClouDet: A dilated separable CNN-Based cloud detection framework for remote sensing imagery","volume":"14","author":"Guo","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"018504","DOI":"10.1117\/1.JRS.15.018504","article-title":"Using improved DeepLabv3+ network integrated with normalized difference water index to extract water bodies in Sentinel-2A urban remote sensing images","volume":"15","author":"Su","year":"2021","journal-title":"J. Appl. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022). ConvNet for the 2020s. arXiv.","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"ref_41","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-Decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"SegNet: A Deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Xie, S., and Tu, Z. (2015, January 7\u201313). Holistically-nested edge detection. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.164"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201323). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_49","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning (PMLR), Long Beach, CA, USA."},{"key":"ref_50","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin transformer: Hierarchical vision transformer using shifted windows C. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_52","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/S0034-4257(02)00034-2","article-title":"An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images","volume":"82","author":"Zhang","year":"2002","journal-title":"Remote Sens. Environ."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","article-title":"Focal loss for dense object detection","volume":"42","author":"Lin","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_55","unstructured":"Jordan, M., Kleinberg, J., and Scholkopf, B. (2006). Linear Models for Classification. Pattern Recognition and Machine Learning (Information Science and Statistics), Springer."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.rse.2017.03.026","article-title":"Cloud detection algorithm comparison and validation for operational Landsat data products","volume":"194","author":"Foga","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"4907","DOI":"10.3390\/rs6064907","article-title":"Automated detection of cloud and cloud shadow in single-date Landsat imagery using neural networks and spatial post-processing","volume":"6","author":"Hughes","year":"2014","journal-title":"Remote Sens."},{"key":"ref_58","first-page":"8026","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Proc. Syst. Proc."},{"key":"ref_59","unstructured":"Loshchilov, I., and Hutter, F. (2016). SGDR: Stochastic gradient descent with warm restarts. arXiv."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3701\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:01:26Z","timestamp":1760140886000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3701"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,2]]},"references-count":59,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14153701"],"URL":"https:\/\/doi.org\/10.3390\/rs14153701","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,2]]}}}