{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T21:23:30Z","timestamp":1776374610325,"version":"3.51.2"},"reference-count":53,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,21]],"date-time":"2021-08-21T00:00:00Z","timestamp":1629504000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The near-infrared (NIR) spectral range (from 780 to 2500 nm) of the multispectral remote sensing imagery provides vital information for landcover classification, especially concerning vegetation assessment. Despite the usefulness of NIR, it does not always accomplish common RGB. Modern achievements in image processing via deep neural networks make it possible to generate artificial spectral information, for example, to solve the image colorization problem. In this research, we aim to investigate whether this approach can produce not only visually similar images but also an artificial spectral band that can improve the performance of computer vision algorithms for solving remote sensing tasks. We study the use of a generative adversarial network (GAN) approach in the task of the NIR band generation using only RGB channels of high-resolution satellite imagery. We evaluate the impact of a generated channel on the model performance to solve the forest segmentation task. Our results show an increase in model accuracy when using generated NIR compared to the baseline model, which uses only RGB (0.947 and 0.914 F1-scores, respectively). The presented study shows the advantages of generating the extra band such as the opportunity to reduce the required amount of labeled data.<\/jats:p>","DOI":"10.3390\/s21165646","type":"journal-article","created":{"date-parts":[[2021,8,22]],"date-time":"2021-08-22T22:59:27Z","timestamp":1629673167000},"page":"5646","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Generation of the NIR Spectral Band for Satellite Images with Convolutional Neural Networks"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2448-9907","authenticated-orcid":false,"given":"Svetlana","family":"Illarionova","sequence":"first","affiliation":[{"name":"Skolkovo Institute of Science and Technology, 143026 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dmitrii","family":"Shadrin","sequence":"additional","affiliation":[{"name":"Skolkovo Institute of Science and Technology, 143026 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexey","family":"Trekin","sequence":"additional","affiliation":[{"name":"Skolkovo Institute of Science and Technology, 143026 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8565-1184","authenticated-orcid":false,"given":"Vladimir","family":"Ignatiev","sequence":"additional","affiliation":[{"name":"Skolkovo Institute of Science and Technology, 143026 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ivan","family":"Oseledets","sequence":"additional","affiliation":[{"name":"Skolkovo Institute of Science and Technology, 143026 Moscow, Russia"},{"name":"Institute of Numerical Mathematics of Russian Academy of Sciences, 119333 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2784","DOI":"10.1080\/01431161.2018.1433343","article-title":"Implementation of machine-learning classification in remote sensing: An applied review","volume":"39","author":"Maxwell","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_2","first-page":"295","article-title":"MODIS vegetation index (MOD13)","volume":"3","author":"Huete","year":"1999","journal-title":"Algorithm Theor. Basis Doc."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, W., Dong, R., Fu, H., and Yu, L. (2019). Large-scale oil palm tree detection from high-resolution satellite images using two-stage convolutional neural networks. Remote Sens., 11.","DOI":"10.3390\/rs11010011"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1810","DOI":"10.1109\/JSTARS.2020.3048372","article-title":"Neural-Based Hierarchical Approach for Detailed Dominant Forest Species Classification by Multispectral Satellite Imagery","volume":"14","author":"Illarionova","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"778","DOI":"10.1109\/LGRS.2017.2681128","article-title":"Deep learning classification of land cover and crop types using remote sensing data","volume":"14","author":"Kussul","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Navarro, P.J., P\u00e9rez, F., Weiss, J., and Egea-Cortines, M. (2016). Machine learning and computer vision system for phenotype data acquisition and analysis in plants. Sensors, 16.","DOI":"10.3390\/s16050641"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1109\/LGRS.2017.2657778","article-title":"Training deep convolutional neural networks for land\u2013cover classification of high-resolution imagery","volume":"14","author":"Scott","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2250","DOI":"10.1109\/TGRS.2016.2640186","article-title":"Unsupervised Feature Learning for Land-Use Scene Recognition","volume":"54","author":"Fan","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","first-page":"101897","article-title":"Using a U-net convolutional neural network to map woody vegetation extent from high resolution satellite imagery across Queensland, Australia","volume":"82","author":"Flood","year":"2019","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Alias, B., Karthika, R., and Parameswaran, L. (2018, January 19\u201322). Classification of High Resolution Remote Sensing Images using Deep Learning Techniques. Proceedings of the 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Bangalore, India.","DOI":"10.1109\/ICACCI.2018.8554605"},{"key":"ref_11","unstructured":"(2021, February 06). Satellite Imagery for Natural Disasters|Digital Globe. Available online: https:\/\/www.digitalglobe.com\/ecosystem\/open-data."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"De Lima, D.C., Saqui, D., Ataky, S., Jorge, L.A.d.C., Ferreira, E.J., and Saito, J.H. (2019). Estimating Agriculture NIR Images from Aerial RGB Data. International Conference on Computational Science, Springer.","DOI":"10.1007\/978-3-030-22734-0_41"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1016\/j.isprsjprs.2018.11.003","article-title":"Analogue-based colorization of remote sensing images using textural information","volume":"147","author":"Gravey","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","first-page":"115330L","article-title":"GAN generation of synthetic multispectral satellite images","volume":"Volume 11533","author":"Abady","year":"2020","journal-title":"Image and Signal Processing for Remote Sensing XXVI. International Society for Optics and Photonics"},{"key":"ref_15","unstructured":"Mohandoss, T., Kulkarni, A., Northrup, D., Mwebaze, E., and Alemohammad, H. (2020). Generating synthetic multispectral satellite imagery from sentinel-2. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1007\/s11831-019-09388-y","article-title":"Applications of generative adversarial networks (gans): An updated review","volume":"28","author":"Alqahtani","year":"2019","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Nazeri, K., Ng, E., and Ebrahimi, M. (2018). Image colorization using generative adversarial networks. International Conference on Articulated Motion and Deformable Objects, Springer.","DOI":"10.1007\/978-3-319-94544-6_9"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Su\u00e1rez, P.L., Sappa, A.D., and Vintimilla, B.X. (2017, January 21\u201326). Infrared image colorization based on a triplet dcgan architecture. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.32"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wu, M., Jin, X., Jiang, Q., Lee, S.J., Guo, L., Di, Y., Huang, S., and Huang, J. (2019, January 19\u201321). Remote Sensing Image Colorization Based on Multiscale SEnet GAN. Proceedings of the 2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Huaqiao, China.","DOI":"10.1109\/CISP-BMEI48845.2019.8965902"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, F., Ma, L., and Cai, J. (2018, January 22\u201327). Multi-discriminator generative adversarial network for high resolution gray-scale satellite image colorization. Proceedings of the IGARSS 2018\u20132018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8517930"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tang, R., Liu, H., and Wei, J. (2020). Visualizing Near Infrared Hyperspectral Images with Generative Adversarial Networks. Remote Sens., 12.","DOI":"10.3390\/rs12233848"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Singh, P., and Komodakis, N. (2018, January 22\u201327). Cloud-gan: Cloud removal for sentinel-2 imagery using a cyclic consistent generative adversarial networks. Proceedings of the IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519033"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Qu, Y., Chen, Y., Huang, J., and Xie, Y. (2019, January 15\u201320). Enhanced pix2pix dehazing network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00835"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, H., and Liu, X. (2021, January 12\u201314). Overview of image colorization and its applications. Proceedings of the 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.","DOI":"10.1109\/IAEAC50856.2021.9390626"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1145\/566654.566576","article-title":"Transferring Color to Greyscale Images","volume":"21","author":"Welsh","year":"2002","journal-title":"ACM Trans. Graph."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wu, M., Jin, X., Jiang, Q., Lee, S.j., Liang, W., Lin, G., and Yao, S. (2020). Remote sensing image colorization using symmetrical multi-scale DCGAN in YUV color space. Visual Comput., 1\u201323.","DOI":"10.1007\/s00371-020-01933-2"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"111676","DOI":"10.1016\/j.rse.2020.111676","article-title":"Fluorescence Correction Vegetation Index (FCVI): A physically based reflectance index to separate physiological and non-physiological information in far-red sun-induced chlorophyll fluorescence","volume":"240","author":"Yang","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Vandal, T.J., McDuff, D., Wang, W., Duffy, K., Michaelis, A., and Nemani, R.R. (2021). Spectral Synthesis for Geostationary Satellite-to-Satellite Translation. IEEE Trans. Geosci. Remote. Sens.","DOI":"10.1109\/TGRS.2021.3088686"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kwan, C., Zhu, X., Gao, F., Chou, B., Perez, D., Li, J., Shen, Y., Koperski, K., and Marchisio, G. (2018). Assessment of Spatiotemporal Fusion Algorithms for Planet and Worldview Images. Sensors, 18.","DOI":"10.3390\/s18041051"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3237","DOI":"10.1080\/01431161.2014.903351","article-title":"Blending MODIS and Landsat images for urban flood mapping","volume":"35","author":"Zhang","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"064020","DOI":"10.1088\/1748-9326\/abfc05","article-title":"The connection between forest degradation and urban energy demand in sub-Saharan Africa: A characterization based on high-resolution remote sensing data","volume":"16","author":"Sedano","year":"2021","journal-title":"Environ. Res. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"He, Q., Sun, X., Yan, Z., and Fu, K. (2021). DABNet: Deformable Contextual and Boundary-Weighted Network for Cloud Detection in Remote Sensing Images. IEEE Trans. Geosci. Remote. Sens., 1\u201316.","DOI":"10.1109\/TGRS.2020.3045474"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Illarionova, S., Nesteruk, S., Shadrin, D., Ignatiev, V., Pukalchik, M., and Oseledets, I. (2021). MixChannel: Advanced Augmentation for Multispectral Satellite Images. Remote Sens., 13.","DOI":"10.3390\/rs13112181"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1080\/01431160412331269698","article-title":"Random forest classifier for remote sensing classification","volume":"26","author":"Pal","year":"2005","journal-title":"Int. J. Remote Sens."},{"key":"ref_37","unstructured":"(2021, August 17). GBDX. Available online: https:\/\/gbdxdocs.digitalglobe.com\/."},{"key":"ref_38","unstructured":"(2021, February 06). Optical and Radar Data|SPOT. Available online: https:\/\/www.intelligence-airbusds.com\/optical-and-radar-data\/#spot."},{"key":"ref_39","unstructured":"(2021, February 06). Satellite Imagery and Archive|Planet. Available online: https:\/\/www.planet.com\/products\/planet-imagery\/."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Salehi, P., and Chalechale, A. (2020, January 18\u201320). Pix2Pix-based Stain-to-Stain Translation: A Solution for Robust Stain Normalization in Histopathology Images Analysis. Proceedings of the 2020 International Conference on Machine Vision and Image Processing (MVIP), Tehran, Iran.","DOI":"10.1109\/MVIP49855.2020.9116895"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"44599","DOI":"10.1109\/ACCESS.2019.2962579","article-title":"Two-stage sketch colorization with color parsing","volume":"8","author":"Ren","year":"2019","journal-title":"IEEE Access"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4\u20139). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.isprsjprs.2020.12.010","article-title":"Review on Convolutional Neural Networks (CNN) in vegetation remote sensing","volume":"173","author":"Kattenborn","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_46","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_47","unstructured":"(2020, August 20). Keras. 2019\u20132020. Available online: https:\/\/keras.io\/."},{"key":"ref_48","unstructured":"(2020, August 20). TensorFlow. 2019\u20132020. Available online: https:\/\/github.com\/tensorflow\/tensorflow."},{"key":"ref_49","unstructured":"(2021, August 17). Securewatch. Available online: https:\/\/www.maxar.com\/products\/securewatch."},{"key":"ref_50","unstructured":"(2021, August 17). OneAtlas. Available online: https:\/\/www.intelligence-airbusds.com\/imagery\/oneatlas\/."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1080\/15481603.2017.1323377","article-title":"Deep learning in remote sensing scene classification: A data augmentation enhanced convolutional neural network framework","volume":"54","author":"Yu","year":"2017","journal-title":"GIScience Remote Sens."},{"key":"ref_52","unstructured":"Illarionova, S., Nesteruk, S., Shadrin, D., Ignatiev, V., Pukalchik, M., and Oseledets, I. (2021). Object-Based Augmentation Improves Quality of Remote SensingSemantic Segmentation. arXiv."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Nesteruk, S., Shadrin, D., Pukalchik, M., Somov, A., Zeidler, C., Zabel, P., and Schubert, D. (2021). Image Compression and Plants Classification Using Machine Learning in Controlled-Environment Agriculture: Antarctic Station Use Case. IEEE Sens. J.","DOI":"10.1109\/JSEN.2021.3050084"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5646\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:48:56Z","timestamp":1760165336000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5646"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,21]]},"references-count":53,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21165646"],"URL":"https:\/\/doi.org\/10.3390\/s21165646","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,21]]}}}