{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T02:54:40Z","timestamp":1775530480287,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,29]],"date-time":"2021-12-29T00:00:00Z","timestamp":1640736000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Brazilian Federal Agency for Support and Evaluation of Graduate Education","award":["88882.433956\/2019-01"],"award-info":[{"award-number":["88882.433956\/2019-01"]}]},{"name":"Brazilian Federal Agency for Support and Evaluation of Graduate Education","award":["88887.310463\/2018-00"],"award-info":[{"award-number":["88887.310463\/2018-00"]}]},{"name":"Brazilian Federal Agency for Support and Evaluation of Graduate Education","award":["88887.473380\/2020-00"],"award-info":[{"award-number":["88887.473380\/2020-00"]}]},{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"publisher","award":["335612"],"award-info":[{"award-number":["335612"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Clouds are one of the major limitations to crop monitoring using optical satellite images. Despite all efforts to provide decision-makers with high-quality agricultural statistics, there is still a lack of techniques to optimally process satellite image time series in the presence of clouds. In this regard, in this article it was proposed to add a Multi-Layer Perceptron loss function to the pix2pix conditional Generative Adversarial Network (cGAN) objective function. The aim was to enforce the generative model to learn how to deliver synthetic pixels whose values were proxies for the spectral response improving further crop type mapping. Furthermore, it was evaluated the generalization capacity of the generative models in producing pixels with plausible values for images not used in the training. To assess the performance of the proposed approach it was compared real images with synthetic images generated with the proposed approach as well as with the original pix2pix cGAN. The comparative analysis was performed through visual analysis, pixel values analysis, semantic segmentation and similarity metrics. In general, the proposed approach provided slightly better synthetic pixels than the original pix2pix cGAN, removing more noise than the original pix2pix algorithm as well as providing better crop type semantic segmentation; the semantic segmentation of the synthetic image generated with the proposed approach achieved an F1-score of 44.2%, while the real image achieved 44.7%. Regarding the generalization, the models trained utilizing different regions of the same image provided better pixels than models trained using other images in the time series. Besides this, the experiments also showed that the models trained using a pair of images selected every three months along the time series also provided acceptable results on images that do not have cloud-free areas.<\/jats:p>","DOI":"10.3390\/rs14010144","type":"journal-article","created":{"date-parts":[[2021,12,29]],"date-time":"2021-12-29T23:31:35Z","timestamp":1640820695000},"page":"144","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Pix2pix Conditional Generative Adversarial Network with MLP Loss Function for Cloud Removal in a Cropland Time Series"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1516-1873","authenticated-orcid":false,"given":"Luiz E.","family":"Christovam","sequence":"first","affiliation":[{"name":"Department of Cartography, S\u00e3o Paulo State University, Roberto Simonsen 305, Presidente Prudente 19060-900, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6740-7863","authenticated-orcid":false,"given":"Milton H.","family":"Shimabukuro","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, S\u00e3o Paulo State University, Roberto Simonsen 305, Presidente Prudente 19060-900, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1726-3152","authenticated-orcid":false,"given":"Maria de Lourdes B. T.","family":"Galo","sequence":"additional","affiliation":[{"name":"Department of Cartography, S\u00e3o Paulo State University, Roberto Simonsen 305, Presidente Prudente 19060-900, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7236-2145","authenticated-orcid":false,"given":"Eija","family":"Honkavaara","sequence":"additional","affiliation":[{"name":"Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute (FGI), National Land Survey of Finland, Geodeetinrinne 2, 02430 Massala, Finland"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,29]]},"reference":[{"key":"ref_1","unstructured":"United Nations (2015). Transforming our world: The 2030 Agenda for Sustainable Development. United Nations General Assembly, United Nations."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"111470","DOI":"10.1016\/j.rse.2019.111470","article-title":"No pixel left behind: Toward integrating Earth Observations for agriculture into the United Nations Sustainable Development Goals framework","volume":"235","author":"Whitcraft","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"124905","DOI":"10.1016\/j.jhydrol.2020.124905","article-title":"A review of remote sensing applications in agriculture for food security: Crop growth and yield, irrigation, and crop losses","volume":"586","author":"Karthikeyan","year":"2020","journal-title":"J. Hydrol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"949","DOI":"10.3390\/rs5020949","article-title":"Advances in remote sensing of agriculture: Context description, existing operational monitoring systems and major information needs","volume":"5","author":"Atzberger","year":"2013","journal-title":"Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.agsy.2018.05.010","article-title":"A comparison of global agricultural monitoring systems and current gaps","volume":"168","author":"Fritz","year":"2019","journal-title":"Agric. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.3390\/rs70201482","article-title":"Meeting earth observation requirements for global agricultural monitoring: An evaluation of the revisit capabilities of current and planned moderate resolution optical earth observing missions","volume":"7","author":"Whitcraft","year":"2015","journal-title":"Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1016\/j.rse.2014.10.009","article-title":"Cloud cover throughout the agricultural growing season: Impacts on passive optical earth observations","volume":"156","author":"Whitcraft","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3826","DOI":"10.1109\/TGRS.2012.2227333","article-title":"Spatial and temporal distribution of clouds observed by MODIS onboard the Terra and Aqua satellites","volume":"51","author":"King","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","first-page":"100414","article-title":"Limitations of cloud cover for optical remote sensing of agricultural areas across South America","volume":"20","author":"Prudente","year":"2020","journal-title":"Remote Sens. Appl. Soc. Environ."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sarukkai, V., Jain, A., Uzkent, B., and Ermon, S. (2020, January 1\u20135). Cloud Removal in Satellite Images Using Spatiotemporal Generative Networks. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093564"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/MGRS.2015.2441912","article-title":"Missing information reconstruction of remote sensing data: A technical review","volume":"3","author":"Shen","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_12","unstructured":"Li, M., Liew, S.C., and Kwoh, L.K. (2003, January 21\u201325). Automated production of cloud-free and cloud shadow-free image mosaics from cloudy satellite imagery. Proceedings of the XXth ISPRS Congress, Toulouse, France."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1109\/TGRS.2005.861929","article-title":"Contextual reconstruction of cloud-contaminated multitemporal multispectral images","volume":"44","author":"Melgani","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Benabdelkader, S., Melgani, F., and Boulemden, M. (2007, January 23\u201328). Cloud-contaminated image reconstruction with contextual spatio-spectral information. In Proceeding of the IGARSS 2007 IEEE International Geoscience and Remote Sensing Symposium, Barcelona, Spain.","DOI":"10.1109\/IGARSS.2007.4422808"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1109\/LGRS.2008.915596","article-title":"Contextual spatiospectral postreconstruction of cloud-contaminated images","volume":"5","author":"Benabdelkader","year":"2008","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"015005","DOI":"10.1117\/1.JRS.11.015005","article-title":"Cloud masking and removal in remote sensing image time series","volume":"11","year":"2017","journal-title":"J. Appl. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.rse.2015.12.023","article-title":"An evaluation of time-series smoothing algorithms for land-cover classifications using MODIS-NDVI multi-temporal data","volume":"174","author":"Shao","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_18","first-page":"823","article-title":"Evaluation of SAR to Optical Image Translation Using Conditional Generative Adversarial Network for Cloud Removal in a Crop Dataset","volume":"43","author":"Christovam","year":"2021","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_19","first-page":"2672","article-title":"Generative adversarial nets","volume":"2","author":"Goodfellow","year":"2014","journal-title":"Adv. Neural Inf. Processing Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Enomoto, K., Sakurada, K., Wang, W., and Kawaguchi, N. (2018, January 22\u201327). Image translation between SAR and optical imagery with generative adversarial nets. Proceedings of the IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518719"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5","DOI":"10.5194\/isprs-annals-IV-1-5-2018","article-title":"SAR to optical image synthesis for cloud removal with generative adversarial networks. ISPRS Ann. Photogramm. Remote Sens","volume":"4","author":"Bermudez","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Grohnfeldt, C., Schmitt, M., and Zhu, X. (2018, January 22\u201327). A Conditional Generative Adversarial Network to Fuse SAR And Multispectral Optical Data For Cloud Removal From Sentinel-2 Images. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519215"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Singh, P., and Komodakis, N. (2018, January 22\u201327). IEEE Cloud-gan: Cloud removal for sentinel-2 imagery using a cyclic consistent generative adversarial networks. Proceedings of the IGARSS 2018\u20132018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519033"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1220","DOI":"10.1109\/LGRS.2019.2894734","article-title":"Synthesis of multispectral optical images from SAR\/optical multitemporal data using conditional generative adversarial networks","volume":"16","author":"Bermudez","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1109\/LGRS.2017.2789120","article-title":"Campo Verde database: Seeking to improve agricultural remote sensing of tropical areas","volume":"15","author":"Sanches","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"60338","DOI":"10.1109\/ACCESS.2020.2977103","article-title":"A SAR-to-optical image translation method based on conditional generation adversarial network (cGAN)","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_28","first-page":"3031199","article-title":"Atrous cGAN for SAR to Optical Image Translation","volume":"19","author":"Turnes","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lorenzo, P.R., Nalepa, J., Kawulok, M., Ramos, L.S., and Pastor, J.R. (2017, January 1). Particle swarm optimization for hyper-parameter selection in deep neural networks. Proceedings of the genetic and evolutionary computation conference, Berlin, Germany.","DOI":"10.1145\/3071178.3071208"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez-de-la-Cruz, J.A., Acosta-Mesa, H.-G., and Mezura-Montes, E. (2021). Evolution of Generative Adversarial Networks Using PSO for Synthesis of COVID-19 Chest X-ray Images, 2021 IEEE Congress on Evolutionary Computation (CEC), IEEE.","DOI":"10.1109\/CEC45853.2021.9504743"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"(2021). Optimized convolutional neural network by firefly algorithm for magnetic resonance image classification of glioma brain tumor grade. J. Real-Time Image Processing, 18, 1085\u20131098.","DOI":"10.1007\/s11554-021-01106-x"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.future.2021.03.022","article-title":"High-quality face image generation using particle swarm optimization-based generative adversarial networks","volume":"122","author":"Zhang","year":"2021","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_33","unstructured":"Mirza, M., and Osindero, S. (2014). Conditional Generative Adversarial Nets. arXiv."},{"key":"ref_34","unstructured":"Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., and Efros, A.A. (1, January June). Context encoders: Feature learning by inpainting. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sanches, I., Feitosa, R.Q., Achanccaray, P., Montibeller, B., Luiz, A.J.B., Soares, M.D., Prudente, V.H.R., Vieira, D.C., and Maurano, L.E.P. (2018). LEM benchmark database for tropical agricultural remote sensing application. ISPRS International Archives of the Photogrammetry, Remote Sensing and Spatial Information Science, ISPRS.","DOI":"10.5194\/isprs-archives-XLII-1-387-2018"},{"key":"ref_36","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/j.neucom.2020.07.061","article-title":"On hyperparameter optimization of machine learning algorithms: Theory and practice","volume":"415","author":"Yang","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_38","unstructured":"Claesen, M., Simm, J., Popovic, D., Moreau, Y., and Moor, B.D. (2014). Easy hyperparameter search using optunity. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1895","DOI":"10.1162\/089976698300017197","article-title":"Approximate statistical tests for comparing supervised classification learning algorithms","volume":"10","author":"Dietterich","year":"1998","journal-title":"Neural Comput."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Navab, N., Hornegger, J., Wells, W., and Frangi, A. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015. Lecture Notes in Computer Science, 9351, Springer.","DOI":"10.1007\/978-3-319-24553-9"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/1\/144\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:55:42Z","timestamp":1760169342000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/1\/144"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,29]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["rs14010144"],"URL":"https:\/\/doi.org\/10.3390\/rs14010144","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,29]]}}}