{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T03:58:08Z","timestamp":1769745488673,"version":"3.49.0"},"reference-count":70,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T00:00:00Z","timestamp":1726704000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["2237474"],"award-info":[{"award-number":["2237474"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1925001"],"award-info":[{"award-number":["1925001"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["DGE\u20131746047"],"award-info":[{"award-number":["DGE\u20131746047"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Cisco Systems Inc.","award":["2237474"],"award-info":[{"award-number":["2237474"]}]},{"name":"Cisco Systems Inc.","award":["1925001"],"award-info":[{"award-number":["1925001"]}]},{"name":"Cisco Systems Inc.","award":["DGE\u20131746047"],"award-info":[{"award-number":["DGE\u20131746047"]}]},{"name":"IBM-IL Discovery Accelerator Institute","award":["2237474"],"award-info":[{"award-number":["2237474"]}]},{"name":"IBM-IL Discovery Accelerator Institute","award":["1925001"],"award-info":[{"award-number":["1925001"]}]},{"name":"IBM-IL Discovery Accelerator Institute","award":["DGE\u20131746047"],"award-info":[{"award-number":["DGE\u20131746047"]}]},{"name":"CloudBank","award":["2237474"],"award-info":[{"award-number":["2237474"]}]},{"name":"CloudBank","award":["1925001"],"award-info":[{"award-number":["1925001"]}]},{"name":"CloudBank","award":["DGE\u20131746047"],"award-info":[{"award-number":["DGE\u20131746047"]}]},{"name":"National Science Foundation Graduate Research Fellowship","award":["2237474"],"award-info":[{"award-number":["2237474"]}]},{"name":"National Science Foundation Graduate Research Fellowship","award":["1925001"],"award-info":[{"award-number":["1925001"]}]},{"name":"National Science Foundation Graduate Research Fellowship","award":["DGE\u20131746047"],"award-info":[{"award-number":["DGE\u20131746047"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Satellite image time series (SITS) segmentation is crucial for many applications, like environmental monitoring, land cover mapping, and agricultural crop type classification. However, training models for SITS segmentation remains a challenging task due to the lack of abundant training data, which requires fine-grained annotation. We propose S4, a new self-supervised pretraining approach that significantly reduces the requirement for labeled training data by utilizing two key insights of satellite imagery: (a) Satellites capture images in different parts of the spectrum, such as radio frequencies and visible frequencies. (b) Satellite imagery is geo-registered, allowing for fine-grained spatial alignment. We use these insights to formulate pretraining tasks in S4. To the best of our knowledge, S4 is the first multimodal and temporal approach for SITS segmentation. S4\u2019s novelty stems from leveraging multiple properties required for SITS self-supervision: (1) multiple modalities, (2) temporal information, and (3) pixel-level feature extraction. We also curate m2s2-SITS, a large-scale dataset of unlabeled, spatially aligned, multimodal, and geographic-specific SITS that serves as representative pretraining data for S4. Finally, we evaluate S4 on multiple SITS segmentation datasets and demonstrate its efficacy against competing baselines while using limited labeled data. Through a series of extensive comparisons and ablation studies, we demonstrate S4\u2019s ability as an effective feature extractor for downstream semantic segmentation.<\/jats:p>","DOI":"10.3390\/rs16183470","type":"journal-article","created":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T03:34:20Z","timestamp":1726716860000},"page":"3470","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Self-Supervised Learning across the Spectrum"],"prefix":"10.3390","volume":"16","author":[{"given":"Jayanth","family":"Shenoy","sequence":"first","affiliation":[{"name":"University of Illinois Urbana-Champaign, Champaign, IL 61801, USA"}]},{"given":"Xingjian Davis","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Champaign, IL 61801, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3768-4250","authenticated-orcid":false,"given":"Bill","family":"Tao","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Champaign, IL 61801, USA"}]},{"given":"Shlok","family":"Mehrotra","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Champaign, IL 61801, USA"}]},{"given":"Rem","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Champaign, IL 61801, USA"}]},{"given":"Han","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Champaign, IL 61801, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3826-0978","authenticated-orcid":false,"given":"Deepak","family":"Vasisht","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Champaign, IL 61801, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,19]]},"reference":[{"key":"ref_1","unstructured":"Escher, A. (2023, May 01). Inside Planet Labs\u2019 New Satellite Manufacturing Site. TechCrunch. Available online: https:\/\/techcrunch.com\/2018\/09\/14\/inside-planet-labs-new-satellite-manufacturing-site\/."},{"key":"ref_2","unstructured":"(2022, November 12). Spire Global Inc. Available online: https:\/\/spire.com\/."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Castelletti, D., Farquharson, G., Stringham, C., Duersch, M., and Eddy, D. (2021, January 11\u201316). Capella Space First Operational SAR Satellite. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium.","DOI":"10.1109\/IGARSS47720.2021.9554100"},{"key":"ref_4","unstructured":"Bamber, J. (2023, May 01). Five Revealing Satellite Images Show How Fast Our Planet Is Changing. Available online: https:\/\/www.weforum.org\/agenda\/2021\/06\/this-is-why-satellites-are-so-vital-for-protecting-the-health-of-our-planet\/."},{"key":"ref_5","unstructured":"Macaulay, T. (2023, October 02). AI Detects Plastics in the Oceans by Analyzing Satellite Images. The Next Web. Available online: https:\/\/thenextweb.com\/news\/ai-detects-plastics-in-the-oceans-by-analyzing-satellite-images."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e2025400118","DOI":"10.1073\/pnas.2025400118","article-title":"Monitoring war destruction from space using machine learning","volume":"118","author":"Mueller","year":"2021","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_7","unstructured":"Wensley, S. (2023, December 07). The Power of Satellite Imagery in Agriculture & Farming. Available online: https:\/\/farmtogether.com\/learn\/blog\/the-power-of-satellite-imagery-in-agriculture."},{"key":"ref_8","unstructured":"Sexton, J. (2023, May 19). Managing the World\u2019s Natural Resources with Earth Observation. Available online: https:\/\/aws.amazon.com\/blogs\/publicsector\/managing-worlds-natural-resources-earth-observation\/."},{"key":"ref_9","unstructured":"Garnot, V.S.F., and Landrieu, L. (2021, January 11\u201317). Panoptic Segmentation of Satellite Image Time Series With Convolutional Temporal Attention Networks. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Oehmcke, S., Chen, T.H.K., Prishchepov, A.V., and Gieseke, F. (2020, January 3). Creating Cloud-Free Satellite Imagery from Image Time Series with Deep Learning. Proceedings of the 9th ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data, Seattle, WA, USA.","DOI":"10.1145\/3423336.3429345"},{"key":"ref_11","unstructured":"Mall, U., Hariharan, B., and Bala, K. (2022, January 28). Change Event Dataset for Discovery from Spatio-temporal Remote Sensing Imagery. Proceedings of the Thirty-Sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track, Virtual."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Karaman, K., Sainte Fare Garnot, V., and Wegner, J.D. (2023, January 2\u20137). Deforestation Detection in the Amazon with Sentinel-1 SAR Image Time Series. Proceedings of the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Cairo, Egypt.","DOI":"10.5194\/isprs-annals-X-1-W1-2023-835-2023"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"127817","DOI":"10.1016\/j.ufug.2022.127817","article-title":"Contribution of time-series data cubes to classify urban vegetation types by remote sensing","volume":"79","author":"Adorno","year":"2023","journal-title":"Urban For. Urban Green."},{"key":"ref_14","unstructured":"Rustowicz, R.M., Cheong, R., Wang, L., Ermon, S., Burke, M., and Lobell, D. (2019, January 15\u201320). Semantic Segmentation of Crop Type in Africa: A Novel Dataset and Analysis of Deep Learning Methods. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Long Beach, CA, USA."},{"key":"ref_15","unstructured":"Bianchetti, R.A. (2022, March 05). In Sea of Satellite Images, Experts\u2019 Eyes Still Needed. Available online: https:\/\/theconversation.com\/in-sea-of-satellite-images-experts-eyes-still-needed-53192."},{"key":"ref_16","unstructured":"DiBiase, D. (2024, July 16). Multispectral Imaging from Space. Available online: https:\/\/www.e-education.psu.edu\/natureofgeoinfo\/node\/1899."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1175\/1520-0442(1989)002<0380:TYOCCS>2.0.CO;2","article-title":"Two Years of Cloud Cover Statistics Using VAS","volume":"2","author":"Wylie","year":"1989","journal-title":"J. Clim."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1175\/BAMS-D-12-00117.1","article-title":"Assessment of Global Cloud Datasets from Satellites: Project and Database Initiated by the GEWEX Radiation Panel","volume":"94","author":"Stubenrauch","year":"2013","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_19","first-page":"4704616","article-title":"Seeing Through Clouds in Satellite Images","volume":"61","author":"Zhao","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","unstructured":"Ziemnicki, P. (2022, March 15). Optics or Radars?. What Is Better for the Earth Observation Purposes? Defence24., Available online: https:\/\/defence24.com\/technology\/optics-or-radars-what-is-better-for-the-earth-observation-purposes."},{"key":"ref_21","unstructured":"Union of Concerned Scientists (2023, November 12). Satellite Database. Union of Concerned Scientists Satellite Database. Available online: https:\/\/www.ucsusa.org\/resources\/satellite-database."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Vasisht, D., Shenoy, J., and Chandra, R. (2021, January 23\u201327). L2D2: Low Latency Distributed Downlink for LEO Satellites. Proceedings of the 2021 ACM SIGCOMM 2021 Conference, Virtual Event.","DOI":"10.1145\/3452296.3472932"},{"key":"ref_23","unstructured":"Cattoi, A., Bruzzone, L., and Haensch, R. (2022, January 25\u201327). Transcoding-based pre-training of semantic segmentation networks for PolSAR images. Proceedings of the European Conference on Synthetic Aperture Radar, Leipzig, Germany."},{"key":"ref_24","unstructured":"Gulyanon, S., Limprasert, W., Songmuang, P., and Kongkachandra, R. (2022). Data Generation for Satellite Image Classification Using Self-Supervised Representation Learning. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, M., Singh, H., Chok, L., and Chunara, R. (2022, January 18\u201324). Segmenting Across Places: The Need for Fair Transfer Learning With Satellite Imagery. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00329"},{"key":"ref_26","unstructured":"Garnot, V.S.F., Landrieu, L., Giordano, S., and Chehata, N. (2020, January 13\u201319). Satellite Image Time Series Classification With Pixel-Set Encoders and Temporal Self-Attention. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA."},{"key":"ref_27","unstructured":"Rudner, T.G.J., Ru\u00dfwurm, M., Fil, J., Pelich, R., Bischke, B., Kopa\u010dkov\u00e1, V., and Bili\u0144ski, P. (February, January 27). Multi3Net: Segmenting Flooded Buildings via Fusion of Multiresolution, Multisensor, and Multitemporal Satellite Imagery. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Manas, O., Lacoste, A., GiroiNieto, X., Vazquez, D., and Rodriguez, P. (2021, January 11\u201317). Seasonal Contrast: Unsupervised Pre-Training From Uncurated Remote Sensing Data. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00928"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ayush, K., Uzkent, B., Meng, C., Tanmay, K., Burke, M., Lobell, D., and Ermon, S. (2021, January 11\u201317). Geography-Aware Self-Supervised Learning. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01002"},{"key":"ref_30","unstructured":"He, Y., Wang, D., Lai, N., Zhang, W., Meng, C., Burke, M., Lobell, D.B., and Ermon, S. (2021, January 6\u201314). Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesis. Proceedings of the Neural Information Processing Systems, Virtual."},{"key":"ref_31","unstructured":"Ramsauer, J. (2023, June 12). Radar vs. Optical: Optimising Satellite Use in Land Cover Classification. Available online: https:\/\/ecologyforthemasses.com\/2020\/05\/27\/radar-vs-optical-optimising-satellite-use-in-land-cover-classification\/."},{"key":"ref_32","unstructured":"Cong, Y., Khanna, S., Meng, C., Liu, P., Rozi, E., He, Y., Burke, M., Lobell, D., and Ermon, S. (December, January 28). SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery. Proceedings of the Advances in Neural Information Processing Systems, New Orleans, LA, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mall, U., Hariharan, B., and Bala, K. (2023, January 17\u201324). Change-Aware Sampling and Contrastive Learning for Satellite Images. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00509"},{"key":"ref_34","unstructured":"Fuller, A., Millard, K., and Green, J.R. (2023, January 10\u201316). CROMA: Remote sensing representations with contrastive radar-optical masked autoencoders. Proceedings of the 37th International Conference on Neural Information Processing Systems, New Orleans, LA, USA."},{"key":"ref_35","unstructured":"(2023, May 01). Sentinel Missions. Available online: https:\/\/sentinel.esa.int\/web\/sentinel\/missions."},{"key":"ref_36","first-page":"5102216","article-title":"SAR Image Segmentation Based on Constrained Smoothing and Hierarchical Label Correction","volume":"60","author":"Shang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Poodanchi, M., Akbarizadeh, G., Sobhanifar, E., and Ansari-Asl, K. (2014, January 27\u201329). SAR image segmentation using morphological thresholding. Proceedings of the 2014 6th Conference on Information and Knowledge Technology (IKT), Shahrood, Iran.","DOI":"10.1109\/IKT.2014.7030329"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2966","DOI":"10.1109\/TGRS.2009.2014364","article-title":"Unsupervised Synthetic Aperture Radar Image Segmentation Using Fisher Distributions","volume":"47","author":"Galland","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5866","DOI":"10.1109\/TGRS.2020.3024744","article-title":"Multisensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagery","volume":"59","author":"Ebel","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"129136","DOI":"10.1109\/ACCESS.2019.2939649","article-title":"SAR-to-Optical Image Translation Using Supervised Cycle-Consistent Adversarial Networks","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1364\/OPTCON.439671","article-title":"Remote sensing image cloud removal by deep image prior with a multitemporal constraint","volume":"1","author":"Zhang","year":"2022","journal-title":"Opt. Contin."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Liu, G., Reda, F.A., Shih, K.J., Wang, T.C., Tao, A., and Catanzaro, B. (2018, January 8\u201314). Image Inpainting for Irregular Holes Using Partial Convolutions. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01252-6_6"},{"key":"ref_43","first-page":"294","article-title":"Multi-Modal Temporal Attention Models for Crop Mapping from Satellite Time Series","volume":"187","author":"Landrieu","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Toker, A., Kondmann, L., Weber, M., Eisenberger, M., Camero, A., Hu, J., Hoderlein, A.P., \u015eenaras, C., Davis, T., and Cremers, D. (2022, January 18\u201324). DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentation. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.02048"},{"key":"ref_45","unstructured":"Wang, Y., Zhuo, W., Li, Y., Wang, Z., Ju, Q., and Zhu, W. (2022). Fully Self-Supervised Learning for Semantic Segmentation. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ouyang, C., Biffi, C., Chen, C., Kart, T., Qiu, H., and Rueckert, D. (2020). Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotation. arXiv.","DOI":"10.1007\/978-3-030-58526-6_45"},{"key":"ref_47","unstructured":"Agastya, C., Ghebremusse, S., Anderson, I., Reed, C., Vahabi, H., and Todeschini, A. (2021). Self-supervised Contrastive Learning for Irrigation Detection in Satellite Imagery. CoRR."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Zhang, T., Qiu, C., Ke, W., S\u00fcsstrunk, S., and Salzmann, M. (2022, January 18\u201324). Leverage Your Local and Global Representations: A New Self-Supervised Learning Strategy. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01608"},{"key":"ref_49","unstructured":"Zou, Y., Zhang, Z., Zhang, H., Li, C.L., Bian, X., Huang, J.B., and Pfister, T. (2021, January 3\u20137). PseudoSeg: Designing Pseudo Labels for Semantic Segmentation. Proceedings of the International Conference on Learning Representations, Virtual Event."},{"key":"ref_50","unstructured":"Chen, T., Kornblith, S., Norouzi, M., and Hinton, G. (2020, January 13\u201318). A Simple Framework for Contrastive Learning of Visual Representations. Proceedings of the 37th International Conference on Machine Learning, 2020, Proceedings of Machine Learning Research, Virtual."},{"key":"ref_51","first-page":"15604","article-title":"Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classification","volume":"12","author":"Eldele","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Wu, H., and Wang, X. (2021, January 11\u201317). Contrastive Learning of Image Representations With Cross-Video Cycle-Consistency. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00999"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Xie, Z., Lin, Y., Zhang, Z., Cao, Y., Lin, S., and Hu, H. (2021, January 20\u201325). Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01641"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Zhong, Y., Yuan, B., Wu, H., Yuan, Z., Peng, J., and Wang, Y.X. (2021, January 11\u201317). Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00718"},{"key":"ref_55","unstructured":"Liu, S., Zhi, S., Johns, E., and Davison, A. (2022, January 25\u201329). Bootstrapping Semantic Segmentation with Regional Contrast. Proceedings of the International Conference on Learning Representations, Virtual."},{"key":"ref_56","unstructured":"Chaitanya, K., Erdil, E., Karani, N., and Konukoglu, E. (2020, January 6\u201312). Contrastive learning of global and local features for medical image segmentation with limited annotations. Proceedings of the Advances in Neural Information Processing Systems, Virtual."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_58","unstructured":"Rustowicz, R.M., Cheong, R., Wang, L., Ermon, S., Burke, M., and Lobell, D. (2019, January 15\u201320). Semantic Segmentation of Crop Type in Africa: A Novel Dataset and Analysis of Deep Learning Methods. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Long Beach, CA, USA."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Cicek, O., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger Olaf, E.S., Joskowicz, L., Sabuncu, M.R., Unal, G., and Wells, W. (2016, January 17\u201321). 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2016, Athens, Greece.","DOI":"10.1007\/978-3-319-46723-8_49"},{"key":"ref_60","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on International Conference on Machine Learning\u2014Volume 37, Lille, France."},{"key":"ref_61","unstructured":"van den Oord, A., Li, Y., and Vinyals, O. (2018). Representation Learning with Contrastive Predictive Coding. CoRR."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.isprsjprs.2020.11.007","article-title":"Fully convolutional recurrent networks for multidate crop recognition from multitemporal image sequences","volume":"171","author":"Feitosa","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_63","unstructured":"Microsoft (2023, October 10). FarmVibes.AI: An AI Platform for Agriculture. GitHub Repository. Available online: https:\/\/github.com\/microsoft\/farmvibes-ai."},{"key":"ref_64","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Shaar, F., Y\u0131lmaz, A., Topcu, A.E., and Alzoubi, Y.I. (2024). Remote Sensing Image Segmentation for Aircraft Recognition Using U-Net as Deep Learning Architecture. Appl. Sci., 14.","DOI":"10.3390\/app14062639"},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Zhang, W., Zhang, H., Zhao, Z., Tang, P., and Zhang, Z. (2023). Attention to Both Global and Local Features: A Novel Temporal Encoder for Satellite Image Time Series Classification. Remote Sens., 15.","DOI":"10.3390\/rs15030618"},{"key":"ref_67","unstructured":"Chen, X., Fan, H., Girshick, R., and He, K. (2020). Improved Baselines with Momentum Contrastive Learning. arXiv."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_69","unstructured":"Zupanc, A. (2022, August 03). Improving Cloud Detection with Machine Learning. Available online: https:\/\/medium.com\/sentinel-hub\/improving-cloud-detection-with-machine-learning-c09dc5d7cf13."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Norman, M., Kellen, V., Smallen, S., DeMeulle, B., Strande, S., Lazowska, E., Alterman, N., Fatland, R., Stone, S., and Tan, A. (2021, January 18\u201322). CloudBank: Managed Services to Simplify Cloud Access for Computer Science Research and Education. Proceedings of the Practice and Experience in Advanced Research Computing, Boston, MA, USA.","DOI":"10.1145\/3437359.3465586"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/18\/3470\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:59:04Z","timestamp":1760111944000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/18\/3470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,19]]},"references-count":70,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["rs16183470"],"URL":"https:\/\/doi.org\/10.3390\/rs16183470","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,19]]}}}