{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T19:48:20Z","timestamp":1778010500142,"version":"3.51.4"},"reference-count":66,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2019,12,17]],"date-time":"2019-12-17T00:00:00Z","timestamp":1576540800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>High-Performance Computing (HPC) has recently been attracting more attention in remote sensing applications due to the challenges posed by the increased amount of open data that are produced daily by Earth Observation (EO) programs. The unique parallel computing environments and programming techniques that are integrated in HPC systems are able to solve large-scale problems such as the training of classification algorithms with large amounts of Remote Sensing (RS) data. This paper shows that the training of state-of-the-art deep Convolutional Neural Networks (CNNs) can be efficiently performed in distributed fashion using parallel implementation techniques on HPC machines containing a large number of Graphics Processing Units (GPUs). The experimental results confirm that distributed training can drastically reduce the amount of time needed to perform full training, resulting in near linear scaling without loss of test accuracy.<\/jats:p>","DOI":"10.3390\/rs11243056","type":"journal-article","created":{"date-parts":[[2019,12,20]],"date-time":"2019-12-20T03:19:36Z","timestamp":1576811976000},"page":"3056","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["Remote Sensing Big Data Classification with High Performance Distributed Deep Learning"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4089-972X","authenticated-orcid":false,"given":"Rocco","family":"Sedona","sequence":"first","affiliation":[{"name":"School of Engineering and Natural Sciences, University of Iceland, Dunhagi 5, 107 Reykjav\u00edk, Iceland"},{"name":"J\u00fclich Supercomputing Centre (JSC), Forschungszentrum J\u00fclich (FZJ), Wilhelm-Johnen-Strasse 1, 52425 J\u00fclich, Germany"},{"name":"High Productivity Data Processing Research Group, JSC, 52425 J\u00fclich, Germany"},{"name":"Cross-Sectional Team Deep Learning (CST-DL), JSC, 52425 J\u00fclich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3239-9904","authenticated-orcid":false,"given":"Gabriele","family":"Cavallaro","sequence":"additional","affiliation":[{"name":"J\u00fclich Supercomputing Centre (JSC), Forschungszentrum J\u00fclich (FZJ), Wilhelm-Johnen-Strasse 1, 52425 J\u00fclich, Germany"},{"name":"High Productivity Data Processing Research Group, JSC, 52425 J\u00fclich, Germany"},{"name":"Cross-Sectional Team Deep Learning (CST-DL), JSC, 52425 J\u00fclich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1221-7851","authenticated-orcid":false,"given":"Jenia","family":"Jitsev","sequence":"additional","affiliation":[{"name":"J\u00fclich Supercomputing Centre (JSC), Forschungszentrum J\u00fclich (FZJ), Wilhelm-Johnen-Strasse 1, 52425 J\u00fclich, Germany"},{"name":"Cross-Sectional Team Deep Learning (CST-DL), JSC, 52425 J\u00fclich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9177-6474","authenticated-orcid":false,"given":"Alexandre","family":"Strube","sequence":"additional","affiliation":[{"name":"J\u00fclich Supercomputing Centre (JSC), Forschungszentrum J\u00fclich (FZJ), Wilhelm-Johnen-Strasse 1, 52425 J\u00fclich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Morris","family":"Riedel","sequence":"additional","affiliation":[{"name":"School of Engineering and Natural Sciences, University of Iceland, Dunhagi 5, 107 Reykjav\u00edk, Iceland"},{"name":"J\u00fclich Supercomputing Centre (JSC), Forschungszentrum J\u00fclich (FZJ), Wilhelm-Johnen-Strasse 1, 52425 J\u00fclich, Germany"},{"name":"High Productivity Data Processing Research Group, JSC, 52425 J\u00fclich, Germany"},{"name":"Cross-Sectional Team Deep Learning (CST-DL), JSC, 52425 J\u00fclich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0621-9647","authenticated-orcid":false,"given":"J\u00f3n","family":"Benediktsson","sequence":"additional","affiliation":[{"name":"School of Engineering and Natural Sciences, University of Iceland, Dunhagi 5, 107 Reykjav\u00edk, Iceland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Emery, W., and Camps, A. (2017). Basic Electromagnetic Concepts and Applications to Optical Sensors. Introduction to Satellite Remote Sensing, Elsevier.","DOI":"10.1016\/B978-0-12-809254-5.00002-6"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wulder, M.A., Masek, J.G., Cohen, W.B., Loveland, T.R., and Woodcock, C.E. (2012). Opening the archive: How free data has enabled the science and monitoring promise of Landsat. Remote. Sens. Environ.","DOI":"10.1016\/j.rse.2012.01.010"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Aschbacher, J. (2017). ESA\u2019s earth observation strategy and Copernicus. Satellite Earth Observations and Their Impact on Society and Policy, Springer.","DOI":"10.1007\/978-981-10-3713-9_5"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.future.2014.10.029","article-title":"Remote sensing big data computing: Challenges and opportunities","volume":"51","author":"Ma","year":"2015","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chi, M., Plaza, A., Benediktsson, J.A., Sun, Z., Shen, J., and Zhu, Y. (2016). Big Data for Remote Sensing: Challenges and Opportunities. Proc. IEEE.","DOI":"10.1109\/JPROC.2016.2598228"},{"key":"ref_6","unstructured":"Li, H., Tao, C., Wu, Z., Chen, J., Gong, J., and Deng, M. (2017). RSI-CB: Large Scale Remote. Sens. Image Classif. Benchmark Via Crowdsource Data. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Stoian, A., Poulain, V., Inglada, J., Poughon, V., and Derksen, D. (2019). Land Cover Maps Production with High Resolution Satellite Image Time Series and Convolutional Neural Networks: Adaptations and Limits for Operational Systems. Remote. Sens., 11.","DOI":"10.20944\/preprints201906.0270.v1"},{"key":"ref_8","first-page":"042609","article-title":"A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community","volume":"11","author":"Ball","year":"2017","journal-title":"SPIE J. Appl. Remote. Sens. (JARS) Spec. Sect. Feature Deep. Learn. Remote. Sens. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MGRS.2017.2762307","article-title":"Deep learning in remote sensing: A comprehensive review and list of resources","volume":"5","author":"Zhu","year":"2017","journal-title":"IEEE Geosci. Remote. Sens. Mag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.isprsjprs.2019.04.015","article-title":"Deep learning in remote sensing applications: A meta-analysis and review","volume":"152","author":"Ma","year":"2019","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_11","first-page":"1","article-title":"Unsupervised Deep Feature Extraction for Remote Sensing Image Classification","volume":"54","author":"Romero","year":"2015","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote. Sens. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ienco, D., Gaetano, R., Dupaquier, C., and Maurel, P. (2017). Land Cover Classification via Multitemporal Spatial Data by Deep Recurrent Neural Networks. IEEE Geosci. Remote. Sens. Lett.","DOI":"10.1109\/LGRS.2017.2728698"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lin, D., Fu, K., Wang, Y., Xu, G., and Sun, X. (2017). MARTA GANs: Unsupervised Representation Learning for Remote Sensing Image Classification. IEEE Geosci. Remote. Sens. Lett.","DOI":"10.1109\/LGRS.2017.2752750"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cavallaro, G., Falco, N., Dalla Mura, M., and Benediktsson, J.A. (2017). Automatic Attribute Profiles. IEEE Trans. Image Process.","DOI":"10.1109\/TIP.2017.2664667"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sumbul, G., Charfuelan, M., Demir, B., and Markl, V. (2019). Bigearthnet: Large-Scale Benchmark Arch. Remote. Sens. Image Underst. arXiv.","DOI":"10.1109\/IGARSS.2019.8900532"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Plaza, A., Valencia, D., Plaza, J., and Martinez, P. (2006). Commodity cluster-based parallel processing of hyperspectral imagery. J. Parallel Distrib. Comput.","DOI":"10.1016\/j.jpdc.2005.10.001"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gorgan, D., Bacu, V., Stefanut, T., Rodila, D., and Mihon, D. (2009, January 21\u201323). Grid based satellite image processing platform for Earth Observation application development. Proceedings of the 5th IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, IDAACS\u20192009, Rende, Italy.","DOI":"10.1109\/IDAACS.2009.5342987"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Foster, I., Zhao, Y., Raicu, I., and Lu, S. (2008, January 12\u201316). Cloud computing and grid computing 360-degree compared. Proceedings of the Grid Comput. Environ. Workshop 2008 (GCE \u201908), Austin, TX, USA.","DOI":"10.1109\/GCE.2008.4738445"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"McKinney, R., Pallipuram, V.K., Vargas, R., and Taufer, M. (September, January 31). From HPC performance to climate modeling: Transforming methods for HPC predictions into models of extreme climate conditions. Proceedings of the 11th IEEE International Conference on eScience, eScience 2015, Munich, Germany.","DOI":"10.1109\/eScience.2015.33"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 2\u20135). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the ACM International Symposium on Advances in Geographic Information Systems, San Jose, CA, USA.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Li, J., Bioucas-Dias, J.M., and Plaza, A. (2013). Spectral-spatial classification of hyperspectral data using loopy belief propagation and active learning. IEEE Trans. Geosci. Remote. Sens.","DOI":"10.1109\/TGRS.2012.2205263"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zou, Q., Ni, L., Zhang, T., and Wang, Q. (2015). Deep Learning Based Feature Selection for Remote Sensing Scene Classification. IEEE Geosci. Remote. Sens. Lett.","DOI":"10.1109\/LGRS.2015.2475299"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Basu, S., Ganguly, S., Mukhopadhyay, S., DiBiano, R., Karki, M., and Nemani, R. (2015, January 3\u20136). DeepSat\u2014A learning framework for satellite imagery. Proceedings of the ACM International Symposium on Advances in Geographic Information Systems, Seattle, WD, USA.","DOI":"10.1145\/2820783.2820816"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhao, B., Zhong, Y., Xia, G.S., and Zhang, L. (2016). Dirichlet-derived multiple topic scene classification model for high spatial resolution remote sensing imagery. IEEE Trans. Geosci. Remote. Sens.","DOI":"10.1109\/TGRS.2015.2496185"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1117\/1.JRS.10.035004","article-title":"Feature significance-based multibag-of-visual-words model for remote sensing image scene classification","volume":"10","author":"Zhao","year":"2016","journal-title":"J. Appl. Remote. Sens."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Penatti, O.A., Nogueira, K., and Dos Santos, J.A. (2015, January 7\u201312). Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301382"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cheng, G., Han, J., and Lu, X. (2017). Remote. Sens. Image Scene Classif. Benchmark State Art. Proc. IEEE, 1865\u20131883.","DOI":"10.1109\/JPROC.2017.2675998"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xia, G.S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L., and Lu, X. (2017). AID: A benchmark data set for performance evaluation of aerial scene classification. IEEE Trans. Geosci. Remote. Sens.","DOI":"10.1109\/TGRS.2017.2685945"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Helber, P., Bischke, B., Dengel, A., and Borth, D. (2017). EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification. Comput. Res. Repos.","DOI":"10.1109\/IGARSS.2018.8519248"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhou, W., Newsam, S., Li, C., and Shao, Z. (2018). PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval. ISPRS J. Photogramm. Remote. Sens.","DOI":"10.1016\/j.isprsjprs.2018.01.004"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 11\u201314). Identity mappings in deep residual networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_35","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, NIPS Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, Nevada, NV, USA, 3\u20136 December 2012, The MIT Press."},{"key":"ref_36","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Wei, L., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conf. Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L., Li, K., and Li, F.-F. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conf. Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_39","unstructured":"Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., and Darrell, T. (2014, January 22\u201324). Decaf: A deep convolutional activation feature for generic visual recognition. Proceedings of the International Conference on Machine Learning, Bejing, China."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Razavian, A.S., Azizpour, H., Sullivan, J., and Carlsson, S. (2014, January 23\u201328). CNN Features Off-the-Shelf: An Astounding Baseline for Recognition. Proceedings of the IEEE Conf. Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.131"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Kornblith, S., Shlens, J., and Le, Q.V. (2019, January 16\u201320). Do better imagenet models transfer better?. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00277"},{"key":"ref_42","unstructured":"Mayer, R., and Jacobsen, H.A. (2019). Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques and Tools. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"You, Y., Zhang, Z., Hsieh, C., Demmel, J., and Keutzer, K. (2019). Fast Deep Neural Network Training on Distributed Systems and Cloud TPUs. IEEE Trans. Parallel Distrib. Syst.","DOI":"10.1109\/TPDS.2019.2913833"},{"key":"ref_44","unstructured":"Ying, C., Kumar, S., Chen, D., Wang, T., and Cheng, Y. (2018). Image classification at supercomputer scale. arXiv."},{"key":"ref_45","unstructured":"Yamazaki, M., Kasagi, A., Tabuchi, A., Honda, T., Miwa, M., Fukumoto, N., Tabaru, T., Ike, A., and Nakashima, K. (2019). Yet Another Accelerated SGD: ResNet-50 Training on ImageNet in 74.7 seconds. arXiv."},{"key":"ref_46","unstructured":"Sergeev, A., and Balso, M.D. (2018). Horovod: Fast and easy distributed deep learning in TensorFlow. arXiv."},{"key":"ref_47","unstructured":"Gibiansky, A. (2019, April 01). Bringing HPC Techniques to Deep Learning. Available online: http:\/\/andrew.gibiansky.com\/blog\/machine-learning\/baidu-allreduce\/."},{"key":"ref_48","unstructured":"(2019, October 15). NVIDIA Collective Communications Library (NCCL). Available online: https:\/\/developer.nvidia.com\/nccl."},{"key":"ref_49","unstructured":"(2019, April 01). TensorFlow Distributed Strategy Documentation. Available online: https:\/\/www.tensorflow.org\/guide\/distributed_training."},{"key":"ref_50","unstructured":"Goyal, P., Doll\u00e1r, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., and He, K. (2017). Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour. arXiv."},{"key":"ref_51","unstructured":"You, Y., Gitman, I., and Ginsburg, B. (2017). Scaling sgd batch size to 32k for imagenet training. arXiv."},{"key":"ref_52","unstructured":"(2019, May 15). Sentinel2 B10: High Atmospheric Absorption Band. Available online: https:\/\/sentinel.esa.int\/web\/sentinel\/technical-guides\/sentinel-2-msi\/level-1c\/cloud-masks."},{"key":"ref_53","unstructured":"(2019, April 01). Scripts to Remove Cloudy and Snowy Patches Provided by BigEarthNet Archive Creators from the Remote Sensing Image Analysis (RSiM) Group at the TU Berlin. Available online: http:\/\/bigearth.net\/."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"J\u00fclich Supercomputing Centre (2019). JUWELS: Modular Tier-0\/1 Supercomputer at the J\u00fclich Supercomputing Centre. J. Large-Scale Res. Facil., 5.","DOI":"10.17815\/jlsrf-5-171"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"J\u00fclich Supercomputing Centre (2018). JURECA: Modular supercomputer at J\u00fclich Supercomputing Centre. J. Large-Scale Res. Facil., 4.","DOI":"10.17815\/jlsrf-4-121-1"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Lanaras, C., Bioucas-Dias, J., Galliani, S., Baltsavias, E., and Schindler, K. (2018). Super-resolution of Sentinel-2 images: Learning a globally applicable deep neural network. ISPRS J. Photogramm. Remote. Sens.","DOI":"10.1016\/j.isprsjprs.2018.09.018"},{"key":"ref_57","unstructured":"GDAL\/OGR contributors (2019). GDAL\/OGR Geospatial Data Abstraction Software Library, Open Source Geospatial Foundation."},{"key":"ref_58","unstructured":"The HDF Group (2019, April 01). Hierarchical Data Format, Version 5, 1997-NNNN. Available online: http:\/\/www.hdfgroup.org\/HDF5\/."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1144","DOI":"10.1109\/TGRS.2017.2760909","article-title":"Multilabel Remote Sensing Image Retrieval Using a Semisupervised Graph-Theoretic Method","volume":"56","author":"Chaudhuri","year":"2018","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Buntine, W., Grobelnik, M., Mladeni\u0107, D., and Shawe-Taylor, J. (2009). Classifier Chains for Multi-label Classification. Machine Learning and Knowledge Discovery in Databases, Springer.","DOI":"10.1007\/978-3-642-04180-8"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Zhang, H., Cisse, M., Dauphin, Y.N., and Lopez-Paz, D. (2017). mixup: Beyond Empirical Risk Minimization. arXiv.","DOI":"10.1007\/978-1-4899-7687-1_79"},{"key":"ref_62","unstructured":"Sutskever, I., Martens, J., Dahl, G., and Hinton, G. (2013, January 16\u201321). On the importance of initialization and momentum in deep learning. Proceedings of the 30th International Conference on Machine Learning, ICML 2013, Atlanta, GA, USA."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures. Lect. Notes Comput. Sci. (Incl. Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinform.).","DOI":"10.1007\/978-3-642-35289-8_26"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Johnson, J.M., and Khoshgoftaar, T.M. (2019). Survey on deep learning with class imbalance. J. Big Data.","DOI":"10.1186\/s40537-019-0192-5"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Buda, M., Maki, A., and Mazurowski, M.A. (2018). A systematic study of the class imbalance problem in convolutional neural networks. Neural Netw.","DOI":"10.1016\/j.neunet.2018.07.011"},{"key":"ref_66","unstructured":"Parikh, N. (2014). Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour. Found. Trends Optim."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/24\/3056\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:43:09Z","timestamp":1760190189000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/24\/3056"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,17]]},"references-count":66,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["rs11243056"],"URL":"https:\/\/doi.org\/10.3390\/rs11243056","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,17]]}}}