{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,5]],"date-time":"2026-07-05T03:43:35Z","timestamp":1783223015657,"version":"3.54.6"},"reference-count":30,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T00:00:00Z","timestamp":1657152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Alion Science and Technology","award":["FA8075-14-D-0019"],"award-info":[{"award-number":["FA8075-14-D-0019"]}]},{"name":"Alion Science and Technology","award":["DSC3133-03 Virginia Tech"],"award-info":[{"award-number":["DSC3133-03 Virginia Tech"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Training deep learning models requires having the right data for the problem and understanding both your data and the models\u2019 performance on that data. Training deep learning models is difficult when data are limited, so in this paper, we seek to answer the following question: how can we train a deep learning model to increase its performance on a targeted area with limited data? We do this by applying rotation data augmentations to a simulated synthetic aperture radar (SAR) image dataset. We use the Uniform Manifold Approximation and Projection (UMAP) dimensionality reduction technique to understand the effects of augmentations on the data in latent space. Using this latent space representation, we can understand the data and choose specific training samples aimed at boosting model performance in targeted under-performing regions without the need to increase training set sizes. Results show that using latent space to choose training data significantly improves model performance in some cases; however, there are other cases where no improvements are made. We show that linking patterns in latent space is a possible predictor of model performance, but results require some experimentation and domain knowledge to determine the best options.<\/jats:p>","DOI":"10.3390\/make4030031","type":"journal-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T07:51:56Z","timestamp":1657180316000},"page":"665-687","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Improving Deep Learning for Maritime Remote Sensing through Data Augmentation and Latent Space"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3134-6461","authenticated-orcid":false,"given":"Daniel","family":"Sobien","sequence":"first","affiliation":[{"name":"National Security Institute, Virginia Tech, Arlington, VA 22203, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0878-7330","authenticated-orcid":false,"given":"Erik","family":"Higgins","sequence":"additional","affiliation":[{"name":"Department of Aerospace and Ocean Engineering, Virginia Tech, Blacksburg, VA 24061, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2862-112X","authenticated-orcid":false,"given":"Justin","family":"Krometis","sequence":"additional","affiliation":[{"name":"National Security Institute, Virginia Tech, Arlington, VA 22203, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3410-1160","authenticated-orcid":false,"given":"Justin","family":"Kauffman","sequence":"additional","affiliation":[{"name":"National Security Institute, Virginia Tech, Arlington, VA 22203, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7108-3921","authenticated-orcid":false,"given":"Laura","family":"Freeman","sequence":"additional","affiliation":[{"name":"National Security Institute, Virginia Tech, Arlington, VA 22203, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_2","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press. Available online: http:\/\/www.deeplearningbook.org."},{"key":"ref_3","unstructured":"Perez, L., and Wang, J. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv."},{"key":"ref_4","unstructured":"Tran, T., Pham, T., Carneiro, G., Palmer, L., and Reid, I. (2017). A bayesian data augmentation approach for learning deep models. arXiv."},{"key":"ref_5","unstructured":"Fabian, Z., Heckel, R., and Soltanolkotabi, M. (2021, January 18\u201324). Data augmentation for deep learning based accelerated MRI reconstruction with limited data. Proceedings of the International Conference on Machine Learning, Virtual."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MAES.2021.3117369","article-title":"A Survey on the Applications of Convolutional Neural Networks for Synthetic Aperture Radar: Recent Advances","volume":"37","author":"Oveis","year":"2021","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_7","first-page":"364","article-title":"Convolutional neural network with data augmentation for SAR target recognition","volume":"13","author":"Ding","year":"2016","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1109\/LGRS.2018.2877599","article-title":"Speckle-noise-invariant convolutional neural network for SAR target recognition","volume":"16","author":"Kwak","year":"2018","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1080\/2150704X.2016.1196837","article-title":"SAR ATR based on displacement-and rotation-insensitive CNN","volume":"7","author":"Du","year":"2016","journal-title":"Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"25459","DOI":"10.1109\/ACCESS.2019.2900522","article-title":"Data augmentation based on attributed scattering centers to train robust CNN for SAR ATR","volume":"7","author":"Lv","year":"2019","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.1109\/LGRS.2017.2717486","article-title":"Improving SAR automatic target recognition models with transfer learning from simulated data","volume":"14","author":"Kusk","year":"2017","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"153391","DOI":"10.1109\/ACCESS.2019.2948618","article-title":"SAR target recognition based on cross-domain and cross-task transfer learning","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_13","first-page":"20150202","article-title":"Principal component analysis: A review and recent developments","volume":"374","author":"Jolliffe","year":"2016","journal-title":"Philos. Trans. R. Soc. Math. Phys. Eng. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1038\/nbt.4314","article-title":"Dimensionality reduction for visualizing single-cell data using UMAP","volume":"37","author":"Becht","year":"2019","journal-title":"Nat. Biotechnol."},{"key":"ref_15","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"McInnes, L., Healy, J., and Melville, J. (2018). Umap: Uniform manifold approximation and projection for dimension reduction. arXiv.","DOI":"10.21105\/joss.00861"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Higgins, E., Sobien, D., Freeman, L., and Pitt, J.S. (2021, January 11\u201315). Data Fusion for Combining Information for Disparate Data Sources for Maritime Remote Sensing. Proceedings of the AIAA Scitech 2021 Forum, American Institute of Aeronautics and Astronautics, Virtual.","DOI":"10.2514\/6.2021-0915"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"12345","DOI":"10.1029\/JC093iC10p12345","article-title":"Full-spectrum modeling of synthetic aperture radar internal wave signatures","volume":"93","author":"Lyzenga","year":"1988","journal-title":"J. Geophys. Res."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, Y., Yang, M., and Chong, J. (2019). Simulation and Analysis of SAR Images of Oceanic Shear-Wave-Generated Eddies. Sensors, 19.","DOI":"10.3390\/s19071529"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Munich, Germany.","DOI":"10.1007\/978-3-319-24571-3"},{"key":"ref_21","unstructured":"Usuyama, N. (2020, November 03). PyTorch-UNet. Available online: https:\/\/github.com\/usuyama\/pytorch-unet."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Higgins, E., Sobien, D., Freeman, L., and Pitt, J.S. (2022, January 3\u20137). Ship Wake Detection Using Data Fusion in Multi-sensor Remote Sensing Applications. Proceedings of the AIAA SCITECH 2022 Forum, San Diego, CA, USA.","DOI":"10.2514\/6.2022-0997"},{"key":"ref_23","first-page":"8026","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lei Ba, J., Swersky, K., and Fidler, S. (2015, January 7\u201313). Predicting deep zero-shot convolutional neural networks using textual descriptions. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.483"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Davis, J., and Goadrich, M. (2006, January 25\u201329). The relationship between Precision-Recall and ROC curves. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143874"},{"key":"ref_26","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"861","DOI":"10.21105\/joss.00861","article-title":"UMAP: Uniform Manifold Approximation and Projection","volume":"3","author":"McInnes","year":"2018","journal-title":"J. Open Source Softw."},{"key":"ref_28","unstructured":"McInnes, L. (2022, May 12). umap Documentation: Release 0.5. Available online: https:\/\/umap-learn.readthedocs.io\/en\/latest\/release_notes.html."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chicco, D., and Jurman, G. (2020). The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genom., 21.","DOI":"10.1186\/s12864-019-6413-7"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1007\/BF02834632","article-title":"Mahalanobis distance","volume":"4","author":"McLachlan","year":"1999","journal-title":"Resonance"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/4\/3\/31\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:43:52Z","timestamp":1760139832000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/4\/3\/31"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,7]]},"references-count":30,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["make4030031"],"URL":"https:\/\/doi.org\/10.3390\/make4030031","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,7]]}}}