{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T04:05:24Z","timestamp":1781841924400,"version":"3.54.5"},"reference-count":55,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2019,12,12]],"date-time":"2019-12-12T00:00:00Z","timestamp":1576108800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1838230, IIS-1838024"],"award-info":[{"award-number":["IIS-1838230, IIS-1838024"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Significant resources have been spent in collecting and storing large and heterogeneous radar datasets during expensive Arctic and Antarctic fieldwork. The vast majority of data available is unlabeled, and the labeling process is both time-consuming and expensive. One possible alternative to the labeling process is the use of synthetically generated data with artificial intelligence. Instead of labeling real images, we can generate synthetic data based on arbitrary labels. In this way, training data can be quickly augmented with additional images. In this research, we evaluated the performance of synthetically generated radar images based on modified cycle-consistent adversarial networks. We conducted several experiments to test the quality of the generated radar imagery. We also tested the quality of a state-of-the-art contour detection algorithm on synthetic data and different combinations of real and synthetic data. Our experiments show that synthetic radar images generated by generative adversarial network (GAN) can be used in combination with real images for data augmentation and training of deep neural networks. However, the synthetic images generated by GANs cannot be used solely for training a neural network (training on synthetic and testing on real) as they cannot simulate all of the radar characteristics such as noise or Doppler effects. To the best of our knowledge, this is the first work in creating radar sounder imagery based on generative adversarial network.<\/jats:p>","DOI":"10.3390\/s19245479","type":"journal-article","created":{"date-parts":[[2019,12,12]],"date-time":"2019-12-12T11:06:41Z","timestamp":1576148801000},"page":"5479","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["AI Radar Sensor: Creating Radar Depth Sounder Images Based on Generative Adversarial Network"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9358-2836","authenticated-orcid":false,"given":"Maryam","family":"Rahnemoonfar","sequence":"first","affiliation":[{"name":"Computer Vision and Remote Sensing Laboratory, University of Maryland, Baltimore, MA 20742, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7801-1813","authenticated-orcid":false,"given":"Jimmy","family":"Johnson","sequence":"additional","affiliation":[{"name":"Department of Computing Sciences, Texas A&amp;M University-Corpus Christi, Corpus Christi, TX 78412-5774, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0775-6284","authenticated-orcid":false,"given":"John","family":"Paden","sequence":"additional","affiliation":[{"name":"Department of Center for Remote Sensing of Ice Sheets, University of Kansas, Lawrence, KS 66045, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,12]]},"reference":[{"key":"ref_1","unstructured":"Crandall, D.J., Fox, G.C., and Paden, J.D. (2012, January 11\u201315). Layer-finding in radar echograms using probabilistic graphical models. Proceedings of the 21st International Conference on Pattern Recognition (ICPR), Tsukuba, Japan."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lee, S., Mitchell, J., Crandall, D.J., and Fox, G.C. (2014, January 27\u201330). Estimating bedrock and surface layer boundaries and confidence intervals in ice sheet radar imagery using MCMC. Proceedings of the IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025021"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mitchell, J.E., Crandall, D.J., Fox, G.C., Rahnemoonfar, M., and Paden, J.D. (2013, January 23\u201326). A semi-automatic approach for estimating bedrock and surface layers from multichannel coherent radar depth sounder imagery. Proceedings of the SPIE Remote Sensing, Dresden, Germany.","DOI":"10.1117\/12.2028992"},{"key":"ref_4","unstructured":"Rahnemoonfar, M., Yari, M., and Fox, G.C. (2019, January 17\u201321). Automatic polar ice thickness estimation from SAR imagery. Proceedings of the SPIE Defense + Security, Baltimore, MD, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5115","DOI":"10.1109\/TGRS.2017.2702200","article-title":"Automatic Ice Surface and Bottom Boundaries Estimation in Radar Imagery Based on Level-Set Approach","volume":"55","author":"Rahnemoonfar","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Rahnemoonfar, M., Abbassi, A., Paden, J., and Fox, G.C. (2017, January 23\u201328). Automatic ice thickness estimation in radar imagery based on charged particle concept. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127813"},{"key":"ref_7","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems 25, Curran Associates, Inc."},{"key":"ref_8","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sheppard, C., and Rahnemoonfar, M. (2017, January 23\u201328). Real-time scene understanding for UAV imagery based on deep convolutional neural networks. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127435"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"#cr-split#-ref_12.1","doi-asserted-by":"crossref","unstructured":"Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T. (2014). Simultaneous Detection and Segmentation. Computer Vision-ECCV 2014","DOI":"10.1007\/978-3-319-10590-1"},{"key":"#cr-split#-ref_12.2","unstructured":"Proceedings of the 13th European Conference, Zurich, Switzerland, 6-12 September 2014, Springer International Publishing. Part VII."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Rahnemoonfar, M., and Sheppard, C. (2017). Deep count: Fruit counting based on deep simulated learning. Sensors, 17.","DOI":"10.3390\/s17040905"},{"key":"ref_14","first-page":"1021809","article-title":"Real-time yield estimation based on deep learning","volume":"Volume 10218","author":"Rahnemoonfar","year":"2017","journal-title":"Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping II"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rahnemoonfar, M., Dobbs, D., Yari, M., and Starek, M.J. (2019). DisCountNet: Discriminating and counting network for real-time counting and localization of sparse objects in high-resolution UAV imagery. Remote Sens., 11.","DOI":"10.3390\/rs11091128"},{"key":"ref_16","unstructured":"Kamangir, H., Rahnemoonfar, M., Dobbs, D., Paden, J., and Fox, G.C. (2018, January 22\u201327). Detecting ice layers in Radar images with deep hybrid networks. Proceedings of the IEEE Conference on Geoscience and Remote Sensing (IGARSS), Valencia, Spain."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1915","DOI":"10.1109\/TPAMI.2012.231","article-title":"Learning Hierarchical Features for Scene Labeling","volume":"35","author":"Farabet","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mostajabi, M., Yadollahpour, P., and Shakhnarovich, G. (2015, January 7\u201312). Feedforward semantic segmentation with zoom-out features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298959"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rahnemoonfar, M., Robin, M., Miguel, M.V., Dobbs, D., and Adams, A. (2018, January 22\u201327). Flooded area detection from UAV images based on densely connected recurrent neural networks. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8517946"},{"key":"ref_20","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, NIPS."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_22","unstructured":"Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_24","unstructured":"Ganguli, S., Garzon, P., and Glaser, N. (2019). GeoGAN: A Conditional GAN with Reconstruction and Style Loss to Generate Standard Layer of Maps from Satellite Images. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2209","DOI":"10.1109\/TMM.2019.2897897","article-title":"SwapGAN: A Multistage Generative Approach for Person-to-Person Fashion Style Transfer","volume":"21","author":"Liu","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1602","DOI":"10.1109\/TIP.2018.2878970","article-title":"Cycle-consistent deep generative hashing for cross-modal retrieval","volume":"28","author":"Wu","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Shah, M., Chen, X., Rohrbach, M., and Parikh, D. (2019). Cycle-Consistency for Robust Visual Question Answering. arXiv.","DOI":"10.1109\/CVPR.2019.00681"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Qiao, T., Zhang, W., Zhang, M., Ma, Z., and Xu, D. (2019, January 7\u201311). Ancient Painting to Natural Image: A New Solution for Painting Processing. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, HI, USA.","DOI":"10.1109\/WACV.2019.00061"},{"key":"ref_29","unstructured":"Almahairi, A., Rajeswar, S., Sordoni, A., Bachman, P., and Courville, A.C. (2018). Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data. arXiv."},{"key":"ref_30","unstructured":"Che, T., Li, Y., Jacob, A.P., Bengio, Y., and Li, W. (2016). Mode regularized generative adversarial networks. arXiv."},{"key":"ref_31","unstructured":"Kodali, N., Abernethy, J., Hays, J., and Kira, Z. (2017). On Convergence and Stability of GANs. arXiv."},{"key":"ref_32","unstructured":"Arjovsky, M., Chintala, S., and Bottou, L. (2017). Wasserstein GAN. arXiv."},{"key":"ref_33","unstructured":"Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A. (2017). Improved Training of Wasserstein GANs. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., and Webb, R. (2017, January 21\u201326). Learning from simulated and unsupervised images through adversarial training. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.241"},{"key":"ref_35","unstructured":"Kim, T., Cha, M., Kim, H., Lee, J.K., and Kim, J. (2017). Learning to Discover Cross-Domain Relations with Generative Adversarial Networks. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, P., and Patel, V.M. (2018, January 23\u201327). Generating high quality visible images from SAR images using CNNs. Proceedings of the 2018 IEEE Radar Conference (RadarConf18), Oklahoma City, OK, USA.","DOI":"10.1109\/RADAR.2018.8378622"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Merkle, N., Fischer, P., Auer, S., and M\u00fcller, R. (2017, January 23\u201328). On the possibility of conditional adversarial networks for multi-sensor image matching. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127535"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Frid-Adar, M., Klang, E., Amitai, M., Goldberger, J., and Greenspan, H. (2018). Synthetic Data Augmentation using GAN for Improved Liver Lesion Classification. arXiv.","DOI":"10.1109\/ISBI.2018.8363576"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.engappai.2018.11.013","article-title":"Cross-Modality Synthesis from CT to PET using FCN and GAN Networks for Improved Automated Lesion Detection","volume":"78","author":"Klang","year":"2019","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_40","unstructured":"Zhu, Y., Aoun, M., Krijn, M., and Vanschoren, J. (2018, January 3\u20136). Data augmentation using conditional generative adversarial networks for leaf counting in arabidopsis plants. Proceedings of the British Machine Vision Conference, Newcastle, UK."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wu, E., Wu, K., Cox, D., and Lotter, W. (2018). Conditional Infilling GANs for Data Augmentation in Mammogram Classification. Image Analysis for Moving Organ, Breast, and Thoracic Images, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-030-00946-5_11"},{"key":"ref_42","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Identity mappings in deep residual networks. arXiv.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_44","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance normalization: The missing ingredient for fast stylization. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","unstructured":"Ridgeway, K., Snell, J., Roads, B., Zemel, R.S., and Mozer, M.C. (2015). Learning to generate images with perceptual similarity metrics. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Kahaki, S.M.M., Nordin, M.J., Ashtari, A.H., and Zahra, S.J. (2016). Invariant feature matching for image registration application based on new dissimilarity of spatial features. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0149710"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Borji, A. (2018). Pros and Cons of GAN Evaluation Measures. arXiv.","DOI":"10.1016\/j.cviu.2018.10.009"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Korhonen, J., and You, J. (2012, January 5\u20137). Peak signal-to-noise ratio revisited: Is simple beautiful?. Proceedings of the Fourth International Workshop on Quality of Multimedia Experience, Yarra Valley, Australia.","DOI":"10.1109\/QoMEX.2012.6263880"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/MSP.2008.930649","article-title":"Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures","volume":"26","author":"Wang","year":"2009","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_51","unstructured":"Yao, S., Lin, W., Ong, E., and Lu, Z. (2005, January 14). Contrast signal-to-noise ratio for image quality assessment. Proceedings of the IEEE International Conference on Image Processing 2005, Genova, Italy."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1080\/21681163.2016.1149104","article-title":"Microscopy Cell Counting with Fully Convolutional Regression Networks","volume":"6","author":"Xie","year":"2018","journal-title":"Comput. Methods Biomech. Biomed. Eng. Imaging Vis."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"4126","DOI":"10.3390\/s140304126","article-title":"Contour-based corner detection and classification by using mean projection transform","volume":"14","author":"Kahaki","year":"2014","journal-title":"Sensors"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1109\/TIP.2003.814250","article-title":"Contour detection based on nonclassical receptive field inhibition","volume":"12","author":"Grigorescu","year":"2003","journal-title":"IEEE Trans. Image Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/24\/5479\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:41:46Z","timestamp":1760190106000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/24\/5479"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,12]]},"references-count":55,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["s19245479"],"URL":"https:\/\/doi.org\/10.3390\/s19245479","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,12]]}}}