{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T20:04:37Z","timestamp":1774901077104,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2022,12,1]],"date-time":"2022-12-01T00:00:00Z","timestamp":1669852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Radar and Electronic Warfare department at the CSIR"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In this paper, a feedback training approach for efficiently dealing with distribution shift in synthetic aperture radar target detection using a Bayesian convolutional neural network is proposed. After training the network on in-distribution data, it is tested on out-of-distribution data. Samples that are classified incorrectly with high certainty are fed back for a second round of training. This results in the reduction of false positives in the out-of-distribution dataset. False positive target detections challenge human attention, sensor resource management, and mission engagement. In these types of applications, a reduction in false positives thus often takes precedence over target detection and classification performance. The classifier is used to discriminate the targets from the clutter and to classify the target type in a single step as opposed to the traditional approach of having a sequential chain of functions for target detection and localisation before the machine learning algorithm. Another aspect of automated synthetic aperture radar detection and recognition problems addressed here is the fact that human users of the output of traditional classification systems are presented with decisions made by \u201cblack box\u201d algorithms. Consequently, the decisions are not explainable, even to an expert in the sensor domain. This paper makes use of the concept of explainable artificial intelligence via uncertainty heat maps that are overlaid onto synthetic aperture radar imagery to furnish the user with additional information about classification decisions. These uncertainty heat maps facilitate trust in the machine learning algorithm and are derived from the uncertainty estimates of the classifications from the Bayesian convolutional neural network. These uncertainty overlays further enhance the users\u2019 ability to interpret the reasons why certain decisions were made by the algorithm. Further, it is demonstrated that feeding back the high-certainty, incorrectly classified out-of-distribution data results in an average improvement in detection performance and a reduction in uncertainty for all synthetic aperture radar images processed. Compared to the baseline method, an improvement in recall of 11.8%, and a reduction in the false positive rate of 7.08% were demonstrated using the Feedback-assisted Bayesian Convolutional Neural Network or FaBCNN.<\/jats:p>","DOI":"10.3390\/rs14236096","type":"journal-article","created":{"date-parts":[[2022,12,2]],"date-time":"2022-12-02T03:00:36Z","timestamp":1669950036000},"page":"6096","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Feedback-Assisted Automatic Target and Clutter Discrimination Using a Bayesian Convolutional Neural Network for Improved Explainability in SAR Applications"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0905-4112","authenticated-orcid":false,"given":"Nicholas","family":"Blomerus","sequence":"first","affiliation":[{"name":"Department of Electrical, Electronic and Computer Engineering, University of Pretoria, Pretoria 0028, South Africa"},{"name":"Council for Industrial and Scientific Research, Pretoria 0184, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9364-3106","authenticated-orcid":false,"given":"Jacques","family":"Cilliers","sequence":"additional","affiliation":[{"name":"Council for Industrial and Scientific Research, Pretoria 0184, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Willie","family":"Nel","sequence":"additional","affiliation":[{"name":"Council for Industrial and Scientific Research, Pretoria 0184, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6894-6108","authenticated-orcid":false,"given":"Erik","family":"Blasch","sequence":"additional","affiliation":[{"name":"Air Force Research Laboratory, Dayton, OH 45324, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2506-6594","authenticated-orcid":false,"given":"Pieter","family":"de Villiers","sequence":"additional","affiliation":[{"name":"Department of Electrical, Electronic and Computer Engineering, University of Pretoria, Pretoria 0028, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,1]]},"reference":[{"key":"ref_1","unstructured":"Berens, P. (2006). Introduction to Synthetic Aperture Radar (SAR), NATO."},{"key":"ref_2","unstructured":"Majumder, U., Blasch, E.P., and Garren, D. (2020). Deep Learning for Radar and Communications Automatic Target Recognition, Artech."},{"key":"ref_3","unstructured":"Wagner, S. (2014, January 7\u201311). Combination of convolutional feature extraction and support vector machines for radar ATR. Proceedings of the Fusion 2014\u201417th International Conference On Information Fusion, Salamanca, Spain."},{"key":"ref_4","unstructured":"Fl\u00f3rez-L\u00f3pez, R. (2002, January 9\u201312). Reviewing RELIEF and its extensions: A new approach for estimating attributes considering high-correlated features. Proceedings of the IEEE International Conference On Data Mining, Maebashi City, Japan."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1109\/5326.897072","article-title":"Neural networks for classification: A survey","volume":"30","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"key":"ref_6","unstructured":"Sain, S., and Vapnik, V. (2000). The Nature of Statistical Learning Theory, Springer."},{"key":"ref_7","unstructured":"Tang, Y., and Srihari, S. (2012, January 11\u201315). Efficient and accurate learning of Bayesian networks using chi-squared independence tests. Proceedings of the International Conference on Pattern Recognition (ICPR), Tsukuba, Japan."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Shi, X., Zhou, F., Yang, S., Zhang, Z., and Su, T. (2019). Automatic Target Recognition for Synthetic Aperture Radar Images Based on Super-Resolution Generative Adversarial Network and Deep Convolutional Neural Network. Remote Sens., 11.","DOI":"10.3390\/rs11020135"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI","volume":"58","author":"Delser","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_10","unstructured":"Russel, S., and Norvig, P. (2003). Artificial Intelligence: A Modern Approach, Prentice Hall."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Haas, J., and Rabus, B. (2021). Uncertainty Estimation for Deep Learning-Based Segmentation of Roads in Synthetic Aperture Radar Imagery. Remote Sens., 13.","DOI":"10.3390\/rs13081472"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3954","DOI":"10.1109\/JSTARS.2021.3068944","article-title":"Training SAR-ATR Models for Reliable Operation in Open-World Environments","volume":"14","author":"Inkawhich","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_13","unstructured":"Gal, Y., and Ghahramani, Z. (2016, January 19\u201324). Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. Proceedings of the ICML\u201916: Proceedings of the 33rd International Conference on International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_14","unstructured":"Blundell, C., Cornebise, J., and Wierstra, D. (2015, January 6\u201311). Weight uncertainty in neural networks. Proceedings of the 32nd International Conference on International Conference on Machine Learning (ICML), Lille, France."},{"key":"ref_15","unstructured":"Shridhar, K., Laumann, F., and Liwicki, M. (2019). A Comprehensive Guide to Bayesian Convolutional Neural Network with Variational Inference. arXiv."},{"key":"ref_16","first-page":"53","article-title":"Review of Recent Advances in AI\/ML using the MSTAR data","volume":"11393","author":"Blasch","year":"2020","journal-title":"Proc. SPIE"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tan, J., Fan, X., Wang, S., and Ren, Y. (2018). Target Recognition of SAR Images via Matching Attributed Scattering Centers with Binary Target Region. Sensors, 18.","DOI":"10.3390\/s18093019"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/7.937475","article-title":"Support vector machines for SAR automatic target recognition","volume":"37","author":"Zhao","year":"2001","journal-title":"in IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"7282","DOI":"10.1109\/TGRS.2018.2849967","article-title":"SAR ATR of Ground Vehicles Based on LM-BN-CNN","volume":"56","author":"Zhou","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7186120","DOI":"10.1155\/2017\/7186120","article-title":"Automatic Target Recognition Strategy for Synthetic Aperture Radar Images Based on Combined Discrimination Trees","volume":"2017","author":"Zhao","year":"2017","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"78571","DOI":"10.1109\/ACCESS.2019.2922844","article-title":"Adversarial Deep Domain Adaptation for Multi-Band SAR Images Classification","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Soldin, R.J. (2018, January 9\u201311). SAR Target Recognition with Deep Learning. Proceedings of the IEEE Appl. Imag. Pattern Recognition Workshop (AIPR), Washington, DC, USA.","DOI":"10.1109\/AIPR.2018.8707419"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","article-title":"Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization","volume":"128","author":"Selvaraju","year":"2020","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","first-page":"110180Q","article-title":"Deep Learning in AI for Information Fusion Panel Discussion","volume":"11018","author":"Blasch","year":"2019","journal-title":"Proc. SPIE"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mandeep, H., Pannu, S., and Malhi, A. (2020, January 6\u20138). Deep learning-based explainable target classification for synthetic aperture radar images. Proceedings of the 2020 13th International Conference on Human System Interaction (HSI), Tokyo, Japan.","DOI":"10.1109\/HSI49210.2020.9142658"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.neuroimage.2018.03.065","article-title":"Bayesian convolutional neural network based MRI brain extraction on nonhuman primates","volume":"175","author":"Zhao","year":"2018","journal-title":"Neuroimage"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5501","DOI":"10.1016\/j.eswa.2013.04.013","article-title":"A Bayesian regularized artificial neural network for stock market forecasting","volume":"40","author":"Ticknor","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tursunov, A., Mustaqeem, J.Y., Choeh, J.Y., and Kwon, S. (2021). Age and Gender Recognition Using a Convolutional Neural Network with a Specially Designed Multi-Attention Module through Speech Spectrograms. Sensors, 21.","DOI":"10.3390\/s21175892"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Dera, D., Rasool, G., Bouaynaya, N., Eichen, A., Shanko, S., Cammerata, J., and Arnold, S. (2020, January 28\u201330). Bayes-SAR Net: Robust SAR image classification with uncertainty estimation using bayesian convolutional neural network. Proceedings of the IEEE International Radar Conference (RADAR), Washington, DC, USA.","DOI":"10.1109\/RADAR42522.2020.9114737"},{"key":"ref_30","unstructured":"De Villiers, J., Jousselme, A., Pavlin, G., Laskey, K., Blasch, E., and Costa, P. (2016, January 5\u20138). Uncertainty evaluation of data and information fusion within the context of the decision loop. Proceedings of the 19th International Conference on Information Fusion (FUSION), Heidelberg, Germany."},{"key":"ref_31","first-page":"198","article-title":"Uncertainty representation and evaluation for modelling and decision-making in information fusion","volume":"13","author":"Pavlin","year":"2018","journal-title":"J. Adv. Inf. Fusion"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Quionero-Candela, J., Sugiyama, M., Schwaighofer, A., and Lawrence, N.D. (2009). Dataset Shift in Machine Learning, MIT Press.","DOI":"10.7551\/mitpress\/9780262170055.001.0001"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lewis, B., Scarnati, T., Sudkamp, E., Nehrbass, J., Rosencrantz, S., and Zelnio, E. (2019). A SAR dataset for ATR development: The synthetic and measured paired labeled experiment (SAMPLE). Algorithms for Synthetic Aperture Radar Imagery XXVI, SPIE.","DOI":"10.1117\/12.2523460"},{"key":"ref_34","unstructured":"DARPA (2021, January 05). Moving and Stationary Target Acquisition Recognition (MSTAR), Program Review, Denver, 1996, Available online: https:\/\/www.sdms.afrl.af.mil\/index.php?collection=mstar&page=targets."},{"key":"ref_35","unstructured":"Blasch, E.P. (1999, January 6\u20139). Fusion of HRR and SAR information for Automatic Target Recognition and Classification. Proceedings of the International Conference on Information Fusion, Sunnyvale, CA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1109\/62.843110","article-title":"Assembling an Information-fused Human-Computer Cognitive Decision Making Tool","volume":"15","author":"Blasch","year":"2000","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_37","unstructured":"Neal, R., and Hinton, G. (2000). A View Of The Em Algorithm That Justifies Incremental, Sparse, And Other Variants. Learning in Graphical Models, Springer."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1109\/7.937460","article-title":"Improved SAR target detection via extended fractal features","volume":"37","author":"Kaplan","year":"2001","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"100049","DOI":"10.1016\/j.patter.2020.100049","article-title":"Rapid Trust Calibration through Interpretable and Uncertainty-Aware AI","volume":"1","author":"Tomsett","year":"2020","journal-title":"Patterns"},{"key":"ref_40","unstructured":"Kendall, A., and Gal, Y. (2017, January 4\u20139). What uncertainties do we need in bayesian deep learning for computer vision?. Proceedings of the 31st International Conference On Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_41","first-page":"1","article-title":"Uncertainty quantification using Bayesian neural networks in classification: Application to ischemic stroke lesion segmentation","volume":"6","author":"Kwon","year":"2018","journal-title":"IEEE Access"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_43","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_44","unstructured":"Simonyan, K., and Zisserman, A. (2014). A Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_45","unstructured":"Kingma, D., and Ba, J. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference On Learning Representations, ICLR 2015\u2014Conference Track Proceedings, San Diego, CA, USA."},{"key":"ref_46","unstructured":"Pelikan, M., Goldberg, D., and Cant\u00fa-Paz, E. (1999, January 12\u201316). BOA: The Bayesian optimization algorithm (department of general engineering. Proceedings of the 1st Annual Conference on Genetic and Evolutionary Computation, San Francisco, CA, USA."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Huang, Q., Zhu, W., Li, Y., Zhu, B., Gao, T., and Wang, P. (2021, January 12\u201314). Survey of target detection algorithms in SAR images. Proceedings of the IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.","DOI":"10.1109\/IAEAC50856.2021.9390728"},{"key":"ref_48","unstructured":"Cilliers, J.E. (2018). Information Theoretic Limits on Non-Cooperative Airborne Target Recognition by Means of Radar Sensors. [Ph.D. Thesis, Department of Electronic and Electrical Engineering, University College London]."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/7.570713","article-title":"Effects of polarization and resolution on SAR ATR","volume":"33","author":"Novak","year":"1997","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Cilliers, J.E., Smit, J.C., Baker, C.J., and Woodbridge, K. (2015, January 10\u201315). On the gain in recognition performance due to the addition of polarisation in an X-band high range resolution radar evaluated for F-18 and F-35 targets using asymptotic EM techniques. Proceedings of the 2015 IEEE Radar Conference (RadarCon), Arlington, VI, USA.","DOI":"10.1109\/RADAR.2015.7131195"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Cilliers, J.E., Potgieter, M., Blaauw, C., Odendaal, J.W., Joubert, J., Woodbridge, K., and Baker, C.J. (2020, January 28\u201330). Comparison of the mutual information content between the polarimetric monostatic and bistatic measured RCS data of a 1:25 boeing 707 model. Proceedings of the 2020 IEEE International Radar Conference (RADAR), Washington, DC, USA.","DOI":"10.1109\/RADAR42522.2020.9114678"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Smit, J.C., Cilliers, J.E., and Burger, E.H. (2012, January 22\u201325). Comparison of MLFMM, PO and SBR for RCS investigations in radar applications. Proceedings of the IET International Conference on Radar Systems (Radar 2012), Glasgow, UK.","DOI":"10.1049\/cp.2012.1636"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Potgieter, M., Cilliers, J.E., and Blaauw, C. (2020, January 28\u201330). The use of sigma hat for modelling of electrically Large practical radar problems. Proceedings of the 2020 IEEE International Radar Conference (RADAR), Washington, DC, USA.","DOI":"10.1109\/RADAR42522.2020.9114751"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/23\/6096\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:32:15Z","timestamp":1760146335000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/23\/6096"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,1]]},"references-count":53,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["rs14236096"],"URL":"https:\/\/doi.org\/10.3390\/rs14236096","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,1]]}}}