{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T13:55:18Z","timestamp":1772027718116,"version":"3.50.1"},"reference-count":47,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,18]],"date-time":"2023-09-18T00:00:00Z","timestamp":1694995200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61971141"],"award-info":[{"award-number":["61971141"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2022YFB3903404"],"award-info":[{"award-number":["2022YFB3903404"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Key Research and Development Program of China","award":["61971141"],"award-info":[{"award-number":["61971141"]}]},{"name":"National Key Research and Development Program of China","award":["2022YFB3903404"],"award-info":[{"award-number":["2022YFB3903404"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Recently, autoencoder (AE)-based anomaly detection approaches for hyperspectral images (HSIs) have been extensively proposed; however, the reconstruction accuracy is susceptible to the anomalies and noises. Moreover, these AE-based anomaly detectors simply compress each pixel into a hidden-layer with a lower dimension and then reconstruct it, which does not consider the spatial properties among pixels. To solve the above issues, this paper proposes a background reconstruction framework via a 3D-transformer (3DTR) network for anomaly detection in HSIs. The experimental results on both synthetic and real hyperspectral datasets demonstrate that the proposed 3DTR network is able to effectively detect most of the anomalies by comprehensively considering the spatial correlations among pixels and the spectral similarity among spectral bands of HSIs. In addition, the proposed method exhibits fewer false alarms than both traditional and state-of-the-art (including model-based and AE-based) anomaly detectors owing to the adopted pre-detection procedure and the proposed novel patch-generation method in this paper. Moreover, two ablation experiments adequately verified the effectiveness of each component in the proposed method.<\/jats:p>","DOI":"10.3390\/rs15184592","type":"journal-article","created":{"date-parts":[[2023,9,19]],"date-time":"2023-09-19T02:47:52Z","timestamp":1695091672000},"page":"4592","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Background Reconstruction via 3D-Transformer Network for Hyperspectral Anomaly Detection"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2347-4113","authenticated-orcid":false,"given":"Ziyu","family":"Wu","sequence":"first","affiliation":[{"name":"Key Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University, Shanghai 200437, China"},{"name":"Image and Intelligence Laboratory, School of Information Science and Technology, Fudan University, Shanghai 200437, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4748-6426","authenticated-orcid":false,"given":"Bin","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University, Shanghai 200437, China"},{"name":"Image and Intelligence Laboratory, School of Information Science and Technology, Fudan University, Shanghai 200437, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2013.2244672","article-title":"Hyperspectral remote sensing data analysis and future challenges","volume":"1","author":"Plaza","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1109\/MGRS.2017.2762087","article-title":"Advances in hyperspectral image and signal processing: A comprehensive overview of the state of the art","volume":"5","author":"Ghamisi","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3711","DOI":"10.1109\/TGRS.2019.2961564","article-title":"Latent relationship guided stacked sparse autoencoder for hyperspectral imagery classification","volume":"58","author":"Liu","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5676","DOI":"10.1109\/TGRS.2020.2968304","article-title":"CVA2E: A conditional variational autoencoder with an adversarial training process for hyperspectral imagery classification","volume":"58","author":"Wang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1109\/JSTARS.2020.2980576","article-title":"Weighted nonlocal low-rank tensor decomposition method for sparse unmixing of hyperspectral images","volume":"13","author":"Sun","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/MSP.2013.2278992","article-title":"Hyperspectral target detection: An overview of current and future challenges","volume":"31","author":"Nasrabadi","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3351","DOI":"10.1109\/JSTARS.2022.3167830","article-title":"Hyperspectral anomaly detection based on machine learning: An overview","volume":"15","author":"Xu","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"108060","DOI":"10.1016\/j.sigpro.2021.108060","article-title":"TSLRLN: Tensor subspace low-rank learning with non-local prior for hyperspectral image mixed denoising","volume":"184","author":"He","year":"2021","journal-title":"Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sun, L., He, C., Zheng, Y., and Tang, S. (2020). SLRL4D: Joint restoration of subspace low-rank learning and non-local 4-D transform filtering for hyperspectral image. Remote Sens., 12.","DOI":"10.3390\/rs12182979"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Dao, M., Kwan, C., Ayhan, B., and Tran, T.D. (2016, January 7\u20139). Burn scar detection using cloudy MODIS images via low-rank and sparsity-based models. Proceedings of the 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Washington, DC, USA.","DOI":"10.1109\/GlobalSIP.2016.7905827"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"8118","DOI":"10.1109\/TGRS.2019.2918342","article-title":"From difference to similarity: A manifold ranking based hyperspectral anomaly detection framework","volume":"57","author":"Huang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gagnon, M.-A., Tremblay, P., Savary, S., Lagueux, P., and Chamberland, M. (2013, January 26\u201328). Standoff thermal hyperspectral imaging for flare and smokestack characterization in industrial environments. Proceedings of the 2013 5th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Gainesville, FL, USA.","DOI":"10.1109\/WHISPERS.2013.8080745"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1109\/TGRS.2003.812908","article-title":"Comparison of airborne hyperspectral data and EO-1 Hyperion for mineral mapping","volume":"41","author":"Kruse","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, J., Zhang, L., Tong, Q., and Sun, X. (2012, January 4\u20137). The spectral crust project\u2014Research on new mineral exploration technology. Proceedings of the 2012 4th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Shanghai, China.","DOI":"10.1109\/WHISPERS.2012.6874254"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1109\/JPROC.2009.2013561","article-title":"Automated hyperspectral cueing for civilian search and rescue","volume":"97","author":"Eismann","year":"2009","journal-title":"Proc. IEEE"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Antson, L., Vandenhoeke, A., Shimoni, M., Hamesse, C., and Luong, H. (2022, January 13\u201316). Detection and tracking of search and rescue personnel under hindered light conditions using hyperspectral imaging. Proceedings of the 2022 12th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), Rome, Italy.","DOI":"10.1109\/WHISPERS56178.2022.9955101"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ardouin, J.-P., L\u00e9vesque, J., and Rea, T.A. (2007, January 9\u201312). A demonstration of hyperspectral image exploitation for military applications. Proceedings of the 2007 10th International Conference on Information Fusion, Quebec, QC, Canada.","DOI":"10.1109\/ICIF.2007.4408184"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Racek, F., and Barta, V. (June, January 31). Spectrally based method of target detection in acquisition system of general fire control system. Proceedings of the 2017 International Conference on Military Technologies (ICMT), Brno, Czech Republic.","DOI":"10.1109\/MILTECHS.2017.7988724"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1760","DOI":"10.1109\/29.60107","article-title":"Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution","volume":"38","author":"Reed","year":"1990","journal-title":"IEEE Trans. Acoust. Speech Signal Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1463","DOI":"10.1109\/TGRS.2014.2343955","article-title":"Collaborative representation for hyperspectral anomaly detection","volume":"53","author":"Li","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","first-page":"11","article-title":"Robust principal component analysis?","volume":"58","author":"Li","year":"2011","journal-title":"J. ACM"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, W., Li, S., Qi, H., Ayhan, B., Kwan, C., and Vance, S. (2015, January 2\u20135). Identify anomaly component by sparsity and low rank. Proceedings of the 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Tokyo, Japan.","DOI":"10.1109\/WHISPERS.2015.8075391"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1109\/TPAMI.2012.88","article-title":"Robust recovery of subspace structures by low-rank representation","volume":"35","author":"Liu","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1990","DOI":"10.1109\/TGRS.2015.2493201","article-title":"Anomaly detection in hyperspectral images based on low-rank and sparse representation","volume":"54","author":"Xu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1109\/TGRS.2019.2936609","article-title":"Graph and total variation regularized lowrank representation for hyperspectral anomaly detection","volume":"58","author":"Cheng","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","first-page":"1","article-title":"Local spatial constraint and total variation for hyperspectral anomaly detection","volume":"60","author":"Feng","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","first-page":"3","article-title":"Autoencoders, minimum description length and Helmholtz free energy","volume":"6","author":"Hinton","year":"1994","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4666","DOI":"10.1109\/TGRS.2020.2965961","article-title":"Discriminative Reconstruction Constrained Generative Adversarial Network for Hyperspectral Anomaly Detection","volume":"58","author":"Jiang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial nets. Adv. Neural Inf. Process. Syst., 2672\u20132680."},{"key":"ref_30","first-page":"1","article-title":"Hyperspectral anomaly detection with robust graph autoencoders","volume":"60","author":"Fan","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5224","DOI":"10.1109\/TGRS.2020.2975295","article-title":"Semisupervised spectral learning with generative adversarial network for hyperspectral anomaly detection","volume":"58","author":"Jiang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","first-page":"1","article-title":"Hyperspectral anomaly detection with guided autoencoder","volume":"60","author":"Xiang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","first-page":"5998","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3231215","article-title":"Spectral\u2013spatial feature tokenization transformer for hyperspectral image classification","volume":"60","author":"Sun","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hu, X., Yang, W., Wen, H., Liu, Y., and Peng, Y. (2021). A lightweight 1-D convolution augmented transformer with metric learning for hyperspectral image classification. Sensors, 21.","DOI":"10.3390\/s21051751"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, X., Chen, Y., and Lin, Z. (2021). Spatial-spectral transformer for hyperspectral image classification. Remote Sens., 13.","DOI":"10.3390\/rs13030498"},{"key":"ref_37","first-page":"1","article-title":"Spectral\u2013spatial\u2013temporal transformers for hyperspectral image change detection","volume":"60","author":"Wang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1414","DOI":"10.1109\/JSTARS.2022.3232762","article-title":"Anomaly detection of hyperspectral images based on transformer with spatial\u2013spectral dual-window mask","volume":"16","author":"Xiao","year":"2023","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Li, K., Wang, S., Zhang, X., Xu, Y., Xu, W., and Tu, Z. (2021). Pose recognition with cascade transformers. CVPR, 1944\u20131953.","DOI":"10.1109\/CVPR46437.2021.00198"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P. (2021). Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. CVPR, 6877\u20136886.","DOI":"10.1109\/CVPR46437.2021.00681"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3230846","article-title":"Swin transformer embedding UNet for remote sensing image semantic segmentation","volume":"60","author":"He","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Dai, X., Chen, Y., Yang, J., Zhang, P., Yuan, L., and Zhang, L. (2021). Dynamic DETR: End-to-end object detection with dynamic attention. ICCV, 2968\u20132977.","DOI":"10.1109\/ICCV48922.2021.00298"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3163173","article-title":"Siamese transformer network for hyperspectral image target detection","volume":"60","author":"Rao","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3225267","article-title":"Spectral\u2013spatial transformer network for hyperspectral image classification: A factorized architecture search framework","volume":"60","author":"Zhong","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"5131","DOI":"10.1109\/TGRS.2020.3021671","article-title":"An effective evaluation tool for hyperspectral target detection: 3D receiver operating characteristic curve analysis","volume":"59","author":"Chang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1109\/83.913593","article-title":"Efficient detection in hyperspectral imagery","volume":"10","author":"Schweizer","year":"2001","journal-title":"IEEE Trans. Image Process."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/18\/4592\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:53:14Z","timestamp":1760129594000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/18\/4592"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,18]]},"references-count":47,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["rs15184592"],"URL":"https:\/\/doi.org\/10.3390\/rs15184592","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,18]]}}}