{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T17:44:53Z","timestamp":1790617493279,"version":"4.1.0"},"reference-count":63,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,4,26]],"date-time":"2020-04-26T00:00:00Z","timestamp":1587859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In recent years, convolutional neural networks (CNNs) have shown great success in the scene classification of computer vision images. Although these CNNs can achieve excellent classification accuracy, the discriminative ability of feature representations extracted from CNNs is still limited in distinguishing more complex remote sensing images. Therefore, we propose a unified feature fusion framework based on attention mechanism in this paper, which is called Deep Discriminative Representation Learning with Attention Map (DDRL-AM). Firstly, by applying Gradient-weighted Class Activation Mapping (Grad-CAM) algorithm, attention maps associated with the predicted results are generated in order to make CNNs focus on the most salient parts of the image. Secondly, a spatial feature transformer (SFT) is designed to extract discriminative features from attention maps. Then an innovative two-channel CNN architecture is proposed by the fusion of features extracted from attention maps and the RGB (red green blue) stream. A new objective function that considers both center and cross-entropy loss are optimized to decrease the influence of inter-class dispersion and within-class variance. In order to show its effectiveness in classifying remote sensing images, the proposed DDRL-AM method is evaluated on four public benchmark datasets. The experimental results demonstrate the competitive scene classification performance of the DDRL-AM approach. Moreover, the visualization of features extracted by the proposed DDRL-AM method can prove that the discriminative ability of features has been increased.<\/jats:p>","DOI":"10.3390\/rs12091366","type":"journal-article","created":{"date-parts":[[2020,4,28]],"date-time":"2020-04-28T10:30:58Z","timestamp":1588069858000},"page":"1366","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":87,"title":["Deep Discriminative Representation Learning with Attention Map for Scene Classification"],"prefix":"10.3390","volume":"12","author":[{"given":"Jun","family":"Li","sequence":"first","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8352-0081","authenticated-orcid":false,"given":"Daoyu","family":"Lin","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Wang","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guangluan","family":"Xu","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1306-5746","authenticated-orcid":false,"given":"Yunyan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chibiao","family":"Ding","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanhai","family":"Zhou","sequence":"additional","affiliation":[{"name":"The Equipment Project Management Center, Equipment Department of People\u2019s Liberation Army Rocket Force, Beijing 100085, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,26]]},"reference":[{"key":"ref_1","first-page":"12","article-title":"What\u2019s wrong with pixels? Some recent developments interfacing remote sensing and GIS","volume":"6","author":"Blaschke","year":"2001","journal-title":"Geobit\/Gis"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Blaschke, T., Lang, S., and Hay, G. (2008). Object-Based Image Analysis: Spatial Concepts for Knowledge-Driven Remote Sensing Applications, Springer Science & Business Media.","DOI":"10.1007\/978-3-540-77058-9"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1109\/JPROC.2015.2449668","article-title":"Multimodal classification of remote sensing images: A review and future directions","volume":"103","author":"Tuia","year":"2015","journal-title":"Proc. IEEE"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3965","DOI":"10.1109\/TGRS.2017.2685945","article-title":"AID: A benchmark dataset for performance evaluation of aerial scene classification","volume":"55","author":"Xia","year":"2017","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2403","DOI":"10.1109\/LGRS.2015.2478966","article-title":"Land-use scene classification in high-resolution remote sensing images using improved correlatons","volume":"12","author":"Qi","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"14680","DOI":"10.3390\/rs71114680","article-title":"Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery","volume":"7","author":"Hu","year":"2015","journal-title":"Remote. Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2321","DOI":"10.1109\/LGRS.2015.2475299","article-title":"Deep Learning Based Feature Selection for Remote Sensing Scene Classification","volume":"12","author":"Zou","year":"2015","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dong, R., Xu, D., Jiao, L., Zhao, J., and An, J. (2020). A Fast Deep Perception Network for Remote Sensing Scene Classification. Remote. Sens., 12.","DOI":"10.3390\/rs12040729"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Pires de Lima, R., and Marfurt, K. (2020). Convolutional Neural Network for Remote-Sensing Scene Classification: Transfer Learning Analysis. Remote. Sens., 12.","DOI":"10.3390\/rs12010086"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1109\/JPROC.2017.2675998","article-title":"Remote sensing image scene classification: Benchmark and state of the art","volume":"105","author":"Cheng","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_11","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention is all you need. In Advances in Neural Information Processing Systems, Curran Associates."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wen, Y., Zhang, K., Li, Z., and Qiao, Y. (2016). A discriminative feature learning approach for deep face recognition. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46478-7_31"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/BF00130487","article-title":"Color indexing","volume":"7","author":"Swain","year":"1991","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural features for image classification","volume":"6","author":"Haralick","year":"1973","journal-title":"IEEE Trans. Syst. ManCybern."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/S0031-3203(96)00068-4","article-title":"Object detection using Gabor filters","volume":"30","author":"Jain","year":"1997","journal-title":"Pattern Recognit."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1023\/A:1011139631724","article-title":"Modeling the shape of the scene: A holistic representation of the spatial envelope","volume":"42","author":"Oliva","year":"2001","journal-title":"Int. J. Comput. Vis."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_20","unstructured":"Fei-Fei, L., and Perona, P. (2005, January 20\u201325). A bayesian hierarchical model for learning natural scene categories. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"J\u00e9gou, H., Douze, M., Schmid, C., and P\u00e9rez, P. (2010, January 13\u201318). Aggregating local descriptors into a compact image representation. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540039"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Perronnin, F., S\u00e1nchez, J., and Mensink, T. (2010). Improving the fisher kernel for large-scale image classification. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-642-15561-1_11"},{"key":"ref_23","unstructured":"Lazebnik, S., Schmid, C., and Ponce, J. (2006, January 17\u201322). Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, NY, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_25","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, Curran Associates."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4427","DOI":"10.1109\/TGRS.2017.2692280","article-title":"Learning a discriminative distance metric with label consistency for scene classification","volume":"55","author":"Wang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2811","DOI":"10.1109\/TGRS.2017.2783902","article-title":"When deep learning meets metric learning: Remote sensing image scene classification via learning discriminative CNNs","volume":"56","author":"Cheng","year":"2018","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Penatti, O.A., Nogueira, K., and dos Santos, J.A. (2015). Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, IEEE.","DOI":"10.1109\/CVPRW.2015.7301382"},{"key":"ref_30","unstructured":"Castelluccio, M., Poggi, G., Sansone, C., and Verdoliva, L. (2015). Land use classification in remote sensing images by convolutional neural networks. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote. Sens. Mag."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1109\/34.730558","article-title":"A model of saliency-based visual attention for rapid scene analysis","volume":"20","author":"Itti","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Zhu, Y., Ye, Q., Qiu, Q., and Jiao, J. (2018). Weakly Supervised Instance Segmentation using Class Peak Response. arXiv.","DOI":"10.1109\/CVPR.2018.00399"},{"key":"ref_34","first-page":"3","article-title":"Object region mining with adversarial erasing: A simple classification to semantic segmentation approach","volume":"1","author":"Wei","year":"2017","journal-title":"IEEE CVPR"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1007\/s11263-017-1059-x","article-title":"Top-down neural attention by excitation backprop","volume":"126","author":"Zhang","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_36","unstructured":"Jetley, S., Lord, N.A., Lee, N., and Torr, P.H. (2018). Learn to pay attention. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., and Tang, X. (2017). Residual attention network for image classification. arXiv.","DOI":"10.1109\/CVPR.2017.683"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_39","unstructured":"Park, J., Woo, S., Lee, J.Y., and Kweon, I.S. (2018). BAM: Bottleneck attention module. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2017). Squeeze-and-excitation networks. arXiv.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_41","unstructured":"Nakka, K.K., and Salzmann, M. (2018). Deep Attentional Structured Representation Learning for Visual Recognition. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Xu, R., Tao, Y., Lu, Z., and Zhong, Y. (2018). Attention-mechanism-containing neural networks for high-resolution remote sensing image classification. Remote. Sens., 10.","DOI":"10.3390\/rs10101602"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Chen, J., Wang, C., Ma, Z., Chen, J., He, D., and Ackland, S. (2018). Remote sensing scene classification based on convolutional neural networks pre-trained using attention-guided sparse filters. Remote. Sens., 10.","DOI":"10.3390\/rs10020290"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4911","DOI":"10.1109\/TIP.2020.2975718","article-title":"A Multiple-Instance Densely-Connected ConvNet for Aerial Scene Classification","volume":"29","author":"Bi","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Cao, R., Fang, L., Lu, T., and He, N. (2020). Self-Attention-Based Deep Feature Fusion for Remote Sensing Scene Classification. IEEE Geosci. Remote. Sens. Lett.","DOI":"10.1109\/LGRS.2020.2968550"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"67200","DOI":"10.1109\/ACCESS.2019.2918732","article-title":"Global-local attention network for aerial scene classification","volume":"7","author":"Guo","year":"2019","journal-title":"IEEE Access"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Wang, J., Shen, L., Qiao, W., Dai, Y., and Li, Z. (2019). Deep feature fusion with integration of residual connection and attention model for classification of VHR remote sensing images. Remote. Sens., 11.","DOI":"10.3390\/rs11131617"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.1109\/TGRS.2018.2864987","article-title":"Scene classification with recurrent attention of VHR remote sensing images","volume":"57","author":"Wang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_49","unstructured":"Simonyan, K., and Zisserman, A. (2014). Two-stream convolutional networks for action recognition in videos. Advances in Neural Information Processing Systems, Curran Associates."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Feichtenhofer, C., Pinz, A., and Zisserman, A. (2016). Convolutional two-stream network fusion for video action recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2016.213"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"4775","DOI":"10.1109\/TGRS.2017.2700322","article-title":"fusion for VHR remote sensing scene classification","volume":"55","author":"Chaib","year":"2017","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Proceedings of the IEEE International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Zeiler, M.D., and Fergus, R. (2014). Visualizing and Understanding Convolutional Networks. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Helber, P., Bischke, B., Dengel, A., and Borth, D. (2017). Eurosat: A novel dataset and deep learning benchmark for land use and land cover classification. arXiv.","DOI":"10.1109\/IGARSS.2018.8519248"},{"key":"ref_56","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_57","unstructured":"Reddi, S.J., Kale, S., and Kumar, S. (2018). On the Convergence of Adam and Beyond. arXiv."},{"key":"ref_58","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019). PyTorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems, Curran Associates."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1109\/TGRS.2013.2241444","article-title":"Unsupervised feature learning for aerial scene classification","volume":"52","author":"Cheriyadat","year":"2014","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"8639367","DOI":"10.1155\/2018\/8639367","article-title":"A Two-Stream Deep Fusion Framework for High-Resolution Aerial Scene Classification","volume":"2018","author":"Yu","year":"2018","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Fan, R., Wang, L., Feng, R., and Zhu, Y. (2019). Attention based Residual Network for High-Resolution Remote Sensing Imagery Scene Classification. IGARSS 2019\u20132019 IEEE International Geoscience and Remote Sensing Symposium, IEEE.","DOI":"10.1109\/IGARSS.2019.8900199"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Zhang, J., Lu, C., Wang, J., Yue, X.G., Lim, S.J., Al-Makhadmeh, Z., and Tolba, A. (2020). Training Convolutional Neural Networks with Multi-Size Images and Triplet Loss for Remote Sensing Scene Classification. Sensors, 20.","DOI":"10.3390\/s20041188"},{"key":"ref_63","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"4629","author":"Maaten","year":"2008","journal-title":"J. Mach. Learn. Res."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/9\/1366\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:32:02Z","timestamp":1760362322000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/9\/1366"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,26]]},"references-count":63,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["rs12091366"],"URL":"https:\/\/doi.org\/10.3390\/rs12091366","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,26]]}}}