{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:35:43Z","timestamp":1760150143542,"version":"build-2065373602"},"reference-count":56,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,20]],"date-time":"2023-10-20T00:00:00Z","timestamp":1697760000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Internal Parenting Program","award":["145AXL250004000X"],"award-info":[{"award-number":["145AXL250004000X"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Land-use scene classification (LUSC) is a key technique in the field of remote sensing imagery (RSI) interpretation. A convolutional neural network (CNN) is widely used for its ability to autonomously and efficiently extract deep semantic feature maps (DSFMs) from large-scale RSI data. However, CNNs cannot accurately extract the rich spatial structure information of RSI, and the key information of RSI is easily lost due to many pooling layers, so it is difficult to ensure the information integrity of the spatial structure feature maps (SSFMs) and DSFMs of RSI with CNNs only for LUSC, which can easily affect the classification performance. To fully utilize the SSFMs and make up for the insufficiency of CNN in capturing the relationship information between the land-use objects of RSI, while reducing the loss of important information, we propose an effective dual-branch hybrid framework, HFCC-Net, for the LUSC task. The CNN in the upper branch extracts multi-scale DSFMs of the same scene using transfer learning techniques; the graph routing-based CapsNet in the lower branch is used to obtain SSFMs from DSFMs in different scales, and element-by-element summation achieves enhanced representations of SSFMs; a newly designed function is used to fuse the top-level DSFMs with SSFMs to generate discriminant feature maps (DFMs); and, finally, the DFMs are fed into classifier. We conducted sufficient experiments using HFCC-Net on four public datasets. The results show that our method has better classification performance compared to some existing CNN-based state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/rs15205044","type":"journal-article","created":{"date-parts":[[2023,10,20]],"date-time":"2023-10-20T07:25:22Z","timestamp":1697786722000},"page":"5044","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["HFCC-Net: A Dual-Branch Hybrid Framework of CNN and CapsNet for Land-Use Scene Classification"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5670-9436","authenticated-orcid":false,"given":"Ningbo","family":"Guo","sequence":"first","affiliation":[{"name":"Space Information Academic, Space Engineering University, Beijing 101407, China"}]},{"given":"Mingyong","family":"Jiang","sequence":"additional","affiliation":[{"name":"Space Information Academic, Space Engineering University, Beijing 101407, China"}]},{"given":"Lijing","family":"Gao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2610-0064","authenticated-orcid":false,"given":"Kaitao","family":"Li","sequence":"additional","affiliation":[{"name":"Space Information Academic, Space Engineering University, Beijing 101407, China"}]},{"given":"Fengjie","family":"Zheng","sequence":"additional","affiliation":[{"name":"Space Information Academic, Space Engineering University, Beijing 101407, China"}]},{"given":"Xiangning","family":"Chen","sequence":"additional","affiliation":[{"name":"Space Information Academic, Space Engineering University, Beijing 101407, China"}]},{"given":"Mingdong","family":"Wang","sequence":"additional","affiliation":[{"name":"Space Information Academic, Space Engineering University, Beijing 101407, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"105295","DOI":"10.1016\/j.cageo.2022.105295","article-title":"Remote sensing scene classification under scarcity of labelled samples\u2014A survey of the state-of-the-arts","volume":"171","author":"Dutta","year":"2023","journal-title":"Comput. Geosci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3735","DOI":"10.1109\/JSTARS.2020.3005403","article-title":"Remote sensing image scene classification meets deep learning: Challenges, methods, benchmarks, and opportunities","volume":"13","author":"Cheng","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","first-page":"5615312","article-title":"Remote Sensing Scene Classification via Multi-Stage Self-Guided Separation Network","volume":"61","author":"Wang","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Huang, X., Liu, F., Cui, Y., Chen, P., Li, L., and Li, P. (2023). Faster and Better: A Lightweight Transformer Network for Remote Sensing Scene Classification. Remote Sens., 15.","DOI":"10.3390\/rs15143645"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhang, J., Zhao, H., and Li, J. (2021). TRS: Transformers for remote sensing scene classification. Remote Sens., 13.","DOI":"10.3390\/rs13204143"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Thapa, A., Horanont, T., Neupane, B., and Aryal, J. (2023). Deep Learning for Remote Sensing Image Scene Classification: A Review and Meta-Analysis. Remote Sens., 15.","DOI":"10.3390\/rs15194804"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.rse.2016.02.028","article-title":"A meta-analysis of remote sensing research on supervised pixel-based land-cover image classification processes: General guidelines for practitioners and future research","volume":"177","author":"Khatami","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6020","DOI":"10.1080\/01431161.2018.1506592","article-title":"An experimental comparison of multi-resolution segmentation, SLIC and K-means clustering for object-based classification of VHR imagery","volume":"39","author":"Kavzoglu","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2797","DOI":"10.1007\/s40747-021-00457-z","article-title":"Remote sensing techniques: Mapping and monitoring of mangrove ecosystem\u2014A review","volume":"7","author":"Maurya","year":"2021","journal-title":"Complex Intell. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.isprsjprs.2019.04.015","article-title":"Deep learning in remote sensing applications: A meta-analysis and review","volume":"152","author":"Ma","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1080\/20964471.2019.1657720","article-title":"A survey of remote sensing image classification based on CNNs","volume":"3","author":"Song","year":"2019","journal-title":"Big Earth Data"},{"key":"ref_12","unstructured":"Sabour, S., Frosst, N., and Hinton, G.E. (2017, January 4\u20139). Dynamic routing between capsules. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Afshar, P., Mohammadi, A., and Plataniotis, K.N. (2018, January 7\u201310). Brain tumor type classification via capsule networks. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451379"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jvcir.2019.01.023","article-title":"Gait recognition based on capsule network","volume":"59","author":"Xu","year":"2019","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"49691","DOI":"10.1109\/ACCESS.2019.2911056","article-title":"A deep learning iris recognition method based on capsule network architecture","volume":"7","author":"Zhao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhang, W., Tang, P., and Zhao, L. (2019). Remote sensing image scene classification using CNN-CapsNet. Remote Sens., 11.","DOI":"10.3390\/rs11050494"},{"key":"ref_17","first-page":"1295","article-title":"Capsule networks\u2013a survey","volume":"34","author":"Patrick","year":"2022","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_18","unstructured":"Goceri, E. (2021, January 21\u201323). Analysis of capsule networks for image classification. Proceedings of the International Conference on Computer Graphics Visualization, Computer Vision and Image Processing, Online."},{"key":"ref_19","unstructured":"Hinton, G.E., Sabour, S., and Frosst, N. (May, January 30). Matrix capsules with EM routing. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/j.neunet.2021.06.018","article-title":"Graph routing between capsules","volume":"143","author":"Li","year":"2021","journal-title":"Neural Netw."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"103405","DOI":"10.1016\/j.cviu.2022.103405","article-title":"Adaptive capsule network","volume":"218","author":"Tao","year":"2022","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_22","unstructured":"Phaye, S.S.R., Sikka, A., Dhall, A., and Bathula, D. (2018). Dense and diverse capsule networks: Making the capsules learn better. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Xiong, Y., Su, G., Ye, S., Sun, Y., and Sun, Y. (2019, January 14\u201319). Deeper capsule network for complex data. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852020"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jia, B., and Huang, Q. (2020). DE-CapsNet: A diverse enhanced capsule network with disperse dynamic routing. Appl. Sci., 10.","DOI":"10.3390\/app10030884"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1080\/2150704X.2020.1766722","article-title":"Using Siamese capsule networks for remote sensing scene classification","volume":"11","author":"Zhou","year":"2020","journal-title":"Remote Sens. Lett."},{"key":"ref_26","unstructured":"Hoogi, A., Wilcox, B., Gupta, Y., and Rubin, D.L. (2019). Self-attention capsule networks for object classification. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gu, J. (2021, January 2\u20139). Interpretable graph capsule networks for object recognition. Proceedings of the AAAI Conference on Artificial Intelligence, Online.","DOI":"10.1609\/aaai.v35i2.16237"},{"key":"ref_28","first-page":"1","article-title":"Land cover classification of multispectral lidar data with an efficient self-attention capsule network","volume":"19","author":"Yu","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3965","DOI":"10.1109\/TGRS.2017.2685945","article-title":"AID: A benchmark data set for performance evaluation of aerial scene classification","volume":"55","author":"Xia","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/TGRS.2019.2931801","article-title":"Remote sensing scene classification by gated bidirectional network","volume":"58","author":"Sun","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"8639367","DOI":"10.1155\/2018\/8639367","article-title":"A two-stream deep fusion framework for high-resolution aerial scene classification","volume":"2018","author":"Yu","year":"2018","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2636","DOI":"10.1109\/JSTARS.2019.2919317","article-title":"A lightweight and discriminative model for remote sensing scene classification with multidilation pooling module","volume":"12","author":"Zhang","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_33","unstructured":"Yang, L., Zhang, R.-Y., Li, L., and Xie, X. (2021, January 18\u201324). Simam: A simple, parameter-free attention module for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Online."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.isprsjprs.2018.01.023","article-title":"Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification","volume":"138","author":"Anwer","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gao, Y., Shi, J., Li, J., and Wang, R. (2020, January 10\u201312). Remote sensing scene classification with dual attention-aware network. Proceedings of the 2020 IEEE 5th International Conference on Image, Vision and Computing (ICIVC), Beijing, China.","DOI":"10.1109\/ICIVC50857.2020.9177460"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1109\/LGRS.2017.2779469","article-title":"Scene classification based on two-stage deep feature fusion","volume":"15","author":"Liu","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1895","DOI":"10.1109\/LGRS.2016.2616440","article-title":"Deep filter banks for land-use scene classification","volume":"13","author":"Wu","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.1109\/TGRS.2018.2864987","article-title":"Scene classification with recurrent attention of VHR remote sensing images","volume":"57","author":"Wang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Peng, F., Lu, W., Tan, W., Qi, K., Zhang, X., and Zhu, Q. (2022). Multi-output network combining GNN and CNN for remote sensing scene classification. Remote Sens., 14.","DOI":"10.3390\/rs14061478"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Phaye, S.S.R., Sikka, A., Dhall, A., and Bathula, D.R. (2018, January 2\u20136). Multi-level dense capsule networks. Proceedings of the Computer Vision\u2013ACCV 2018: 14th Asian Conference on Computer Vision, Perth, Australia. Revised Selected Papers, Part V 14.","DOI":"10.1007\/978-3-030-20873-8_37"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1850","DOI":"10.1109\/LSP.2018.2873892","article-title":"MS-CapsNet: A novel multi-scale capsule network","volume":"25","author":"Xiang","year":"2018","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"107851","DOI":"10.1016\/j.patcog.2021.107851","article-title":"CapsNet regularization and its conjugation with ResNet for signature identification","volume":"120","author":"Jampour","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wang, A., Wang, M., Wu, H., Jiang, K., and Iwahori, Y. (2020). A novel LiDAR data classification algorithm combined capsnet with resnet. Sensors, 20.","DOI":"10.3390\/s20041151"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Yousra, D., Abdelhakim, A.B., and Mohamed, B.A. (2021, January 27\u201329). A novel model for detection and classification coronavirus (COVID-19) based on Chest X-Ray images using CNN-CapsNet. Proceedings of the Sustainable Smart Cities and Territories, Doha, Qatar.","DOI":"10.1007\/978-3-030-78901-5_17"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1007939","DOI":"10.3389\/fnbot.2022.1007939","article-title":"A novel CapsNet neural network based on MobileNetV2 structure for robot image classification","volume":"16","author":"Zhang","year":"2022","journal-title":"Front. Neurorobotics"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wang, P., Wang, J., Li, Y., Li, P., Li, L., and Jiang, M. (2021). Automatic classification of breast cancer histopathological images based on deep feature fusion and enhanced routing. Biomed. Signal Process. Control, 65.","DOI":"10.1016\/j.bspc.2020.102341"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2321","DOI":"10.1109\/LGRS.2015.2475299","article-title":"Deep learning based feature selection for remote sensing scene classification","volume":"12","author":"Zou","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2108","DOI":"10.1109\/TGRS.2015.2496185","article-title":"Dirichlet-derived multiple topic scene classification model for high spatial resolution remote sensing imagery","volume":"54","author":"Zhao","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 2\u20135). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"5194","DOI":"10.1109\/JSTARS.2020.3018307","article-title":"Branch feature fusion convolution network for remote sensing scene classification","volume":"13","author":"Shi","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"14078","DOI":"10.1109\/ACCESS.2021.3051085","article-title":"Classification of remote sensing images using EfficientNet-B3 CNN model with attention","volume":"9","author":"Alhichri","year":"2021","journal-title":"IEEE Access"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Li, L., Liang, P., Ma, J., Jiao, L., Guo, X., Liu, F., and Sun, C. (2020). A multiscale self-adaptive attention network for remote sensing scene classification. Remote Sens., 12.","DOI":"10.3390\/rs12142209"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Khan, S.D., and Basalamah, S. (2023). Multi-Branch Deep Learning Framework for Land Scene Classification in Satellite Imagery. Remote Sens., 15.","DOI":"10.3390\/rs15133408"},{"key":"ref_55","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_56","first-page":"143","article-title":"Transfer learning using vgg-16 with deep convolutional neural network for classifying images","volume":"9","author":"Tammina","year":"2019","journal-title":"Int. J. Sci. Res. Publ. IJSRP"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/20\/5044\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:09:10Z","timestamp":1760130550000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/20\/5044"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,20]]},"references-count":56,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["rs15205044"],"URL":"https:\/\/doi.org\/10.3390\/rs15205044","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,10,20]]}}}