{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T15:33:28Z","timestamp":1760369608628,"version":"build-2065373602"},"reference-count":64,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2020,3,29]],"date-time":"2020-03-29T00:00:00Z","timestamp":1585440000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001602","name":"Science Foundation Ireland","doi-asserted-by":"publisher","award":["SFI\/12\/RC\/2289-P2"],"award-info":[{"award-number":["SFI\/12\/RC\/2289-P2"]}],"id":[{"id":"10.13039\/501100001602","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Scene classification is an important aspect of image\/video understanding and segmentation. However, remote-sensing scene classification is a challenging image recognition task, partly due to the limited training data, which causes deep-learning Convolutional Neural Networks (CNNs) to overfit. Another difficulty is that images often have very different scales and orientation (viewing angle). Yet another is that the resulting networks may be very large, again making them prone to overfitting and unsuitable for deployment on memory- and energy-limited devices. We propose an efficient deep-learning approach to tackle these problems. We use transfer learning to compensate for the lack of data, and data augmentation to tackle varying scale and orientation. To reduce network size, we use a novel unsupervised learning approach based on k-means clustering, applied to all parts of the network: most network reduction methods use computationally expensive supervised learning methods, and apply only to the convolutional or fully connected layers, but not both. In experiments, we set new standards in classification accuracy on four remote-sensing and two scene-recognition image datasets.<\/jats:p>","DOI":"10.3390\/rs12071092","type":"journal-article","created":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T03:44:13Z","timestamp":1585712653000},"page":"1092","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["PulseNetOne: Fast Unsupervised Pruning of Convolutional Neural Networks for Remote Sensing"],"prefix":"10.3390","volume":"12","author":[{"given":"David","family":"Browne","sequence":"first","affiliation":[{"name":"Insight Centre for Data Analytics, University College Cork, Cork City T12 XF62, Ireland"}]},{"given":"Michael","family":"Giering","sequence":"additional","affiliation":[{"name":"United Technologies Research Centre, Penrose Wharf Business Centre, Penrose Quay, Cork City T23 XN53, Ireland"}]},{"given":"Steven","family":"Prestwich","sequence":"additional","affiliation":[{"name":"Insight Centre for Data Analytics, University College Cork, Cork City T12 XF62, Ireland"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Penatti, O.A., Nogueira, K., and Dos Santos, J.A. (2015, January 7\u201312). Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?. Proceedings of the IEEE conference on computer vision and pattern recognition workshops, Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301382"},{"key":"ref_2","unstructured":"dos Santos, J.A., Penatti, O.A.B., and da Silva Torres, R. (2010, January 17\u201321). Evaluating the Potential of Texture and Color Descriptors for Remote Sensing Image Retrieval and Classification. Proceedings of the Fifth International Conference on Computer Vision Theory and Applications, VISAPP (2), Angers, France."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Khan, N.Y., McCane, B., and Wyvill, G. (2011, January 6\u20138). SIFT and SURF performance evaluation against various image deformations on benchmark dataset. Proceedings of the IEEE 2011 International Conference on Digital Image Computing: Techniques and Applications, Noosa, Australia.","DOI":"10.1109\/DICTA.2011.90"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Cheng, G., Zhou, P., Yao, X., Yao, C., Zhang, Y., and Han, J. (2016, January 4\u20136). Object detection in VHR optical remote sensing images via learning rotation-invariant HOG feature. Proceedings of the IEEE 2016 4th International Workshop on Earth Observation and Remote Sensing Applications (EORSA), Guangzhou, China.","DOI":"10.1109\/EORSA.2016.7552845"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1109\/LGRS.2015.2402391","article-title":"A comparative study of bag-of-words and bag-of-topics models of EO image patches","volume":"12","author":"Bahmanyar","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Huang, L., Chen, C., Li, W., and Du, Q. (2016). Remote sensing image scene classification using multi-scale completed local binary patterns and fisher vectors. Remote Sens., 8.","DOI":"10.3390\/rs8060483"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.isprsjprs.2016.03.004","article-title":"A spectral\u2013Structural bag-of-features scene classifier for very high spatial resolution remote sensing imagery","volume":"116","author":"Zhao","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1109\/LGRS.2015.2513443","article-title":"Bag-of-visual-words scene classifier with local and global features for high spatial resolution remote sensing imagery","volume":"13","author":"Zhu","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1793","DOI":"10.1109\/TGRS.2015.2488681","article-title":"Scene classification via a gradient boosting random convolutional network framework","volume":"54","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_11","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, CA, USA."},{"key":"ref_12","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gong, Y., Wang, L., Guo, R., and Lazebnik, S. (2014). Multi-scale orderless pooling of deep convolutional activation features. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-10584-0_26"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zuo, Z., Wang, G., Shuai, B., Zhao, L., Yang, Q., and Jiang, X. (2014). Learning discriminative and shareable features for scene classification. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-10590-1_36"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, R., Wang, B., Wang, W., and Yu, Y. (2015, January 21). Harvesting discriminative meta objects with deep CNN features for scene classification. Proceedings of the IEEE International Conference on Computer Vision, Beijing, China.","DOI":"10.1109\/ICCV.2015.152"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Herranz, L., Jiang, S., and Li, X. (2016, January 27\u201330). Scene recognition with CNNs: Objects, scales and dataset bias. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.68"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1109\/TGRS.2013.2241444","article-title":"Unsupervised feature learning for aerial scene classification","volume":"52","author":"Cheriyadat","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_20","unstructured":"Csurka, G., Dance, C., Fan, L., Willamowski, J., and Bray, C. (2004, January 11\u201314). Visual categorization with bags of keypoints. Proceedings of the Workshop on Statistical Learning in Computer Vision, ECCV, Prague, Czech Republic."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2889","DOI":"10.1109\/JSTARS.2017.2683799","article-title":"Fusing local and global features for high-resolution scene classification","volume":"10","author":"Bian","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_22","first-page":"1967","article-title":"Semi-supervised multitask learning for scene recognition","volume":"45","author":"Lu","year":"2014","journal-title":"IEEE Trans. Cybern."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1007\/s11760-015-0804-2","article-title":"Land-use scene classification using multi-scale completed local binary patterns","volume":"10","author":"Chen","year":"2016","journal-title":"Signal Image Video Process."},{"key":"ref_24","unstructured":"Lazebnik, S., Schmid, C., and Ponce, J. (2006, January 17\u201322). Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2008, January 12\u201315). Comparing SIFT descriptors and Gabor texture features for classification of remote sensed imagery. Proceedings of the 2008 15th IEEE International Conference on Image Processing, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4712139"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/TGRS.2017.2743243","article-title":"Learning multiscale deep features for high-resolution satellite image scene classification","volume":"56","author":"Liu","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2395","DOI":"10.1080\/01431161.2011.608740","article-title":"High-resolution satellite scene classification using a sparse coding based multiple feature combination","volume":"33","author":"Sheng","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2175","DOI":"10.1109\/TGRS.2014.2357078","article-title":"Saliency-guided unsupervised feature learning for scene classification","volume":"53","author":"Zhang","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2811","DOI":"10.1109\/TGRS.2017.2783902","article-title":"When deep learning meets metric learning: Remote sensing image scene classification via learning discriminative CNNs","volume":"56","author":"Cheng","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Seong, H., Hyun, J., and Kim, E. (2019). FOSNet: An End-to-End Trainable Deep Neural Network for Scene Recognition. arXiv.","DOI":"10.1109\/ACCESS.2020.2989863"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.ins.2016.02.021","article-title":"Scene classification using local and global features with collaborative representation fusion","volume":"348","author":"Zou","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Han, X., Zhong, Y., Cao, L., and Zhang, L. (2017). Pre-trained alexnet architecture with pyramid pooling and supervision for high spatial resolution remote sensing image scene classification. Remote Sens., 9.","DOI":"10.3390\/rs9080848"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.neucom.2016.11.023","article-title":"G-MS2F: GoogLeNet based multi-stage feature fusion of deep CNN for scene recognition","volume":"225","author":"Tang","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, B.D., Xie, W.Y., Meng, J., Li, Y., and Wang, Y. (2018). Hybrid collaborative representation for remote-sensing image scene classification. Remote Sens., 10.","DOI":"10.3390\/rs10121934"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, W., Tang, P., and Zhao, L. (2019). Remote Sensing Image Scene Classification Using CNN-CapsNet. Remote Sens., 11.","DOI":"10.3390\/rs11050494"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4775","DOI":"10.1109\/TGRS.2017.2700322","article-title":"Deep feature fusion for VHR remote sensing scene classification","volume":"55","author":"Chaib","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2437","DOI":"10.1016\/j.patcog.2004.12.013","article-title":"A new method of feature fusion and its application in image recognition","volume":"38","author":"Sun","year":"2005","journal-title":"Pattern Recognit."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zeng, H., and Chen, G. (2019). Scene Recognition with Comprehensive Regions Graph Modeling. International Conference on Image and Graphics, Springer.","DOI":"10.1007\/978-3-030-34113-8_52"},{"key":"ref_39","unstructured":"Kipf, T.N., and Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.eswa.2017.11.028","article-title":"A new image classification method using CNN transfer learning and web data augmentation","volume":"95","author":"Han","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1016\/j.patcog.2016.07.001","article-title":"Towards better exploiting convolutional neural networks for remote sensing scene classification","volume":"61","author":"Nogueira","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Browne, B., Giering, G., and Prestwich, P. (2019, January 15\u201318). Pulse-Net: Dynamic Compression of Convolutional Neural Networks. Proceedings of the 2019 IEEE 5th World Forum on Internet of Things (WF-IoT), Limerick, Ireland.","DOI":"10.1109\/WF-IoT.2019.8767300"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 4\u20136). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, Seattle, WA, USA.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1109\/JPROC.2017.2675998","article-title":"Remote sensing image scene classification: Benchmark and state of the art","volume":"105","author":"Cheng","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Xiao, J., Hays, J., Ehinger, K.A., Oliva, A., and Torralba, A. (2010, January 13\u201318). Sun database: Large-scale scene recognition from abbey to zoo. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539970"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Quattoni, A., and Torralba, A. (2009, January 20\u201325). Recognizing indoor scenes. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206537"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"3965","DOI":"10.1109\/TGRS.2017.2685945","article-title":"AID: A benchmark data set for performance evaluation of aerial scene classification","volume":"55","author":"Xia","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Chen, G., Zhang, X., Tan, X., Cheng, Y., Dai, F., Zhu, K., Gong, Y., and Wang, Q. (2018). Training small networks for scene classification of remote sensing images via knowledge distillation. Remote Sens., 10.","DOI":"10.3390\/rs10050719"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Yu, Y., and Liu, F. (2018). A two-stream deep fusion framework for high-resolution aerial scene classification. Comput. Intell. Neurosci., 2018.","DOI":"10.1155\/2018\/8639367"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1715","DOI":"10.1109\/TCSVT.2018.2848543","article-title":"Fusing Object Semantics and Deep Appearance Features for Scene Recognition","volume":"29","author":"Sun","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Margolin, R., Zelnik-Manor, L., and Tal, A. (2014). Otc: A novel local descriptor for scene classification. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-10584-0_25"},{"key":"ref_52","unstructured":"Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., and Oliva, A. (2014, January 8\u201313). Learning deep features for scene recognition using places database. Proceedings of the Advances in neural information processing systems, Montreal, QC, Canada."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, CA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_54","unstructured":"Gao, B.B., Wei, X.S., Wu, J., and Lin, W. (2015). Deep spatial pyramid: The devil is once again in the details. arXiv."},{"key":"ref_55","unstructured":"Xie, L., Zheng, L., Wang, J., Yuille, A.L., and Tian, Q. (July, January 26). Interactive: Inter-layer activeness propagation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"2721","DOI":"10.1109\/TIP.2017.2686017","article-title":"Multi-scale multi-feature context modeling for scene recognition in the semantic manifold","volume":"26","author":"Song","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Nascimento, G., Laranjeira, C., Braz, V., Lacerda, A., and Nascimento, E.R. (2017). A robust indoor scene recognition method based on sparse representation. Iberoamerican Congress on Pattern Recognition, Springer.","DOI":"10.1007\/978-3-319-75193-1_49"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Li, Y., Dixit, M., and Vasconcelos, N. (2017, January 22\u201329). Deep scene image classification with the MFAFVNet. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.613"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1109\/JSTARS.2017.2761800","article-title":"Scene classification via triplet networks","volume":"11","author":"Liu","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Zhao, Z., and Larson, M. (2018). From Volcano to Toyshop: Adaptive Discriminative Region Discovery for Scene Recognition. arXiv.","DOI":"10.1145\/3240508.3240698"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"025006","DOI":"10.1117\/1.JRS.10.025006","article-title":"Large patch convolutional neural networks for the scene classification of high spatial resolution imagery","volume":"10","author":"Zhong","year":"2016","journal-title":"J. Appl. Remote Sens."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"2448","DOI":"10.1109\/LGRS.2015.2483680","article-title":"Multiview deep learning for land-use classification","volume":"12","author":"Luus","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/LGRS.2015.2499239","article-title":"Deep learning earth observation classification using ImageNet pretrained networks","volume":"13","author":"Marmanis","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"14680","DOI":"10.3390\/rs71114680","article-title":"Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery","volume":"7","author":"Hu","year":"2015","journal-title":"Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/7\/1092\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:13:01Z","timestamp":1760173981000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/7\/1092"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,29]]},"references-count":64,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["rs12071092"],"URL":"https:\/\/doi.org\/10.3390\/rs12071092","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,3,29]]}}}