{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:53:02Z","timestamp":1760241182877,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2019,12,3]],"date-time":"2019-12-03T00:00:00Z","timestamp":1575331200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2016YFC0803000"],"award-info":[{"award-number":["2016YFC0803000"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41371342","61331016"],"award-info":[{"award-number":["41371342","61331016"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Hubei Innovation Group","award":["2018CFA006"],"award-info":[{"award-number":["2018CFA006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In the past two decades, traditional hand-crafted feature based methods and deep feature based methods have successively played the most important role in image classification. In some cases, hand-crafted features still provide better performance than deep features. This paper proposes an innovative network based on deep learning integrated with binary coding and Sinkhorn distance (DBSNet) for remote sensing and texture image classification. The statistical texture features of the image extracted by uniform local binary pattern (ULBP) are introduced as a supplement for deep features extracted by ResNet-50 to enhance the discriminability of features. After the feature fusion, both diversity and redundancy of the features have increased, thus we propose the Sinkhorn loss where an entropy regularization term plays a key role in removing redundant information and training the model quickly and efficiently. Image classification experiments are performed on two texture datasets and five remote sensing datasets. The results show that the statistical texture features of the image extracted by ULBP complement the deep features, and the new Sinkhorn loss performs better than the commonly used softmax loss. The performance of the proposed algorithm DBSNet ranks in the top three on the remote sensing datasets compared with other state-of-the-art algorithms.<\/jats:p>","DOI":"10.3390\/rs11232870","type":"journal-article","created":{"date-parts":[[2019,12,3]],"date-time":"2019-12-03T04:58:39Z","timestamp":1575349119000},"page":"2870","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Remote Sensing and Texture Image Classification Network Based on Deep Learning Integrated with Binary Coding and Sinkhorn Distance"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3662-5769","authenticated-orcid":false,"given":"Chu","family":"He","sequence":"first","affiliation":[{"name":"School of Electronic Information, Wuhan University, Wuhan 430072, China"},{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7750-4616","authenticated-orcid":false,"given":"Qingyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Electronic Information, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Qu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dingwen","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingsheng","family":"Liao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1080\/01431160600746456","article-title":"A survey of image classification methods and techniques for improving classification performance","volume":"28","author":"Lu","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_2","unstructured":"Caicedo, J.C., Cruz, A., and Gonzalez, F.A. (2019, January 18\u201322). Histopathology image classification using bag of features and kernel functions. Proceedings of the Conference on Artificial Intelligence in Medicine in Europe, Verona, Italy."},{"key":"ref_3","unstructured":"Szummer, M., and Picard, R.W. (1998, January 3). Indoor-outdoor image classification. Proceedings of the 1998 IEEE International Workshop on Content-Based Access of Image and Video Database, Bombay, India."},{"key":"ref_4","first-page":"187","article-title":"Theory of edge detection","volume":"207","author":"Marr","year":"1980","journal-title":"Proc. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"ref_5","unstructured":"Davidson, M.W., and Abramowitz, M. (2006). Molecular Expressions Microscopy Primer: Digital Image Processing-Difference of Gaussians Edge Enhancement Algorithm, Olympus America Inc. and Florida State University."},{"key":"ref_6","unstructured":"Lowe, D.G. (\u20132, January 27). Object recognition from local scale-invariant features. Proceedings of the International Conference on Computer Vision (ICCV 2019), Seoul, Korea."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","unstructured":"F\u00f6rstner, W., and G\u00fclch, E. (1987, January 2\u20134). A fast operator for detection and precise location of distinct points, corners and centres of circular features. Proceedings of the ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yang, J., Jiang, Y.G., Hauptmann, A.G., and Ngo, C.W. (2007, January 24\u201329). Evaluating bag-of-visual-words representations in scene classification. Proceedings of the International Workshop on Workshop on Multimedia Information Retrieval, Augsburg, Germany.","DOI":"10.1145\/1290082.1290111"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Perronnin, F., S\u00e1nchez, J., and Mensink, T. (2010, January 5\u201311). Improving the fisher kernel for large-scale image classification. Proceedings of the European Conference on Computer Vision, Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_11"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2037","DOI":"10.1109\/TPAMI.2006.244","article-title":"Face description with local binary patterns: Application to face recognition","volume":"28","author":"Ahonen","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2557","DOI":"10.1109\/TIP.2014.2316640","article-title":"Combining LBP difference and feature correlation for texture description","volume":"23","author":"Hong","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1368","DOI":"10.1109\/TIP.2016.2522378","article-title":"Median robust extended local binary pattern for texture classification","volume":"25","author":"Liu","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","unstructured":"Hong, X., Xu, Y., and Zhao, G. (2016, January 20\u201324). Lbp-top: A tensor unfolding revisit. Proceedings of the Asian Conference on Computer Vision, Taipei, Taiwan."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1134\/S1054661816010065","article-title":"A survey of deep learning methods and software tools for image classification and object detection","volume":"26","author":"Druzhkov","year":"2016","journal-title":"Pattern Recognit. Image Anal."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"042609","DOI":"10.1117\/1.JRS.11.042609","article-title":"Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community","volume":"11","author":"Ball","year":"2017","journal-title":"J. Appl. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_18","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"LeCun, Y., Kavukcuoglu, K., and Farabet, C. (June, January 30). Convolutional networks and applications in vision. Proceedings of the 2010 IEEE International Symposium on Circuits and Systems, Paris, France.","DOI":"10.1109\/ISCAS.2010.5537907"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, L., Fieguth, P., Wang, X., Pietik\u00e4inen, M., and Hu, D. (2016, January 8\u201316). Evaluation of LBP and deep texture descriptors with a new robustness benchmark. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_5"},{"key":"ref_22","unstructured":"Courbariaux, M., Bengio, Y., and David, J.P. (2015). Binaryconnect: Training deep neural networks with binary weights during propagations. Advances in Neural Information Processing Systems, Curran Associates."},{"key":"ref_23","unstructured":"Hubara, I., Courbariaux, M., Soudry, D., El-Yaniv, R., and Bengio, Y. (2016). Binarized neural networks. Advances in Neural Information Processing Systems, Curran Associates."},{"key":"ref_24","first-page":"1","article-title":"Survey on multiclass classification methods","volume":"19","author":"Aly","year":"2005","journal-title":"Neural Netw."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wen, Y., Zhang, K., Li, Z., and Qiao, Y. (2016, January 8\u201316). A discriminative feature learning approach for deep face recognition. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46478-7_31"},{"key":"ref_26","unstructured":"Liu, W., Wen, Y., Yu, Z., and Yang, M. (2016, January 19\u201324). Large-margin softmax loss for convolutional neural networks. Proceedings of the 2016 International Conference on Machine Learning (ICML 2016), New York, NY, USA."},{"key":"ref_27","unstructured":"Cuturi, M. (2013). Sinkhorn distances: Lightspeed computation of optimal transport. Advances in Neural Information Processing Systems, Curran Associates."},{"key":"ref_28","unstructured":"Rubner, Y., Tomasi, C., and Guibas, L.J. (1998, January 7). A metric for distributions with applications to image databases. Proceedings of the Sixth International Conference on Computer Vision (IEEE Cat. No. 98CH36271), Bombay, India."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3634","DOI":"10.1016\/j.eswa.2011.09.054","article-title":"Survey on LBP based texture descriptors for image classification","volume":"39","author":"Nanni","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1109\/JPROC.2017.2675998","article-title":"Remote sensing image scene classification: Benchmark and state of the art","volume":"105","author":"Cheng","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., and Liu, W. (2018, January 18\u201323). Cosface: Large margin cosine loss for deep face recognition. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00552"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, C., He, B., Liu, X., Kang, C., and Liao, M. (2019). Statistics Learning Network Based on the Quadratic Form for SAR Image Classification. Remote Sens., 11.","DOI":"10.3390\/rs11030282"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/TPAMI.2006.68","article-title":"A texture-based method for modeling the background and detecting moving objects","volume":"28","author":"Heikkila","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1109\/TPAMI.2007.1110","article-title":"Dynamic texture recognition using local binary patterns with an application to facial expressions","volume":"29","author":"Zhao","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_36","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Maaten","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3965","DOI":"10.1109\/TGRS.2017.2685945","article-title":"AID: A benchmark data set for performance evaluation of aerial scene classification","volume":"55","author":"Xia","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2321","DOI":"10.1109\/LGRS.2015.2475299","article-title":"Deep learning based feature selection for remote sensing scene classification","volume":"12","author":"Zou","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 2\u20135). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2395","DOI":"10.1080\/01431161.2011.608740","article-title":"High-resolution satellite scene classification using a sparse coding based multiple feature combination","volume":"33","author":"Sheng","year":"2012","journal-title":"Int.l J. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.1109\/TGRS.2018.2864987","article-title":"Scene classification with recurrent attention of VHR remote sensing images","volume":"57","author":"Wang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014, January 3\u20137). Caffe: Convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM International Conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Sun, H., Li, S., Zheng, X., and Lu, X. (2019). Remote Sensing Scene Classification by Gated Bidirectional Network. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2019.2931801"},{"key":"ref_44","first-page":"1871","article-title":"LIBLINEAR: A library for large linear classification","volume":"9","author":"Fan","year":"2008","journal-title":"J. Mach. Learn. Res."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/23\/2870\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:39:36Z","timestamp":1760189976000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/23\/2870"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,3]]},"references-count":44,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["rs11232870"],"URL":"https:\/\/doi.org\/10.3390\/rs11232870","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,12,3]]}}}