{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,9]],"date-time":"2025-11-09T03:44:06Z","timestamp":1762659846022,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2019,11,13]],"date-time":"2019-11-13T00:00:00Z","timestamp":1573603200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2016YFC0803000"],"award-info":[{"award-number":["2016YFC0803000"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41371342","61331016"],"award-info":[{"award-number":["41371342","61331016"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Hubei Innovation Group","award":["2018CFA006"],"award-info":[{"award-number":["2018CFA006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Recently, convolutional neural networks (CNNs) achieve impressive results on remote sensing scene classification, which is a fundamental problem for scene semantic understanding. However, convolution, the most essential operation in CNNs, restricts the development of CNN-based methods for scene classification. Convolution is not efficient enough for high-resolution remote sensing images and limited in extracting discriminative features due to its linearity. Thus, there has been growing interest in improving the convolutional layer. The hardware implementation of the JPEG2000 standard relies on the lifting scheme to perform wavelet transform (WT). Compared with the convolution-based two-channel filter bank method of WT, the lifting scheme is faster, taking up less storage and having the ability of nonlinear transformation. Therefore, the lifting scheme can be regarded as a better alternative implementation for convolution in vanilla CNNs. This paper introduces the lifting scheme into deep learning and addresses the problems that only fixed and finite wavelet bases can be replaced by the lifting scheme, and the parameters cannot be updated through backpropagation. This paper proves that any convolutional layer in vanilla CNNs can be substituted by an equivalent lifting scheme. A lifting scheme-based deep neural network (LSNet) is presented to promote network applications on computational-limited platforms and utilize the nonlinearity of the lifting scheme to enhance performance. LSNet is validated on the CIFAR-100 dataset and the overall accuracies increase by 2.48% and 1.38% in the 1D and 2D experiments respectively. Experimental results on the AID which is one of the newest remote sensing scene dataset demonstrate that 1D LSNet and 2D LSNet achieve 2.05% and 0.45% accuracy improvement compared with the vanilla CNNs respectively.<\/jats:p>","DOI":"10.3390\/rs11222648","type":"journal-article","created":{"date-parts":[[2019,11,13]],"date-time":"2019-11-13T09:11:27Z","timestamp":1573636287000},"page":"2648","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Lifting Scheme-Based Deep Neural Network for Remote Sensing Scene Classification"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3662-5769","authenticated-orcid":false,"given":"Chu","family":"He","sequence":"first","affiliation":[{"name":"Electronic and Information School, Wuhan University, Wuhan 430072, China"},{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zishan","family":"Shi","sequence":"additional","affiliation":[{"name":"Electronic and Information School, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Qu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dingwen","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingsheng","family":"Liao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"14680","DOI":"10.3390\/rs71114680","article-title":"Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery","volume":"7","author":"Hu","year":"2015","journal-title":"Remote Sens."},{"key":"ref_2","unstructured":"Castelluccio, M., Poggi, G., Sansone, C., and Verdoliva, L. (2015). Land use classification in remote sensing images by convolutional neural networks. arXiv."},{"key":"ref_3","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on Machine Learning (ICML-10), Haifa, Israel."},{"key":"ref_4","unstructured":"Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16\u201321). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the International Conference on Machine Learning (ICML), Atlanta, GA, USA."},{"key":"ref_5","unstructured":"Clevert, D.A., Unterthiner, T., and Hochreiter, S. (2015). Fast and accurate deep network learning by exponential linear units (elus). arXiv."},{"key":"ref_6","unstructured":"Klambauer, G., Unterthiner, T., Mayr, A., and Hochreiter, S. (2017). Self-normalizing neural networks. Advances in Neural Information Processing Systems, Proceedings of the NIPS 2017, Long Beach, CA, USA, 4\u20139 December 2017, Neural Information Processing Systems Foundation."},{"key":"ref_7","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_8","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, B.D., Meng, J., Xie, W.Y., Shao, S., Li, Y., and Wang, Y. (2019). Weighted Spatial Pyramid Matching Collaborative Representation for Remote-Sensing-Image Scene Classification. Remote Sens., 11.","DOI":"10.3390\/rs11050518"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5653","DOI":"10.1109\/TGRS.2017.2711275","article-title":"Integrating Multilayer Features of Convolutional Neural Networks for Remote Sensing Scene Classification","volume":"55","author":"Li","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4775","DOI":"10.1109\/TGRS.2017.2700322","article-title":"Deep Feature Fusion for VHR Remote Sensing Scene Classification","volume":"55","author":"Chaib","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.patcog.2018.12.019","article-title":"Dictionaries of deep features for land-use scene classification of very high spatial resolution images","volume":"89","author":"Flores","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1109\/34.192463","article-title":"A theory for multiresolution signal decomposition: The wavelet representation","volume":"11","author":"Mallat","year":"1989","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1117\/12.217619","article-title":"Lifting scheme: A new philosophy in biorthogonal wavelet constructions","volume":"2569","author":"Sweldens","year":"1995","journal-title":"Proc. SPIE"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1006\/acha.1996.0015","article-title":"The lifting scheme: A custom-design construction of biorthogonal wavelets","volume":"3","author":"Sweldens","year":"1996","journal-title":"Appl. Comput. Harmon. Anal."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1137\/S0036141095289051","article-title":"The lifting scheme: A construction of second generation wavelets","volume":"29","author":"Sweldens","year":"1998","journal-title":"SIAM J. Math. Anal."},{"key":"ref_17","first-page":"41","article-title":"Wavelets and the lifting scheme: A 5 minute tour","volume":"76","author":"Sweldens","year":"1996","journal-title":"ZAMM-Zeitschrift fur Angewandte Mathematik und Mechanik"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sweldens, W., and Schr\u00f6der, P. (2000). Building your own wavelets at home. Wavelets in the Geosciences, Springer.","DOI":"10.1007\/BFb0011093"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1007\/BF02476026","article-title":"Factoring wavelet transforms into lifting steps","volume":"4","author":"Daubechies","year":"1998","journal-title":"J. Fourier Anal. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/79.952804","article-title":"The Jpeg 2000 Still Image Compression Standard","volume":"18","author":"Skodras","year":"2001","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1109\/ISCAS.2001.921103","article-title":"Lifting based discrete wavelet transform architecture for JPEG2000","volume":"Volume 2","author":"Lian","year":"2001","journal-title":"Proceedings of the 2001 IEEE International Symposium on Circuits and Systems (ISCAS 2001)"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1897","DOI":"10.1109\/83.877211","article-title":"Nonlinear multiresolution signal decomposition schemes. II. Morphological wavelets","volume":"9","author":"Heijmans","year":"2000","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1109\/ICASSP.1998.681737","article-title":"Adaptive wavelet transforms via lifting","volume":"Volume 3","author":"Claypoole","year":"1998","journal-title":"Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201998)"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1620","DOI":"10.1109\/TSP.2002.1011203","article-title":"Adaptive lifting schemes with perfect reconstruction","volume":"50","author":"Piella","year":"2002","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1006\/acha.1997.0238","article-title":"Wavelet transforms that map integers to integers","volume":"5","author":"Calderbank","year":"1998","journal-title":"Appl. Comput. Harmonic Analy."},{"key":"ref_26","unstructured":"Zheng, Y., Wang, R., and Li, J. (2010, January 17\u201319). Nonlinear wavelets and bp neural networks adaptive lifting scheme. Proceedings of the 2010 International Conference on Apperceiving Computing and Intelligence Analysis, Chengdu, China."},{"key":"ref_27","unstructured":"Lin, M., Chen, Q., and Yan, S. (2013). Network in network. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_29","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_31","first-page":"1","article-title":"Learning representations by back-propagating errors","volume":"5","author":"Rumelhart","year":"1988","journal-title":"Cogn. Modeling"},{"key":"ref_32","unstructured":"Oppenheim, A.V. (1999). Discrete-Time Signal Processing, Pearson Education India."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1080\/10106048709354084","article-title":"Introductory digital image processing: A remote sensing perspective","volume":"2","author":"Jensen","year":"1987","journal-title":"Geocarto Int."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1109\/TITS.2017.2750080","article-title":"Erfnet: Efficient residual factorized convnet for real-time semantic segmentation","volume":"19","author":"Romera","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_36","unstructured":"Krizhevsky, A., and Hinton, G. (2009). Learning Multiple Layers of Features from Tiny Images, Citeseer. Technical report."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3965","DOI":"10.1109\/TGRS.2017.2685945","article-title":"AID: A benchmark data set for performance evaluation of aerial scene classification","volume":"55","author":"Xia","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/22\/2648\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:34:01Z","timestamp":1760189641000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/22\/2648"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,13]]},"references-count":37,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["rs11222648"],"URL":"https:\/\/doi.org\/10.3390\/rs11222648","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,11,13]]}}}