{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T20:05:12Z","timestamp":1787169912487,"version":"3.56.0"},"reference-count":54,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T00:00:00Z","timestamp":1600819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41871225"],"award-info":[{"award-number":["41871225"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Although efforts and progress have been made in crop classification using optical remote sensing images, it is still necessary to make full use of the high spatial, temporal, and spectral resolutions of remote sensing images. However, with the increasing volume of remote sensing data, a key emerging issue in the field of crop classification is how to find useful information from massive data to balance classification accuracy and processing time. To address this challenge, we developed a novel crop classification method, combining optimal feature selection (OFSM) with hybrid convolutional neural network-random forest (CNN-RF) networks for multi-temporal optical remote sensing images. This research used 234 features including spectral, segmentation, color, and texture features from three scenes of Sentinel-2 images to identify crop types in the Jilin province of northeast China. To effectively extract the effective features of remote sensing data with lower time requirements, the use of OFSM was proposed with the results compared with two traditional feature selection methods (TFSM): random forest feature importance selection (RF-FI) and random forest recursive feature elimination (RF-RFE). Although the time required for OFSM was 26.05 s, which was between RF-FI with 1.97 s and RF-RFE with 132.54 s, OFSM outperformed RF-FI and RF-RFE in terms of the overall accuracy (OA) of crop classification by 4% and 0.3%, respectively. On the basis of obtaining effective feature information, to further improve the accuracy of crop classification we designed two hybrid CNN-RF networks to leverage the advantages of one-dimensional convolution (Conv1D) and Visual Geometry Group (VGG) with random forest (RF), respectively. Based on the selected optimal features using OFSM, four networks were tested for comparison: Conv1D-RF, VGG-RF, Conv1D, and VGG. Conv1D-RF achieved the highest OA at 94.27% as compared with VGG-RF (93.23%), Conv1D (92.59%), and VGG (91.89%), indicating that the Conv1D-RF method with optimal feature input provides an effective and efficient method of time series representation for multi-temporal crop-type classification.<\/jats:p>","DOI":"10.3390\/rs12193119","type":"journal-article","created":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T09:28:08Z","timestamp":1600853288000},"page":"3119","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":103,"title":["Crop Classification Method Based on Optimal Feature Selection and Hybrid CNN-RF Networks for Multi-Temporal Remote Sensing Imagery"],"prefix":"10.3390","volume":"12","author":[{"given":"Shuting","family":"Yang","sequence":"first","affiliation":[{"name":"College of Electronic Science &amp; Engineering, Jilin University, Changchun 130012, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lingjia","family":"Gu","sequence":"additional","affiliation":[{"name":"College of Electronic Science &amp; Engineering, Jilin University, Changchun 130012, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7302-8042","authenticated-orcid":false,"given":"Xiaofeng","family":"Li","sequence":"additional","affiliation":[{"name":"Northeast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun 130102, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tao","family":"Jiang","sequence":"additional","affiliation":[{"name":"Northeast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun 130102, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruizhi","family":"Ren","sequence":"additional","affiliation":[{"name":"College of Electronic Science &amp; Engineering, Jilin University, Changchun 130012, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.agrformet.2013.01.007","article-title":"Forecasting crop yield using remotely sensed vegetation indices and crop phenology metrics","volume":"173","author":"Bolton","year":"2013","journal-title":"Agric. For. Meteorol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.rse.2018.02.045","article-title":"A high-performance and in-season classification system of field-level crop types using time-series Landsat data and a machine learning approach","volume":"210","author":"Cai","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ji, S., Zhang, C., Xu, A., Shi, Y., and Duan, Y. (2018). 3D convolutional neural networks for crop classification with multi-temporal remote sensing images. Remote Sens., 10.","DOI":"10.3390\/rs10010075"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2903","DOI":"10.1016\/j.rse.2006.11.021","article-title":"Analysis of time-series MODIS 250 m vegetation index data for crop classification in the US Central Great Plains","volume":"108","author":"Wardlow","year":"2007","journal-title":"Remote Sens. Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1654","DOI":"10.2134\/agronj2007.0170","article-title":"Corn and soybean mapping in the United States using MODIS time-series data sets","volume":"99","author":"Chang","year":"2007","journal-title":"Agron. J."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4502","DOI":"10.1080\/01431161.2011.649864","article-title":"Multi-scale object-based image analysis and feature selection of multi-sensor earth observation imagery using random forests","volume":"33","author":"Duro","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zheng, H., Yuan, J., and Chen, L. (2017). Short-term load forecasting using EMD-LSTM neural networks with a Xgboost algorithm for feature importance evaluation. Energies, 10.","DOI":"10.3390\/en10081168"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.snb.2015.02.025","article-title":"Feature selection and analysis on correlated gas sensor data with recursive feature elimination","volume":"212","author":"Yan","year":"2015","journal-title":"Sens. Actuators B Chem."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"5347","DOI":"10.3390\/rs70505347","article-title":"Feature selection of time series MODIS data for early crop classification using random forest: A case study in Kansas, USA","volume":"7","author":"Hao","year":"2015","journal-title":"Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yin, L., You, N., Zhang, G., Huang, J., and Dong, J. (2020). Optimizing Feature Selection of Individual Crop Types for Improved Crop Mapping. Remote Sens., 12.","DOI":"10.3390\/rs12010162"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1007\/s12517-020-5145-y","article-title":"Preliminary tests on the performance of MLC-RFE and SVM-RFE in Lansat-8 image classification","volume":"13","author":"Liu","year":"2020","journal-title":"Arab. J. Geosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2227","DOI":"10.1080\/01431160701395203","article-title":"Crop classification by support vector machine with intelligently selected training data for an operational application","volume":"29","author":"Mathur","year":"2008","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ahmad, I., Siddiqi, M.H., Fatima, I., Lee, S., and Lee, Y.K. (2011, January 21\u201323). Weed classification based on Haar wavelet transform via k-nearest neighbor (k-NN) for real-time automatic sprayer control system. Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication, Seoul, Korea.","DOI":"10.1145\/1968613.1968634"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4871","DOI":"10.1080\/0143116031000070490","article-title":"Classification of wheat crop with multi-temporal images: Performance of maximum likelihood and artificial neural networks","volume":"24","author":"Murthy","year":"2003","journal-title":"Int. J. Remote Sens."},{"key":"ref_15","unstructured":"Chen, T., He, T., Benesty, M., Khotilovich, V., and Tang, Y. (2017, January 01). Xgboost: Extreme Gradient Boosting. Available online: Cran.fhcrc.org\/web\/packages\/xgboost\/vignettes\/xgboost.pdf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1016\/S0034-4257(97)00049-7","article-title":"Decision tree classification of land cover from remotely sensed data","volume":"61","author":"Friedl","year":"1997","journal-title":"Remote Sens. Environ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.compag.2015.05.001","article-title":"Crop classification of upland fields using Random forest of time-series Landsat 7 ETM+ data","volume":"115","author":"Tatsumi","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1604","DOI":"10.1080\/2150704X.2015.1019015","article-title":"Comparison of support vector machine, artificial neural network, and spectral angle mapper algorithms for crop classification using LISS IV data","volume":"36","author":"Kumar","year":"2015","journal-title":"Int. J. Remote Sens."},{"key":"ref_19","first-page":"102032","article-title":"Crop classification from full-year fully-polarimetric L-band UAVSAR time-series using the Random Forest algorithm","volume":"87","author":"Li","year":"2020","journal-title":"Int. J. Appl. Earth Obs."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, H., Eziz, A., Xiao, J., Tao, S., Wang, S., Tang, Z., and Fang, J. (2019). High-Resolution Vegetation Mapping Using Extreme Gradient Boosting Based on Extensive Features. Remote Sens., 11.","DOI":"10.3390\/rs11121505"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1109\/TGRS.2015.2478379","article-title":"Unsupervised deep feature extraction for remote sensing image classification","volume":"54","author":"Romero","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","unstructured":"Castelluccio, M., Poggi, G., Sansone, C., and Verdoliva, L. (2015, August 14). Land Use Classification in Remote Sensing Images by Convolutional Neural Networks. Available online: http:\/\/arxiv.org\/abs\/1508.00092."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1109\/TGRS.2017.2756851","article-title":"Multisource remote sensing data classification based on convolutional neural network","volume":"56","author":"Xu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","first-page":"551","article-title":"Multi-Temporal Land Cover Classification with Long Short-Term Memory Neural Networks","volume":"42","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ru\u00dfwurm, M., and K\u00f6rner, M. (2017, January 21\u201326). Temporal Vegetation Modelling Using Long Short-Term Memory Networks for Crop Identification from Medium-Resolution Multi-spectral Satellite Images. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.193"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1016\/j.rse.2018.11.032","article-title":"Deep learning based multi-temporal crop classification","volume":"221","author":"Zhong","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Guidici, D., and Clark, M. (2017). One-Dimensional convolutional neural network land-cover classification of multi-seasonal hyperspectral imagery in the San Francisco Bay Area, California. Remote Sens., 9.","DOI":"10.3390\/rs9060629"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3606","DOI":"10.1016\/j.eswa.2012.12.067","article-title":"Single Classifier-based Multiple Classification Scheme for weak classifiers: An experimental comparison","volume":"40","author":"Ko","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_29","first-page":"597","article-title":"Textural and contextual land-cover classification using single and multiple classifier systems","volume":"68","author":"Debeir","year":"2002","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2291","DOI":"10.1109\/TGRS.2002.802476","article-title":"Multiple classifiers applied to multisource remote sensing data","volume":"40","author":"Briem","year":"2002","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4764","DOI":"10.3390\/s120404764","article-title":"Multiple classifier system for remote sensing image classification: A review","volume":"12","author":"Du","year":"2012","journal-title":"Sensors"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhou, Z.H. (2015). Ensemble learning. Encyclopedia of Biometrics, Springer.","DOI":"10.1007\/978-1-4899-7488-4_293"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Leng, J., Li, T., Bai, G., Dong, Q., and Dong, H. (2016, January 6\u20138). Cube-CNN-SVM: A novel hyperspectral image classification method. Proceedings of the 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI), San Jose, CA, USA.","DOI":"10.1109\/ICTAI.2016.0158"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Immitzer, M., Vuolo, F., and Atzberger, C. (2016). First Experience with Sentinel-2 Data for Crop and Tree Species Classifications in Central Europe. Remote Sens., 8.","DOI":"10.3390\/rs8030166"},{"key":"ref_35","first-page":"122","article-title":"How much does multi-temporal Sentinel-2 data improve crop type classification?","volume":"72","author":"Vuolo","year":"2018","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"925","DOI":"10.13031\/trans.59.11489","article-title":"Quantification and mapping of surface residue cover for maize and soybean fields in south central Nebraska","volume":"59","author":"Sharma","year":"2016","journal-title":"Trans. ASABE"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1023\/B:VISI.0000022288.19776.77","article-title":"Efficient graph-based image segmentation","volume":"59","author":"Felzenszwalb","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1109\/83.597279","article-title":"A study of efficiency and accuracy in the transformation from RGB to CIELAB color space","volume":"6","author":"Connolly","year":"1997","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1016\/j.rse.2011.01.009","article-title":"Object-based crop identification using multiple vegetation indices, textural features and crop phenology","volume":"115","author":"Ngugi","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_40","first-page":"1682","article-title":"Texture feature extraction for classification of remote sensing data using wavelet decomposition: A comparative study","volume":"XXXV","author":"Ruiz","year":"2004","journal-title":"Int. Arch. Photogramm. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"19","DOI":"10.32614\/RJ-2015-018","article-title":"VSURF: An R Package for variable selection using random forests","volume":"7","author":"Genuer","year":"2015","journal-title":"R J."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.chemolab.2006.01.007","article-title":"Recursive feature elimination with random forest for PTR-MS analysis of agroindustrial products","volume":"83","author":"Granitto","year":"2006","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1080\/01621459.1972.10481251","article-title":"Significance testing of the spearman rank correlation coefficient","volume":"67","author":"Zar","year":"1972","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Khare, S., Bhandari, A., Singh, S., and Arora, A. (2011, January 20\u201322). ECG arrhythmia classification using spearman rank correlation and support vector machine. Proceedings of the International Conference on Soft Computing for Problem Solving (SocProS 2011), Roorkee, India.","DOI":"10.1007\/978-81-322-0491-6_54"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sengupta, A., Ye, Y., Wang, R., Liu, C., and Roy, K. (2019). Going deeper in spiking neural networks: VGG and residual architectures. Front. Neurosci., 13.","DOI":"10.3389\/fnins.2019.00095"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Mateen, M., Wen, J., Song, S., and Huang, Z. (2019). Fundus image classification using VGG-19 architecture with PCA and SVD. Symmetry, 11.","DOI":"10.3390\/sym11010001"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1109\/JSTARS.2019.2953234","article-title":"Very High Resolution Remote Sensing Imagery Classification Using a Fusion of Random Forest and Deep Learning Technique\u2014Subtropical Area for Example","volume":"13","author":"Dong","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Fu, G., Liu, C., Zhou, R., Sun, T., and Zhang, Q. (2017). Classification for high resolution remote sensing imagery using a fully convolutional network. Remote Sens., 9.","DOI":"10.3390\/rs9050498"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Punia, S., Nikolopoulos, K., Singh, S.P., Madaan, J.K., and Litsiou, K. (2020). Deep learning with long short-term memory networks and random forests for demand forecasting in multi-channel retail. Int. J. Prod. Res., 1\u201316.","DOI":"10.1080\/00207543.2020.1735666"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.neucom.2019.01.090","article-title":"A novel scene classification model combining ResNet based transfer learning and data augmentation with a filter","volume":"338","author":"Liu","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Rakhlin, A., Davydow, A., and Nikolenko, S. (2018, January 18\u201322). Land Cover Classification from Satellite Imagery with U-Net and Lovasz-Softmax Loss. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00048"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"778","DOI":"10.1109\/LGRS.2017.2681128","article-title":"Deep learning classification of land cover and crop types using remote sensing data","volume":"14","author":"Kussul","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.isprsjprs.2016.05.014","article-title":"Automated mapping of soybean and corn using phenology","volume":"119","author":"Zhong","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2013.08.023","article-title":"Efficient corn and soybean mapping with temporal extendability: A multi-year experiment using Landsat imagery","volume":"140","author":"Zhong","year":"2014","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/19\/3119\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:12:50Z","timestamp":1760177570000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/19\/3119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,23]]},"references-count":54,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["rs12193119"],"URL":"https:\/\/doi.org\/10.3390\/rs12193119","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,23]]}}}