{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T03:19:45Z","timestamp":1780543185976,"version":"3.54.1"},"reference-count":51,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2019,7,13]],"date-time":"2019-07-13T00:00:00Z","timestamp":1562976000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No.11472090"],"award-info":[{"award-number":["No.11472090"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Manned Space Advance Research Fund","award":["No.060101"],"award-info":[{"award-number":["No.060101"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Accurate classification and identification of the detected terrain is the basis for the long-distance patrol mission of the planetary rover. But terrain measurement based on vision and radar is subject to conditions such as light changes and dust storms. In this paper, under the premise of not increasing the sensor load of the existing rover, a terrain classification and recognition method based on vibration is proposed. Firstly, the time-frequency domain transformation of vibration information is realized by fast Fourier transform (FFT), and the characteristic representation of vibration information is given. Secondly, a deep neural network based on multi-layer perception is designed to realize classification of different terrains. Finally, combined with the Jackal unmanned vehicle platform, the XQ unmanned vehicle platform, and the vibration sensor, the terrain classification comparison test based on five different terrains was completed. The results show that the proposed algorithm has higher classification accuracy, and different platforms and running speeds have certain influence on the terrain classification at the same time, which provides support for subsequent practical applications.<\/jats:p>","DOI":"10.3390\/s19143102","type":"journal-article","created":{"date-parts":[[2019,7,15]],"date-time":"2019-07-15T04:55:27Z","timestamp":1563166527000},"page":"3102","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":48,"title":["Deep Multi-Layer Perception Based Terrain Classification for Planetary Exploration Rovers"],"prefix":"10.3390","volume":"19","author":[{"given":"Chengchao","family":"Bai","sequence":"first","affiliation":[{"name":"School of Astronautics, Harbin Institute of Technology, Harbin 150000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jifeng","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Astronautics, Harbin Institute of Technology, Harbin 150000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linli","family":"Guo","sequence":"additional","affiliation":[{"name":"China Aerospace Science and Technology Corporation, Beijing 100000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junlin","family":"Song","sequence":"additional","affiliation":[{"name":"School of Astronautics, Harbin Institute of Technology, Harbin 150000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ellery, A. (2016). Planetary Rovers\u2014Robotics Exploration of the Solar System, Springer.","DOI":"10.1007\/978-3-642-03259-2"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wong, C., Yang, E., Yan, X., and Gu, D. (2017, January 24\u201327). Adaptive and intelligent navigation of autonomous planetary rovers\u2014A survey. Proceedings of the NASA\/ESA Conference on Adaptive Hardware and Systems, Pasadena, CA, USA.","DOI":"10.1109\/AHS.2017.8046384"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bai, C., Guo, J., and Zheng, H. (2019). High-precision navigation and positioning of celestial exploration rover based on depth camera. Aircr. Eng. Aerosp. Technol.","DOI":"10.1108\/AEAT-09-2017-0200"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bai, C., and Guo, J. (2019). Uncertainty-based vibration\/gyro composite planetary terrain mapping. Sensors, 19.","DOI":"10.3390\/s19122681"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1109\/TSMC.1976.5408777","article-title":"A comparative study of texture measures for terrain classification","volume":"4","author":"Weszka","year":"1976","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_6","unstructured":"Otte, S., Laible, S., Hanten, R., Liwicki, M., and Zell, A. (2015, January 22\u201324). Robust visual terrain classification with recurrent neural networks. Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium."},{"key":"ref_7","unstructured":"Zelter, F. (2016). Autonomous terrain classification through unsupervised learning. [Master Thesis, University of Wurzburg]."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rothrock, B., Papon, J., Kennedy, R., Ono, M., and Heverly, M. (2016, January 9). SPOC: Deep learning-based terrain classification for mars rover missions. Proceedings of the AIAA Space Forum, Long Beach, CA, USA.","DOI":"10.2514\/6.2016-5539"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"He, C., Liu, X., Feng, D., Shi, B., Luo, B., and Liao, M. (2017). Hierarchical terrain classification based on multilayer Bayesian network and conditional random field. Remote Sens., 9.","DOI":"10.3390\/rs9010096"},{"key":"ref_10","first-page":"1","article-title":"Optimum pipeline for visual terrain classification using improved bag of visual words and fusion methods","volume":"10","author":"Wu","year":"2017","journal-title":"J. Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1002\/rob.20134","article-title":"Natural terrain classification using three-dimensional ladar data for ground robot mobility","volume":"23","author":"Lalonde","year":"2006","journal-title":"J. Field Robot."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Suger, B., Steder, B., and Burgard, W. (2015, January 26\u201330). Traversability analysis for mobile robots in outdoor environments: A semi-supervised learning approach based on 3D-lidar data. Proceedings of the IEEE International Conference on Robotics and Automation(ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139749"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Libby, J., and Stentz, A. (2012, January 14\u201318). Using sound to classify vehicle-terrain interactions in outdoor environments. Proceedings of the IEEE International Conference on Robotics and Automation(ICRA), Saint Paul, UK.","DOI":"10.1109\/ICRA.2012.6225357"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bicchi, A., and Burgard, W. (2018). Deep Feature Learning for Acoustics-Based Terrain Classification. Robotics Research, Springer.","DOI":"10.1007\/978-3-319-60916-4"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1177\/0278364917727062","article-title":"Deep spatiotemporal models for robust proprioceptive terrain classification","volume":"36","author":"Valada","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.jterra.2017.01.005","article-title":"Terrain classification using intelligent tire","volume":"17","author":"Khaleghian","year":"2017","journal-title":"J. Terramechanics"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Oliveira, F., Santos, E., Neto, A., Campos, M., and Macharet, D. (2017, January 8\u201311). Speed-invariant terrain roughness classification and control based on inertial sensors. Proceedings of the Latin American Robotics Symposium and Brazilian Symposium on Robotics, Curitiba, Brazil.","DOI":"10.1109\/SBR-LARS-R.2017.8215332"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1023\/B:AURO.0000047286.62481.1d","article-title":"Obstacle detection and terrain classification for autonomous off-road navigation","volume":"18","author":"Manduchi","year":"2005","journal-title":"Auton. Robot."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1002\/rob.21521","article-title":"Terrain classification in complex three-dimensional outdoor environments","volume":"32","author":"Navarro","year":"2015","journal-title":"J. Field Robot."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhao, K., Dong, M., and Gu, L. (2017). A new terrain classification framework using proprioceptive sensors for mobile robots. Math. Probl. Eng., 1\u201314.","DOI":"10.1155\/2017\/3938502"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Park, J., Min, K., Kim, H., Lee, W., Cho, G., and Huh, K. (2018). Road surface classification using a deep ensemble network with sensor feature selection. Sensors, 18.","DOI":"10.3390\/s18124342"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Rosenfeld, R.D., Restrepo, M.G., Gerard, W.H., Bruce, W.E., Branch, A.A., Lewin, G.C., and Bezzo, N. (2018, January 27). Unsupervised surface classification to enhance the control performance of a UGV. Proceedings of the IEEE Systems and Information Engineering Design Symposium, Charlottesville, VA, USA.","DOI":"10.1109\/SIEDS.2018.8374741"},{"key":"ref_23","unstructured":"Iagnemma, K., Shiby, H., and Dubowsky, S. (2002, January 11\u201315). On-line terrain parameter estimation for planetary rovers. Proceedings of the IEEE International Conference on Robotics and Automation(ICRA), Washington, DC, USA."},{"key":"ref_24","unstructured":"Iagnamma, K., Brooks, C., and Dubowsky, S. (2004, January 6\u201313). Visual, tactile and vibration-based terrain analysis for planetary rovers. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1185","DOI":"10.1109\/TRO.2005.855994","article-title":"Vibration-based terrain classification for planetary exploration rovers","volume":"21","author":"Brooks","year":"2005","journal-title":"IEEE Trans. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Brooks, C., and Iagnemma, K. (2007, January 3\u201310). Self-supervised classification for planetary rover terrain sensing. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2007.352693"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Weiss, C., Frohlich, H., and Zell, A. (2006, January 9\u201315). Vibration-based terrain classification using support vector machines. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Beijing, China.","DOI":"10.1109\/IROS.2006.282076"},{"key":"ref_28","unstructured":"Weiss, C., Fechner, N., Stark, M., and Zell, A. (2007, January 19\u201321). Comparison of different approaches to vibration-based terrain classification. Proceedings of the 3rd European Conference on Mobile Robots, Freiburg, Germany."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Berns, K., and Luksch, T. (2007). SVMs for Vibration-Based Terrain Classification. Autonome Mobile Systeme 2007, Springer.","DOI":"10.1007\/978-3-540-74764-2"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Weiss, C., Tamimi, H., and Zell, A. (2008, January 22\u201326). A combination of vision and vibration-based terrain classification. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Nice, France.","DOI":"10.1109\/IROS.2008.4650678"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Komma, P., Weiss, C., and Zell, A. (2009, January 12\u201317). Adaptive Bayesian filtering for vibration-based terrain classification. Proceedings of the IEEE International Conference on Robotics and Automation(ICRA), Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152327"},{"key":"ref_32","unstructured":"Weiss, C., and Zell, A. (, January July). Novelty detection and online learning for vibration-based terrain classification. Proceedings of the 10th International Conference on Intelligent Autonomous Systems (IAS), Baden, Germany."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1002\/rob.20113","article-title":"Terrain characterization and classification with a mobile robot","volume":"23","author":"Ojeda","year":"2006","journal-title":"J. Field Robot."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hoepflinger, M.A., Remy, C.D., Hutter, M., Spinello, L., and Siegwart, R. (2010, January 3\u20137). Haptic terrain classification for legged robots. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509309"},{"key":"ref_35","unstructured":"Bermudez, F., Julian, R., Haldane, D., Abbeel, P., and Fearing, R. (2012, January 7\u201312). Performance analysis and terrain classification for a legged robot over rough terrain. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Park, B., Kim, J., and Lee, J. (2012, January 4\u20136). Terrain feature extraction and classification for mobile robots utilizing contact sensors on rough terrain. Proceedings of the International Symposium on Robotics and Intelligent Sensors, Sarawak, Malaysia.","DOI":"10.1016\/j.proeng.2012.07.253"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Collins, E.G., and Coyle, E.J. (2008, January 19\u201323). Vibration-based terrain classification using surface profile input frequency responses. Proceedings of the IEEE International Conference on Robotics and Automation(ICRA), Pasadena, CA, USA.","DOI":"10.1109\/ROBOT.2008.4543710"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Tick, D., Rahman, T., Busso, C., and Gans, N. (2012, January 14\u201318). Indoor robotic terrain classification via angular velocity based hierarchical classifier selection. Proceedings of the IEEE International Conference on Robotics and Automation(ICRA), Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225128"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1007\/s10514-007-9077-0","article-title":"Frequency response method for terrain classification in autonomous ground vehicles","volume":"24","author":"Dupont","year":"2008","journal-title":"Auton. Robot."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Dupont, E., Moore, C., and Roberts, R. (2008, January 19\u201323). Terrain Classification for mobile robots traveling at various speeds: An eigenspace manifold approach. Proceedings of the IEEE International Conference on Robotics and Automation(ICRA), Pasadena, CA, USA.","DOI":"10.1109\/ROBOT.2008.4543711"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Mei, M., Chang, J., Li, Y., Li, Z., Li, X., and Lv, W. (2019). Comparative study of different methods in vibration-based terrain classification for wheeled robots with shock absorbers. Sensors, 19.","DOI":"10.3390\/s19051137"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1626","DOI":"10.1109\/LRA.2019.2896732","article-title":"Haptic inspection of planetary soils with legged robots","volume":"4","author":"Kolvenbach","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_43","unstructured":"Lomio, F., Skenderi, E., Mohamadi, D., Collin, J., Ghabcheloo, R., and Huttunen, H. (2019). Surface type classification for autonomous robot indoor navigation. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1007\/s10514-018-9796-4","article-title":"Improving slip prediction on mars using thermal inertia measurements","volume":"43","author":"Cunningham","year":"2019","journal-title":"Auton. Robot."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wang, S. (2019). Road Terrain Classification Technology for Autonomous Vehicle, Springer.","DOI":"10.1007\/978-981-13-6155-5"},{"key":"ref_46","unstructured":"Krizhevsky, A., Suyskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_47","unstructured":"Liu, W., Wen, Y., Yu, Z., and Yang, M. (2016, January 9). Large-margin softmax loss for convolutional neural networks. Proceedings of the 33rd International Conference on Machine Learning (ICML), New York, NY, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.neucom.2018.05.011","article-title":"Retinal vessel segmentation of color fundus images using multiscale convolutional neural network with an improved cross-entropy loss function","volume":"309","author":"Hu","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"63485","DOI":"10.1109\/ACCESS.2019.2916480","article-title":"Three-dimensional vibration-based terrain classification for mobile robots","volume":"7","author":"Bai","year":"2019","journal-title":"IEEE Access"},{"key":"ref_50","unstructured":"Bwbot (2018, January 05). XQ Unmanned Vehicle Platform. Available online: http:\/\/www.bwbot.org\/zh-cn\/products\/xiaoqiang-4-pro."},{"key":"ref_51","unstructured":"Clearpath (2018, February 17). Jackal Unmanned Vehicle Platform. Available online: https:\/\/www.clearpathrobotics.com\/jackal-small-unmanned-ground-vehicle\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/14\/3102\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:05:23Z","timestamp":1760187923000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/14\/3102"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,13]]},"references-count":51,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2019,7]]}},"alternative-id":["s19143102"],"URL":"https:\/\/doi.org\/10.3390\/s19143102","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,13]]}}}