{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T15:17:59Z","timestamp":1776784679772,"version":"3.51.2"},"reference-count":28,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,2,17]],"date-time":"2019-02-17T00:00:00Z","timestamp":1550361600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Huaimin Wang","award":["nos. 61751208"],"award-info":[{"award-number":["nos. 61751208"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Autonomously following a man-made trail in the wild is a challenging problem for robotic systems. Recently, deep learning-based approaches have cast the trail following problem as an image classification task and have achieved great success in the vision-based trail-following problem. However, the existing research only focuses on the trail-following task with a single-robot system. In contrast, many robotic tasks in reality, such as search and rescue, are conducted by a group of robots. While these robots are grouped to move in the wild, they can cooperate to lead to a more robust performance and perform the trail-following task in a better manner. Concretely, each robot can periodically exchange the vision data with other robots and make decisions based both on its local view and the information from others. This paper proposes a sensor fusion-based cooperative trail-following method, which enables a group of robots to implement the trail-following task by fusing the sensor data of each robot. Our method allows each robot to face the same direction from different altitudes to fuse the vision data feature on the collective level and then take action respectively. Besides, considering the quality of service requirement of the robotic software, our method limits the condition to implementing the sensor data fusion process by using the \u201cthreshold\u201d mechanism. Qualitative and quantitative experiments on the real-world dataset have shown that our method can significantly promote the recognition accuracy and lead to a more robust performance compared with the single-robot system.<\/jats:p>","DOI":"10.3390\/s19040823","type":"journal-article","created":{"date-parts":[[2019,2,17]],"date-time":"2019-02-17T22:11:50Z","timestamp":1550441510000},"page":"823","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Sensor Fusion-Based Cooperative Trail Following for Autonomous Multi-Robot System"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7239-1819","authenticated-orcid":false,"given":"Mingyang","family":"Geng","sequence":"first","affiliation":[{"name":"National Key Laboratory of Parallel and Distributed Processing, College of Computer, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuqi","family":"Liu","sequence":"additional","affiliation":[{"name":"National Key Laboratory of Big Data Management and Analysis, Northeastern University, Shenyang 110000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaoxia","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Control Engineering, Northeastern University at Qinhuangdao, Qinhuangdao 066004, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,17]]},"reference":[{"key":"ref_1","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, CA, USA."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Cire\u015fan, D., Meier, U., and Schmidhuber, J. (arXiv, 2012). Multi-column deep neural networks for image classification, arXiv.","DOI":"10.1109\/CVPR.2012.6248110"},{"key":"ref_3","unstructured":"Ciresan, D., Giusti, A., Gambardella, L.M., and Schmidhuber, J. (2012, January 3\u20136). Deep neural networks segment neuronal membranes in electron microscopy images. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, CA, USA."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1109\/LRA.2015.2509024","article-title":"A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots","volume":"1","author":"Giusti","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Smolyanskiy, N., Kamenev, A., Smith, J., and Birchfield, S. (arXiv, 2017). Toward low-flying autonomous MAV trail navigation using deep neural networks for environmental awareness, arXiv.","DOI":"10.1109\/IROS.2017.8206285"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rasmussen, C., Lu, Y., and Kocamaz, M. (2009, January 10\u201315). Appearance contrast for fast, robust trail-following. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems IROS 2009, St. Louis, MO, USA.","DOI":"10.1109\/IROS.2009.5354059"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1002\/rob.21423","article-title":"Tracking natural trails with swarm-based visual saliency","volume":"30","author":"Santana","year":"2013","journal-title":"J. Field Robot."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2131","DOI":"10.1109\/TPAMI.2011.53","article-title":"Computational versus psychophysical bottom-up image saliency: A comparative evaluation study","volume":"33","author":"Toet","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Geng, M., Zhou, X., Ding, B., Wang, H., and Zhang, L. (2018). Learning to Cooperate in Decentralized Multi-robot Exploration of Dynamic Environments. Neural Information Processing, Springer.","DOI":"10.1007\/978-3-030-04239-4_4"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1007\/s10514-018-9803-9","article-title":"Guest editorial: Special issue on distributed robotics\u2014From fundamentals to applications","volume":"42","author":"Kolling","year":"2018","journal-title":"Auton. Robots"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Schwager, M., Dames, P., Rus, D., and Kumar, V. (2017). A multi-robot control policy for information gathering in the presence of unknown hazards. Robotics Research, Springer.","DOI":"10.1007\/978-3-319-29363-9_26"},{"key":"ref_13","unstructured":"Srivastava, N., Mansimov, E., and Salakhudinov, R. (2015, January 6\u20131). Unsupervised learning of video representations using lstms. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yue-Hei Ng, J., Hausknecht, M., Vijayanarasimhan, S., Vinyals, O., Monga, R., and Toderici, G. (2015, January 7\u201312). Beyond short snippets: Deep networks for video classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299101"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, Z., Wang, X., Jiang, Y.G., Ye, H., and Xue, X. (2015, January 26\u201330). Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806222"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Natarajan, P., Wu, S., Vitaladevuni, S., Zhuang, X., Tsakalidis, S., Park, U., Prasad, R., and Natarajan, P. (2012, January 16\u201321). Multimodal feature fusion for robust event detection in web videos. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247814"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., Gulshan, V., Varma, M., and Zisserman, A. (October, January 26). Multiple kernels for object detection. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459183"},{"key":"ref_18","unstructured":"Ye, G., Liu, D., Jhuo, I.H., and Chang, S.F. (2012, January 16\u201321). Robust late fusion with rank minimization. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Geng, M., Li, Y., Ding, B., and Wang, H. (2018, January 3\u20138). Deep Learning-Based Cooperative Trail Following for Multi-Robot System. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio, Brazil.","DOI":"10.1109\/IJCNN.2018.8489239"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Levin, A., and Weiss, Y. (2006, January 7\u201313). Learning to combine bottom-up and top-down segmentation. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744085_45"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., and Fei-Fei, L. (2014, January 23\u201328). Large-scale video classification with convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.223"},{"key":"ref_22","unstructured":"Simonyan, K., and Zisserman, A. (2014, January 23\u201327). Two-stream convolutional networks for action recognition in videos. Proceedings of the Advances in Neural Information Processing Systems, Prague, Czech Republic."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1109\/TPAMI.2017.2670560","article-title":"Exploiting feature and class relationships in video categorization with regularized deep neural networks","volume":"40","author":"Jiang","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Eitel, A., Springenberg, J.T., Spinello, L., Riedmiller, M., and Burgard, W. (2015, January 1\u20135). Multimodal deep learning for robust RGB-D object recognition. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2015.7353446"},{"key":"ref_25","first-page":"2949","article-title":"Multimodal Learning with Deep Boltzmann Machines","volume":"15","author":"Srivastava","year":"2014","journal-title":"JMLR"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hori, C., Hori, T., Lee, T.Y., Zhang, Z., Harsham, B., Hershey, J.R., Marks, T.K., and Sumi, K. (2017, January 22\u201329). Attention-based multimodal fusion for video description. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.450"},{"key":"ref_27","unstructured":"(2014, November 18). Parrot Bebop Drone. Available online: http:\/\/www.cnet.com\/news\/parrot-bebop-drone-lands-in-december-499-us\/."},{"key":"ref_28","unstructured":"(2019, February 16). NVIDIA cuDNN. Available online: https:\/\/developer.nvidia.com\/cudnn."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/4\/823\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:32:45Z","timestamp":1760185965000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/4\/823"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,17]]},"references-count":28,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19040823"],"URL":"https:\/\/doi.org\/10.3390\/s19040823","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,17]]}}}