{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,19]],"date-time":"2026-11-19T22:59:03Z","timestamp":1795129143795,"version":"4.10.3"},"reference-count":37,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,6,22]],"date-time":"2022-06-22T00:00:00Z","timestamp":1655856000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62166043"],"award-info":[{"award-number":["62166043"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U2003207"],"award-info":[{"award-number":["U2003207"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Road detection is a crucial part of the autonomous driving system, and semantic segmentation is used as the default method for this kind of task. However, the descriptive categories of agroforestry are not directly definable and constrain the semantic segmentation-based method for road detection. This paper proposes a novel road detection approach to overcome the problem mentioned above. Specifically, a novel two-stage method for road detection in an agroforestry environment, namely ARDformer. First, a transformer-based hierarchical feature aggregation network is used for semantic segmentation. After the segmentation network generates the scene mask, the edge extraction algorithm extracts the trail\u2019s edge. It then calculates the periphery of the trail to surround the area where the trail and grass are located. The proposed method is tested on the public agroforestry dataset, and experimental results show that the intersection over union is approximately 0.82, which significantly outperforms the baseline. Moreover, ARDformer is also effective in a real agroforestry environment.<\/jats:p>","DOI":"10.3390\/s22134696","type":"journal-article","created":{"date-parts":[[2022,6,22]],"date-time":"2022-06-22T04:12:01Z","timestamp":1655871121000},"page":"4696","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["ARDformer: Agroforestry Road Detection for Autonomous Driving Using Hierarchical Transformer"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0755-149X","authenticated-orcid":false,"given":"Eksan","family":"Firkat","sequence":"first","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinlai","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Mechanical Engineering, Guangxi University, Nanning 530004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danfeng","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Robotics, Beijing Union University, Beijing 100100, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minyuan","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Vehicle and Mobility, Tsinghua University, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jihong","family":"Zhu","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830049, China"},{"name":"College of Mechanical Engineering, Guangxi University, Nanning 530004, China"},{"name":"Department of Precision Instrument, Tsinghua University, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2321-308X","authenticated-orcid":false,"given":"Askar","family":"Hamdulla","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1109\/TITS.2017.2768573","article-title":"Scene-adaptive off-road detection using a monocular camera","volume":"19","author":"Mei","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_2","unstructured":"Kong, H., Audibert, J.Y., and Ponce, J. (2009, January 20\u201325). Vanishing point detection for road detection. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Khac, C.N., Choi, Y., Park, J.H., and Jung, H.Y. (2021). A Robust Road Vanishing Point Detection Adapted to the Real-world Driving Scenes. Sensors, 21.","DOI":"10.3390\/s21062133"},{"key":"ref_4","unstructured":"Zhou, S., and Iagnemma, K. (2010, January 18\u201322). Self-supervised learning method for unstructured road detection using fuzzy support vector machines. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Teichmann, M., Weber, M., Zoellner, M., Cipolla, R., and Urtasun, R. (2018, January 26\u201330). Multinet: Real-time joint semantic reasoning for autonomous driving. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.","DOI":"10.1109\/IVS.2018.8500504"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.asoc.2018.05.018","article-title":"A survey on deep learning techniques for image and video semantic segmentation","volume":"70","author":"Oprea","year":"2018","journal-title":"Appl. Soft Comput."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Valada, A., Oliveira, G.L., Brox, T., and Burgard, W. (2016, January 3\u20138). Deep multispectral semantic scene understanding of forested environments using multimodal fusion, Nagasaki, Japan. Proceedings of the International Symposium on Experimental Robotics, Tokyo, Japan.","DOI":"10.1007\/978-3-319-50115-4_41"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tang, L., Ding, X., Yin, H., Wang, Y., and Xiong, R. (2017, January 5\u20138). From one to many: Unsupervised traversable area segmentation in off-road environment. Proceedings of the 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), Macao, Macau.","DOI":"10.1109\/ROBIO.2017.8324513"},{"key":"ref_11","unstructured":"Rasmussen, C. (July, January 27). Grouping dominant orientations for ill-structured road following. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u2014CVPR 2004, Washington, DC, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1109\/TIP.2011.2162422","article-title":"Fast vanishing-point detection in unstructured environments","volume":"21","author":"Moghadam","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lu, K., Li, J., An, X., and He, H. (June, January 31). A hierarchical approach for road detection. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906904"},{"key":"ref_14","unstructured":"Wang, J., Ji, Z., and Su, Y.T. (2009, January 12\u201315). Unstructured road detection using hybrid features. Proceedings of the 2009 International Conference on Machine Learning and Cybernetics, Baoding, China."},{"key":"ref_15","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (July, January 26). The cityscapes dataset for semantic urban scene understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1177\/02783649211006735","article-title":"Towards 3D LiDAR-based semantic scene understanding of 3D point cloud sequences: The SemanticKITTI Dataset","volume":"40","author":"Behley","year":"2021","journal-title":"Int. J. Robot. Res."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Siam, M., Elkerdawy, S., Jagersand, M., and Yogamani, S. (2017, January 16\u201319). Deep semantic segmentation for automated driving: Taxonomy, roadmap and challenges. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.","DOI":"10.1109\/ITSC.2017.8317714"},{"key":"ref_18","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20137). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_19","unstructured":"Han, K., Wang, Y., Chen, H., Chen, X., Guo, J., Liu, Z., Tang, Y., Xiao, A., Xu, C., and Xu, Y. (2022). A survey on vision transformer. arXiv."},{"key":"ref_20","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"109965","DOI":"10.1016\/j.jfoodeng.2020.109965","article-title":"Monitoring sugar crystallization with deep neural networks","volume":"280","author":"Zhang","year":"2020","journal-title":"J. Food Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"27908","DOI":"10.1109\/ACCESS.2021.3058522","article-title":"Pa-mvsnet: Sparse-to-dense multi-view stereo with pyramid attention","volume":"9","author":"Zhang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23\u201328). End-to-end object detection with transformers. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, H., Zhu, Y., Adam, H., Yuille, A., and Chen, L.C. (2020, January 14\u201319). Max-deeplab: End-to-end panoptic segmentation with mask transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR46437.2021.00542"},{"key":"ref_25","first-page":"1","article-title":"Looking Outside the Window: Wide-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images","volume":"60","author":"Ding","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","unstructured":"Chang, Y., Hu, M., Zhai, G., and Zhang, X. (2021). TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentation. arXiv."},{"key":"ref_27","unstructured":"Hendrycks, D., and Gimpel, K. (2016). Gaussian error linear units (gelus). arXiv."},{"key":"ref_28","unstructured":"Agarap, A.F. (2018). Deep learning using rectified linear units (relu). arXiv."},{"key":"ref_29","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8\u201314). Pytorch: An imperative style, high-performance deep learning library. Proceedings of the Advances in Neural Information Processing Systems 32 (NeurIPS 2019), Honolulu, HI, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Nuanes, T., Elsey, M., Sankaranarayanan, A., and Shen, J. (2021, January 19\u201325). Soft Cross Entropy Loss and Bottleneck Tri-Cost Volume for Efficient Stereo Depth Prediction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Virtual.","DOI":"10.1109\/CVPRW53098.2021.00319"},{"key":"ref_31","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 16\u201320). Dual attention network for scene segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.isprsjprs.2020.09.019","article-title":"Parsing very high resolution urban scene images by learning deep ConvNets with edge-aware loss","volume":"170","author":"Zheng","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Jiang, P., Osteen, P., Wigness, M., and Saripalli, S. (June, January 30). Rellis-3d dataset: Data, benchmarks and analysis. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561251"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shao, Y., Zhao, K., Cao, Z., Peng, Z., Peng, X., Li, P., Wang, Y., and Ma, J. (2022). MobilePrune: Neural Network Compression via \u21130 Sparse Group Lasso on the Mobile System. Sensors, 22.","DOI":"10.3390\/s22114081"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"106653","DOI":"10.1016\/j.compag.2021.106653","article-title":"BushNet: Effective semantic segmentation of bush in large-scale point clouds","volume":"193","author":"Wei","year":"2022","journal-title":"Comput. Electron. Agric."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4696\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:37:12Z","timestamp":1760139432000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4696"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,22]]},"references-count":37,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22134696"],"URL":"https:\/\/doi.org\/10.3390\/s22134696","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,22]]}}}