{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T04:43:01Z","timestamp":1787460181168,"version":"build-2736575974"},"reference-count":38,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,25]],"date-time":"2021-12-25T00:00:00Z","timestamp":1640390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ratchadapisek Somphot Fund for Postdoctoral Fellowship, Chulalongkorn University","award":["This research was supported by Ratchadapisek Somphot Fund for Postdoctoral Fellowship, Chulalongkorn University"],"award-info":[{"award-number":["This research was supported by Ratchadapisek Somphot Fund for Postdoctoral Fellowship, Chulalongkorn University"]}]},{"name":"Center of Excellence in Infrastructure Management, Chulalongkorn University","award":["This research was supported by Center of Excellence in Infrastructure Management, Chulalongkorn University"],"award-info":[{"award-number":["This research was supported by Center of Excellence in Infrastructure Management, Chulalongkorn University"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Due to the various sizes of each object, such as kilometer stones, detection is still a challenge, and it directly impacts the accuracy of these object counts. Transformers have demonstrated impressive results in various natural language processing (NLP) and image processing tasks due to long-range modeling dependencies. This paper aims to propose an exceeding you only look once (YOLO) series with two contributions: (i) We propose to employ a pre-training objective to gain the original visual tokens based on the image patches on road asset images. By utilizing pre-training Vision Transformer (ViT) as a backbone, we immediately fine-tune the model weights on downstream tasks by joining task layers upon the pre-trained encoder. (ii) We apply Feature Pyramid Network (FPN) decoder designs to our deep learning network to learn the importance of different input features instead of simply summing up or concatenating, which may cause feature mismatch and performance degradation. Conclusively, our proposed method (Transformer-Based YOLOX with FPN) learns very general representations of objects. It significantly outperforms other state-of-the-art (SOTA) detectors, including YOLOv5S, YOLOv5M, and YOLOv5L. We boosted it to 61.5% AP on the Thailand highway corpus, surpassing the current best practice (YOLOv5L) by 2.56% AP for the test-dev data set.<\/jats:p>","DOI":"10.3390\/info13010005","type":"journal-article","created":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T01:00:54Z","timestamp":1640566854000},"page":"5","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Object Detection of Road Assets Using Transformer-Based YOLOX with Feature Pyramid Decoder on Thai Highway Panorama"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8464-4476","authenticated-orcid":false,"given":"Teerapong","family":"Panboonyuen","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Faculty of Engineering, Chulalongkorn University, Phayathai Rd, Pathumwan, Bangkok 10330, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sittinun","family":"Thongbai","sequence":"additional","affiliation":[{"name":"InfraPlus Co., Ltd., Phayathai Rd, Pathumwan, Bangkok 10330, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weerachai","family":"Wongweeranimit","sequence":"additional","affiliation":[{"name":"Center of Excellence in Infrastructure Management, Chulalongkorn University, Phayathai Rd, Pathumwan, Bangkok 10330, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Phisan","family":"Santitamnont","sequence":"additional","affiliation":[{"name":"Center of Excellence in Infrastructure Management, Chulalongkorn University, Phayathai Rd, Pathumwan, Bangkok 10330, Thailand"},{"name":"Department of Survey Engineering, Faculty of Engineering, Chulalongkorn University, Phayathai Rd, Pathumwan, Bangkok 10330, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kittiwan","family":"Suphan","sequence":"additional","affiliation":[{"name":"InfraPlus Co., Ltd., Phayathai Rd, Pathumwan, Bangkok 10330, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaiyut","family":"Charoenphon","sequence":"additional","affiliation":[{"name":"Department of Survey Engineering, Faculty of Engineering, Chulalongkorn University, Phayathai Rd, Pathumwan, Bangkok 10330, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dai, X., Chen, Y., Xiao, B., Chen, D., Liu, M., Yuan, L., and Zhang, L. (2021, January 19\u201325). Dynamic Head: Unifying Object Detection Heads with Attentions. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00729"},{"key":"ref_2","first-page":"5603914","article-title":"Center-Boundary Dual Attention for Oriented Object Detection in Remote Sensing Images","volume":"60","author":"Liu","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gu, Y., Wang, L., Wang, Z., Liu, Y., Cheng, M.M., and Lu, S.P. (2020, January 7\u201312). Pyramid constrained self-attention network for fast video salient object detection. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i07.6718"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Haris, M., and Glowacz, A. (2021). Road Object Detection: A Comparative Study of Deep Learning-Based Algorithms. Electronics, 10.","DOI":"10.3390\/electronics10161932"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1007\/s42154-021-00157-x","article-title":"VCANet: Vanishing-Point-Guided Context-Aware Network for Small Road Object Detection","volume":"4","author":"Chen","year":"2021","journal-title":"Automot. Innov."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"107846","DOI":"10.1016\/j.asoc.2021.107846","article-title":"An advanced YOLOv3 method for small-scale road object detection","volume":"112","author":"Wang","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"211164","DOI":"10.1109\/ACCESS.2020.3036620","article-title":"Detection of road objects with small appearance in images for autonomous driving in various traffic situations using a deep learning based approach","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"ref_8","unstructured":"Yang, J., Li, C., Zhang, P., Dai, X., Xiao, B., Yuan, L., and Gao, J. (2021). Focal self-attention for local-global interactions in vision transformers. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Adarsh, P., Rathi, P., and Kumar, M. (2020, January 6\u20137). YOLO v3-Tiny: Object Detection and Recognition using one stage improved model. Proceedings of the 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.","DOI":"10.1109\/ICACCS48705.2020.9074315"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., and Sang, N. (2018, January 8\u201314). Bisenet: Bilateral segmentation network for real-time semantic segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01261-8_20"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"105742","DOI":"10.1016\/j.compag.2020.105742","article-title":"Using channel pruning-based YOLO v4 deep learning algorithm for the real-time and accurate detection of apple flowers in natural environments","volume":"178","author":"Wu","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wu, W., Liu, H., Li, L., Long, Y., Wang, X., Wang, Z., Li, J., and Chang, Y. (2021). Application of local fully Convolutional Neural Network combined with YOLO v5 algorithm in small target detection of remote sensing image. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0259283"},{"key":"ref_14","unstructured":"Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding yolo series in 2021. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Lu, X., Cao, G., Yang, Y., Jiao, L., and Liu, F. (2021, January 19\u201325). ViT-YOLO: Transformer-Based YOLO for Object Detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Nashville, TN, USA.","DOI":"10.1109\/ICCVW54120.2021.00314"},{"key":"ref_16","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 \u00d7 16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_17","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, X., Chen, Y., and Lin, Z. (2021). Spatial-Spectral Transformer for Hyperspectral Image Classification. Remote Sens., 13.","DOI":"10.3390\/rs13030498"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Qing, Y., Liu, W., Feng, L., and Gao, W. (2021). Improved Transformer Net for Hyperspectral Image Classification. Remote Sens., 13.","DOI":"10.3390\/rs13112216"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sun, Z., Cao, S., Yang, Y., and Kitani, K.M. (2021, January 19\u201325). Rethinking transformer-based set prediction for object detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Nashville, TN, USA.","DOI":"10.1109\/ICCV48922.2021.00359"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, F., Zhai, Q., Li, X., Huang, R., Luo, A., Cheng, H., and Fan, D.P. (2021, January 19\u201325). Uncertainty-Guided Transformer Reasoning for Camouflaged Object Detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Nashville, TN, USA.","DOI":"10.1109\/ICCV48922.2021.00411"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, L., Li, R., Wang, D., Duan, C., Wang, T., and Meng, X. (2021). Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images. Remote Sens., 13.","DOI":"10.3390\/rs13163065"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.patrec.2021.04.024","article-title":"TrSeg: Transformer for semantic segmentation","volume":"148","author":"Jin","year":"2021","journal-title":"Pattern Recognit. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kim, S.W., Kook, H.K., Sun, J.Y., Kang, M.C., and Ko, S.J. (2018, January 8\u201314). Parallel feature pyramid network for object detection. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01228-1_15"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhu, X., Lyu, S., Wang, X., and Zhao, Q. (2021, January 19\u201325). TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarios. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Nashville, TN, USA.","DOI":"10.1109\/ICCVW54120.2021.00312"},{"key":"ref_26","unstructured":"Thuan, D. (2021, November 12). Evolution of Yolo Algorithm and Yolov5: The State-of-the-Art Object Detection Algorithm. Available online: https:\/\/www.theseus.fi\/handle\/10024\/452552."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., and Gao, W. (2021, January 19\u201325). Pre-trained image processing transformer. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01212"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ranftl, R., Bochkovskiy, A., and Koltun, V. (2021, January 19\u201325). Vision transformers for dense prediction. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Nashville, TN, USA.","DOI":"10.1109\/ICCV48922.2021.01196"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Srinivas, A., Lin, T.Y., Parmar, N., Shlens, J., Abbeel, P., and Vaswani, A. (2021, January 19\u201325). Bottleneck transformers for visual recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01625"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kim, K., Wu, B., Dai, X., Zhang, P., Yan, Z., Vajda, P., and Kim, S.J. (2021, January 19\u201325). Rethinking the Self-Attention in Vision Transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPRW53098.2021.00342"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Salvador, A., Gundogdu, E., Bazzani, L., and Donoser, M. (2021, January 19\u201325). Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01522"},{"key":"ref_32","unstructured":"Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., and J\u00e9gou, H. (2021). Training data-efficient image transformers & distillation through attention. International Conference on Machine Learning, PMLR."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021). Swin transformer: Hierarchical vision transformer using shifted windows. arXiv.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lin, A., Chen, B., Xu, J., Zhang, Z., and Lu, G. (2021). DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation. arXiv.","DOI":"10.1109\/TIM.2022.3178991"},{"key":"ref_35","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). Tensorflow: A system for large-scale machine learning. Proceedings of the OSDI, Savannah, GA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H. (2021, January 19\u201325). Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00681"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Cheng, B., Wei, Y., Shi, H., Feris, R., Xiong, J., and Huang, T. (2018, January 8\u201314). Revisiting rcnn: On awakening the classification power of faster rcnn. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01267-0_28"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Vicente, S., Carreira, J., Agapito, L., and Batista, J. (2014, January 23\u201328). Reconstructing pascal voc. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.13"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/1\/5\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:53:19Z","timestamp":1760169199000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/1\/5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,25]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["info13010005"],"URL":"https:\/\/doi.org\/10.3390\/info13010005","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,25]]}}}