{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:03:05Z","timestamp":1760234585080,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T00:00:00Z","timestamp":1622419200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U1913602","61991412"],"award-info":[{"award-number":["U1913602","61991412"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Ship detection in remote sensing has been achieving increasing significance recently. In remote sensing, ships are arbitrary oriented and the detector has to learn the object features of arbitrary orientation by rote, which demands a large amount of training data to prevent overfitting. In addition, plenty of ships have a distinct direction from the center point to the head point. However, little attention has been paid to the direction information of ships and previous studies just predict the bow directions of ships. In this paper, we propose to further exploit the ship direction information to solve the arbitrary orientation problem, including direction augmentation, direction prediction, and direction normalization. A Variable-Direction Rotated RoI Align module is designed for direction augmentation and normalization with an additional feature extraction direction as input. The direction augmentation method directly augments the features of ship RRoIs and brings great diversities to the training data set. The direction prediction introduces additional direction information for learning and helps to reduce noise. In the direction normalization method, the predicted ship directions are utilized to normalize the directions of ship features from stern to bow through the VDR RoI Align module, making the ship features present in one orientation and easier to be identified by the detector. On the L1 task of the HRSC2016 data set, the direction augmentation method and direction normalization method boost the RoI Transformer baseline from 86.2% to 90.4% and 90.6%, respectively, achieving the state-of-the-art performance.<\/jats:p>","DOI":"10.3390\/rs13112155","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T21:42:06Z","timestamp":1622497326000},"page":"2155","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Exploit Direction Information for Remote Ship Detection"],"prefix":"10.3390","volume":"13","author":[{"given":"Zhenbiao","family":"Tan","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zekun","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tingzhuang","family":"Xing","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiao","family":"Huang","sequence":"additional","affiliation":[{"name":"China Ship Development and Design Center, Wuhan 430064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junbin","family":"Gong","sequence":"additional","affiliation":[{"name":"China Ship Development and Design Center, Wuhan 430064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Nie, T., Han, X., He, B., Li, X., Liu, H., and Bi, G. (2020). Ship Detection in Panchromatic Optical Remote Sensing Images Based on Visual Saliency and Multi-Dimensional Feature Description. Remote Sens., 12.","DOI":"10.3390\/rs12010152"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3091","DOI":"10.1109\/TGRS.2017.2658950","article-title":"Inshore Ship Detection in Remote Sensing Images via Weighted Pose Voting","volume":"55","author":"He","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhu, C., Zhou, H., Wang, R., and Guo, J. (2010). A novel hierarchical method of ship detection from spaceborne optical image based on shape and texture features. IEEE Trans. Geosci. Remote Sens., 48.","DOI":"10.1109\/TGRS.2010.2046330"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6014","DOI":"10.1109\/ACCESS.2016.2611492","article-title":"Automatic Target Recognition in Synthetic Aperture Radar Imagery: A State-of-the-Art Review","volume":"4","author":"Gill","year":"2016","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Rostami, M., Kolouri, S., Eaton, E., and Kim, K. (2019). Deep transfer learning for few-shot SAR image classification. Remote Sens., 11.","DOI":"10.20944\/preprints201905.0030.v1"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wei, S., Su, H., Ming, J., Wang, C., Yan, M., Kumar, D., Shi, J., and Zhang, X. (2020). Precise and robust ship detection for high-resolution SAR imagery based on HR-SDNet. Remote Sens., 12.","DOI":"10.3390\/rs12010167"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wu, Y., Ma, W., Gong, M., Bai, Z., Zhao, W., Guo, Q., Chen, X., and Miao, Q. (2020). A coarse-to-fine network for ship detection in optical remote sensing images. Remote Sens., 12.","DOI":"10.3390\/rs12020246"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, S., Wu, R., Xu, K., Wang, J., and Sun, W. (2019). R-CNN-Based Ship Detection from High Resolution Remote Sensing Imagery. Remote Sens., 11.","DOI":"10.3390\/rs11060631"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rabbi, J., Ray, N., Schubert, M., Chowdhury, S., and Chao, D. (2020). Small-object detection in remote sensing images with end-to-end edge-enhanced GAN and object detector network. Remote Sens., 12.","DOI":"10.20944\/preprints202003.0313.v2"},{"key":"ref_10","unstructured":"Yang, X., Yang, J., Yan, J., Zhang, Y., Zhang, T., Guo, Z., Sun, X., and Fu, K. (November, January 27). SCRDet: Towards more robust detection for small, cluttered and rotated objects. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_11","unstructured":"Yang, X., Yan, J., Ming, Q., Wang, W., Zhang, X., and Tian, Q. (2021). Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yang, X., and Yan, J. (2020). Arbitrary-Oriented Object Detection with Circular Smooth Label. arXiv.","DOI":"10.1007\/978-3-030-58598-3_40"},{"key":"ref_13","unstructured":"Qian, W., Yang, X., Peng, S., Guo, Y., and Yan, J. (2019). Learning modulated loss for rotated object detection. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhong, B., and Ao, K. (2020). Single-stage rotation-decoupled detector for oriented object. Remote Sens., 12.","DOI":"10.3390\/rs12193262"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Liu, Z., Hu, J., Weng, L., and Yang, Y. (2018, January 7). Rotated region based CNN for ship detection. Proceedings of the International Conference on Image Processing, ICIP, Athens, Greece.","DOI":"10.1109\/ICIP.2017.8296411"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ding, J., Xue, N., Long, Y., Xia, G.-S., and Lu, Q. (2018). Learning RoI Transformer for Detecting Oriented Objects in Aerial Images. arXiv.","DOI":"10.1109\/CVPR.2019.00296"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yang, X., Sun, H., Sun, X., Yan, M., Guo, Z., and Fu, K. (2018). Position Detection and Direction Prediction for Arbitrary-Oriented Ships via Multitask Rotation Region Convolutional Neural Network. IEEE Access, 6.","DOI":"10.1109\/ACCESS.2018.2869884"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, F., Wang, X., Zhou, S., Wang, Y., and Hou, Y. (2021). Arbitrary-oriented ship detection through center-headpoint extraction. arXiv.","DOI":"10.1109\/TGRS.2021.3120411"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kene, Y., Khot, U., and Rizvi, I. (2019). A Survey of Image Classification and Techniques for Improving Classification Performance. SSRN Electron. J.","DOI":"10.2139\/ssrn.3349696"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wu, X., Sahoo, D., and Hoi, S.C.H. (2020). Recent advances in deep learning for object detection. Neurocomputing, 396.","DOI":"10.1016\/j.neucom.2020.01.085"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Minaee, S., Boykov, Y.Y., Porikli, F., Plaza, A.J., Kehtarnavaz, N., and Terzopoulos, D. (2021). Image Segmentation Using Deep Learning: A Survey. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2021.3059968"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 11\u201318). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Las Condes, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2017). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Trans. Pattern Anal. Mach. Intell., 39.","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hosang, J., Benenson, R., Dollar, P., and Schiele, B. (2016). What Makes for Effective Detection Proposals?. IEEE Trans. Pattern Anal. Mach. Intell., 38.","DOI":"10.1109\/TPAMI.2015.2465908"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once:unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_27","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 8\u201312). Feature pyramid networks for object detection. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR, 2017, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Oksuz, K., Cam, B.C., Kalkan, S., and Akbas, E. (2020). Imbalance Problems in Object Detection: A Review. IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE.","DOI":"10.1109\/TPAMI.2020.2981890"},{"key":"ref_30","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020). End-to-End Object Detection with Transformers. LNCS Lecture Notes in Computer Science, Springer.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021). Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. arXiv.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ma, J., Shao, W., Ye, H., Wang, L., Wang, H., Zheng, Y., and Xue, X. (2018). Arbitrary-oriented scene text detection via rotation proposals. IEEE Trans. Multimed., 20.","DOI":"10.1109\/TMM.2018.2818020"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., and Liang, J. (2017, January 8\u201312). EAST: An efficient and accurate scene text detector. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.283"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xu, Y., Fu, M., Wang, Q., Wang, Y., Chen, K., Xia, G.S., and Bai, X. (2021). Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection. IEEE Trans. Pattern Anal. Mach. Intell., 43.","DOI":"10.1109\/TPAMI.2020.2974745"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, Z., Yuan, L., Weng, L., and Yang, Y. (2017, January 24\u201326). A high resolution optical satellite image dataset for ship recognition and some new baselines. Proceedings of the ICPRAM 2017\u20146th International Conference on Pattern Recognition Applications and Methods, Porto, Portugal.","DOI":"10.5220\/0006120603240331"},{"key":"ref_37","unstructured":"Yang, X., Liu, Q., Yan, J., and Li, A. (2019). R3Det: Refined single-stage detector with feature refinement for rotating object. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"4370","DOI":"10.1109\/TGRS.2020.3020165","article-title":"Point-Based Estimator for Arbitrary-Oriented Object Detection in Aerial Images","volume":"59","author":"Fu","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/11\/2155\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:09:23Z","timestamp":1760162963000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/11\/2155"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,31]]},"references-count":38,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["rs13112155"],"URL":"https:\/\/doi.org\/10.3390\/rs13112155","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,5,31]]}}}