{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T22:14:00Z","timestamp":1776377640136,"version":"3.51.2"},"reference-count":28,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T00:00:00Z","timestamp":1724803200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"New Product and New Process Development Funding Project of China Coal Research Institute Corporation","award":["2023CG-MJ-05"],"award-info":[{"award-number":["2023CG-MJ-05"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In maritime transportation, a ship\u2019s draft survey serves as a primary method for weighing bulk cargo. The accuracy of the ship\u2019s draft reading determines the fairness of bulk cargo transactions. Human visual-based draft reading methods face issues such as safety concerns, high labor costs, and subjective interpretation. Therefore, some image processing methods are utilized to achieve automatic draft reading. However, due to the limitations in the spectral characteristics of RGB images, existing image processing methods are susceptible to water surface environmental interference, such as reflections. To solve this issue, we obtained and annotated 524 multispectral images of a ship\u2019s draft as the research dataset, marking the first application of integrating NIR information and RGB images for automatic draft reading tasks. Additionally, a dual-branch backbone named BIF is proposed to extract and combine spectral information from RGB and NIR images. The backbone network can be combined with the existing segmentation head and detection head to perform waterline segmentation and draft detection. By replacing the original ResNet-50 backbone of YOLOv8, we reached a mAP of 99.2% in the draft detection task. Similarly, combining UPerNet with our dual-branch backbone, the mIoU of the waterline segmentation task was improved from 98.9% to 99.3%. The inaccuracy of the draft reading is less than \u00b10.01 m, confirming the efficacy of our method for automatic draft reading tasks.<\/jats:p>","DOI":"10.3390\/s24175580","type":"journal-article","created":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T11:54:10Z","timestamp":1724846050000},"page":"5580","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Smart Ship Draft Reading by Dual-Flow Deep Learning Architecture and Multispectral Information"],"prefix":"10.3390","volume":"24","author":[{"given":"Bo","family":"Zhang","sequence":"first","affiliation":[{"name":"China Coal Research Institute Corporation, Beijing 100013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiangyun","family":"Li","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Key Laboratory of Knowledge Automation for Industrial Processes, Ministry of Education, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haicheng","family":"Tang","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Key Laboratory of Knowledge Automation for Industrial Processes, Ministry of Education, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xi","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Key Laboratory of Knowledge Automation for Industrial Processes, Ministry of Education, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,28]]},"reference":[{"key":"ref_1","first-page":"33","article-title":"Research Review of Ship Draft Observation Methods","volume":"8","author":"Wei","year":"2023","journal-title":"Am. J. Traffic Transp. Eng."},{"key":"ref_2","first-page":"79","article-title":"Problem In Vessl\u2019S Draft Survey And Countmeature To Increase Its Precision","volume":"20","author":"Wu","year":"2010","journal-title":"J. Insp. Quar."},{"key":"ref_3","unstructured":"Salminen, J.O. (2012). Draft of a Ship-Measurement Technologies and Applications. [Master\u2019s Thesis, Aalto University]."},{"key":"ref_4","first-page":"1","article-title":"Simultaneous optimization of the liner shipping route and ship schedule designs with time windows","volume":"2020","author":"Jiang","year":"2020","journal-title":"Math. Probl. Eng."},{"key":"ref_5","first-page":"407","article-title":"Real-Time Ship Draft Measurement and Optimal Estimation Using Kalman Filter","volume":"17","author":"Dhar","year":"2023","journal-title":"Int. J. Multiphysics"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1900327","DOI":"10.1002\/adfm.201900327","article-title":"Self-powered distributed water level sensors based on liquid\u2013solid triboelectric nanogenerators for ship draft detecting","volume":"29","author":"Zhang","year":"2019","journal-title":"Adv. Funct. Mater."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"312","DOI":"10.4028\/www.scientific.net\/AMM.333-335.312","article-title":"Digital measurement system for ship draft survey","volume":"333","author":"Gu","year":"2013","journal-title":"Appl. Mech. Mater."},{"key":"ref_8","unstructured":"Rodriguez, D.R., Peavey, R.W., Beech, W.E., and Beatty, J.M. (2002). Portable Draft Measurement Device and Method of Use Therefor. (6,347,461), U.S. Patent."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1109\/19.816106","article-title":"New level sensor system for ship stability analysis and monitor","volume":"48","author":"Zheng","year":"1999","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"012230","DOI":"10.1088\/1742-6596\/1575\/1\/012230","article-title":"A Ship Draft Line Detection Method Based on Image Processing and Deep Learning","volume":"1575","author":"Wang","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kirilenko, Y., and Epifantsev, I. (2022). Automatic Recognition of Draft Marks on a Ship\u2019s Board Using Deep Learning System. International School on Neural Networks, Initiated by IIASS and EMFCSC, Springer.","DOI":"10.1007\/978-3-031-11051-1_143"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.patcog.2007.04.003","article-title":"Real-time line detection through an improved Hough transform voting scheme","volume":"41","author":"Fernandes","year":"2008","journal-title":"Pattern Recognit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"104104","DOI":"10.1117\/1.OE.55.10.104104","article-title":"Automatic draft reading based on image processing","volume":"55","author":"Tsujii","year":"2016","journal-title":"Opt. Eng."},{"key":"ref_14","first-page":"39","article-title":"Draft line detection based on image processing for ship draft survey","volume":"Volume 2","author":"Ran","year":"2012","journal-title":"Proceedings of the 2011 2nd International Congress on Computer Applications and Computational Science"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, K., Kong, C., Sun, F., Cong, C., Shen, Y., and Jiang, Y. (2022, January 8\u201312). Intelligent Recognition of Waterline Value Based on Neural Network. Proceedings of the International Conference on Computational & Experimental Engineering and Sciences, Dubai, United Arab Emirates.","DOI":"10.1007\/978-3-031-02097-1_15"},{"key":"ref_16","first-page":"024105","article-title":"Computer vision with deep learning for ship draft reading","volume":"60","author":"Wang","year":"2021","journal-title":"Opt. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s11265-022-01816-w","article-title":"Research and Application of U 2-NetP Network Incorporating Coordinate Attention for Ship Draft Reading in Complex Situations","volume":"95","author":"Li","year":"2023","journal-title":"J. Signal Process. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4552","DOI":"10.1109\/TITS.2023.3327824","article-title":"Multi-Task Learning-Enabled Automatic Vessel Draft Reading for Intelligent Maritime Surveillance","volume":"25","author":"Qu","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_19","unstructured":"Tosi, F., Ramirez, P.Z., Poggi, M., Salti, S., Mattoccia, S., and Di Stefano, L. (18, January 18\u201322). RGB-Multispectral matching: Dataset, learning methodology, evaluation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1007\/s11119-017-9558-x","article-title":"RGB and multispectral UAV image fusion for Gramineae weed detection in rice fields","volume":"19","author":"Barrero","year":"2018","journal-title":"Precis. Agric."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, H., Fromont, E., Lefevre, S., and Avignon, B. (2020, January 25\u201328). Multispectral fusion for object detection with cyclic fuse-and-refine blocks. Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP), Virtual.","DOI":"10.1109\/ICIP40778.2020.9191080"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2725","DOI":"10.1007\/s00371-022-02488-0","article-title":"NIR\/RGB image fusion for scene classification using deep neural networks","volume":"39","author":"Soroush","year":"2023","journal-title":"Vis. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4015","DOI":"10.1080\/01431160600702384","article-title":"Segmentation and morphology of open water bodies from multispectral images","volume":"27","author":"Lira","year":"2006","journal-title":"Int. J. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.1016\/j.proenv.2011.12.223","article-title":"Comparative analysis of automatic water identification method based on multispectral remote sensing","volume":"11","author":"Zhang","year":"2011","journal-title":"Procedia Environ. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"181","DOI":"10.5194\/isprsarchives-XXXIX-B8-181-2012","article-title":"Water body extraction from multi spectral image by spectral pattern analysis","volume":"39","author":"Nguyen","year":"2012","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_26","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Xiao, T., Liu, Y., Zhou, B., Jiang, Y., and Sun, J. (2018, January 8\u201314). Unified perceptual parsing for scene understanding. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01228-1_26"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/17\/5580\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:44:28Z","timestamp":1760111068000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/17\/5580"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,28]]},"references-count":28,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["s24175580"],"URL":"https:\/\/doi.org\/10.3390\/s24175580","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,28]]}}}