{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T05:18:23Z","timestamp":1789103903195,"version":"build-2803163510"},"reference-count":36,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,1,5]],"date-time":"2018-01-05T00:00:00Z","timestamp":1515110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2017YFB1103100"],"award-info":[{"award-number":["2017YFB1103100"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Project xx-079 supported by Ministry of Industry and Information Technology of China","award":["xx-079"],"award-info":[{"award-number":["xx-079"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Multi-layer\/multi-pass welding (MLMPW) technology is widely used in the energy industry to join thick components. During automatic welding using robots or other actuators, it is very important to recognize the actual weld pass position using visual methods, which can then be used not only to perform reasonable path planning for actuators, but also to correct any deviations between the welding torch and the weld pass position in real time. However, due to the small geometrical differences between adjacent weld passes, existing weld position recognition technologies such as structured light methods are not suitable for weld position detection in MLMPW. This paper proposes a novel method for weld position detection, which fuses various kinds of information in MLMPW. First, a synchronous acquisition method is developed to obtain various kinds of visual information when directional light and structured light sources are on, respectively. Then, interferences are eliminated by fusing adjacent images. Finally, the information from directional and structured light images is fused to obtain the 3D positions of the weld passes. Experiment results show that each process can be done in 30 ms and the deviation is less than 0.6 mm. The proposed method can be used for automatic path planning and seam tracking in the robotic MLMPW process as well as electron beam freeform fabrication process.<\/jats:p>","DOI":"10.3390\/s18010129","type":"journal-article","created":{"date-parts":[[2018,1,8]],"date-time":"2018-01-08T04:21:21Z","timestamp":1515385281000},"page":"129","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":46,"title":["A Weld Position Recognition Method Based on Directional and Structured Light Information Fusion in Multi-Layer\/Multi-Pass Welding"],"prefix":"10.3390","volume":"18","author":[{"given":"Jinle","family":"Zeng","sequence":"first","affiliation":[{"name":"Key Laboratory for Advanced Materials Processing Technology, Ministry of Education, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China"},{"name":"Beijing Aerospace Smart Manufacturing Technology Development Co., Ltd., Beijing 100039, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3281-8686","authenticated-orcid":false,"given":"Baohua","family":"Chang","sequence":"additional","affiliation":[{"name":"Key Laboratory for Advanced Materials Processing Technology, Ministry of Education, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Du","sequence":"additional","affiliation":[{"name":"Key Laboratory for Advanced Materials Processing Technology, Ministry of Education, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory for Advanced Materials Processing Technology, Ministry of Education, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuhe","family":"Chang","sequence":"additional","affiliation":[{"name":"Key Laboratory for Advanced Materials Processing Technology, Ministry of Education, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guodong","family":"Peng","sequence":"additional","affiliation":[{"name":"Key Laboratory for Advanced Materials Processing Technology, Ministry of Education, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenzhu","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory for Advanced Materials Processing Technology, Ministry of Education, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,1,5]]},"reference":[{"key":"ref_1","unstructured":"(2017, October 22). Multiple Pass Weave with TIG. Available online: https:\/\/www.pinterest.com\/kristen4418\/welding\/."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1109\/TIE.2014.2319216","article-title":"WPD-PCA-based laser welding process monitoring and defects diagnosis by using FNN and SVM","volume":"62","author":"You","year":"2015","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4315","DOI":"10.1109\/TIE.2012.2193854","article-title":"Seam tracking monitoring based on adaptive Kalman filter embedded Elman neural network during high-power fiber laser welding","volume":"59","author":"Gao","year":"2012","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TII.2014.2309482","article-title":"Multisensor fusion system for monitoring high-power disk laser welding using support vector machine","volume":"10","author":"You","year":"2014","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2177","DOI":"10.1109\/TIE.2008.918637","article-title":"Sputter tracking for the automatic monitoring of industrial laser-welding processes","volume":"55","author":"Jager","year":"2008","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1109\/41.31496","article-title":"Robotic acoustic seam tracking: System development and application","volume":"36","author":"Umeagukwu","year":"1989","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1109\/TIE.1984.350038","article-title":"Application of acoustic sensors to robotic seam tracking","volume":"31","author":"Estonchen","year":"1984","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1109\/41.87591","article-title":"Investigation of an array technique for robotic seam tracking of weld joints","volume":"38","author":"Umeagukwu","year":"1991","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_9","first-page":"79s","article-title":"Development of a multiline laser vision sensor for joint tracking in welding","volume":"88","author":"Sung","year":"2009","journal-title":"Weld. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1109\/TIA.2011.2124432","article-title":"Low-cost system for weld tracking based on artificial vision","volume":"47","author":"Villan","year":"2011","journal-title":"IEEE Trans. Ind. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1109\/TIM.2013.2283139","article-title":"Weld line detection and tracking via spatial-temporal cascaded hidden Markov models and cross structured light","volume":"64","author":"Zhang","year":"2014","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1841","DOI":"10.1109\/TIM.2009.2028222","article-title":"Measurement and defect detection of the weld bead based on online vision inspection","volume":"59","author":"Li","year":"2010","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/s00170-016-8707-0","article-title":"Welding seam profiling techniques based on active vision sensing for intelligent robotic welding","volume":"88","author":"Muhammad","year":"2017","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_14","first-page":"1","article-title":"A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision","volume":"94","author":"Muhammad","year":"2016","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_15","first-page":"319","article-title":"Image processing of seam tracking system using laser vision","volume":"362","author":"Li","year":"2007","journal-title":"Robot. Weld. Intell. Autom."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1007\/s00170-013-5034-6","article-title":"Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor","volume":"69","author":"Gu","year":"2013","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zeng, J., Chang, B., Du, D., Hong, Y., Chang, S., and Zou, Y. (2016). A precise visual method for narrow butt detection in specular reflection workpiece welding. Sensors, 16.","DOI":"10.3390\/s16091480"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fang, Z., and Xu, D. (2009, January 19\u201323). Image-based visual seam tracking system for fillet joint. Proceedings of the IEEE International Conference on Robotics and Biomimetics, Guilin, China.","DOI":"10.1109\/ROBIO.2009.5420852"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1007\/s00170-009-2421-0","article-title":"Visual seam tracking system for butt weld of thin plate","volume":"49","author":"Fang","year":"2010","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1109\/TMECH.2010.2045766","article-title":"A vision-based self-tuning fuzzy controller for fillet weld seam tracking","volume":"16","author":"Fang","year":"2011","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, L., Jiao, J., Ye, Q., Han, Z., and Yang, W. (2012, January 5\u20138). Robust weld line detection with cross structured light and hidden Markov model. Proceedings of the IEEE International Conference on Mechatronics and Automation, Chengdu, China.","DOI":"10.1109\/ICMA.2012.6284343"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zeng, J., Chang, B., Du, D., Peng, G., Chang, S., Hong, Y., Wang, L., and Shan, J. (2017). A vision-aided 3D path teaching method before narrow butt joint welding. Sensors, 17.","DOI":"10.3390\/s17051099"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1007\/s00170-012-3902-0","article-title":"Development of a real-time laser-based machine vision system to monitor and control welding processes","volume":"63","author":"Huang","year":"2012","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, Y., Wang, Q., Li, Y., Xu, D., and Tan, M. (2008, January 12\u201315). Online visual measurement and inspection of weld bead using structured light. Proceedings of the IEEE International Instrumentation and Measurement Technology Conference, Victoria, BC, Canada.","DOI":"10.1109\/IMTC.2008.4547383"},{"key":"ref_25","unstructured":"Shi, Y., Wang, G., and Li, G. (June, January 30). Adaptive robotic welding system using laser vision sensing for underwater engineering. Proceedings of the IEEE International Conference on Control and Automation, Guangzhou, China."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1007\/BF02984264","article-title":"A study on a vision sensor system for tracking the I-butt weld joints","volume":"19","author":"Kim","year":"2005","journal-title":"J. Mech. Sci. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"7261","DOI":"10.1109\/TIE.2017.2694399","article-title":"Automatic welding seam tracking and identification","volume":"64","author":"Li","year":"2017","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.jmapro.2016.07.002","article-title":"A visual weld edge recognition method based on light and shadow feature construction using directional lighting","volume":"24","author":"Zeng","year":"2016","journal-title":"J. Manuf. Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1007\/s00170-004-2359-1","article-title":"Multi sensor data fusion for improving performance and reliability of fully automatic welding system","volume":"28","author":"Moon","year":"2006","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.rcim.2015.04.005","article-title":"Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model","volume":"37","author":"He","year":"2016","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rcim.2011.06.001","article-title":"A new seam-tracking algorithm through characteristic-point detection for a portable welding robot","volume":"28","author":"Chang","year":"2012","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_32","first-page":"108","article-title":"Study of vision sensing technology in seam recognition based on analyzding target feature","volume":"29","author":"Du","year":"2008","journal-title":"Trans. China Weld. Inst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1108\/IR-06-2014-0358","article-title":"Research on a visual weld detection method based on invariant moment features","volume":"42","author":"Jinle","year":"2015","journal-title":"Ind. Robot Int. J."},{"key":"ref_34","first-page":"33","article-title":"Visual method for weld seam recognition based on multi-feature extraction and information fusion","volume":"34","author":"Zou","year":"2008","journal-title":"Trans. China Weld. Inst."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kr\u00e4mer, S., Fiedler, W., Drenker, A., and Abels, P. (2014, January 20). Seam tracking with texture based image processing for laser material processing. Proceedings of the International Society for Optics and Photonics, High-Power Laser Materials Processing: Lasers, Beam Delivery, Diagnostics and Applications III, San Francisco, CA, USA.","DOI":"10.1117\/12.2040483"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/1\/129\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:50:17Z","timestamp":1760194217000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/1\/129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1,5]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,1]]}},"alternative-id":["s18010129"],"URL":"https:\/\/doi.org\/10.3390\/s18010129","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1,5]]}}}