{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T15:06:19Z","timestamp":1764687979500,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>This work proposes a novel solution for detecting and tracing spatially varying edges of large manufacturing workpieces, using a consumer grade RGB depth camera, with only a partial view of the workpiece and without prior knowledge. The proposed system can visually detect and trace various edges, with a wide array of degrees, to an accuracy of 15 mm or less, without the need for any previous information, setup or planning. A combination of physical experiments on the setup and more complex simulated experiments were conducted. The effectiveness of the system is demonstrated via simulated and physical experiments carried out on both acute and obtuse edges, as well as typical aerospace structures, made from a variety of materials, with dimensions ranging from 400 mm to 600 mm. Simulated results show that, with artificial noise added, the solution presented can detect aerospace structures to an accuracy of 40 mm or less, depending on the amount of noise present, while physical aerospace inspired structures can be traced with a consistent accuracy of 5 mm regardless of the cardinal direction. Compared to current industrial solutions, the lack of required planning and robustness of edge detection means it should be able to complete tasks more quickly and easily than the current standard, with a lower financial and computational cost than the current techniques being used within.<\/jats:p>","DOI":"10.3390\/robotics11010025","type":"journal-article","created":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T02:40:17Z","timestamp":1644547217000},"page":"25","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Implementation of a Flexible and Lightweight Depth-Based Visual Servoing Solution for Feature Detection and Tracing of Large, Spatially-Varying Manufacturing Workpieces"],"prefix":"10.3390","volume":"11","author":[{"given":"Lee","family":"Clift","sequence":"first","affiliation":[{"name":"Department of Automatic Control and Systems Engineering, University of Sheffield, Sheffield S1 3JD, UK"}]},{"given":"Divya","family":"Tiwari","sequence":"additional","affiliation":[{"name":"Department of Automatic Control and Systems Engineering, University of Sheffield, Sheffield S1 3JD, UK"}]},{"given":"Chris","family":"Scraggs","sequence":"additional","affiliation":[{"name":"Advanced Manufacturing Research Centre, Sheffield S9 1ZA, UK"}]},{"given":"Windo","family":"Hutabarat","sequence":"additional","affiliation":[{"name":"Department of Automatic Control and Systems Engineering, University of Sheffield, Sheffield S1 3JD, UK"}]},{"given":"Lloyd","family":"Tinkler","sequence":"additional","affiliation":[{"name":"Advanced Manufacturing Research Centre, Sheffield S9 1ZA, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4204-4020","authenticated-orcid":false,"given":"Jonathan M.","family":"Aitken","sequence":"additional","affiliation":[{"name":"Department of Automatic Control and Systems Engineering, University of Sheffield, Sheffield S1 3JD, UK"}]},{"given":"Ashutosh","family":"Tiwari","sequence":"additional","affiliation":[{"name":"Department of Automatic Control and Systems Engineering, University of Sheffield, Sheffield S1 3JD, UK"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,11]]},"reference":[{"key":"ref_1","unstructured":"Williams, M. (2019). JOBS02: Workforce Jobs by Industry, Office for National Statistics. Technical Report."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.arcontrol.2007.01.002","article-title":"Present and future robot control development-An industrial perspective","volume":"31","year":"2007","journal-title":"Annu. Rev. Control."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"180","DOI":"10.4271\/2010-01-1836","article-title":"Applied Accurate Robotic Drilling for Aircraft Fuselage","volume":"3","author":"Devlieg","year":"2010","journal-title":"SAE Int. J. Aerosp."},{"key":"ref_4","unstructured":"Agin, G.J. (1979). Real Time Control of a Robot with a Mobile Camera, SRI International. Technical Note."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1109\/70.538972","article-title":"A tutorial on visual servo control","volume":"12","author":"Hutchinson","year":"1996","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chen, W., Wang, X., Liu, H., Tang, Y., and Liu, J. (2019). Optimized combination of spray painting trajectory on 3D entities. Electronics, 8.","DOI":"10.3390\/electronics8010074"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s10846-006-9078-9","article-title":"Autonomous acquisition of seam coordinates for arc welding robot based on visual servoing","volume":"47","author":"Zhou","year":"2006","journal-title":"J. Intell. Robot. Syst. Theory Appl."},{"key":"ref_8","unstructured":"Xu, D., Wang, L., and Tan, M. (2004, January 22\u201326). Image processing and visual control method for arc welding robot. Proceedings of the 2004 IEEE International Conference on Robotics and Biomimetics, Shenyang, China."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1849","DOI":"10.1007\/s00170-013-5593-6","article-title":"A robust visual servo control system for narrow seam double head welding robot","volume":"71","author":"Chen","year":"2014","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zacharia, P.T., Mariolis, I.G., Aspragathos, N.A., and Dermatas, E.S. (2006). Visual Servoing Controller for Robot Handling Fabrics of Curved Edges. Intelligent Production Machines and Systems\u20142nd I*PROMS Virtual International Conference 3\u201314 July 2006, Elsevier.","DOI":"10.1016\/B978-008045157-2\/50056-0"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chang, W.C., Cheng, M.Y., and Tsai, H.J. (2013, January 20\u201323). Implementation of an Image-Based Visual Servoing structure in contour following of objects with unknown geometric models. Proceedings of the International Conference on Control, Automation and Systems, Gwangju, Korea.","DOI":"10.1109\/ICCAS.2013.6704089"},{"key":"ref_12","unstructured":"Gangloff, J.A., de Mathelin, M., and Abba, G. (1999, January 10\u201315). Visual servoing of a 6 DOF manipulator for unknown 3D profile following. Proceedings of the IEEE International Conference on Robotics and Automation, Detroit, MI, USA."},{"key":"ref_13","unstructured":"Boeing (2013). Robot Painters, Boeing."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1109\/TMECH.2017.2747084","article-title":"Fringe Pattern Based Plane-to-Plane Visual Servoing for Robotic Spray Path Planning","volume":"23","author":"Chen","year":"2018","journal-title":"IEEE\/ASME Trans. Mechatronics"},{"key":"ref_15","unstructured":"Kuka (2016). KUKA OmniMove Moves Heavy Parts in Confined Spaces during Construction of the A380 at Airbus, Kuka."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4617","DOI":"10.1007\/s00170-019-04257-1","article-title":"Autonomous mobile robots in manufacturing: Highway Code development, simulation, and testing","volume":"104","author":"Liaqat","year":"2019","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_17","unstructured":"AMRC (2016). AMRC\u2019s Robot Research Cuts the Cost of Producing Aircraft Components for BAE Systems Technology to Evolve Over Time and Embrace, AMRC. Technical report."},{"key":"ref_18","unstructured":"Airbus (2017). Wing of the Future, Airbus."},{"key":"ref_19","unstructured":"Choi, C., Trevor, A.J.B., and Christensen, H.I. (2013, January 3\u20137). RGB-D edge detection and edge-based registration. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan."},{"key":"ref_20","first-page":"122","article-title":"The OpenCV Library","volume":"120","author":"Bradski","year":"2000","journal-title":"Dr. Dobb\u2019s J. Softw. Tools"},{"key":"ref_21","unstructured":"Stanford Artificial Intelligence Laboratory (2018). Robotic Operating System, Stanford Artificial Intelligence Laboratory."},{"key":"ref_22","unstructured":"Intel (2018). Pyrealsense2, Intel."},{"key":"ref_23","first-page":"959013","article-title":"Robotics Middleware: A Comprehensive Literature Survey and Attribute-Based Bibliography","volume":"2012","author":"Elkady","year":"2012","journal-title":"J. Robot."},{"key":"ref_24","unstructured":"Koenig, N., and Howard, A. (October, January 28). Design and use paradigms for Gazebo, an open-source multi-robot simulator. Proceedings of the 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan."},{"key":"ref_25","unstructured":"Nogueira, L. (2011, January 20\u201322). Comparative Analysis Between Gazebo and V-REP Robotic Simulators. Proceedings of the 2011 International Conference on Materials for Renewable Energy and Environment, Shanghai, China."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","unstructured":"Rosebrock, A. (2021, November 11). Zero-Parameter, Automatic Canny Edge Detection with Python and OpenCV. Available online: https:\/\/www.pyimagesearch.com\/2015\/04\/06\/zero-parameter-automatic-canny-edge-detection-with-python-and-opencv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T. (2014). LSD-SLAM: Large-Scale Direct Monocular SLAM. Computer Vision\u2014ECCV 2014, Springer International Publishing.","DOI":"10.1007\/978-3-319-10602-1"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Godard, C., Aodha, O., Firman, M., and Gabriel, J. (November, January 27). Digging Into Self-Supervised Monocular Depth Estimation. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00393"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Patil, V., Patil, I., Kalaichelvi, V., and Karthikeyan, R. (2019, January 19\u201322). Extraction of Weld Seam in 3D Point Clouds for Real Time Welding Using 5 DOF Robotic Arm. Proceedings of the 2019 5th International Conference on Control, Automation and Robotics, Beijing, China.","DOI":"10.1109\/ICCAR.2019.8813703"},{"key":"ref_31","unstructured":"Anderson, M., and Whitcomb, P. (2015). Chapter 3: Two-Level Factorial Design. DOE Simplified: Practical Tools for Effective Experimentation, CRC Press. [3rd ed.]."},{"key":"ref_32","first-page":"1","article-title":"Study on Effect of Lighting Variations in Edge Detection of Objects using Machine Vision System","volume":"4","author":"Manish","year":"2016","journal-title":"Int. J. Eng. Res. Technol."},{"key":"ref_33","unstructured":"Commonplace Robotics (2014). Robotic Arm Mover6 User Guide, Commonplace Robotics GmbH."},{"key":"ref_34","unstructured":"(1998). Manipulating Industrial Robots\u2014Performance Criteria and Related Test Methods (Standard No. ISO 9283:1998)."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"102237","DOI":"10.1016\/j.rcim.2021.102237","article-title":"Comparison of visual servoing technologies for robotized aerospace structural assembly and inspection","volume":"73","author":"Villani","year":"2022","journal-title":"Robot. Comput.-Integr. Manuf."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/11\/1\/25\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:18:07Z","timestamp":1760134687000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/11\/1\/25"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,11]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["robotics11010025"],"URL":"https:\/\/doi.org\/10.3390\/robotics11010025","relation":{},"ISSN":["2218-6581"],"issn-type":[{"type":"electronic","value":"2218-6581"}],"subject":[],"published":{"date-parts":[[2022,2,11]]}}}