{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T06:27:21Z","timestamp":1762324041404,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2017,1,7]],"date-time":"2017-01-07T00:00:00Z","timestamp":1483747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"UK\u2019s Engineering and Physical Sciences Research Council (EPSRC)","award":["EP\/I033424\/1)"],"award-info":[{"award-number":["EP\/I033424\/1)"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The most compelling requirements for visual tracking systems are a high detection accuracy and an adequate processing speed. However, the combination between the two requirements in real world applications is very challenging due to the fact that more accurate tracking tasks often require longer processing times, while quicker responses for the tracking system are more prone to errors, therefore a trade-off between accuracy and speed, and vice versa is required. This paper aims to achieve the two requirements together by implementing an accurate and time efficient tracking system. In this paper, an eye-to-hand visual system that has the ability to automatically track a moving target is introduced. An enhanced Circular Hough Transform (CHT) is employed for estimating the trajectory of a spherical target in three dimensions, the colour feature of the target was carefully selected by using a new colour selection process, the process relies on the use of a colour segmentation method (Delta E) with the CHT algorithm for finding the proper colour of the tracked target, the target was attached to the six degree of freedom (DOF) robot end-effector that performs a pick-and-place task. A cooperation of two Eye-to Hand cameras with their image Averaging filters are used for obtaining clear and steady images. This paper also examines a new technique for generating and controlling the observation search window in order to increase the computational speed of the tracking system, the techniques is named Controllable Region of interest based on Circular Hough Transform (CRCHT). Moreover, a new mathematical formula is introduced for updating the depth information of the vision system during the object tracking process. For more reliable and accurate tracking, a simplex optimization technique was employed for the calculation of the parameters for camera to robotic transformation matrix. The results obtained show the applicability of the proposed approach to track the moving robot with an overall tracking error of 0.25 mm. Also, the effectiveness of CRCHT technique in saving up to 60% of the overall time required for image processing.<\/jats:p>","DOI":"10.3390\/s17010104","type":"journal-article","created":{"date-parts":[[2017,1,9]],"date-time":"2017-01-09T11:03:23Z","timestamp":1483959803000},"page":"104","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["3D Visual Tracking of an Articulated Robot in Precision Automated Tasks"],"prefix":"10.3390","volume":"17","author":[{"given":"Hamza","family":"Alzarok","sequence":"first","affiliation":[{"name":"Centre for Precision Technologies, School of Computing and Engineering, University of Huddersfield, Queensgate, Huddersfield HD1 3DH, UK"}]},{"given":"Simon","family":"Fletcher","sequence":"additional","affiliation":[{"name":"Centre for Precision Technologies, School of Computing and Engineering, University of Huddersfield, Queensgate, Huddersfield HD1 3DH, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2886-3305","authenticated-orcid":false,"given":"Andrew","family":"Longstaff","sequence":"additional","affiliation":[{"name":"Centre for Precision Technologies, School of Computing and Engineering, University of Huddersfield, Queensgate, Huddersfield HD1 3DH, UK"}]}],"member":"1968","published-online":{"date-parts":[[2017,1,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"P\u00e9rez, L., Rodr\u00edguez, \u00cd., Rodr\u00edguez, N., Usamentiaga, R., and Garc\u00eda, D.F. (2016). Robot guidance using machine vision techniques in industrial environments: A comparative review. Sensors, 16.","DOI":"10.3390\/s16030335"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1109\/70.768192","article-title":"End-Effector Position-Orientation Measurement","volume":"15","author":"Yuan","year":"1999","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Axelsson, P. (2014). Sensor Fusion and Control Applied to Industrial Manipulators. [Ph.D. Thesis, Department of Electrical Engineering, Link\u00f6ping University].","DOI":"10.3384\/diss.diva-105343"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/s00170-011-3166-0","article-title":"Experimental comparison of dynamic tracking performance of IGPS and laser tracker","volume":"56","author":"Wang","year":"2011","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_5","unstructured":"Olsson, T. (2007). High-Speed Vision and Force Feedback for Motion-Controlled Industrial Manipulators, Lund University."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Keshmiri, M., and Xie, W.F. (2013, January 17\u201319). Catching Moving Objects Using a Navigation Guidance Technique in a Robotic Visual Servoing System. Proceedings of the American Control Conference (ACC), Washington, DC, USA.","DOI":"10.1109\/ACC.2013.6580826"},{"key":"ref_7","unstructured":"Nomura, H., and Naito, T. (2000, January 8\u201311). Integrated Visual Servoing System to Grasp Industrial Parts Moving on Conveyer by Controlling 6DOF ARM. Proceedings of the 2000 IEEE International Conference on Systems, Man, and Cybernetics, Nashville, TN, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1007\/s00170-013-5034-6","article-title":"Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor","volume":"69","author":"Gu","year":"2013","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1007\/s00170-014-5925-1","article-title":"Real-time image processing for vision-based weld seam tracking in robotic gmaw","volume":"73","author":"Xu","year":"2014","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1007\/s00170-010-2962-2","article-title":"Robotic drilling system for titanium structures","volume":"54","author":"Bi","year":"2011","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1903","DOI":"10.1007\/s00170-015-7031-4","article-title":"Robot base frame calibration with a 2D vision system for mobile robotic drilling","volume":"80","author":"Mei","year":"2015","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_12","first-page":"259","article-title":"Binocular visual tracking and grasping of a moving object with a 3D trajectory predictor","volume":"7","year":"2009","journal-title":"J. Appl. Res. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1007\/s00170-011-3741-4","article-title":"Hand-eye calibration and positioning for a robot drilling system","volume":"61","author":"Zhan","year":"2012","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Guo, H., Xiao, H., Wang, S., He, W., and Yuan, K. (2015, January 2\u20135). Real-Time Detection and Classification of Machine Parts with Embedded System for Industrial Robot Grasping. Proceedings of the 2015 IEEE International Conference on Mechatronics and Automation (ICMA), Beijing, China.","DOI":"10.1109\/ICMA.2015.7237740"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1109\/TRO.2008.2001356","article-title":"Adaptive visual servoing using point and line features with an uncalibrated eye-in-hand camera","volume":"24","author":"Wang","year":"2008","journal-title":"IEEE Trans. Robot."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xu, D., Yan, Z., Fang, Z., and Tan, M. (2011, January 6\u20138). Vision Tracking System for Narrow Butt Seams with CO2 Gas Shielded ARC Welding. Proceedings of the 2011 5th International Conference on Automation, Robotics and Applications (ICARA), Wellington, New Zealand.","DOI":"10.1109\/ICARA.2011.6144841"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.rcim.2013.01.004","article-title":"Autonomous weld seam identification and localisation using eye-in-hand stereo vision for robotic arc welding","volume":"29","author":"Dinham","year":"2013","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_18","unstructured":"Wunsch, P., and Hirzinger, G. (,  1997). Real-Time Visual Tracking of 3D Objects with Dynamic handling of Occlusion. Proceedings of the 1997 IEEE International Conference on Robotics and Automation, Albuquerque, NM, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, W., Yuan, K., Xiao, H., and Xu, Z. (2011, January 7\u20139). A High Speed Robot Vision System with GIGE Vision Extension. Proceedings of the 2011 International Conference on Mechatronics and Automation (ICMA), Beijing, China.","DOI":"10.1109\/ICMA.2011.5985700"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chang, T., Hong, T., Shneier, M., Holguin, G., Park, J., and Eastman, R.D. (2008, January 19\u201321). Dynamic 6DOF Metrology for Evaluating a Visual Servoing System. Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, Gaithersburg, MD, USA.","DOI":"10.1145\/1774674.1774702"},{"key":"ref_21","unstructured":"Kragic, D., and Christensen, H.I. (1999, January 17\u201321). Integration of Visual Cues for Active Tracking of an End-Effector. Proceedings of the IROS, Kyongju, Korea."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gupta, O.K., and Jarvis, R.A. (2010, January 28\u201330). Robust Pose Estimation and Tracking System for a Mobile Robot Using a Panoramic Camera. Proceedings of the 2010 IEEE Conference on, Robotics Automation and Mechatronics (RAM), Singapore.","DOI":"10.1109\/RAMECH.2010.5513136"},{"key":"ref_23","unstructured":"Gengenbach, V., Nagel, H.-H., Tonko, M., and Schafer, K. (1996, January 22\u201328). Automatic Dismantling Integrating Optical Flow into a Machine Vision-Controlled Robot System. Proceedings of the 1996 IEEE International Conference on Robotics and Automation, Minneapolis, MN, USA."},{"key":"ref_24","unstructured":"Lund, H.H., de Ves Cuenca, E., and Hallam, J. (1996). A Simple Real-Time Mobile Robot Tracking System, Citeseer."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1007\/s00170-007-1257-8","article-title":"Arc welding robot system with seam tracking and weld pool control based on passive vision","volume":"39","author":"Shen","year":"2008","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_26","unstructured":"Bailey, B., and Wolf, A. (2007). Real Time 3D Motion Tracking for Interactive Computer Simulations, Imperial College."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.robot.2005.09.005","article-title":"Visual tracking of a moving target using active contour based SSD algorithm","volume":"53","author":"Han","year":"2005","journal-title":"Robot. Autonom. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1023\/A:1008972101435","article-title":"Target reaching by using visual information and Q-learning controllers","volume":"9","author":"Distante","year":"2000","journal-title":"Autonom. Robots"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1109\/TRA.2002.802202","article-title":"Visual servoing via navigation functions","volume":"18","author":"Cowan","year":"2002","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1137\/S1052623496303470","article-title":"Convergence properties of the nelder\u2014Mead simplex method in low dimensions","volume":"9","author":"Lagarias","year":"1998","journal-title":"SIAM J. Optim."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1016\/S0262-8856(98)00160-7","article-title":"Size invariant circle detection","volume":"17","author":"Atherton","year":"1999","journal-title":"Image Vis. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Rogowska, A.M. (2015). Synaesthesia and Individual Differences, Cambridge University Press.","DOI":"10.1017\/CBO9781316156230"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Alzarok, H., Fletcher, S., and Longstaff, A.P. (2016, January 7\u20138). A New Strategy for Improving Vision Based Tracking Accuracy Based on Utilization of Camera Calibration Information. Proceedings of the 2016 22nd International Conference on Automation and Computing (ICAC), Colchester, UK.","DOI":"10.1109\/IConAC.2016.7604932"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gapinski, B., and Rucki, M. (2008, January 21\u201322). The Roundness Deviation Measurement with CMM. Proceedings of the IEEE International Workshop on Advanced Methods for Uncertainty Estimation in Measurement, AMUEM, Sardagna, Italy.","DOI":"10.1109\/AMUEM.2008.4589944"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/1\/104\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:25:42Z","timestamp":1760207142000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/1\/104"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,1,7]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,1]]}},"alternative-id":["s17010104"],"URL":"https:\/\/doi.org\/10.3390\/s17010104","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,1,7]]}}}