{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T04:56:58Z","timestamp":1776747418160,"version":"3.51.2"},"reference-count":111,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,12,2]],"date-time":"2022-12-02T00:00:00Z","timestamp":1669939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100009157","name":"National Institute on Disability, Independent Living, and Rehabilitation Research","doi-asserted-by":"publisher","award":["90DPGE0018-01-00"],"award-info":[{"award-number":["90DPGE0018-01-00"]}],"id":[{"id":"10.13039\/100009157","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Being an emerging technology, robotic manipulation has encountered tremendous advancements due to technological developments starting from using sensors to artificial intelligence. Over the decades, robotic manipulation has advanced in terms of the versatility and flexibility of mobile robot platforms. Thus, robots are now capable of interacting with the world around them. To interact with the real world, robots require various sensory inputs from their surroundings, and the use of vision is rapidly increasing nowadays, as vision is unquestionably a rich source of information for a robotic system. In recent years, robotic manipulators have made significant progress towards achieving human-like abilities. There is still a large gap between human and robot dexterity, especially when it comes to executing complex and long-lasting manipulations. This paper comprehensively investigates the state-of-the-art development of vision-based robotic application, which includes the current state, components, and approaches used along with the algorithms with respect to the control and application of robots. Furthermore, a comprehensive analysis of those vision-based applied algorithms, their effectiveness, and their complexity has been enlightened here. To conclude, there is a discussion over the constraints while performing the research and potential solutions to develop a robust and accurate vision-based robot manipulation.<\/jats:p>","DOI":"10.3390\/robotics11060139","type":"journal-article","created":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T01:42:21Z","timestamp":1670204541000},"page":"139","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["A Comprehensive Review of Vision-Based Robotic Applications: Current State, Components, Approaches, Barriers, and Potential Solutions"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1797-3736","authenticated-orcid":false,"given":"Md Tanzil","family":"Shahria","sequence":"first","affiliation":[{"name":"Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI 53211, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6584-1877","authenticated-orcid":false,"given":"Md Samiul Haque","family":"Sunny","sequence":"additional","affiliation":[{"name":"Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI 53211, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3491-0240","authenticated-orcid":false,"given":"Md Ishrak Islam","family":"Zarif","sequence":"additional","affiliation":[{"name":"Computer Science, Marquette University, Milwaukee, WI 53233, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8289-6124","authenticated-orcid":false,"given":"Jawhar","family":"Ghommam","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering, Sultan Qaboos University, Al Seeb, Muscat 123, Oman"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5385-7647","authenticated-orcid":false,"given":"Sheikh Iqbal","family":"Ahamed","sequence":"additional","affiliation":[{"name":"Computer Science, Marquette University, Milwaukee, WI 53233, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6370-8757","authenticated-orcid":false,"given":"Mohammad H","family":"Rahman","sequence":"additional","affiliation":[{"name":"Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI 53211, USA"},{"name":"Mechanical Engineering, University of Wisconsin-Milwaukee, Milwaukee, WI 53211, USA"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"510","DOI":"10.3389\/fpls.2020.00510","article-title":"Recognition and localization methods for vision-based fruit picking robots: A review","volume":"11","author":"Tang","year":"2020","journal-title":"Front. Plant Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3014","DOI":"10.1109\/TSMC.2019.2917034","article-title":"A real-time robotic grasping approach with oriented anchor box","volume":"51","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bertolucci, R., Capitanelli, A., Maratea, M., Mastrogiovanni, F., and Vallati, M. (2019, January 19\u201322). Automated planning encodings for the manipulation of articulated objects in 3d with gravity. Proceedings of the International Conference of the Italian Association for Artificial Intelligence, Rende, Italy.","DOI":"10.1007\/978-3-030-35166-3_10"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1109\/LRA.2016.2519149","article-title":"On the problem of moving objects with autonomous robots: A unifying high-level planning approach","volume":"1","author":"Marino","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6358","DOI":"10.1109\/TSMC.2019.2961687","article-title":"IWSCR: An intelligent water surface cleaner robot for collecting floating garbage","volume":"51","author":"Kong","year":"2020","journal-title":"IEEE Trans. Syst. Man, Cybern. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1177\/0278364911430417","article-title":"A geometric approach to robotic laundry folding","volume":"31","author":"Miller","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Do, H.M., Choi, T., Park, D., and Kyung, J. (2015, January 13\u201316). Automatic cell production for cellular phone packing using two dual-arm robots. Proceedings of the 2015 15th International Conference on Control, Automation and Systems (ICCAS), Busan, Republic of Korea.","DOI":"10.1109\/ICCAS.2015.7364713"},{"key":"ref_8","unstructured":"Kemp, C.C., and Edsinger, A. (June, January 31). Robot manipulation of human tools: Autonomous detection and control of task relevant features. Proceedings of the Fifth International Conference on Development and Learning, Bloomington, IN, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Edsinger, A. (2007). Robot Manipulation in Human Environments, CSAIL Technical Reports.","DOI":"10.1109\/ICHR.2006.321370"},{"key":"ref_10","unstructured":"(2009). What Are Manual Robots?, Bright Hub Engineering."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Van Pham, H., Asadi, F., Abut, N., and Kandilli, I. (2019). Hybrid spiral STC-hedge algebras model in knowledge reasonings for robot coverage path planning and its applications. Appl. Sci., 9.","DOI":"10.3390\/app9091909"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1177\/0278364904039806","article-title":"Solving the forward kinematics of a Gough-type parallel manipulator with interval analysis","volume":"23","author":"Merlet","year":"2004","journal-title":"Int. J. Robot. Res."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kucuk, S., and Bingul, Z. (2006). Robot Kinematics: Forward and Inverse Kinematics, INTECH Open Access Publisher.","DOI":"10.5772\/5015"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/S0925-2312(97)00048-9","article-title":"Forward kinematics solution of Stewart platform using neural networks","volume":"16","author":"Lim","year":"1997","journal-title":"Neurocomputing"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"106","DOI":"10.5772\/55592","article-title":"Geometrical derivation of differential kinematics to calibrate model parameters of flexible manipulator","volume":"10","author":"Lee","year":"2013","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1088\/1742-6596\/48\/1\/001","article-title":"Robot calibration using iteration and differential kinematics","volume":"48","author":"Ye","year":"2006","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1059","DOI":"10.1109\/TMECH.2011.2158234","article-title":"Laser-based kinematic calibration of robot manipulator using differential kinematics","volume":"17","author":"Park","year":"2011","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_18","first-page":"298","article-title":"Learning inverse kinematics","volume":"Volume 1","author":"Vijayakumar","year":"2001","journal-title":"Proceedings of the 2001 IEEE\/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No. 01CH37180)"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Grochow, K., Martin, S.L., Hertzmann, A., and Popovi\u0107, Z. (2004, January 8\u201312). Style-based inverse kinematics. Proceedings of the ACM SIGGRAPH 2004 Papers, Los Angeles, CA, USA.","DOI":"10.1145\/1186562.1015755"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1109\/70.326569","article-title":"Efficient inverse kinematics for general 6R manipulators","volume":"10","author":"Manocha","year":"1994","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/JRA.1985.1086995","article-title":"A complete generalized solution to the inverse kinematics of robots","volume":"1","author":"Goldenberg","year":"1985","journal-title":"IEEE J. Robot. Autom."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1109\/70.86079","article-title":"A combined optimization method for solving the inverse kinematics problems of mechanical manipulators","volume":"7","author":"Wang","year":"1991","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_23","unstructured":"Tedrake, R. (2022, November 02). Robotic Manipulation Course Notes for MIT 6.4210. Available online: https:\/\/manipulation.csail.mit.edu\/."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"eaat8414","DOI":"10.1126\/science.aat8414","article-title":"Trends and challenges in robot manipulation","volume":"364","author":"Billard","year":"2019","journal-title":"Science"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/S0921-8890(96)00067-X","article-title":"Evolutionary robotics: The Sussex approach","volume":"20","author":"Harvey","year":"1997","journal-title":"Robot. Auton. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1109\/TRO.2004.829498","article-title":"Abstraction and control for groups of robots","volume":"20","author":"Belta","year":"2004","journal-title":"IEEE Trans. Robot."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Arents, J., and Greitans, M. (2022). Smart industrial robot control trends, challenges and opportunities within manufacturing. Appl. Sci., 12.","DOI":"10.3390\/app12020937"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1080\/02533839.2018.1473800","article-title":"Effective manipulation for industrial robot manipulators based on tablet PC","volume":"41","author":"Su","year":"2018","journal-title":"J. Chin. Inst. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Su, Y., Liao, C., Ko, C., Cheng, S., and Young, K.Y. (2017, January 17\u201320). An AR-based manipulation system for industrial robots. Proceedings of the 2017 11th Asian Control Conference (ASCC), Gold Coast, Australia.","DOI":"10.1109\/ASCC.2017.8287355"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Inkulu, A.K., Bahubalendruni, M.R., Dara, A., and SankaranarayanaSamy, K. (2021). Challenges and opportunities in human robot collaboration context of Industry 4.0\u2014A state of the art review. Industrial Robot: The International Journal of Robotics Research and Application, Emerald Publishing.","DOI":"10.1108\/IR-04-2021-0077"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Balaguer, C., and Abderrahim, M. (2008). Robotics and Automation in Construction, BoD\u2014Books on Demand.","DOI":"10.5772\/5865"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Capitanelli, A., Maratea, M., Mastrogiovanni, F., and Vallati, M. (2017, January 14\u201317). Automated planning techniques for robot manipulation tasks involving articulated objects. Proceedings of the Conference of the Italian Association for Artificial Intelligence, Bari, Italy.","DOI":"10.1007\/978-3-319-70169-1_36"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"331","DOI":"10.5545\/sv-jme.2017.4324","article-title":"Machine-vision-based human-oriented mobile robots: A review","volume":"63","year":"2017","journal-title":"Stroj. Vestn. J. Mech. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"103451","DOI":"10.1016\/j.robot.2020.103451","article-title":"I-Support: A robotic platform of an assistive bathing robot for the elderly population","volume":"126","author":"Zlatintsi","year":"2020","journal-title":"Robot. Auton. Syst."},{"key":"ref_35","unstructured":"Shahria, M.T., Iftekhar, L., and Rahman, M.H. (2020, January 19\u201321). Learning-Based Approaches in Swarm Robotics: In A Nutshell. Proceedings of the International Conference on Mechanical, Industrial and Energy Engineering 2020, Khulna, Bangladesh."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Martinez-Martin, E., and Del Pobil, A.P. (2019). Vision for robust robot manipulation. Sensors, 19.","DOI":"10.3390\/s19071648"},{"key":"ref_37","unstructured":"Budge, B. (2020). 1.1 Computer Vision in Robotics. Deep Learning Approaches for 3D Inference from Monocular Vision, Queensland University of Technology."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1016\/j.robot.2012.06.005","article-title":"An automated vision based on-line novel percept detection method for a mobile robot","volume":"60","author":"Wang","year":"2012","journal-title":"Robot. Auton. Syst."},{"key":"ref_39","unstructured":"Robot Vision-Sensor Solutions for Robotics, SICK. Available online: https:\/\/www.sick.com\/cl\/en\/robot-vision-sensor-solutions-for-robotics\/w\/robotics-robot-vision\/."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.robot.2013.11.003","article-title":"A survey on recent object detection techniques useful for monocular vision-based planetary terrain classification","volume":"62","author":"Gao","year":"2014","journal-title":"Robot. Auton. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/S0921-8890(00)00113-5","article-title":"A vision system for object verification and localization based on local features","volume":"34","author":"Baerveldt","year":"2001","journal-title":"Robot. Auton. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.robot.2014.11.009","article-title":"Vision-based topological mapping and localization methods: A survey","volume":"64","author":"Ortiz","year":"2015","journal-title":"Robot. Auton. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1677","DOI":"10.1007\/s10462-020-09888-5","article-title":"Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: A review","volume":"54","author":"Du","year":"2021","journal-title":"Artif. Intell. Rev."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1109\/TSMC.2016.2616343","article-title":"A novel vision-based tracking algorithm for a human-following mobile robot","volume":"47","author":"Gupta","year":"2016","journal-title":"IEEE Trans. Syst. Man, Cybern. Syst."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"7191","DOI":"10.1109\/TSMC.2020.2967786","article-title":"Visual trajectory tracking of wheeled mobile robots with uncalibrated camera extrinsic parameters","volume":"51","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Syst. Man, Cybern. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Lin, L., Yang, Y., Cheng, H., and Chen, X. (2019). Autonomous vision-based aerial grasping for rotorcraft unmanned aerial vehicles. Sensors, 19.","DOI":"10.3390\/s19153410"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1049\/iet-csr.2020.0013","article-title":"Review on vision-based tracking in surgical navigation","volume":"2","author":"Yang","year":"2020","journal-title":"IET Cyber-Syst. Robot."},{"key":"ref_48","first-page":"30","article-title":"A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms","volume":"22","author":"Kroemer","year":"2021","journal-title":"J. Mach. Learn. Res."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Ruiz-del Solar, J., and Loncomilla, P. (2020). Applications of deep learning in robot vision. Deep Learning in Computer Vision, CRC Press.","DOI":"10.1201\/9781351003827-8"},{"key":"ref_50","unstructured":"Watt, N. (2021). Deep Neural Networks for Robot Vision in Evolutionary Robotics, Nelson Mandela University."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1895897","DOI":"10.1155\/2017\/1895897","article-title":"A brief review of neural networks based learning and control and their applications for robots","volume":"2017","author":"Jiang","year":"2017","journal-title":"Complexity"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1410","DOI":"10.1109\/72.641464","article-title":"Neural-network-based robust fault diagnosis in robotic systems","volume":"8","author":"Vemuri","year":"1997","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1007\/BF00437601","article-title":"Artificial neural network based robot control: An overview","volume":"15","author":"Prabhu","year":"1996","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.robot.2004.09.010","article-title":"A study of neural network based inverse kinematics solution for a three-joint robot","volume":"49","author":"Ekiz","year":"2004","journal-title":"Robot. Auton. Syst."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1080\/01691864.2017.1365009","article-title":"Deep learning in robotics: A review of recent research","volume":"31","author":"Pierson","year":"2017","journal-title":"Adv. Robot."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.procir.2018.03.224","article-title":"Deep learning-based multimodal control interface for human\u2013robot collaboration","volume":"72","author":"Liu","year":"2018","journal-title":"Procedia CIRP"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"103515","DOI":"10.1016\/j.robot.2020.103515","article-title":"Skill transfer learning for autonomous robots and human\u2013robot cooperation: A survey","volume":"128","author":"Liu","year":"2020","journal-title":"Robot. Auton. Syst."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s10015-020-00618-2","article-title":"Detection of minute defects using transfer learning-based CNN models","volume":"26","author":"Nakashima","year":"2021","journal-title":"Artif. Life Robot."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Tanaka, K., Yonetani, R., Hamaya, M., Lee, R., Von Drigalski, F., and Ijiri, Y. (June, January 30). Trans-am: Transfer learning by aggregating dynamics models for soft robotic assembly. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561081"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Zarif, M.I.I., Shahria, M.T., Sunny, M.S.H., and Rahaman, M.M. (2022, January 02\u201304). A Vision-based Object Detection and Localization System in 3D Environment for Assistive Robots\u2019 Manipulation. Proceedings of the 9th International Conference of Control Systems, and Robotics (CDSR\u201922), Niagara Falls, Canada.","DOI":"10.11159\/cdsr22.112"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1109\/TRO.2010.2061290","article-title":"A kalman-filter-based method for pose estimation in visual servoing","volume":"26","author":"Marey","year":"2010","journal-title":"IEEE Trans. Robot."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"6860","DOI":"10.1109\/TIE.2014.2327553","article-title":"Particle-filter-based radio localization for mobile robots in the environments with low-density WLAN APs","volume":"61","author":"Wu","year":"2014","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_63","first-page":"1136","article-title":"Low-pass-filter-based position synchronization sliding mode control for multiple robotic manipulator systems","volume":"225","author":"Zhao","year":"2011","journal-title":"Proc. Inst. Mech. Eng. Part I J. Syst. Control Eng."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1109\/ACCESS.2016.2520093","article-title":"A novel eye-gaze-controlled wheelchair system for navigating unknown environments: Case study with a person with ALS","volume":"4","author":"Eid","year":"2016","journal-title":"IEEE Access"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1109\/LRA.2016.2521894","article-title":"Pupil variation applied to the eye tracking control of an endoscopic manipulator","volume":"1","author":"Cao","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_66","first-page":"1169","article-title":"Development of sensory-motor fusion-based manipulation and grasping control for a robotic hand-eye system","volume":"47","author":"Hu","year":"2016","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Nair, A., Chen, D., Agrawal, P., Isola, P., Abbeel, P., Malik, J., and Levine, S. (2017, January 29). Combining self-supervised learning and imitation for vision-based rope manipulation. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989247"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Cheng, H., Lin, L., Zheng, Z., Guan, Y., and Liu, Z. (2017, January 21\u201323). An autonomous vision-based target tracking system for rotorcraft unmanned aerial vehicles. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Exeter, UK.","DOI":"10.1109\/IROS.2017.8205986"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.neucom.2017.03.050","article-title":"Efficient deep network for vision-based object detection in robotic applications","volume":"245","author":"Lu","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Yao, N., Anaya, E., Tao, Q., Cho, S., Zheng, H., and Zhang, F. (2017, January 24\u201328). Monocular vision-based human following on miniature robotic blimp. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Vancouver, BC, Canada.","DOI":"10.1109\/ICRA.2017.7989369"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1109\/MRA.2016.2615329","article-title":"Object detection and recognition for assistive robots: Experimentation and implementation","volume":"24","year":"2017","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Abiyev, R.H., Arslan, M., Gunsel, I., and Cagman, A. (2017, January 21\u201323). Robot pathfinding using vision based obstacle detection. Proceedings of the 2017 3rd IEEE International Conference on Cybernetics (CYBCONF), Exeter, UK.","DOI":"10.1109\/CYBConf.2017.7985805"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s00138-017-0878-7","article-title":"Vision-based navigation of an unmanned surface vehicle with object detection and tracking abilities","volume":"29","author":"Shin","year":"2018","journal-title":"Mach. Vis. Appl."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"7127","DOI":"10.1007\/s13369-017-2917-0","article-title":"A vision-based real-time mobile robot controller design based on gaussian function for indoor environment","volume":"43","author":"Kocamaz","year":"2018","journal-title":"Arab. J. Sci. Eng."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"3013","DOI":"10.1007\/s12555-018-0017-x","article-title":"Autonomous vision-based target detection and safe landing for UAV","volume":"16","author":"Rabah","year":"2018","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Quillen, D., Jang, E., Nachum, O., Finn, C., Ibarz, J., and Levine, S. (2018, January 21\u201325). Deep reinforcement learning for vision-based robotic grasping: A simulated comparative evaluation of off-policy methods. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461039"},{"key":"ref_77","unstructured":"Kalashnikov, D., Irpan, A., Pastor, P., Ibarz, J., Herzog, A., Jang, E., Quillen, D., Holly, E., Kalakrishnan, M., and Vanhoucke, V. (2018). Qt-opt: Scalable deep reinforcement learning for vision-based robotic manipulation. arXiv."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Rahmatizadeh, R., Abolghasemi, P., B\u00f6l\u00f6ni, L., and Levine, S. (2018, January 21\u201325). Vision-based multi-task manipulation for inexpensive robots using end-to-end learning from demonstration. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461076"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.procs.2018.07.025","article-title":"Vision-based robot manipulator for industrial applications","volume":"133","author":"Ali","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_80","unstructured":"Ebert, F., Finn, C., Dasari, S., Xie, A., Lee, A., and Levine, S. (2018). Visual foresight: Model-based deep reinforcement learning for vision-based robotic control. arXiv."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Almeshal, A.M., and Alenezi, M.R. (2018). A vision-based neural network controller for the autonomous landing of a quadrotor on moving targets. Robotics, 7.","DOI":"10.3390\/robotics7040071"},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.neucom.2019.01.032","article-title":"A recurrent emotional CMAC neural network controller for vision-based mobile robots","volume":"334","author":"Fang","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1109\/LRA.2019.2893611","article-title":"Vision-based control and stability analysis of a cable-driven parallel robot","volume":"4","author":"Zake","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"1326","DOI":"10.1109\/TCST.2018.2790966","article-title":"Vision-based leader\u2013follower formation control of multiagents with visibility constraints","volume":"27","author":"Liu","year":"2018","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"7050915","DOI":"10.1155\/2019\/7050915","article-title":"Vision-based object recognition and precise localization for space body control","volume":"2019","author":"Shangguan","year":"2019","journal-title":"Int. J. Aerosp. Eng."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"1194","DOI":"10.1109\/LRA.2019.2893691","article-title":"Vision-based online learning kinematic control for soft robots using local gaussian process regression","volume":"4","author":"Fang","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"2344","DOI":"10.1109\/TNSRE.2019.2950619","article-title":"Proof of concept of an assistive robotic arm control using artificial stereovision and eye-tracking","volume":"27","author":"Cio","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_88","first-page":"178","article-title":"A novel robotic guidance system with eye gaze tracking control for needle based interventions","volume":"13","author":"Guo","year":"2019","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"25095","DOI":"10.1109\/ACCESS.2019.2900424","article-title":"Appearance-based gaze estimator for natural interaction control of surgical robots","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"10996","DOI":"10.1109\/JSEN.2020.2995395","article-title":"A novel vision-based grasping method under occlusion for manipulating robotic system","volume":"20","author":"Yu","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Du, Y.C., Muslikhin, M., Hsieh, T.H., and Wang, M.S. (2020). Stereo vision-based object recognition and manipulation by regions with convolutional neural network. Electronics, 9.","DOI":"10.3390\/electronics9020210"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Hu, T.K., Gama, F., Chen, T., Wang, Z., Ribeiro, A., and Sadler, B.M. (2021, January 6\u201311). VGAI: End-to-end learning of vision-based decentralized controllers for robot swarms. Proceedings of the ICASSP 2021\u20142021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.","DOI":"10.1109\/ICASSP39728.2021.9414219"},{"key":"ref_93","unstructured":"Jia, Z., Lin, M., Chen, Z., and Jian, S. (2020). Vision-based robot manipulation learning via human demonstrations. arXiv."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"50648","DOI":"10.1109\/ACCESS.2020.2980005","article-title":"Real-Time Iris Tracking Using Deep Regression Networks for Robotic Ophthalmic Surgery","volume":"8","author":"Qiu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.1109\/LRA.2020.2969953","article-title":"Eye-in-hand visual servoing enhanced with sparse strain measurement for soft continuum robots","volume":"5","author":"Wang","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1002\/asjc.2480","article-title":"Vision-based control architecture for human\u2013robot hand-over applications","volume":"23","author":"Melchiorre","year":"2021","journal-title":"Asian J. Control"},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10846-020-01290-1","article-title":"Vision-Based Imitation Learning of Needle Reaching Skill for Robotic Precision Manipulation","volume":"101","author":"Li","year":"2021","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"2282","DOI":"10.1109\/TII.2020.2995142","article-title":"Visual-Guided Robotic Object Grasping Using Dual Neural Network Controllers","volume":"17","author":"Fang","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_99","unstructured":"Roland, C., Choi, D., Kim, M., and Jang, J. (2021, January 3). Implementation of Enhanced Vision for an Autonomous Map-based Robot Navigation. Proceedings of the Korean Institute of Information and Commucation Sciences Conference, Yeosu, Republic of Korea."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"04020058","DOI":"10.1061\/(ASCE)CP.1943-5487.0000946","article-title":"Automated object manipulation using vision-based mobile robotic system for construction applications","volume":"35","author":"Asadi","year":"2021","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"85265","DOI":"10.1109\/ACCESS.2021.3082947","article-title":"Calibration-free monocular vision-based robot manipulations with occlusion awareness","volume":"9","author":"Luo","year":"2021","journal-title":"IEEE Access"},{"key":"ref_102","doi-asserted-by":"crossref","unstructured":"James, S., Wada, K., Laidlow, T., and Davison, A.J. (2021). Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisation. arXiv.","DOI":"10.1109\/CVPR52688.2022.01337"},{"key":"ref_103","doi-asserted-by":"crossref","unstructured":"Tang, X., Li, Y., Liu, X., Liu, D., Chen, Z., and Arai, T. (2022). Vision-Based Automated Control of Magnetic Microrobots. Micromachines, 13.","DOI":"10.3390\/mi13020337"},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"4606","DOI":"10.1109\/LRA.2022.3150497","article-title":"Vision-only robot navigation in a neural radiance world","volume":"7","author":"Adamkiewicz","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"107322","DOI":"10.1016\/j.ast.2021.107322","article-title":"Vision-based reduced-order adaptive control of aerial continuum manipulation systems","volume":"121","author":"Samadikhoshkho","year":"2022","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"1612","DOI":"10.1109\/LRA.2022.3140817","article-title":"Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulation","volume":"7","author":"James","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"Yin, R., Wu, H., Li, M., Cheng, Y., Song, Y., and Handroos, H. (2022). RGB-D-Based Robotic Grasping in Fusion Application Environments. Appl. Sci., 12.","DOI":"10.3390\/app12157573"},{"key":"ref_108","doi-asserted-by":"crossref","unstructured":"Abdi, A., Ranjbar, M.H., and Park, J.H. (2022). Computer vision-based path planning for robot arms in three-dimensional workspaces using Q-learning and neural networks. Sensors, 22.","DOI":"10.3390\/s22051697"},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Montoya Angulo, A., Pari Pinto, L., Sulla Espinoza, E., Silva Vidal, Y., and Supo Colquehuanca, E. (2022). Assisted Operation of a Robotic Arm Based on Stereo Vision for Positioning Near an Explosive Device. Robotics, 11.","DOI":"10.3390\/robotics11050100"},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"1575","DOI":"10.1080\/01691864.2015.1078743","article-title":"A review on vision-based control of flexible manipulators","volume":"29","author":"Hussein","year":"2015","journal-title":"Adv. Robot."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/0031-3203(73)90015-0","article-title":"Guiding a robot by visual feedback in assembling tasks","volume":"5","author":"Shirai","year":"1973","journal-title":"Pattern Recognit."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/11\/6\/139\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:33:10Z","timestamp":1760146390000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/11\/6\/139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,2]]},"references-count":111,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["robotics11060139"],"URL":"https:\/\/doi.org\/10.3390\/robotics11060139","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,2]]}}}