{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,1]],"date-time":"2026-03-01T07:12:58Z","timestamp":1772349178100,"version":"3.50.1"},"reference-count":35,"publisher":"Wiley","license":[{"start":{"date-parts":[[2022,3,23]],"date-time":"2022-03-23T00:00:00Z","timestamp":1647993600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Accelerate Program","award":["IT14727"],"award-info":[{"award-number":["IT14727"]}]},{"name":"Accelerate Program","award":["RGPIN-2017-05762"],"award-info":[{"award-number":["RGPIN-2017-05762"]}]},{"DOI":"10.13039\/501100004489","name":"Mitacs","doi-asserted-by":"publisher","award":["IT14727"],"award-info":[{"award-number":["IT14727"]}],"id":[{"id":"10.13039\/501100004489","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004489","name":"Mitacs","doi-asserted-by":"publisher","award":["RGPIN-2017-05762"],"award-info":[{"award-number":["RGPIN-2017-05762"]}],"id":[{"id":"10.13039\/501100004489","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Discovery Program","award":["IT14727"],"award-info":[{"award-number":["IT14727"]}]},{"name":"Discovery Program","award":["RGPIN-2017-05762"],"award-info":[{"award-number":["RGPIN-2017-05762"]}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["IT14727"],"award-info":[{"award-number":["IT14727"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2017-05762"],"award-info":[{"award-number":["RGPIN-2017-05762"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Sensors"],"published-print":{"date-parts":[[2022,3,23]]},"abstract":"<jats:p>The fourth industrial revolution (industry 4.0) demands high-autonomy and intelligence robotic manipulators. The goal is to accomplish autonomous manipulation tasks without human interventions. However, visual pose estimation of target object in 3D space is one of the critical challenges for robot-object interaction. Incorporating the estimated pose into an autonomous manipulation control scheme is another challenge. In this paper, a deep-ConvNet algorithm is developed for object pose estimation. Then, it is integrated into a 3D visual servoing to achieve a long-range mobile manipulation task using a single camera setup. The proposed system integrates (1) deep-ConvNet training using only synthetic single images, (2) 6DOF object pose estimation as sensing feedback, and (3) autonomous long-range mobile manipulation control. The developed system consists of two main steps. First, a perception network trains on synthetic datasets and then efficiently generalizes to real-life environment without postrefinements. Second, the execution step takes the estimated pose to generate continuous translational and orientational joint velocities. The proposed system has been experimentally verified and discussed using the Husky mobile base and 6DOF UR5 manipulator. Experimental findings from simulations and real-world settings showed the efficiency of using synthetic datasets in mobile manipulation task.<\/jats:p>","DOI":"10.1155\/2022\/3511265","type":"journal-article","created":{"date-parts":[[2022,3,23]],"date-time":"2022-03-23T16:20:24Z","timestamp":1648052424000},"page":"1-13","source":"Crossref","is-referenced-by-count":3,"title":["DeepNet-Based 3D Visual Servoing Robotic Manipulation"],"prefix":"10.1155","volume":"2022","author":[{"given":"Abdulrahman","family":"Al-Shanoon","sequence":"first","affiliation":[{"name":"Department of Automotive and Mechatronics Engineering, Ontario Tech University, Oshawa, ON, L1G 0C5, Canada"}]},{"given":"Yanjun","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Automotive and Mechatronics Engineering, Ontario Tech University, Oshawa, ON, L1G 0C5, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3552-1944","authenticated-orcid":true,"given":"Haoxiang","family":"Lang","sequence":"additional","affiliation":[{"name":"Department of Automotive and Mechatronics Engineering, Ontario Tech University, Oshawa, ON, L1G 0C5, Canada"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"crossref","article-title":"Towards remote teleoperation of a semi-autonomous mobile manipulator system in machine tending tasks","author":"V. Annem","DOI":"10.1115\/MSEC2019-3027"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1177\/1729881417718588"},{"issue":"2","key":"3","doi-asserted-by":"crossref","first-page":"1202","DOI":"10.1109\/TII.2018.2879426","article-title":"Dexterous grasping by manipulability selection for mobile manipulator with visual guidance","volume":"15","author":"F. Chen","year":"2018","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"4","doi-asserted-by":"crossref","article-title":"Posecnn: a convolutional neural network for 6d object pose estimation in cluttered scenes","author":"Y. Xiang","DOI":"10.15607\/RSS.2018.XIV.019"},{"key":"5","first-page":"2038","article-title":"Falling things: a synthetic dataset for 3d object detection and pose estimation","author":"J. Tremblay"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2020.103433"},{"key":"7","first-page":"1521","article-title":"Ssd-6d: making rgb-based 3d detection and 6d pose estimation great again","author":"W. Kehl"},{"key":"8","first-page":"3828","article-title":"Bb8: a scalable, accurate, robust to partial occlusion method for predicting the 3d poses of challenging objects without using depth","author":"M. Rad"},{"key":"9","first-page":"292","article-title":"Real-time seamless single shot 6d object pose prediction","author":"B. Tekin"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.3390\/s20030939"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2019.2927955"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1177\/0278364918754677"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2018.01.005"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8460950"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-018-1073-7"},{"key":"16","first-page":"3234","article-title":"The synthia dataset: a large collection of synthetic images for semantic segmentation of urban scenes","author":"G. Ros"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8202133"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2015.2510749"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1109\/JSYST.2014.2358876"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1177\/1729881417752738"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.3991\/ijoe.v14i02.7789"},{"key":"22","first-page":"138","article-title":"Fuzzy logic controller ith color vision system tracking for mobile manipulator robot","volume-title":"International Conference on Advanced Machine Learning Technologies and Applications","author":"A. T. Azar","year":"2018"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-013-9883-x"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1109\/ICAR.2015.7251504"},{"key":"25","article-title":"Very deep convolutional networks for large-scale image recognition","author":"K. Simonyan"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-008-0152-6"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611970920"},{"key":"29","volume-title":"Automatic Differentiation in Pytorch","author":"A. Paszke","year":"2017"},{"key":"30","article-title":"Adam: a method for stochastic optimization","author":"D. P. Kingma"},{"key":"31","first-page":"4724","article-title":"Convolutional pose machines","author":"S. E. Wei"},{"key":"32","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2016.10.033"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8461068"},{"key":"34","article-title":"End-to-end learning of semantic grasping","author":"E. Jang"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2016.7759615"}],"container-title":["Journal of Sensors"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2022\/3511265.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2022\/3511265.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2022\/3511265.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,23]],"date-time":"2022-03-23T16:20:47Z","timestamp":1648052447000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/js\/2022\/3511265\/"}},"subtitle":[],"editor":[{"given":"Min","family":"Xia","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,3,23]]},"references-count":35,"alternative-id":["3511265","3511265"],"URL":"https:\/\/doi.org\/10.1155\/2022\/3511265","relation":{},"ISSN":["1687-7268","1687-725X"],"issn-type":[{"value":"1687-7268","type":"electronic"},{"value":"1687-725X","type":"print"}],"subject":[],"published":{"date-parts":[[2022,3,23]]}}}