{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T15:12:11Z","timestamp":1753888331671,"version":"3.41.2"},"reference-count":42,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2021,7,24]],"date-time":"2021-07-24T00:00:00Z","timestamp":1627084800000},"content-version":"vor","delay-in-days":204,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Journal of Sensors"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>The adjustment times of the attitude alignment are fluctuated due to the fluctuation of the contact force signal caused by the disturbing moments in the compliant peg\u2010in\u2010hole assembly. However, these fluctuations are difficult to accurately measure or definition as a result of many uncertain factors in the working environment. It is worth noting that gravitational disturbing moments and inertia moments significantly impact these fluctuations, in which the changes of the peg concerning the mass and the length have a crucial influence on them. In this paper, a visual grasping strategy based on deep reinforcement learning is proposed for peg\u2010in\u2010hole assembly. Firstly, the disturbing moments of assembly are analyzed to investigate the factors for the fluctuation of assembly time. Then, this research designs a visual grasping strategy, which establishes a mapping relationship between the grasping position and the assembly time to improve the assembly efficiency. Finally, a robotic system for the assembly was built in V\u2010REP to verify the effectiveness of the proposed method, and the robot can complete the training independently without human intervention and manual labeling in the grasping training process. The simulated results show that this method can improve assembly efficiency by 13.83%. And, when the mass and the length of the peg change, the proposed method is still effective for the improvement of assembly efficiency.<\/jats:p>","DOI":"10.1155\/2021\/8741454","type":"journal-article","created":{"date-parts":[[2021,7,24]],"date-time":"2021-07-24T17:50:07Z","timestamp":1627149007000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Visual Grasping Strategy for Improving Assembly Efficiency Based on Deep Reinforcement Learning"],"prefix":"10.1155","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1105-6275","authenticated-orcid":false,"given":"Yongzhi","family":"Wang","sequence":"first","affiliation":[]},{"given":"Sicheng","family":"Zhu","sequence":"additional","affiliation":[]},{"given":"Qian","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Ran","family":"Zhou","sequence":"additional","affiliation":[]},{"given":"Rutong","family":"Dou","sequence":"additional","affiliation":[]},{"given":"Haonan","family":"Sun","sequence":"additional","affiliation":[]},{"given":"Qingfeng","family":"Yao","sequence":"additional","affiliation":[]},{"given":"Mingwei","family":"Xu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5762-7726","authenticated-orcid":false,"given":"Yu","family":"Zhang","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2021,7,24]]},"reference":[{"key":"e_1_2_8_1_2","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2019.1691941"},{"key":"e_1_2_8_2_2","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2019.1694068"},{"key":"e_1_2_8_3_2","doi-asserted-by":"publisher","DOI":"10.1111\/itor.12167"},{"key":"e_1_2_8_4_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2019.00042"},{"key":"e_1_2_8_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2018.2792694"},{"key":"e_1_2_8_6_2","doi-asserted-by":"crossref","unstructured":"Watkins-VallsD. VarleyJ. andAllenP. Multi-modal geometric learning for grasping and manipulation 2019 International Conference on Robotics and Automation (ICRA) 2019 Montreal QC Canada 7339\u20137345 https:\/\/doi.org\/10.1109\/icra.2019.8794233 2-s2.0-85071449541.","DOI":"10.1109\/ICRA.2019.8794233"},{"key":"e_1_2_8_7_2","doi-asserted-by":"crossref","unstructured":"DengJ. DongW. SocherR. LiL.-J. LiK. andFei-FeiL. Imagenet: a large-scale hierarchical image database 2009 IEEE Conference on Computer Vision and Pattern Recognition 2009 Miami FL USA 248\u2013255 https:\/\/doi.org\/10.1109\/cvpr.2009.5206848.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_8_8_2","doi-asserted-by":"crossref","unstructured":"LinY. RenS. ClevengerM. andSunY. Learning grasping force from demonstration 2012 IEEE International Conference on Robotics and Automation 2012 Saint Paul MN USA 1526\u20131531 https:\/\/doi.org\/10.1109\/ICRA.2012.6225222 2-s2.0-84864483234.","DOI":"10.1109\/ICRA.2012.6225222"},{"key":"e_1_2_8_9_2","doi-asserted-by":"crossref","unstructured":"MaS. DuL. TsuchiyaE. andFuchimiM. Paper-made grippers for soft food grasping 2020 17th International Conference on Ubiquitous Robots (UR) 2020 Kyoto Japan 362\u2013367 https:\/\/doi.org\/10.1109\/UR49135.2020.9144853.","DOI":"10.1109\/UR49135.2020.9144853"},{"key":"e_1_2_8_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymssp.2020.107579"},{"key":"e_1_2_8_11_2","doi-asserted-by":"crossref","unstructured":"GerezL. GaoG. andLiarokapisM. Employing magnets to improve the force exertion capabilities of adaptive robot hands in precision grasps 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) 2019 Macau China 7630\u20137635 https:\/\/doi.org\/10.1109\/iros40897.2019.8967939.","DOI":"10.1109\/IROS40897.2019.8967939"},{"key":"e_1_2_8_12_2","doi-asserted-by":"crossref","unstructured":"SchmidtsA. M. LeeD. andPeerA. Imitation learning of human grasping skills from motion and force data 2011 IEEE\/RSJ International Conference on Intelligent Robots and Systems 2011 San Francisco CA USA 1002\u20131007 https:\/\/doi.org\/10.1109\/iros.2011.6048638 2-s2.0-84455170214.","DOI":"10.1109\/IROS.2011.6094951"},{"key":"e_1_2_8_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2018.03.003"},{"key":"e_1_2_8_14_2","doi-asserted-by":"crossref","unstructured":"BianchiM. AvertaG. BattagliaE. RosalesC. BonillaM. TondoA. PoggianiM. SantaeraG. CiottiS. CatalanoM. G. andBicchiA. Touch-based grasp primitives for soft hands: applications to human-to-robot handover tasks and beyond 2018 IEEE International Conference on Robotics and Automation (ICRA) 2018 Brisbane QLD Australia 7794\u20137801 https:\/\/doi.org\/10.1109\/icra.2018.8463212 2-s2.0-85063156407.","DOI":"10.1109\/ICRA.2018.8463212"},{"key":"e_1_2_8_15_2","doi-asserted-by":"crossref","unstructured":"Merzi\u0107H. Bogdanovi\u0107M. KapplerD. RighettiL. andBohgJ. Leveraging contact forces for learning to grasp 2019 international conference on robotics and automation (ICRA) 2019 Montreal QC Canada 3615\u20133621 https:\/\/doi.org\/10.1109\/ICRA.2019.8793733 2-s2.0-85071422957.","DOI":"10.1109\/ICRA.2019.8793733"},{"key":"e_1_2_8_16_2","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2019.1698461"},{"key":"e_1_2_8_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-019-09891-y"},{"key":"e_1_2_8_18_2","doi-asserted-by":"crossref","unstructured":"XieX. LiC. ZhangC. ZhuY. andZhuS.-C. Learning virtual grasp with failed demonstrations via bayesian inverse reinforcement learning 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) 2019 Macau China https:\/\/doi.org\/10.1109\/iros40897.2019.8968063.","DOI":"10.1109\/IROS40897.2019.8968063"},{"key":"e_1_2_8_19_2","doi-asserted-by":"crossref","unstructured":"ZimmerJ. HellebrekersT. AsfourT. MajidiC. andKroemerO. Predicting grasp success with a soft sensing skin and shape-memory actuated gripper 2019 IEEE\/RSJ international conference on intelligent robots and systems (IROS) 2019 Macau China 7120\u20137127 https:\/\/doi.org\/10.1109\/iros40897.2019.8967558.","DOI":"10.1109\/IROS40897.2019.8967558"},{"key":"e_1_2_8_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-019-02098-7"},{"key":"e_1_2_8_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2019.09.006"},{"key":"e_1_2_8_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TASE.2018.2871354"},{"key":"e_1_2_8_23_2","doi-asserted-by":"crossref","unstructured":"TanwaniA. K. MorN. KubiatowiczJ. GonzalezJ. E. andGoldbergK. A fog robotics approach to deep robot learning: application to object recognition and grasp planning in surface decluttering 2019 international conference on robotics and automation (ICRA) 2019 Montreal QC Canada 4559\u20134566 https:\/\/doi.org\/10.1109\/icra.2019.8793690 2-s2.0-85071496466.","DOI":"10.1109\/ICRA.2019.8793690"},{"key":"e_1_2_8_24_2","doi-asserted-by":"crossref","unstructured":"WuB. AkinolaI. andAllenP. K. Pixel-attentive policy gradient for multi-fingered grasping in cluttered scenes 2019 https:\/\/arxiv.org\/abs\/1903.03227.","DOI":"10.1109\/IROS40897.2019.8968263"},{"key":"e_1_2_8_25_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aau4984"},{"key":"e_1_2_8_26_2","doi-asserted-by":"crossref","unstructured":"KragicD. MillerA. T. andAllenP. K. Real-time tracking meets online grasp planning 3 Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164) 2001 Seoul Korea (South) 2460\u20132465 https:\/\/doi.org\/10.1109\/ROBOT.2001.932992 2-s2.0-0034873738.","DOI":"10.1109\/ROBOT.2001.932992"},{"key":"e_1_2_8_27_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364914549607"},{"key":"e_1_2_8_28_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364917710318"},{"key":"e_1_2_8_29_2","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2018.1520145"},{"key":"e_1_2_8_30_2","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2018.1509018"},{"key":"e_1_2_8_31_2","unstructured":"MnihV. KavukcuogluK. SilverD. GravesA. AntonoglouI. WierstraD. andRiedmillerM. Playing atari with deep reinforcement learning 2013 https:\/\/arxiv.org\/pdf\/1312.5602\/."},{"key":"e_1_2_8_32_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_2_8_33_2","doi-asserted-by":"crossref","unstructured":"ZengA. SongS. WelkerS. LeeJ. RodriguezA. andFunkhouserT. Learning synergies between pushing and grasping with self-supervised deep reinforcement learning 2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS) 2018 Madrid Spain 4238\u20134245 https:\/\/doi.org\/10.1109\/iros.2018.8593986 2-s2.0-85060062627.","DOI":"10.1109\/IROS.2018.8593986"},{"key":"e_1_2_8_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-55130-8_20"},{"key":"e_1_2_8_35_2","doi-asserted-by":"crossref","unstructured":"PedersenO. M. MisimiE. andChaumetteF. Grasping unknown objects by coupling deep reinforcement learning generative adversarial networks and visual servoing 2020 IEEE international conference on robotics and automation (ICRA) 2020 Paris France 5655\u20135662 https:\/\/doi.org\/10.1109\/icra40945.2020.9197196.","DOI":"10.1109\/ICRA40945.2020.9197196"},{"key":"e_1_2_8_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/tie.2018.2838069"},{"key":"e_1_2_8_37_2","doi-asserted-by":"crossref","unstructured":"TangT. LinH. C. ZhaoY. ChenW. andTomizukaM. Autonomous alignment of peg and hole by force\/torque measurement for robotic assembly 2016 IEEE international conference on automation science and engineering (CASE) 2016 Fort Worth TX USA 162\u2013167 https:\/\/doi.org\/10.1109\/coase.2016.7743375 2-s2.0-85000893952.","DOI":"10.1109\/COASE.2016.7743375"},{"key":"e_1_2_8_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2946406"},{"key":"e_1_2_8_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIE.2017.2682002"},{"key":"e_1_2_8_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2954459"},{"key":"e_1_2_8_41_2","doi-asserted-by":"crossref","unstructured":"InoueT. De MagistrisG. MunawarA. YokoyaT. andTachibanaR. Deep reinforcement learning for high precision assembly tasks 2017 IEEE\/RSJ international conference on intelligent robots and systems (IROS) 2017 Vancouver BC Canada 819\u2013825 https:\/\/doi.org\/10.1109\/iros.2017.8202244 2-s2.0-85035809381.","DOI":"10.1109\/IROS.2017.8202244"},{"key":"e_1_2_8_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2019.01.087"}],"container-title":["Journal of Sensors"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2021\/8741454.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2021\/8741454.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2021\/8741454","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T01:09:01Z","timestamp":1722906541000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2021\/8741454"}},"subtitle":[],"editor":[{"given":"Kelvin","family":"Wong","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1155\/2021\/8741454"],"URL":"https:\/\/doi.org\/10.1155\/2021\/8741454","archive":["Portico"],"relation":{},"ISSN":["1687-725X","1687-7268"],"issn-type":[{"type":"print","value":"1687-725X"},{"type":"electronic","value":"1687-7268"}],"subject":[],"published":{"date-parts":[[2021,1]]},"assertion":[{"value":"2021-05-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"8741454"}}