{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T10:45:45Z","timestamp":1766486745789,"version":"3.41.2"},"reference-count":25,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01","funder":[{"name":"ubei Province Safety Production Special Fund","award":["SJZX20211006"],"award-info":[{"award-number":["SJZX20211006"]}]},{"name":"Optical Valley Talent Plan","award":["3551"],"award-info":[{"award-number":["3551"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Model. Simul. Sci. Comput."],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:p> Radioactive waste sorting often faces an unstructured and locally radioactive working environment. At present, remote operation sorting has problems such as low sorting efficiency, greater difficulty in operation, longer training periods for personnel, and poor autonomous control capabilities. Based on the premise of improving the adaptability and autonomous operation ability of robots in an unstructured environment, this paper uses the dual deep Q learning algorithm to optimize the classic deep Q learning algorithm to improve training speed and improve sorting efficiency and stability. Secondly, the sorting algorithm model of deep reinforcement learning is used to determine the optimal behavior in this state. Set up multiple sets of simulations and physical experiments to verify the sorting method. The results show that the robotic arm can autonomously complete sorting tasks under complex conditions and can significantly improve work efficiency when pushing and grasping collaborative operations and will preferentially grasp objects with high radioactivity in the radioactive area. The algorithm has migration ability and good generalization. <\/jats:p>","DOI":"10.1142\/s1793962323410076","type":"journal-article","created":{"date-parts":[[2022,3,1]],"date-time":"2022-03-01T01:54:05Z","timestamp":1646099645000},"source":"Crossref","is-referenced-by-count":2,"title":["Sorting operation method of manipulator based on deep reinforcement learning"],"prefix":"10.1142","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3219-2591","authenticated-orcid":false,"given":"Qing","family":"An","sequence":"first","affiliation":[{"name":"Artificial Intelligence School, Wuchang University of Technology, Wuhan 430223, P. R. China"}]},{"given":"Yanhua","family":"Chen","sequence":"additional","affiliation":[{"name":"Artificial Intelligence School, Wuchang University of Technology, Wuhan 430223, P. R. China"}]},{"given":"Hui","family":"Zeng","sequence":"additional","affiliation":[{"name":"Artificial Intelligence School, Wuchang University of Technology, Wuhan 430223, P. R. China"}]},{"given":"Junhua","family":"Wang","sequence":"additional","affiliation":[{"name":"Artificial Intelligence School, Wuchang University of Technology, Wuhan 430223, P. R. China"}]}],"member":"219","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"issue":"05","key":"S1793962323410076BIB001","first-page":"1","volume":"39","author":"Chengkun Z.","year":"2018","journal-title":"Nucl. Power Eng."},{"issue":"01","key":"S1793962323410076BIB002","first-page":"230","volume":"41","author":"Zhengwan W.","year":"2019","journal-title":"Res. Agric. Mech."},{"issue":"04","key":"S1793962323410076BIB003","first-page":"24","volume":"34","author":"Na G.","year":"2020","journal-title":"J. Shandong Univ. Technol."},{"issue":"02","key":"S1793962323410076BIB004","first-page":"423","volume":"20","author":"Shaobo L.","year":"2020","journal-title":"Sci. Technol. Eng."},{"issue":"2","key":"S1793962323410076BIB005","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s10514-014-9382-3","volume":"37","author":"Becerra H. M.","year":"2014","journal-title":"Auton. Robots"},{"key":"S1793962323410076BIB006","first-page":"26","volume":"17","author":"Bo S.","year":"2019","journal-title":"Comput. Eng. Appl."},{"key":"S1793962323410076BIB008","first-page":"1","volume":"2020","author":"Bin Z.","year":"2020","journal-title":"Robot"},{"volume-title":"Research on Deep Reinforcement Learning Based on Q-Learning","year":"2021","author":"Guanfeng M.","key":"S1793962323410076BIB009"},{"issue":"3","key":"S1793962323410076BIB010","doi-asserted-by":"crossref","first-page":"032065","DOI":"10.1088\/1742-6596\/1748\/3\/032065","volume":"1748","author":"Zeng W.","year":"2021","journal-title":"J. Phy. Conf. Ser."},{"key":"S1793962323410076BIB011","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neunet.2018.08.001","volume":"107","author":"Sun R.","year":"2018","journal-title":"Neural Networks"},{"journal-title":"IEEE Journal on Selected Areas in Communications","year":"2021","author":"Huang C.","key":"S1793962323410076BIB012"},{"volume-title":"Research on Hand-eye Calibration and Target Tracking Method of Industrial Robot","year":"2018","author":"Zhifang L.","key":"S1793962323410076BIB014"},{"key":"S1793962323410076BIB015","first-page":"1097","author":"Krizhevsky A.","year":"2012","journal-title":"Adv. Neural Inform. Process. Syst."},{"key":"S1793962323410076BIB017","first-page":"1","volume-title":"Proc. IEEE Conf. Computer Vision and Pattern Recognition","author":"Szegedy C.","year":"2015"},{"key":"S1793962323410076BIB018","first-page":"770","volume-title":"IEEE Conf. Computer Vision and Pattern Recognition (CVPR)","author":"He K.","year":"2016"},{"key":"S1793962323410076BIB019","first-page":"4700","volume-title":"Proc. IEEE Conf. Computer Vision and Pattern Recognition","author":"Huang G.","year":"2017"},{"issue":"09","key":"S1793962323410076BIB021","first-page":"36","volume":"2018","author":"Limei W.","year":"2018","journal-title":"Comput. Telecom."},{"issue":"06","key":"S1793962323410076BIB022","first-page":"51","volume":"36","author":"Zhuangwei J.","year":"2020","journal-title":"J. Shanxi Datong Univ."},{"issue":"04","key":"S1793962323410076BIB023","first-page":"55","volume":"42","author":"Pu W.","year":"2021","journal-title":"Coal Mine Mach."},{"issue":"2","key":"S1793962323410076BIB024","first-page":"65","volume":"54","author":"Wang W.","year":"2020","journal-title":"Eur. J Remote Sens."},{"key":"S1793962323410076BIB025","first-page":"1321","volume-title":"2013 IEEE\/RSJ Int. Conf. Intelligent Robots and Systems","author":"Rohmer E.","year":"2013"},{"issue":"4","key":"S1793962323410076BIB026","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1007\/s12652-019-01229-x","volume":"11","author":"Cobos-Guzman S.","year":"2019","journal-title":"J. Amb. Intell. Human. Comput."},{"key":"S1793962323410076BIB027","first-page":"120","volume":"2021","author":"Enkan W.","year":"2021","journal-title":"Inform. Technol. Inform."},{"issue":"01","key":"S1793962323410076BIB028","first-page":"31","volume":"2008","author":"Xiuqing Y.","year":"2008","journal-title":"Robot Technol. Appl."},{"key":"S1793962323410076BIB029","doi-asserted-by":"crossref","first-page":"106765","DOI":"10.1016\/j.compeleceng.2020.106765","volume":"87","author":"Koppu S.","year":"2020","journal-title":"Comput. Electric. Eng."}],"container-title":["International Journal of Modeling, Simulation, and Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1793962323410076","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,22]],"date-time":"2023-03-22T07:12:44Z","timestamp":1679469164000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S1793962323410076"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":25,"journal-issue":{"issue":"01","published-print":{"date-parts":[[2023,2]]}},"alternative-id":["10.1142\/S1793962323410076"],"URL":"https:\/\/doi.org\/10.1142\/s1793962323410076","relation":{},"ISSN":["1793-9623","1793-9615"],"issn-type":[{"type":"print","value":"1793-9623"},{"type":"electronic","value":"1793-9615"}],"subject":[],"published":{"date-parts":[[2022,2,25]]},"article-number":"2341007"}}