{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T07:41:02Z","timestamp":1776498062526,"version":"3.51.2"},"reference-count":20,"publisher":"World Scientific Pub Co Pte Ltd","issue":"18","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61906021"],"award-info":[{"award-number":["61906021"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J CIRCUIT SYST COMP"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:p> Twin delayed deep deterministic (TD3) policy gradient has several limitations when applied in planning a path in environment with a number of dilemmas according to our experiment, due to the complexity of the robot path planning task, the rate of convergence of TD3 algorithm is slow and the rate of collision is high. To address this problem, deep dense dueling twin delayed deep deterministic (D3-TD3) architecture is proposed, a method that preserves important information from cross-layer inputs through dense connections and divides the network into a value function and a dominance function, thus, allowing for faster convergence when solving complex tasks. Finally, a spatial model based on three-dimension (3D) point cloud is built, and simulation experimental results show that in static environment, the algorithm proposed in the paper has 40.6% fewer collisions compared to TD3, 30% fewer collisions compared to TD3-BC, 19.2% fewer collisions compared to Dueling TD3 and 17.4% fewer collisions compared to deep dense TD3. In dynamic and static environment, the algorithm proposed in the paper has 34.4% fewer collisions compared to TD3, 24% fewer collisions compared to TD3-BC, 6% fewer collisions compared to Dueling TD3 and 25% fewer collisions compared to deep dense TD3. <\/jats:p>","DOI":"10.1142\/s021812662350305x","type":"journal-article","created":{"date-parts":[[2023,4,30]],"date-time":"2023-04-30T08:15:40Z","timestamp":1682842540000},"source":"Crossref","is-referenced-by-count":6,"title":["D3-TD3: Deep Dense Dueling Architectures in TD3 Algorithm for Robot Path Planning Based on 3D Point Cloud"],"prefix":"10.1142","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3148-9414","authenticated-orcid":false,"given":"Yuwan","family":"Gu","sequence":"first","affiliation":[{"name":"Digital Twin Technology Engineering Research Center for Key Equipment of Petrochemical Process, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"},{"name":"College of Computer Science and Artificial Intelligence, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhitao","family":"Zhu","sequence":"additional","affiliation":[{"name":"Digital Twin Technology Engineering Research Center for Key Equipment of Petrochemical Process, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"},{"name":"College of Computer Science and Artificial Intelligence, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongtao","family":"Chu","sequence":"additional","affiliation":[{"name":"Digital Twin Technology Engineering Research Center for Key Equipment of Petrochemical Process, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"},{"name":"College of Computer Science and Artificial Intelligence, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jidong","family":"Lv","sequence":"additional","affiliation":[{"name":"Digital Twin Technology Engineering Research Center for Key Equipment of Petrochemical Process, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"},{"name":"College of Computer Science and Artificial Intelligence, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xueyuan","family":"Wang","sequence":"additional","affiliation":[{"name":"Digital Twin Technology Engineering Research Center for Key Equipment of Petrochemical Process, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"},{"name":"College of Computer Science and Artificial Intelligence, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7119-1006","authenticated-orcid":false,"given":"Shoukun","family":"Xu","sequence":"additional","affiliation":[{"name":"Digital Twin Technology Engineering Research Center for Key Equipment of Petrochemical Process, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"},{"name":"College of Computer Science and Artificial Intelligence, Changzhou University, 21 Gehu Rd, Changzhou 213164, Jiangsu Province, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2023,6,14]]},"reference":[{"key":"S021812662350305XBIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2021.102289"},{"key":"S021812662350305XBIB002","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2022.03.037"},{"key":"S021812662350305XBIB003","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-211801"},{"key":"S021812662350305XBIB004","first-page":"7820","volume":"17","author":"Zhou J. L.","year":"2021","journal-title":"IEEE Trans. Ind. Electron."},{"key":"S021812662350305XBIB005","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2021.3068095"},{"key":"S021812662350305XBIB006","doi-asserted-by":"publisher","DOI":"10.1109\/TASE.2021.3062408"},{"key":"S021812662350305XBIB008","first-page":"2231","volume":"17","author":"Wang X. K.","year":"2020","journal-title":"IEEE Trans. Ind. Electron."},{"key":"S021812662350305XBIB009","first-page":"40","volume":"36","author":"Wang X. K.","year":"2022","journal-title":"IEEE Netw."},{"key":"S021812662350305XBIB010","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"S021812662350305XBIB011","first-page":"1995","volume-title":"Proc. 33rd ACM Int. Conf. Machine Learning","author":"Wang Z.","year":"2016"},{"key":"S021812662350305XBIB012","first-page":"387","volume-title":"Proc. 31st ACM Int. Conf. Machine Learning","author":"Silver D.","year":"2014"},{"key":"S021812662350305XBIB013","first-page":"1","volume-title":"Proc. 4th Int. Conf. Learning Representations","author":"Timothy P. L.","year":"2016"},{"key":"S021812662350305XBIB014","first-page":"1","volume-title":"Proc. 35rd ACM Int. Conf. Machine Learning","author":"Fujimoto S.","year":"2018"},{"key":"S021812662350305XBIB015","first-page":"1889","volume-title":"Proc. 32nd ACM Int. Conf. Machine Learning","author":"Schulman J.","year":"2015"},{"key":"S021812662350305XBIB017","first-page":"1","volume-title":"Proc. 37th ACM Int. Conf. Machine Learning","author":"Ota K.","year":"2020"},{"key":"S021812662350305XBIB018","first-page":"20132","volume-title":"Advances in Neural Information Processing Systems (NIPS)","volume":"34","author":"Fujimoto S.","year":"2021"},{"key":"S021812662350305XBIB019","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JSEN.2020.3014328","volume":"20","author":"Guo S. Y.","year":"2020","journal-title":"Sensors"},{"key":"S021812662350305XBIB020","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3102185"},{"key":"S021812662350305XBIB021","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JSEN.2020.3014328","volume":"20","author":"Junli G.","year":"2020","journal-title":"Sensors"},{"key":"S021812662350305XBIB023","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.125"}],"container-title":["Journal of Circuits, Systems and Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S021812662350305X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,5]],"date-time":"2024-02-05T08:25:57Z","timestamp":1707121557000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S021812662350305X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,14]]},"references-count":20,"journal-issue":{"issue":"18","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["10.1142\/S021812662350305X"],"URL":"https:\/\/doi.org\/10.1142\/s021812662350305x","relation":{},"ISSN":["0218-1266","1793-6454"],"issn-type":[{"value":"0218-1266","type":"print"},{"value":"1793-6454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,14]]},"article-number":"2350305"}}