{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T07:09:36Z","timestamp":1780384176736,"version":"3.54.1"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,8,7]],"date-time":"2022-08-07T00:00:00Z","timestamp":1659830400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,7]],"date-time":"2022-08-07T00:00:00Z","timestamp":1659830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"University of Eastern Finland (UEF) including Kuopio University Hospital"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Manuf"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Robotic motion planning in dense and dynamic indoor scenarios constantly challenges the researchers because of the motion unpredictability of obstacles. Recent progress in reinforcement learning enables robots to better cope with the dense and unpredictable obstacles by encoding complex features of the robot and obstacles into the encoders like the <jats:italic>long-short term memory<\/jats:italic> (LSTM). Then these features are learned by the robot using reinforcement learning algorithms, such as the deep Q network and asynchronous advantage actor critic algorithm. However, existing methods depend heavily on expert experiences to enhance the convergence speed of the networks by initializing them via imitation learning. Moreover, those approaches based on LSTM to encode the obstacle features are not always efficient and robust enough, therefore sometimes causing the network overfitting in training. This paper focuses on the advantage actor critic algorithm and introduces an <jats:italic>attention-based actor critic algorithm with experience replay algorithm<\/jats:italic> to improve the performance of existing algorithm from two perspectives. First, LSTM encoder is replaced by a robust encoder <jats:italic>attention weight<\/jats:italic> to better interpret the complex features of the robot and obstacles. Second, the robot learns from its past prioritized experiences to initialize the networks of the advantage actor-critic algorithm. This is achieved by applying the <jats:italic>prioritized experience replay<\/jats:italic> method, which makes the best of past useful experiences to improve the convergence speed. As results, the network based on our algorithm takes only around 15% and 30% experiences to get rid of the early-stage training without the expert experiences in cases with five and ten obstacles, respectively. Then it converges faster to a better reward with less experiences (near 45% and 65% of experiences in cases with ten and five obstacles respectively) when comparing with the baseline LSTM-based advantage actor critic algorithm. Our source code is freely available at the GitHub (<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/CHUENGMINCHOU\/AW-PER-A2C\">https:\/\/github.com\/CHUENGMINCHOU\/AW-PER-A2C<\/jats:ext-link>).<\/jats:p>","DOI":"10.1007\/s10845-022-01988-z","type":"journal-article","created":{"date-parts":[[2022,8,7]],"date-time":"2022-08-07T16:02:32Z","timestamp":1659888152000},"page":"151-180","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Attention-based advantage actor-critic algorithm with prioritized experience replay for complex 2-D robotic motion planning"],"prefix":"10.1007","volume":"34","author":[{"given":"Chengmin","family":"Zhou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bingding","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haseeb","family":"Hassan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9554-2827","authenticated-orcid":false,"given":"Pasi","family":"Fr\u00e4nti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,8,7]]},"reference":[{"key":"1988_CR1","doi-asserted-by":"publisher","unstructured":"Bai, Z., Cai, B., Shangguan, W., & Chai, L. (2019). Deep learning based motion planning for autonomous vehicle using spatiotemporal LSTM network. In Proceedings 2018 Chinese Automation Congress, CAC 2018 (pp. 1610\u20131614). https:\/\/doi.org\/10.1109\/CAC.2018.8623233","DOI":"10.1109\/CAC.2018.8623233"},{"key":"1988_CR2","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1016\/b978-1-55860-377-6.50013-x","volume":"1995","author":"L Baird","year":"1995","unstructured":"Baird, L. (1995). Residual algorithms: Reinforcement learning with function approximation. Machine Learning Proceedings, 1995, 30\u201337. https:\/\/doi.org\/10.1016\/b978-1-55860-377-6.50013-x","journal-title":"Machine Learning Proceedings"},{"issue":"1","key":"1988_CR3","doi-asserted-by":"publisher","first-page":"115","DOI":"10.3722\/cadaps.2009.115-123","volume":"6","author":"M Barton","year":"2009","unstructured":"Barton, M., Shragai, N., & Elber, G. (2009). Kinematic simulation of planar and spatial mechanisms using a polynomial constraints solver. Computer-Aided Design and Applications, 6(1), 115\u2013123. https:\/\/doi.org\/10.3722\/cadaps.2009.115-123","journal-title":"Computer-Aided Design and Applications"},{"key":"1988_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32323-3_12","author":"E Bas","year":"2019","unstructured":"Bas, E. (2019). An introduction to Markov chains. Basics of Probability and Stochastic Processes. https:\/\/doi.org\/10.1007\/978-3-030-32323-3_12","journal-title":"Basics of Probability and Stochastic Processes"},{"key":"1988_CR5","unstructured":"Brownlee, J. (2018). Better deep learning: train faster, reduce overfitting, and make better predictions. Machine Learning Mastery. Retrieved from https:\/\/machinelearningmastery.com\/better-deep-learning\/."},{"key":"1988_CR6","doi-asserted-by":"publisher","unstructured":"Bry, A. & Roy, N. (2011). Rapidly-exploring random belief trees for motion planning under uncertainty. In Proceedings\u2014IEEE international conference on robotics and automation. https:\/\/doi.org\/10.1109\/ICRA.2011.5980508.","DOI":"10.1109\/ICRA.2011.5980508"},{"key":"1988_CR7","doi-asserted-by":"publisher","unstructured":"Bu, F. & Chang, D. E. (2020). Double prioritized state recycled experience replay. In 2020 IEEE international conference on consumer electronics\u2014Asia, ICCE-Asia 2020. https:\/\/doi.org\/10.1109\/ICCE-Asia49877.2020.9276975.","DOI":"10.1109\/ICCE-Asia49877.2020.9276975"},{"key":"1988_CR8","doi-asserted-by":"publisher","unstructured":"Chen, Y. F., Liu, M., Everett, M. & How, J. P. (2017). Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning. In Proceedings\u2014IEEE international conference on robotics and automation (pp. 285\u2013292). https:\/\/doi.org\/10.1109\/ICRA.2017.7989037.","DOI":"10.1109\/ICRA.2017.7989037"},{"key":"1988_CR9","doi-asserted-by":"crossref","unstructured":"Chen, C., Hu, S., Nikdel, P., Mori, G. & Savva, M. (2019a). Relational graph learning for crowd navigation. ArXiv. http:\/\/arxiv.org\/abs\/1909.13165.","DOI":"10.1109\/IROS45743.2020.9340705"},{"key":"1988_CR10","doi-asserted-by":"publisher","unstructured":"Chen, C., Liu, Y., Kreiss, S., & Alahi, A. (2019b). Crowd-robot interaction: Crowd-aware robot navigation with attention-based deep reinforcement learning. In Proceedings\u2014IEEE international conference on robotics and automation (pp. 6015\u20136022). https:\/\/doi.org\/10.1109\/ICRA.2019.8794134","DOI":"10.1109\/ICRA.2019.8794134"},{"key":"1988_CR11","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2021.3112699","author":"P Cheng","year":"2021","unstructured":"Cheng, P., Wang, H., Stojanovic, V., He, S., Shi, K., Luan, X., Liu, F., & Sun, C. (2021). Asynchronous fault detection observer for 2-D Markov jump systems. IEEE Transactions on Cybernetics. https:\/\/doi.org\/10.1109\/TCYB.2021.3112699","journal-title":"IEEE Transactions on Cybernetics"},{"issue":"2","key":"1988_CR12","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1109\/TVCG.2008.80","volume":"15","author":"YK Choi","year":"2009","unstructured":"Choi, Y. K., Chang, J. W., Wang, W., Kim, M. S., & Elber, G. (2009). Continuous collision detection for ellipsoids. IEEE Transactions on Visualization and Computer Graphics, 15(2), 311\u2013324. https:\/\/doi.org\/10.1109\/TVCG.2008.80","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"issue":"14","key":"1988_CR13","doi-asserted-by":"publisher","first-page":"1912","DOI":"10.1049\/iet-cta.2019.1316","volume":"14","author":"X Dong","year":"2020","unstructured":"Dong, X., He, S., & Stojanovic, V. (2020). Robust fault detection filter design for a class of discrete-time conic-type non-linear Markov jump systems with jump fault signals. IET Control Theory & Applications, 14(14), 1912\u20131919. https:\/\/doi.org\/10.1049\/iet-cta.2019.1316","journal-title":"IET Control Theory & Applications"},{"key":"1988_CR14","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2018.8593871","author":"M Everett","year":"2018","unstructured":"Everett, M., Chen, Y. F., & How, J. P. (2018). Motion planning among dynamic, decision-making agents with deep reinforcement learning. IEEE International Conference on Intelligent Robots and Systems, Iii. https:\/\/doi.org\/10.1109\/IROS.2018.8593871","journal-title":"IEEE International Conference on Intelligent Robots and Systems, Iii"},{"issue":"1","key":"1988_CR15","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/BF02519035","volume":"2","author":"RT Farouki","year":"1994","unstructured":"Farouki, R. T., & Sakkalis, T. (1994). Pythagorean-hodograph space curves. Advances in Computational Mathematics, 2(1), 41\u201366. https:\/\/doi.org\/10.1007\/BF02519035","journal-title":"Advances in Computational Mathematics"},{"issue":"1","key":"1988_CR16","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1109\/100.580977","volume":"4","author":"D Fox","year":"1997","unstructured":"Fox, D., Burgard, W., & Thrun, S. (1997). The dynamic window approach to collision avoidance. IEEE Robotics & Automation Magazine, 4(1), 23\u201333. https:\/\/doi.org\/10.1109\/100.580977","journal-title":"IEEE Robotics & Automation Magazine"},{"key":"1988_CR17","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1109\/IVS.2012.6232212","volume":"2012","author":"J Funke","year":"2012","unstructured":"Funke, J., Theodosis, P., Hindiyeh, R., Stanek, G., Kritatakirana, K., Gerdes, C., Langer, D., Hernandez, M., M\u00fcller-Bessler, B., & Huhnke, B. (2012). Up to the limits: Autonomous Audi TTS. IEEE Intelligent Vehicles Symposium, 2012, 541\u2013547. https:\/\/doi.org\/10.1109\/IVS.2012.6232212","journal-title":"IEEE Intelligent Vehicles Symposium"},{"key":"1988_CR18","doi-asserted-by":"publisher","unstructured":"Gonz\u00e1lez, D., P\u00e9rez, J., Lattarulo, R., Milan\u00e9s, V. & Nashashibi, F. (2014). Continuous curvature planning with obstacle avoidance capabilities in urban scenarios. In 2014 17th IEEE international conference on intelligent transportation systems, ITSC 2014 (pp. 1430\u20131435). https:\/\/doi.org\/10.1109\/ITSC.2014.6957887.","DOI":"10.1109\/ITSC.2014.6957887"},{"key":"1988_CR19","unstructured":"Goodfellow, I., Bengio, Y. & Courville, A. (2016). Deep learning. MIT press, Cambridge, MA. Retrieved from http:\/\/www.deeplearningbook.org."},{"issue":"2","key":"1988_CR20","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1109\/TSSC.1968.300136","volume":"4","author":"PE Hart","year":"1968","unstructured":"Hart, P. E., Nilsson, N. J., & Raphael, B. (1968). A formal basis for the heuristic determination of minimum cost paths. IEEE Transactions on Systems Science and Cybernetics, 4(2), 100\u2013107. https:\/\/doi.org\/10.1109\/TSSC.1968.300136","journal-title":"IEEE Transactions on Systems Science and Cybernetics"},{"issue":"5","key":"1988_CR21","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","volume":"2","author":"K Hornik","year":"1989","unstructured":"Hornik, K., Stinchcombe, M., & White, H. (1989). Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359\u2013366. https:\/\/doi.org\/10.1016\/0893-6080(89)90020-8","journal-title":"Neural Networks"},{"issue":"1","key":"1988_CR22","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.mechmachtheory.2006.02.001","volume":"42","author":"ML Husty","year":"2007","unstructured":"Husty, M. L., Pfurner, M., & Schr\u00f6cker, H.-P. (2007). A new and efficient algorithm for the inverse kinematics of a general serial 6R manipulator. Mechanism and Machine Theory, 42(1), 66\u201381. https:\/\/doi.org\/10.1016\/j.mechmachtheory.2006.02.001","journal-title":"Mechanism and Machine Theory"},{"key":"1988_CR23","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1007\/978-981-13-0341-8_29","volume":"759","author":"M Inoue","year":"2019","unstructured":"Inoue, M., Yamashita, T., & Nishida, T. (2019). Robot path planning by LSTM network under changing environment. Advances in Intelligent Systems and Computing, 759, 317\u2013329. https:\/\/doi.org\/10.1007\/978-981-13-0341-8_29","journal-title":"Advances in Intelligent Systems and Computing"},{"key":"1988_CR24","unstructured":"Jiang, M., Grefenstette, E. & Rockt\u00e4schel, T. (2020). Prioritized level replay. ArXiv. http:\/\/arxiv.org\/abs\/2010.03934."},{"key":"1988_CR25","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1007\/978-3-319-59063-9_9","volume-title":"International conference on artificial intelligence and soft computing 2017: Artificial intelligence and soft computing","author":"J Kolbusz","year":"2017","unstructured":"Kolbusz, J., Rozycki, P., & Wilamowski, B. M. (2017). The study of architecture MLP with linear neurons in order to eliminate the \u201cvanishing gradient\u201d problem BT\u2014artificial intelligence and soft computing. In L. Rutkowski, M. Korytkowski, R. Scherer, R. Tadeusiewicz, L. A. Zadeh, & J. M. Zurada (Eds.), International conference on artificial intelligence and soft computing 2017: Artificial intelligence and soft computing (pp. 97\u2013106). Springer. https:\/\/doi.org\/10.1007\/978-3-319-59063-9_9"},{"key":"1988_CR26","unstructured":"Konda, V. R. & Tsitsiklis, J. N. (2000). Actor-critic algorithms. In Advances in neural information processing systems (pp. 1008\u20131014)."},{"key":"1988_CR27","unstructured":"Li, A. A., Lu, Z. & Miao, C. (2021). Revisiting prioritized experience replay: A value perspective. ArXiv. http:\/\/arxiv.org\/abs\/2102.03261."},{"key":"1988_CR28","unstructured":"Lin, Z., Feng, M., Dos Santos, C. N., Yu, M., Xiang, B., Zhou, B. & Bengio, Y. (2017). A structured self-attentive sentence embedding. In 5th international conference on learning representations, ICLR 2017\u2014conference track proceedings (pp. 1\u201315)."},{"issue":"1","key":"1988_CR29","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1145\/44571.44572","volume":"16","author":"RP Lippmann","year":"1988","unstructured":"Lippmann, R. P. (1988). An introduction to computing with neural nets. ACM SIGARCH Computer Architecture News, 16(1), 7\u201325. https:\/\/doi.org\/10.1145\/44571.44572","journal-title":"ACM SIGARCH Computer Architecture News"},{"key":"1988_CR30","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D. & Riedmiller, M. (2013). Playing atari with deep reinforcement learning, pp. 1\u20139. ArXiv, http:\/\/arxiv.org\/abs\/1312.5602."},{"issue":"7540","key":"1988_CR31","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., & Hassabis, D. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529\u2013533. https:\/\/doi.org\/10.1038\/nature14236","journal-title":"Nature"},{"key":"1988_CR32","first-page":"1928","volume-title":"Proeedings of machine learning research","author":"V Mnih","year":"2016","unstructured":"Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D., & Kavukcuoglu, K. (2016). Asynchronous methods for deep reinforcement learning. In M. F. Balcan & K. Q. Weinberger (Eds.), Proeedings of machine learning research (Vol. 48, pp. 1928\u20131937). PMLR. http:\/\/proceedings.mlr.press\/v48\/mniha16.pdf"},{"key":"1988_CR33","first-page":"1054","volume":"26","author":"R Munos","year":"2016","unstructured":"Munos, R., Stepleton, T., Harutyunyan, A., & Bellemare, M. G. (2016). Safe and efficient off-policy reinforcement learning. Advances in Neural Information Processing Systems, Nips, 26, 1054\u20131062.","journal-title":"Advances in Neural Information Processing Systems, Nips"},{"issue":"2","key":"1988_CR34","first-page":"6214","volume":"9","author":"J Oh","year":"2018","unstructured":"Oh, J., Guo, Y., Singh, S., & Lee, H. (2018). Self-Imitation Learning. 35th International Conference on Machine Learning, ICML, 9(2), 6214\u20136223.","journal-title":"35th International Conference on Machine Learning, ICML"},{"issue":"2","key":"1988_CR35","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1115\/1.1884133","volume":"5","author":"S Redon","year":"2005","unstructured":"Redon, S., Lin, M. C., Manocha, D., & Kim, Y. J. (2005). Fast continuous collision detection for articulated models. Journal of Computing and Information Science in Engineering, 5(2), 126\u2013137. https:\/\/doi.org\/10.1115\/1.1884133","journal-title":"Journal of Computing and Information Science in Engineering"},{"key":"1988_CR36","doi-asserted-by":"crossref","unstructured":"Reed, R. & MarksII, R. J. (1999). Neural smithing: Supervised learning in feedforward artificial neural networks. MIT Press. Retrieved from https:\/\/mitpress.mit.edu\/books\/neural-smithing.","DOI":"10.7551\/mitpress\/4937.001.0001"},{"issue":"2","key":"1988_CR37","doi-asserted-by":"publisher","first-page":"367","DOI":"10.2140\/pjm.1990.145.367","volume":"145","author":"JA Reeds","year":"1990","unstructured":"Reeds, J. A., & Shepp, L. A. (1990). Optimal paths for a car that goes both forwards and backwards. Pacific Journal of Mathematics, 145(2), 367\u2013393. https:\/\/doi.org\/10.2140\/pjm.1990.145.367","journal-title":"Pacific Journal of Mathematics"},{"key":"1988_CR38","unstructured":"Schaul, T., Quan, J., Antonoglou, I. & Silver, D. (2016). Prioritized experience replay. In 4th international conference on learning representations, ICLR 2016\u2014conference track proceedings (pp. 1\u201321)."},{"key":"1988_CR39","unstructured":"Schulman, J., Levine, S., Moritz, P., Jordan, M. & Abbeel, P. (2015). Trust region policy optimization. In 32nd international conference on machine learning, ICML 2015, (vol. 3, pp. 1889\u20131897)."},{"key":"1988_CR40","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A. & Klimov, O. (2017). Proximal policy optimization algorithms. (pp. 1\u201312) ArXiv."},{"key":"1988_CR41","unstructured":"Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D. & Riedmiller, M. (2014). Deterministic policy gradient algorithms. In 31st international conference on machine learning, ICML 2014, (vol. 1, pp. 605\u2013619)."},{"issue":"8","key":"1988_CR42","doi-asserted-by":"publisher","first-page":"2133","DOI":"10.1080\/01431160802549278","volume":"30","author":"D Stathakis","year":"2009","unstructured":"Stathakis, D. (2009). How many hidden layers and nodes? International Journal of Remote Sensing, 30(8), 2133\u20132147. https:\/\/doi.org\/10.1080\/01431160802549278","journal-title":"International Journal of Remote Sensing"},{"issue":"4","key":"1988_CR43","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1109\/ROBOT.2008.4543489","volume":"2","author":"J Van Den Berg","year":"2008","unstructured":"Van Den Berg, J., Lin, M., & Manocha, D. (2008). Reciprocal velocity obstacles for real-time multi-agent navigation. Proceedings\u2014IEEE International Conference on Robotics and Automation, 2(4), 100\u2013107. https:\/\/doi.org\/10.1109\/ROBOT.2008.4543489","journal-title":"Proceedings\u2014IEEE International Conference on Robotics and Automation"},{"key":"1988_CR44","doi-asserted-by":"crossref","unstructured":"Van Hasselt, H., Guez, A. & Silver, D. (2016). Deep reinforcement learning with double Q-Learning. In 30th AAAI Conference on Artificial Intelligence, AAAI 2016, (pp. 2094\u20132100).","DOI":"10.1609\/aaai.v30i1.10295"},{"issue":"9","key":"1988_CR45","first-page":"2939","volume":"4","author":"Z Wang","year":"2016","unstructured":"Wang, Z., Schaul, T., Hessel, M., Van Hasselt, H., Lanctot, M., & De Frcitas, N. (2016). Dueling network architectures for deep reinforcement learning. 33rd International Conference on Machine Learning, ICML 2016, 4(9), 2939\u20132947.","journal-title":"33rd International Conference on Machine Learning, ICML 2016"},{"key":"1988_CR46","unstructured":"Wang, Z., Mnih, V., Bapst, V., Munos, R., Heess, N., Kavukcuoglu, K. & De Freitas, N. (2017). Sample efficient actor-critic with experience replay. In 5th international conference on learning representations, ICLR 2017\u2014conference track proceedings, 2016. Retrieved from https:\/\/static.aminer.cn\/upload\/pdf\/239\/1521\/964\/58d82fc8d649053542fd5854.pdf."},{"key":"1988_CR47","doi-asserted-by":"publisher","first-page":"2061","DOI":"10.1109\/ICRA.2012.6225063","volume":"2012","author":"W Xu","year":"2012","unstructured":"Xu, W., Wei, J., Dolan, J. M., Zhao, H., & Zha, H. (2012). A real-time motion planner with trajectory optimization for autonomous vehicles. IEEE International Conference on Robotics and Automation, 2012, 2061\u20132067. https:\/\/doi.org\/10.1109\/ICRA.2012.6225063","journal-title":"IEEE International Conference on Robotics and Automation"},{"key":"1988_CR48","doi-asserted-by":"publisher","unstructured":"Zha, D., Lai, K. H., Zhou, K. & Hu, X. (2019). Experience replay optimization. In IJCAI international joint conference on artificial intelligence (Vols. 2019-Augus). https:\/\/doi.org\/10.24963\/ijcai.2019\/589","DOI":"10.24963\/ijcai.2019\/589"}],"container-title":["Journal of Intelligent Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10845-022-01988-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10845-022-01988-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10845-022-01988-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T20:10:09Z","timestamp":1672863009000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10845-022-01988-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,7]]},"references-count":48,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1]]}},"alternative-id":["1988"],"URL":"https:\/\/doi.org\/10.1007\/s10845-022-01988-z","relation":{},"ISSN":["0956-5515","1572-8145"],"issn-type":[{"value":"0956-5515","type":"print"},{"value":"1572-8145","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,7]]},"assertion":[{"value":"13 October 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to publish"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}