{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,20]],"date-time":"2024-10-20T04:10:05Z","timestamp":1729397405518,"version":"3.27.0"},"reference-count":33,"publisher":"Institute of Electronics, Information and Communications Engineers (IEICE)","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Inf. & Syst."],"published-print":{"date-parts":[[2023,5,1]]},"DOI":"10.1587\/transinf.2022dlp0057","type":"journal-article","created":{"date-parts":[[2023,4,30]],"date-time":"2023-04-30T22:24:30Z","timestamp":1682893470000},"page":"765-772","source":"Crossref","is-referenced-by-count":2,"title":["SPSD: Semantics and Deep Reinforcement Learning Based Motion Planning for Supermarket Robot"],"prefix":"10.1587","volume":"E106.D","author":[{"given":"Jialun","family":"CAI","sequence":"first","affiliation":[{"name":"School of Electronic and Computer Engineering (SECE), Peking University"}]},{"given":"Weibo","family":"HUANG","sequence":"additional","affiliation":[{"name":"School of Electronic and Computer Engineering (SECE), Peking University"}]},{"given":"Yingxuan","family":"YOU","sequence":"additional","affiliation":[{"name":"School of Electronic and Computer Engineering (SECE), Peking University"}]},{"given":"Zhan","family":"CHEN","sequence":"additional","affiliation":[{"name":"School of Electronic and Computer Engineering (SECE), Peking University"}]},{"given":"Bin","family":"REN","sequence":"additional","affiliation":[{"name":"Department of Information Engineering and Computer Science (DISI), University of Trento"}]},{"given":"Hong","family":"LIU","sequence":"additional","affiliation":[{"name":"School of Electronic and Computer Engineering (SECE), Peking University"}]}],"member":"532","reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"[1] H. Bai, S. Cai, N. Ye, D. Hsu, and W.S. Lee, \u201cIntention-aware online pomdp planning for autonomous driving in a crowd,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.454-460, IEEE, 2015. 10.1109\/icra.2015.7139219","DOI":"10.1109\/ICRA.2015.7139219"},{"key":"2","doi-asserted-by":"publisher","unstructured":"[2] Y. Sun, J. Cheng, G. Zhang, and H. Xu, \u201cMapless motion planning system for an autonomous underwater vehicle using policy gradient-based deep reinforcement learning,\u201d Journal of Intelligent and Robotic Systems, vol.96, pp.591-601, 2019. 10.1007\/s10846-019-01004-2","DOI":"10.1007\/s10846-019-01004-2"},{"key":"3","doi-asserted-by":"crossref","unstructured":"[3] P.E. Hart, N.J. Nilsson, and B. Raphael, \u201cA formal basis for the heuristic determination of minimum cost paths,\u201d IEEE Trans. Syst. Sci. Cybern., vol.4, no.2, pp.100-107, 1968. 10.1109\/tssc.1968.300136","DOI":"10.1109\/TSSC.1968.300136"},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] L.E. Kavraki, P. Svestka, J.-C. Latombe, and M.H. Overmars, \u201cProbabilistic roadmaps for path planning in high-dimensional configuration spaces,\u201d IEEE Trans. Robot. Autom., vol.12, no.4, pp.566-580, 1996. 10.1109\/70.508439","DOI":"10.1109\/70.508439"},{"key":"5","doi-asserted-by":"crossref","unstructured":"[5] S.M. LaValle and J.J. Kuffner Jr, \u201cRandomized kinodynamic planning,\u201d The International Journal of Robotics Research, vol.20, no.5, pp.378-400, 2001. 10.1177\/02783640122067453","DOI":"10.1177\/02783640122067453"},{"key":"6","doi-asserted-by":"crossref","unstructured":"[6] O. Khatib, \u201cReal-time obstacle avoidance for manipulators and mobile robots,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.500-505, IEEE, 21986. 10.1109\/robot.1985.1087247","DOI":"10.1109\/ROBOT.1985.1087247"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] H.E. Romeijn and R.L. Smith, \u201cSimulated annealing for constrained global optimization,\u201d Journal of Global Optimization, vol.5, pp.101-126, 1994. 10.1007\/bf01100688","DOI":"10.1007\/BF01100688"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] J. Li, G. Deng, C. Luo, Q. Lin, Q. Yan, and Z. Ming, \u201cA hybrid path planning method in unmanned air\/ground vehicle (uav\/ugv) cooperative systems,\u201d IEEE Trans. Veh. Technol., vol.65, no.12, pp.9585-9596, 2016. 10.1109\/tvt.2016.2623666","DOI":"10.1109\/TVT.2016.2623666"},{"key":"9","doi-asserted-by":"publisher","unstructured":"[9] N.C. Luong, D.T. Hoang, S. Gong, D. Niyato, P. Wang, Y.-C. Liang, and D.I. Kim, \u201cApplications of deep reinforcement learning in communica-tions and networking: A survey,\u201d IEEE Commun. Surveys Tuts., vol.21, no.4, pp.3133-3174, 2019. 10.1109\/comst.2019.2916583","DOI":"10.1109\/COMST.2019.2916583"},{"key":"10","doi-asserted-by":"publisher","unstructured":"[10] X. Lei, Z. Zhang, and P. Dong, \u201cDynamic path planning of unknown environment based on deep reinforcement learning,\u201d Journal of Robotics, vol.2018, 2018. 10.1155\/2018\/5781591","DOI":"10.1155\/2018\/5781591"},{"key":"11","doi-asserted-by":"crossref","unstructured":"[11] Y. Zhu, R. Mottaghi, E. Kolve, J.J. Lim, A. Gupta, L. Fei-Fei, and A. Farhadi, \u201cTarget-driven visual navigation in indoor scenes using deep reinforcement learning,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.3357-3364, IEEE, 2017. 10.1109\/icra.2017.7989381","DOI":"10.1109\/ICRA.2017.7989381"},{"key":"12","doi-asserted-by":"publisher","unstructured":"[12] B. Li and Y. Wu, \u201cPath planning for uav ground target tracking via deep reinforcement learning,\u201d IEEE access, vol.8, pp.29064-29074, 2020. 10.1109\/access.2020.2971780","DOI":"10.1109\/ACCESS.2020.2971780"},{"key":"13","doi-asserted-by":"crossref","unstructured":"[13] M. Lorbach, S. H\u00f6fer, and O. Brock, \u201cPrior-assisted propagation of spatial information for object search,\u201d IEEE\/RSJ International Conference on Intelligent Robots and Systems, pp.2904-2909, IEEE, 2014. 10.1109\/iros.2014.6942962","DOI":"10.1109\/IROS.2014.6942962"},{"key":"14","doi-asserted-by":"crossref","unstructured":"[14] R. Han, S. Chen, and Q. Hao, \u201cCooperative multi-robot navigation in dynamic environment with deep reinforcement learning,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.448-454, IEEE, 2020. 10.1109\/icra40945.2020.9197209","DOI":"10.1109\/ICRA40945.2020.9197209"},{"key":"15","unstructured":"[15] V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, \u201cPlaying atari with deep reinforcement learning,\u201d Computer Science, 2013."},{"key":"16","doi-asserted-by":"publisher","unstructured":"[16] B. Sangiovanni, G.P. Incremona, M. Piastra, and A. Ferrara, \u201cSelf-configuring robot path planning with obstacle avoidance via deep reinforcement learning,\u201d IEEE Control Systems Letters, vol.5, no.2, pp.397-402, 2020. 10.1109\/lcsys.2020.3002852","DOI":"10.1109\/LCSYS.2020.3002852"},{"key":"17","unstructured":"[17] P. Mirowski, R. Pascanu, F. Viola, H. Soyer, A.J. Ballard, A. Banino, M. Denil, R. Goroshin, L. Sifre, K. Kavukcuoglu, et al., \u201cLearning to navigate in complex environment,\u201d arXiv preprint arXiv:1611.03673, 2016."},{"key":"18","doi-asserted-by":"crossref","unstructured":"[18] L. Tai and M. Liu, \u201cTowards cognitive exploration through deep reinforcement learning for mobile robots,\u201d arXiv preprint arXiv:1610.01733, 2016.","DOI":"10.1186\/s40638-016-0055-x"},{"key":"19","doi-asserted-by":"crossref","unstructured":"[19] M. Everett, Y.F. Chen, and J.P. How, \u201cMotion planning among dynamic, decision-making agents with deep reinforcement learning,\u201d IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3052-3059, IEEE, 2018. 10.1109\/iros.2018.8593871","DOI":"10.1109\/IROS.2018.8593871"},{"key":"20","unstructured":"[20] M.F. Everett, \u201cRobot designed for socially acceptable navigation,\u201d Ph. D. thesis, Massachusetts Institute of Technology, 2017."},{"key":"21","doi-asserted-by":"publisher","unstructured":"[21] P. Loncomilla, J. Ruiz-del Solar, and M. Saavedra A, \u201cA bayesian based methodology for indirect object search,\u201d Journal of Intelligent and Robotic Systems, vol.90, pp.45-63, 2018. 10.1007\/s10846-017-0643-1","DOI":"10.1007\/s10846-017-0643-1"},{"key":"22","doi-asserted-by":"publisher","unstructured":"[22] J. Elfring, S. Jansen, R. van de Molengraft, and M. Steinbuch, \u201cActive object search exploiting probabilistic object-object relations,\u201d Robot Soccer World Cup, vol.8371, pp.13-24, Springer, 2014. 10.1007\/978-3-662-44468-9_2","DOI":"10.1007\/978-3-662-44468-9_2"},{"key":"23","doi-asserted-by":"crossref","unstructured":"[23] D. Joho and W. Burgard, \u201cSearching for objects: Combining multiple cues to object locations using a maximum entropy model,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.723-728, IEEE, 2010. 10.1109\/robot.2010.5509285","DOI":"10.1109\/ROBOT.2010.5509285"},{"key":"24","doi-asserted-by":"crossref","unstructured":"[24] J. Wu, J. Jiao, Q. Yang, Z.-J. Zha, and X. Chen, \u201cGround-aware point cloud semantic segmentation for autonomous driving,\u201d Proceedings of the 27th ACM International Conference on Multimedia, pp.971-979, 2019. 10.1145\/3343031.3351076","DOI":"10.1145\/3343031.3351076"},{"key":"25","unstructured":"[25] J. Redmon and A. Farhadi, \u201cYolov3: An incremental improvement,\u201d arXiv preprint arXiv:1804.02767, 2018."},{"key":"26","doi-asserted-by":"crossref","unstructured":"[26] Z. Zeng, A. R\u00f6fer, and O.C. Jenkins, \u201cSemantic linking maps for active visual object search,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.1984-1990, IEEE, 2020. 10.1109\/icra40945.2020.9196830","DOI":"10.1109\/ICRA40945.2020.9196830"},{"key":"27","doi-asserted-by":"crossref","unstructured":"[27] X.B. Peng, M. Andrychowicz, W. Zaremba, and P. Abbeel, \u201cSim-to-real transfer of robotic control with dynamics randomization,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.3803-3810, IEEE, 2018. 10.1109\/icra.2018.8460528","DOI":"10.1109\/ICRA.2018.8460528"},{"key":"28","doi-asserted-by":"crossref","unstructured":"[28] S.M. LaValle and J.J. Kuffner Jr., \u201cRandomized kinodynamic planning,\u201d The International Journal of Robotics Research, vol.20, no.5, pp.378-400, 2001. 10.1177\/02783640122067453","DOI":"10.1177\/02783640122067453"},{"key":"29","doi-asserted-by":"crossref","unstructured":"[29] S. Karaman, M.R. Walter, A. Perez, E. Frazzoli, and S. Teller, \u201cAnytime motion planning using the rrt*,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.1478-1483, IEEE, 2011. 10.1109\/icra.2011.5980479","DOI":"10.1109\/ICRA.2011.5980479"},{"key":"30","doi-asserted-by":"crossref","unstructured":"[30] T.T. Enevoldsen, C. Reinartz, and R. Galeazzi, \u201cColregs-informed rrt* for collision avoidance of marine crafts,\u201d IEEE International Conference on Robotics and Automation (ICRA), pp.8083-8089, IEEE, 2021. 10.1109\/icra48506.2021.9560909","DOI":"10.1109\/ICRA48506.2021.9560909"},{"key":"31","doi-asserted-by":"publisher","unstructured":"[31] J. Nasir, F. Islam, U. Malik, Y. Ayaz, O. Hasan, M. Khan, and M.S. Muhammad, \u201cRrt*-smart: A rapid convergence implementation of rrt*,\u201d International Journal of Advanced Robotic Systems, vol.10, no.7, p.299, 2013. 10.5772\/56718","DOI":"10.5772\/56718"},{"key":"32","unstructured":"[32] I. Noreen, A. Khan, and Z. Habib, \u201cA comparison of rrt, rrt* and rrt*-smart path planning algorithms,\u201d International Journal of Computer Science and Network Security (IJCSNS), vol.16, no.10, p.20, 2016."},{"key":"33","doi-asserted-by":"publisher","unstructured":"[33] H. Van Hasselt, A. Guez, and D. Silver, \u201cDeep reinforcement learning with double q-learning,\u201d Proceedings of the AAAI conference on artificial intelligence, vol.30, no.1, 2016. 10.1609\/aaai.v30i1.10295","DOI":"10.1609\/aaai.v30i1.10295"}],"container-title":["IEICE Transactions on Information and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E106.D\/5\/E106.D_2022DLP0057\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,19]],"date-time":"2024-10-19T14:22:36Z","timestamp":1729347756000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E106.D\/5\/E106.D_2022DLP0057\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,1]]},"references-count":33,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023]]}},"URL":"https:\/\/doi.org\/10.1587\/transinf.2022dlp0057","relation":{},"ISSN":["0916-8532","1745-1361"],"issn-type":[{"type":"print","value":"0916-8532"},{"type":"electronic","value":"1745-1361"}],"subject":[],"published":{"date-parts":[[2023,5,1]]},"article-number":"2022DLP0057"}}