{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T12:38:04Z","timestamp":1784810284864,"version":"3.55.0"},"reference-count":28,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T00:00:00Z","timestamp":1675641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"China West Normal University Talent Fund","award":["17YC046"],"award-info":[{"award-number":["17YC046"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Efficient navigation in a socially compliant manner is an important and challenging task for robots working in dynamic dense crowd environments. With the development of artificial intelligence, deep reinforcement learning techniques have been widely used in the robot navigation. Previous model-free reinforcement learning methods only considered the interactions between robot and humans, not the interactions between humans and humans. To improve this, we propose a decentralized structured RNN network with coarse-grained local maps (LM-SRNN). It is capable of modeling not only Robot\u2013Human interactions through spatio-temporal graphs, but also Human\u2013Human interactions through coarse-grained local maps. Our model captures current crowd interactions and also records past interactions, which enables robots to plan safer paths. Experimental results show that our model is able to navigate efficiently in dense crowd environments, outperforming state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/s23041810","type":"journal-article","created":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T04:08:07Z","timestamp":1675656487000},"page":"1810","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Crowd-Aware Mobile Robot Navigation Based on Improved Decentralized Structured RNN via Deep Reinforcement Learning"],"prefix":"10.3390","volume":"23","author":[{"given":"Yulin","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Electronic Information Engineering, China West Normal University, Nanchong 637009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhengyong","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Electronic Information Engineering, China West Normal University, Nanchong 637009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,6]]},"reference":[{"key":"ref_1","unstructured":"Borenstein, J., and Koren, Y. (1990, January 13\u201318). Real-Time Obstacle Avoidance for Fast Mobile Robots in Cluttered Environments. Proceedings of the IEEE International Conference on Robotics and Automation, Cincinnati, OH, USA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1109\/100.580977","article-title":"The Dynamic Window Approach to Collision Avoidance","volume":"4","author":"Fox","year":"1997","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1726","DOI":"10.1016\/j.robot.2013.05.007","article-title":"Human-Aware Robot Navigation: A Survey","volume":"61","author":"Kruse","year":"2013","journal-title":"Robot. Auton. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., and Alahi, A. (2018, January 18\u201322). Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00240"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-642-19457-3_1","article-title":"Reciprocal N-Body Collision Avoidance","volume":"70","author":"Pradalier","year":"2011","journal-title":"Robotics Research"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4282","DOI":"10.1103\/PhysRevE.51.4282","article-title":"Social Force Model for Pedestrian Dynamics","volume":"51","author":"Helbing","year":"1995","journal-title":"Phys. Rev. E"},{"key":"ref_7","unstructured":"Kuderer, M., Kretzschmar, H., Sprunk, C., and Burgard, W. (2013). Robotics: Science and Systems VIII, MIT Press."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1177\/0278364915619772","article-title":"Socially Compliant Mobile Robot Navigation via Inverse Reinforcement Learning","volume":"35","author":"Kretzschmar","year":"2016","journal-title":"Int. J. Robot. Res."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Trautman, P., and Krause, A. (2010, January 18\u201322). Unfreezing the Robot: Navigation in Dense, Interacting Crowds. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, IEEE, Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5654369"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1178","DOI":"10.1109\/LRA.2019.2891491","article-title":"Getting Robots Unfrozen and Unlost in Dense Pedestrian Crowds","volume":"4","author":"Fan","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, Y.F., Liu, M., Everett, M., and How, J.P. (June, January 29). Decentralized Non-Communicating Multiagent Collision Avoidance with Deep Rein-forcement Learning. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), IEEE, Singapore.","DOI":"10.1109\/ICRA.2017.7989037"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chen, Y.F., Everett, M., Liu, M., and How, J.P. (2017, January 24\u201328). Socially Aware Motion Planning with Deep Reinforcement Learning. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8202312"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, C., Hu, S., Nikdel, P., Mori, G., and Savva, M. (January, January 24). Relational Graph Learning for Crowd Navigation. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9340705"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chen, C., Liu, Y., Kreiss, S., and Alahi, A. (2019, January 20\u201324). Crowd-Robot Interaction: Crowd-Aware Robot Navigation With Attention-Based Deep Reinforcement Learning. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), IEEE, Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794134"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Everett, M., Chen, Y.F., and How, J.P. (2018, January 1\u20135). Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593871"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2754","DOI":"10.1109\/LRA.2020.2972868","article-title":"Robot Navigation in Crowds by Graph Convolutional Networks With Attention Learned From Human Gaze","volume":"5","author":"Chen","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, S., Chang, P., Liang, W., Chakraborty, N., and Driggs-Campbell, K. (2021\u20135, January 30). Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learning. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561595"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"van den Berg, J., Lin, M., and Manocha, D. (2008, January 19\u201323). Reciprocal Velocity Obstacles for Real-Time Multi-Agent Navigation. In Proceedings of the 2008 IEEE International Conference on Robotics and Automation, IEEE, Pasadena, CA, USA.","DOI":"10.1109\/ROBOT.2008.4543489"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1177\/027836499801700706","article-title":"Motion Planning in Dynamic Environments Using Velocity Obstacles","volume":"17","author":"Fiorini","year":"1998","journal-title":"Int. J. Robot. Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1109\/LRA.2017.2651371","article-title":"Deep-Learned Collision Avoidance Policy for Distributed Multi-Agent Navigation","volume":"2","author":"Long","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sadeghian, A., Alahi, A., and Savarese, S. (2017, January 22\u201329). Tracking the Untrackable: Learning to Track Multiple Cues with Long-Term Dependencies. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), IEEE, Venice, Italy.","DOI":"10.1109\/ICCV.2017.41"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1109\/TSTE.2018.2844102","article-title":"Spatio-Temporal Graph Deep Neural Network for Short-Term Wind Speed Forecasting","volume":"10","author":"Khodayar","year":"2019","journal-title":"IEEE Trans. Sustain. Energy"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yu, B., Yin, H., and Zhu, Z. (2018, January 13\u201319). Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/505"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jain, A., Zamir, A.R., Savarese, S., and Saxena, A. (2016, January 27\u201330). Structural-RNN: Deep Learning on Spatio-Temporal Graphs. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.573"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Matsuzaki, S., and Hasegawa, Y. (2022, January 23\u201327). Learning Crowd-Aware Robot Navigation from Challenging Environments via Distributed Deep Reinforcement Learning. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), IEEE, Phila-delphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9812011"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Vemula, A., Muelling, K., and Oh, J. (2018, January 21\u201325). Social Attention: Modeling Attention in Human Crowds. Proceedings of the 2018 IEEE In-ternational Conference on Robotics and Automation (ICRA), IEEE, Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460504"},{"key":"ref_27","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Long Beach, CA, USA."},{"key":"ref_28","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1810\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:25:27Z","timestamp":1760120727000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1810"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,6]]},"references-count":28,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23041810"],"URL":"https:\/\/doi.org\/10.3390\/s23041810","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,6]]}}}