{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T19:46:50Z","timestamp":1765828010834,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,1,14]],"date-time":"2021-01-14T00:00:00Z","timestamp":1610582400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,1,14]]},"DOI":"10.1145\/3448218.3448219","type":"proceedings-article","created":{"date-parts":[[2021,2,15]],"date-time":"2021-02-15T14:30:13Z","timestamp":1613399413000},"page":"57-62","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Action-limited, Multimodal Deep Q Learning for AGV Fleet Route Planning"],"prefix":"10.1145","author":[{"given":"Hang","family":"Liu","sequence":"first","affiliation":[{"name":"Research &amp; Development Group, Hitachi, Ltd Tokyo, Japan"}]},{"given":"Akihiko","family":"Hyodo","sequence":"additional","affiliation":[{"name":"Research &amp; Development Group, Hitachi, Ltd Tokyo, Japan"}]},{"given":"Akihito","family":"Akai","sequence":"additional","affiliation":[{"name":"Research &amp; Development Group, Hitachi, Ltd Tokyo, Japan"}]},{"given":"Hidenori","family":"Sakaniwa","sequence":"additional","affiliation":[{"name":"Research &amp; Development Group, Hitachi, Ltd Tokyo, Japan"}]},{"given":"Shintaro","family":"Suzuki","sequence":"additional","affiliation":[{"name":"Research &amp; Development Group, Hitachi, Ltd Tokyo, Japan"}]}],"member":"320","published-online":{"date-parts":[[2021,2,15]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-013-0003-8"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2004.09.020"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-003-1933-2"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/07408170008967423"},{"key":"e_1_3_2_1_5_1","volume-title":"Engineering route planning algorithms. Algorithmics of large and complex networks","author":"Delling Daniel","year":"2009","unstructured":"Delling , Daniel , et al. Engineering route planning algorithms. Algorithmics of large and complex networks . Springer , Berlin, Heidelberg , 2009 . 117--139. Delling, Daniel, et al. Engineering route planning algorithms. Algorithmics of large and complex networks. Springer, Berlin, Heidelberg, 2009. 117--139."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSSC.1968.300136"},{"key":"e_1_3_2_1_7_1","first-page":"530","volume-title":"AAAI\/IAAI","volume":"1","author":"Holte Robert C","year":"1996","unstructured":"Holte , Robert C . , et al. Hierarchical a : Searching abstraction hierarchies efficiently . In AAAI\/IAAI , Vol. 1 , pages 530 -- 535 . Citeseer , 1996 . Holte, Robert C., et al. Hierarchical a: Searching abstraction hierarchies efficiently. In AAAI\/IAAI, Vol. 1, pages 530--535. Citeseer, 1996."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s007780050040"},{"key":"e_1_3_2_1_9_1","volume-title":"Join processing in relational databases. ACM Computing Surveys (CSUR), 24(1):63--113","author":"Mishra Priti","year":"1992","unstructured":"Mishra , Priti , and Margaret H . Eich . Join processing in relational databases. ACM Computing Surveys (CSUR), 24(1):63--113 , 1992 . Mishra, Priti, and Margaret H. Eich. Join processing in relational databases. ACM Computing Surveys (CSUR), 24(1):63--113, 1992."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.1990.126042"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4613-8997-2_29"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/00207540110091712"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tre.2009.09.001"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_1_15_1","volume-title":"Playing Atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602","author":"Mnih Volodymyr","year":"2013","unstructured":"Mnih , Volodymyr , et al. Playing Atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 , 2013 . Mnih, Volodymyr, et al. Playing Atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013."},{"key":"e_1_3_2_1_16_1","volume-title":"Thirtieth AAAI conference on artificial intelligence","author":"Van Hasselt Hado","year":"2016","unstructured":"Van Hasselt , Hado , Arthur Guez , and David Silver . Deep reinforcement learning with double q-learning . In Thirtieth AAAI conference on artificial intelligence , 2016 . Van Hasselt, Hado, Arthur Guez, and David Silver. Deep reinforcement learning with double q-learning. In Thirtieth AAAI conference on artificial intelligence, 2016."},{"key":"e_1_3_2_1_17_1","volume-title":"Dueling network architectures for deep reinforcement learning. arXiv preprint arXiv:1511.06581","author":"Wang Ziyu","year":"2015","unstructured":"Wang , Ziyu , et al. Dueling network architectures for deep reinforcement learning. arXiv preprint arXiv:1511.06581 , 2015 . Wang, Ziyu, et al. Dueling network architectures for deep reinforcement learning. arXiv preprint arXiv:1511.06581, 2015."},{"key":"e_1_3_2_1_18_1","volume-title":"Prioritized experience replay. arXiv preprint arXiv:1511.05952","author":"Schaul Tom","year":"2015","unstructured":"Schaul , Tom , et al. Prioritized experience replay. arXiv preprint arXiv:1511.05952 , 2015 . Schaul, Tom, et al. Prioritized experience replay. arXiv preprint arXiv:1511.05952, 2015."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICC.2018.8422706"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2918703"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2014.01.001"},{"key":"e_1_3_2_1_22_1","volume-title":"Reinforcement learning: An introduction","author":"Sutton Richard S","year":"2018","unstructured":"Sutton , Richard S . , and Andrew G . Barto . Reinforcement learning: An introduction . MIT press , 2018 . Sutton, Richard S., and Andrew G. Barto. Reinforcement learning: An introduction. MIT press, 2018."},{"key":"e_1_3_2_1_23_1","first-page":"903","volume-title":"ICML","author":"Smart William D","year":"2000","unstructured":"Smart , William D . , and Leslie Pack Kaelbling . Practical reinforcement learning in continuous spaces . In ICML , pages 903 -- 910 . Citeseer , 2000 . Smart, William D., and Leslie Pack Kaelbling. Practical reinforcement learning in continuous spaces. In ICML, pages 903--910. Citeseer, 2000."},{"key":"e_1_3_2_1_24_1","volume-title":"Machine learning, 8(3-4):279--292","author":"Watkins Christopher JCH","year":"1992","unstructured":"Watkins , Christopher JCH , and Peter Dayan . Q-learning. Machine learning, 8(3-4):279--292 , 1992 . Watkins, Christopher JCH, and Peter Dayan. Q-learning. Machine learning, 8(3-4):279--292, 1992."},{"key":"e_1_3_2_1_25_1","volume-title":"Multimodal machine learning: A survey and taxonomy","author":"Baltru\u0161aitis Tadas","year":"2018","unstructured":"Baltru\u0161aitis , Tadas , Chaitanya Ahuja , and Louis-Philippe Morency . Multimodal machine learning: A survey and taxonomy . IEEE transaction- s on pattern analysis and machine intelligence, 41(2):423--443, 2018 . Baltru\u0161aitis, Tadas, Chaitanya Ahuja, and Louis-Philippe Morency. Multimodal machine learning: A survey and taxonomy. IEEE transaction- s on pattern analysis and machine intelligence, 41(2):423--443, 2018."}],"event":{"name":"CCEAI 2021: 5th International Conference on Control Engineering and Artificial Intelligence","sponsor":["York University"],"location":"Sanya China","acronym":"CCEAI 2021"},"container-title":["Proceedings of the 5th International Conference on Control Engineering and Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448218.3448219","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3448218.3448219","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:40Z","timestamp":1750193260000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448218.3448219"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,14]]},"references-count":25,"alternative-id":["10.1145\/3448218.3448219","10.1145\/3448218"],"URL":"https:\/\/doi.org\/10.1145\/3448218.3448219","relation":{},"subject":[],"published":{"date-parts":[[2021,1,14]]},"assertion":[{"value":"2021-02-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}