{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T06:40:09Z","timestamp":1722235209820},"reference-count":36,"publisher":"World Scientific Pub Co Pte Ltd","issue":"04","funder":[{"name":"Research Fund of the Istanbul Technical University","award":["41399"],"award-info":[{"award-number":["41399"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Semantic Computing"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:p>In this study, a unified motion planner with low level controller for continuous control of a differential drive mobile robot under variable payload values is presented. The deep reinforcement agent takes 11-dimensional state vector as input and calculates each wheel\u2019s torque value as a 2-dimensional output vector. These torque values are fed into the dynamic model of the robot, and lastly steering commands are gathered. In previous studies, intersection navigation solutions that uses deep-RL methods, have not been considered with variable payloads. This study is focused specifically on service robotic applications where payload is subject to change. In this study, deep-RL-based motion planning is performed by considering both kinematic and dynamic constraints. According to the simulations in a dynamic environment, the agent successfully navigates to target with 98.2% success rate in test time with unseen payload masses during training. Another agent is also trained without payload randomization for comparison. Results show that our agent outperforms the other agent, that is not aware of its own payload, with more than 40% gap. Our agent is also compared with the Time-to-Collision (TTC) algorithm. It is observed that our agent uses far less time than TTC to accomplish the mission while success rates of two methods are same. Lastly, the proposed method is applied on a real robot in order to show the real-time applicability of the approach.<\/jats:p>","DOI":"10.1142\/s1793351x19400233","type":"journal-article","created":{"date-parts":[[2019,12,27]],"date-time":"2019-12-27T01:54:36Z","timestamp":1577411676000},"page":"541-563","source":"Crossref","is-referenced-by-count":2,"title":["Motion Planning and Control with Randomized Payloads on Real Robot Using Deep Reinforcement Learning"],"prefix":"10.1142","volume":"13","author":[{"given":"Ali","family":"Demir","sequence":"first","affiliation":[{"name":"Mechatronics Engineering, Istanbul Technical University, Maslak, Istanbul 34496, Turkey"},{"name":"TOFA\u015e Turkish Automobile Company R&D Center, Bursa, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Volkan","family":"Sezer","sequence":"additional","affiliation":[{"name":"Control and Automation Engineering, Istanbul Technical University, Maslak, Istanbul 34496, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2019,12,26]]},"reference":[{"key":"S1793351X19400233BIB001","first-page":"995","volume-title":"IEEE\/RSJ Int. Conf. Intelligent Robots and Systems","author":"Schauerte B.","year":"2014"},{"key":"S1793351X19400233BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2013.2271739"},{"key":"S1793351X19400233BIB003","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2001.976257"},{"key":"S1793351X19400233BIB005","first-page":"1126","volume-title":"Proc. 34th Int. Conf. Machine Learning","volume":"70","author":"Finn C.","year":"2017"},{"key":"S1793351X19400233BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8206505"},{"key":"S1793351X19400233BIB008","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989324"},{"key":"S1793351X19400233BIB009","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989182"},{"key":"S1793351X19400233BIB010","doi-asserted-by":"publisher","DOI":"10.3906\/elk-1603-75"},{"key":"S1793351X19400233BIB011","first-page":"445","volume-title":"23rd European Symp. Artificial Neural Networks, Computational Intelligence and Machine Learning","author":"Castro D. M. R.","year":"2015"},{"key":"S1793351X19400233BIB012","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(02)00237-3"},{"key":"S1793351X19400233BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8206050"},{"key":"S1793351X19400233BIB014","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.605"},{"key":"S1793351X19400233BIB015","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.769"},{"key":"S1793351X19400233BIB016","doi-asserted-by":"publisher","DOI":"10.1109\/WISP.2009.5286557"},{"key":"S1793351X19400233BIB019","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8202134"},{"key":"S1793351X19400233BIB020","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989381"},{"key":"S1793351X19400233BIB021","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-23778-7_25"},{"key":"S1793351X19400233BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/CEIT.2018.8751788"},{"key":"S1793351X19400233BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/IRC.2019.00014"},{"key":"S1793351X19400233BIB030","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2889.001.0001","volume-title":"Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines","author":"Nolfi S.","year":"2000"},{"key":"S1793351X19400233BIB031","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7353877"},{"key":"S1793351X19400233BIB032","doi-asserted-by":"publisher","DOI":"10.1080\/15472450.2017.1334558"},{"key":"S1793351X19400233BIB033","doi-asserted-by":"publisher","DOI":"10.1109\/IVS.2017.7995818"},{"key":"S1793351X19400233BIB034","volume-title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","author":"Puterman M. L.","year":"2014"},{"key":"S1793351X19400233BIB035","volume-title":"Probabilistic Robotics","author":"Thrun S.","year":"2005"},{"key":"S1793351X19400233BIB036","first-page":"92","volume-title":"Dynamic Programming","volume":"89","author":"Richard B.","year":"1957"},{"key":"S1793351X19400233BIB037","volume-title":"Artificial Intelligence: A Modern Approach","author":"Russell S.","year":"2010"},{"key":"S1793351X19400233BIB038","doi-asserted-by":"publisher","DOI":"10.1016\/S0952-1976(01)00007-0"},{"key":"S1793351X19400233BIB039","first-page":"1928","volume-title":"Int. Conf. Machine Learning","author":"Mnih V.","year":"2016"},{"key":"S1793351X19400233BIB041","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"issue":"107","key":"S1793351X19400233BIB042","first-page":"1","volume":"2","author":"Dhaouadi R.","year":"2013","journal-title":"Adv. Robot. Autom."},{"key":"S1793351X19400233BIB043","volume-title":"7th EUROSIM Congress on Modelling and Simulation","volume":"2","author":"Ivanjko E.","year":"2010"},{"key":"S1793351X19400233BIB044","doi-asserted-by":"publisher","DOI":"10.5772\/5997"},{"key":"S1793351X19400233BIB045","first-page":"5","volume-title":"ICRA Workshop on Open Source Software","volume":"3","author":"Quigley M.","year":"2009"},{"key":"S1793351X19400233BIB046","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2004.1389727"},{"key":"S1793351X19400233BIB049","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRev.36.823"}],"container-title":["International Journal of Semantic Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1793351X19400233","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T05:59:33Z","timestamp":1722232773000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S1793351X19400233"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":36,"journal-issue":{"issue":"04","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["10.1142\/S1793351X19400233"],"URL":"https:\/\/doi.org\/10.1142\/s1793351x19400233","relation":{},"ISSN":["1793-351X","1793-7108"],"issn-type":[{"value":"1793-351X","type":"print"},{"value":"1793-7108","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]}}}