{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,17]],"date-time":"2025-11-17T14:29:24Z","timestamp":1763389764957,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,7,5]],"date-time":"2023-07-05T00:00:00Z","timestamp":1688515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,7,5]]},"DOI":"10.1145\/3610419.3610494","type":"proceedings-article","created":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T15:24:14Z","timestamp":1698938654000},"page":"1-6","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["A Study on Reinforcement Learning based Control of Quadcopter with a Cable-suspended Payload"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8369-1964","authenticated-orcid":false,"given":"Pratik","family":"Prajapati","sequence":"first","affiliation":[{"name":"Human-Centered Robotics Lab, Indian Institute of Technology Gandhinagar, India"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7397-8025","authenticated-orcid":false,"given":"Atul","family":"Patidar","sequence":"additional","affiliation":[{"name":"Human-Centered Robotics Lab, Indian Institute of Technology Gandhinagar, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6776-7431","authenticated-orcid":false,"given":"Vineet","family":"Vashista","sequence":"additional","affiliation":[{"name":"Human-Centered Robotics Lab, Indian Institute of Technology Gandhinagar, India"}]}],"member":"320","published-online":{"date-parts":[[2023,11,2]]},"reference":[{"key":"#cr-split#-e_1_3_2_1_1_1.1","unstructured":"Greg Brockman Vicki Cheung Ludwig Pettersson Jonas Schneider John Schulman Jie Tang and Wojciech Zaremba. 2016. OpenAI Gym. https:\/\/doi.org\/10.48550\/ARXIV.1606.01540 10.48550\/ARXIV.1606.01540"},{"key":"#cr-split#-e_1_3_2_1_1_1.2","unstructured":"Greg Brockman Vicki Cheung Ludwig Pettersson Jonas Schneider John Schulman Jie Tang and Wojciech Zaremba. 2016. OpenAI Gym. https:\/\/doi.org\/10.48550\/ARXIV.1606.01540"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-control-042920-020211"},{"volume-title":"Geometric control of mechanical systems: modeling, analysis, and design for simple mechanical control systems. Vol.\u00a049","author":"Bullo Francesco","key":"e_1_3_2_1_3_1","unstructured":"Francesco Bullo and Andrew\u00a0 D Lewis . 2019. Geometric control of mechanical systems: modeling, analysis, and design for simple mechanical control systems. Vol.\u00a049 . Springer . Francesco Bullo and Andrew\u00a0D Lewis. 2019. Geometric control of mechanical systems: modeling, analysis, and design for simple mechanical control systems. Vol.\u00a049. Springer."},{"volume-title":"vision and control: fundamental algorithms in MATLAB. Vol.\u00a073","author":"Corke I","key":"e_1_3_2_1_4_1","unstructured":"Peter\u00a0 I Corke and Oussama Khatib . 2011. Robotics , vision and control: fundamental algorithms in MATLAB. Vol.\u00a073 . Springer . Peter\u00a0I Corke and Oussama Khatib. 2011. Robotics, vision and control: fundamental algorithms in MATLAB. Vol.\u00a073. Springer."},{"key":"e_1_3_2_1_5_1","volume-title":"53rd IEEE Conference on Decision and Control. IEEE, 6149\u20136154","author":"Dai S.","year":"2014","unstructured":"S. Dai , T. Lee , and D.\u00a0 S. Bernstein . 2014 . Adaptive control of a quadrotor UAV transporting a cable-suspended load with unknown mass . In 53rd IEEE Conference on Decision and Control. IEEE, 6149\u20136154 . S. Dai, T. Lee, and D.\u00a0S. Bernstein. 2014. Adaptive control of a quadrotor UAV transporting a cable-suspended load with unknown mass. In 53rd IEEE Conference on Decision and Control. IEEE, 6149\u20136154."},{"key":"e_1_3_2_1_6_1","volume-title":"2013 IEEE International Conference on Robotics and Automation. 4902\u20134909","author":"Faust Aleksandra","year":"2013","unstructured":"Aleksandra Faust , Ivana Palunko , Patricio Cruz , Rafael Fierro , and Lydia Tapia . 2013 . Learning swing-free trajectories for UAVs with a suspended load . In 2013 IEEE International Conference on Robotics and Automation. 4902\u20134909 . https:\/\/doi.org\/10.1109\/ICRA.2013.6631277 10.1109\/ICRA.2013.6631277 Aleksandra Faust, Ivana Palunko, Patricio Cruz, Rafael Fierro, and Lydia Tapia. 2013. Learning swing-free trajectories for UAVs with a suspended load. In 2013 IEEE International Conference on Robotics and Automation. 4902\u20134909. https:\/\/doi.org\/10.1109\/ICRA.2013.6631277"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.artint.2014.11.009","article-title":"Automated aerial suspended cargo delivery through reinforcement learning","volume":"247","author":"Faust Aleksandra","year":"2017","unstructured":"Aleksandra Faust , Ivana Palunko , Patricio Cruz , Rafael Fierro , and Lydia Tapia . 2017 . Automated aerial suspended cargo delivery through reinforcement learning . Artificial Intelligence 247 (2017), 381 \u2013 398 . Aleksandra Faust, Ivana Palunko, Patricio Cruz, Rafael Fierro, and Lydia Tapia. 2017. Automated aerial suspended cargo delivery through reinforcement learning. Artificial Intelligence 247 (2017), 381\u2013398.","journal-title":"Artificial Intelligence"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Philipp Foehn Davide Falanga Naveen Kuppuswamy Russ Tedrake and Davide Scaramuzza. 2017. Fast Trajectory Optimization for Agile Quadrotor Maneuvers with a Cable-Suspended Payload.. In Robotics: Science and Systems. 1\u201310.  Philipp Foehn Davide Falanga Naveen Kuppuswamy Russ Tedrake and Davide Scaramuzza. 2017. Fast Trajectory Optimization for Agile Quadrotor Maneuvers with a Cable-Suspended Payload.. In Robotics: Science and Systems. 1\u201310.","DOI":"10.15607\/RSS.2017.XIII.030"},{"key":"e_1_3_2_1_9_1","volume-title":"2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, IEEE, 5196\u20135202","author":"Gassner Michael","year":"2017","unstructured":"Michael Gassner , Titus Cieslewski , and Davide Scaramuzza . 2017 . Dynamic collaboration without communication: Vision-based cable-suspended load transport with two quadrotors . In 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, IEEE, 5196\u20135202 . Michael Gassner, Titus Cieslewski, and Davide Scaramuzza. 2017. Dynamic collaboration without communication: Vision-based cable-suspended load transport with two quadrotors. In 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, IEEE, 5196\u20135202."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","first-page":"121001","DOI":"10.1115\/1.4033945","article-title":"Stabilization of a rigid body payload with multiple cooperative quadrotors","volume":"138","author":"Goodarzi A","year":"2016","unstructured":"Farhad\u00a0 A Goodarzi and Taeyoung Lee . 2016 . Stabilization of a rigid body payload with multiple cooperative quadrotors . Journal of Dynamic Systems, Measurement, and Control 138 , 12 (2016), 121001 . Farhad\u00a0A Goodarzi and Taeyoung Lee. 2016. Stabilization of a rigid body payload with multiple cooperative quadrotors. Journal of Dynamic Systems, Measurement, and Control 138, 12 (2016), 121001.","journal-title":"Journal of Dynamic Systems, Measurement, and Control"},{"key":"e_1_3_2_1_11_1","volume-title":"International conference on machine learning. PMLR","author":"Haarnoja Tuomas","year":"2018","unstructured":"Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , and Sergey Levine . 2018 . Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor . In International conference on machine learning. PMLR , 1861\u20131870. Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International conference on machine learning. PMLR, 1861\u20131870."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2017.2720851"},{"key":"e_1_3_2_1_13_1","volume-title":"49th IEEE Conference on Decision and Control (CDC). IEEE, 5420\u20135425","author":"Lee Taeyoung","year":"2010","unstructured":"Taeyoung Lee , Melvin Leok , and N.\u00a0 Harris McClamroch . 2010 . Geometric tracking control of a quadrotor UAV on SE(3) . In 49th IEEE Conference on Decision and Control (CDC). IEEE, 5420\u20135425 . https:\/\/doi.org\/10.1109\/CDC.2010.5717652 10.1109\/CDC.2010.5717652 Taeyoung Lee, Melvin Leok, and N.\u00a0Harris McClamroch. 2010. Geometric tracking control of a quadrotor UAV on SE(3). In 49th IEEE Conference on Decision and Control (CDC). IEEE, 5420\u20135425. https:\/\/doi.org\/10.1109\/CDC.2010.5717652"},{"key":"e_1_3_2_1_14_1","volume-title":"52nd IEEE conference on decision and control. IEEE, 5510\u20135515","author":"Lee Taeyoung","year":"2013","unstructured":"Taeyoung Lee , Koushil Sreenath , and Vijay Kumar . 2013 . Geometric control of cooperating multiple quadrotor UAVs with a suspended payload . In 52nd IEEE conference on decision and control. IEEE, 5510\u20135515 . Taeyoung Lee, Koushil Sreenath, and Vijay Kumar. 2013. Geometric control of cooperating multiple quadrotor UAVs with a suspended payload. In 52nd IEEE conference on decision and control. IEEE, 5510\u20135515."},{"key":"e_1_3_2_1_15_1","volume-title":"Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971","author":"Lillicrap P","year":"2015","unstructured":"Timothy\u00a0 P Lillicrap , Jonathan\u00a0 J Hunt , Alexander Pritzel , Nicolas Heess , Tom Erez , Yuval Tassa , David Silver , and Daan Wierstra . 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 ( 2015 ). Timothy\u00a0P Lillicrap, Jonathan\u00a0J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2010.937855"},{"key":"e_1_3_2_1_17_1","volume-title":"On-board cable attitude measurement and controller for outdoor aerial transportation. Robotica","author":"Prajapati Pratik","year":"2021","unstructured":"Pratik Prajapati , Sagar Parekh , and Vineet Vashista . 2021. On-board cable attitude measurement and controller for outdoor aerial transportation. Robotica ( 2021 ), 1\u201315. https:\/\/doi.org\/10.1017\/S0263574721001302 10.1017\/S0263574721001302 Pratik Prajapati, Sagar Parekh, and Vineet Vashista. 2021. On-board cable attitude measurement and controller for outdoor aerial transportation. Robotica (2021), 1\u201315. https:\/\/doi.org\/10.1017\/S0263574721001302"},{"key":"e_1_3_2_1_18_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 ( 2017 ). John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)."},{"volume-title":"52nd IEEE Conference on Decision and Control. 2269\u20132274","author":"Sreenath K.","key":"e_1_3_2_1_19_1","unstructured":"K. Sreenath , T. Lee , and V. Kumar . 2013. Geometric control and differential flatness of a quadrotor UAV with a cable-suspended load . In 52nd IEEE Conference on Decision and Control. 2269\u20132274 . K. Sreenath, T. Lee, and V. Kumar. 2013. Geometric control and differential flatness of a quadrotor UAV with a cable-suspended load. In 52nd IEEE Conference on Decision and Control. 2269\u20132274."},{"key":"e_1_3_2_1_20_1","volume-title":"2013 IEEE International Conference on Robotics and Automation. IEEE, 4888\u20134895","author":"Sreenath Koushil","year":"2013","unstructured":"Koushil Sreenath , Nathan Michael , and Vijay Kumar . 2013 . Trajectory generation and control of a quadrotor with a cable-suspended load-a differentially-flat hybrid system . In 2013 IEEE International Conference on Robotics and Automation. IEEE, 4888\u20134895 . Koushil Sreenath, Nathan Michael, and Vijay Kumar. 2013. Trajectory generation and control of a quadrotor with a cable-suspended load-a differentially-flat hybrid system. In 2013 IEEE International Conference on Robotics and Automation. IEEE, 4888\u20134895."},{"key":"e_1_3_2_1_21_1","volume-title":"2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, IEEE, 2216\u20132222","author":"Tang Sarah","year":"2015","unstructured":"Sarah Tang and Vijay Kumar . 2015 . Mixed integer quadratic program trajectory generation for a quadrotor with a cable-suspended payload . In 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, IEEE, 2216\u20132222 . Sarah Tang and Vijay Kumar. 2015. Mixed integer quadratic program trajectory generation for a quadrotor with a cable-suspended payload. In 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, IEEE, 2216\u20132222."}],"event":{"name":"AIR 2023: Advances In Robotics - 6th International Conference of The Robotics Society","acronym":"AIR 2023","location":"Ropar India"},"container-title":["Advances In Robotics - 6th International Conference of The Robotics Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610419.3610494","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610419.3610494","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:03Z","timestamp":1750182543000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610419.3610494"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,5]]},"references-count":22,"alternative-id":["10.1145\/3610419.3610494","10.1145\/3610419"],"URL":"https:\/\/doi.org\/10.1145\/3610419.3610494","relation":{},"subject":[],"published":{"date-parts":[[2023,7,5]]},"assertion":[{"value":"2023-11-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}