{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T11:21:11Z","timestamp":1773141671892,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":26,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF (National Science Foundation)","doi-asserted-by":"publisher","award":["1564080, 1724157, DGE-1610403"],"award-info":[{"award-number":["1564080, 1724157, DGE-1610403"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N000141612835, N000141612785"],"award-info":[{"award-number":["N000141612835, N000141612785"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,8]]},"DOI":"10.1145\/3434074.3446361","type":"proceedings-article","created":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T01:33:17Z","timestamp":1615167197000},"page":"577-579","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Interactive Reinforcement Learning from Imperfect Teachers"],"prefix":"10.1145","author":[{"given":"Taylor A.","family":"Kessler Faulkner","sequence":"first","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Thomaz","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,8]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33486-3_8"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2010.2051030"},{"key":"e_1_3_2_2_3_1","volume-title":"Twenty-Fourth International Joint Conference on Artificial Intelligence.","author":"Cederborg Thomas","year":"2015","unstructured":"Thomas Cederborg , Ishaan Grover , Charles L Isbell , and Andrea L Thomaz . 2015 . Policy shaping with human teachers . In Twenty-Fourth International Joint Conference on Artificial Intelligence. Thomas Cederborg, Ishaan Grover, Charles L Isbell, and Andrea L Thomaz. 2015. Policy shaping with human teachers. In Twenty-Fourth International Joint Conference on Artificial Intelligence."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622716.1622717"},{"key":"e_1_3_2_2_5_1","volume-title":"On integrating apprentice learning and reinforcement learning","author":"Clouse Jeffery Allen","unstructured":"Jeffery Allen Clouse . 1996. On integrating apprentice learning and reinforcement learning . University of Massachusetts Amherst. Jeffery Allen Clouse. 1996. On integrating apprentice learning and reinforcement learning. University of Massachusetts Amherst."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2012.04.006"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390194"},{"key":"e_1_3_2_2_8_1","volume-title":"Interactive Reinforcement Learning with Inaccurate Feedback. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 7498--7504","author":"Kessler Faulkner Taylor A","year":"2020","unstructured":"Taylor A Kessler Faulkner , Elaine Schaertl Short , and Andrea L Thomaz . 2020 . Interactive Reinforcement Learning with Inaccurate Feedback. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 7498--7504 . Taylor A Kessler Faulkner, Elaine Schaertl Short, and Andrea L Thomaz. 2020. Interactive Reinforcement Learning with Inaccurate Feedback. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 7498--7504."},{"key":"e_1_3_2_2_9_1","volume-title":"Policy Shaping with Supervisory Attention Driven Exploration. In 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 842--847","author":"Faulkner Taylor Kessler","year":"2018","unstructured":"Taylor Kessler Faulkner , Elaine Schaertl Short , and Andrea Lockerd Thomaz . 2018 . Policy Shaping with Supervisory Attention Driven Exploration. In 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 842--847 . Taylor Kessler Faulkner, Elaine Schaertl Short, and Andrea Lockerd Thomaz. 2018. Policy Shaping with Supervisory Attention Driven Exploration. In 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 842--847."},{"key":"e_1_3_2_2_10_1","unstructured":"Shane Griffith Kaushik Subramanian Jonathan Scholz Charles L Isbell and Andrea L Thomaz. 2013. Policy shaping: Integrating human feedback with reinforcement learning. In Advances in neural information processing systems. 2625--2633.  Shane Griffith Kaushik Subramanian Jonathan Scholz Charles L Isbell and Andrea L Thomaz. 2013. Policy shaping: Integrating human feedback with reinforcement learning. In Advances in neural information processing systems. 2625--2633."},{"key":"e_1_3_2_2_11_1","volume-title":"Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. 728--736","author":"Faulkner Taylor Kessler","year":"2019","unstructured":"Taylor Kessler Faulkner , Reymundo A Gutierrez , Elaine Schaertl Short , Guy Hoffman , and Andrea L Thomaz . 2019 . Active attention-modified policy shaping: socially interactive agents track . In Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. 728--736 . Taylor Kessler Faulkner, Reymundo A Gutierrez, Elaine Schaertl Short, Guy Hoffman, and Andrea L Thomaz. 2019. Active attention-modified policy shaping: socially interactive agents track. In Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. 728--736."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/DEVLRN.2008.4640845"},{"key":"e_1_3_2_2_13_1","volume-title":"Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems","volume":"1","author":"Bradley Knox W","year":"2010","unstructured":"W Bradley Knox and Peter Stone . 2010 . Combining manual feedback with subsequent MDP reward signals for reinforcement learning . In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems : volume 1-Volume 1 . International Foundation for Autonomous Agents and Multiagent Systems, 5--12. W Bradley Knox and Peter Stone. 2010. Combining manual feedback with subsequent MDP reward signals for reinforcement learning. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1-Volume 1. International Foundation for Autonomous Agents and Multiagent Systems, 5--12."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3277904"},{"key":"e_1_3_2_2_15_1","volume-title":"Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 720--727","author":"Krening Samantha","year":"2019","unstructured":"Samantha Krening and Karen M Feigh . 2019 . Newtonian Action Advice: Integrating Human Verbal Instruction with Reinforcement Learning . In Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 720--727 . Samantha Krening and Karen M Feigh. 2019. Newtonian Action Advice: Integrating Human Verbal Instruction with Reinforcement Learning. In Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 720--727."},{"key":"e_1_3_2_2_16_1","volume-title":"Conference on Robot Learning (CoRL).","author":"Kurenkov Andrey","year":"2019","unstructured":"Andrey Kurenkov , Ajay Mandlekar , Roberto Martin-Martin , Silvio Savarese , and Animesh Garg . 2019 . AC-Teach: A Bayesian Actor-Critic Method for Policy Learning with an Ensemble of Suboptimal Teachers . In Conference on Robot Learning (CoRL). Andrey Kurenkov, Ajay Mandlekar, Roberto Martin-Martin, Silvio Savarese, and Animesh Garg. 2019. AC-Teach: A Bayesian Actor-Critic Method for Policy Learning with an Ensemble of Suboptimal Teachers. In Conference on Robot Learning (CoRL)."},{"key":"e_1_3_2_2_17_1","volume-title":"Human-Centered Reinforcement Learning: A Survey","author":"Li Guangliang","year":"2019","unstructured":"Guangliang Li , Randy Gomez , Keisuke Nakamura , and Bo He. 2019. Human-Centered Reinforcement Learning: A Survey . IEEE Transactions on Human-Machine Systems ( 2019 ). Guangliang Li, Randy Gomez, Keisuke Nakamura, and Bo He. 2019. Human-Centered Reinforcement Learning: A Survey. IEEE Transactions on Human-Machine Systems (2019)."},{"key":"e_1_3_2_2_18_1","volume-title":"exploit or listen: Combining human feedback and policy model to speed up deep reinforcement learning in 3D worlds. arXiv preprint arXiv:1709.03969","author":"Lin Zhiyu","year":"2017","unstructured":"Zhiyu Lin , Brent Harrison , Aaron Keech , and Mark O Riedl . 2017. Explore , exploit or listen: Combining human feedback and policy model to speed up deep reinforcement learning in 3D worlds. arXiv preprint arXiv:1709.03969 ( 2017 ). Zhiyu Lin, Brent Harrison, Aaron Keech, and Mark O Riedl. 2017. Explore, exploit or listen: Combining human feedback and policy model to speed up deep reinforcement learning in 3D worlds. arXiv preprint arXiv:1709.03969 (2017)."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/0376-6349(82)90041-4"},{"key":"e_1_3_2_2_20_1","volume-title":"Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems","author":"Saunders William","year":"2018","unstructured":"William Saunders , Girish Sastry , Andreas Stuhlmueller , and Owain Evans . 2018 . Trial without error: Towards safe reinforcement learning via human intervention . In Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems , 2067--2069. William Saunders, Girish Sastry, Andreas Stuhlmueller, and Owain Evans. 2018. Trial without error: Towards safe reinforcement learning via human intervention. In Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 2067--2069."},{"key":"e_1_3_2_2_21_1","volume-title":"Future of Interactive Learning Machines Workshop at NIPS'16","author":"Senft Emmanuel","year":"2016","unstructured":"Emmanuel Senft , S\u00e9verin Lemaignan , Paul E Baxter , Tony Belpaeme , 2016 . Sparc: an efficient way to combine reinforcement learning and supervised autonomy . In Future of Interactive Learning Machines Workshop at NIPS'16 ( Barcelona, Spain). Emmanuel Senft, S\u00e9verin Lemaignan, Paul E Baxter, Tony Belpaeme, et almbox. 2016. Sparc: an efficient way to combine reinforcement learning and supervised autonomy. In Future of Interactive Learning Machines Workshop at NIPS'16 (Barcelona, Spain)."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2011.37"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/acp.3255"},{"key":"e_1_3_2_2_24_1","volume-title":"Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 447--456","author":"Subramanian Kaushik","year":"2016","unstructured":"Kaushik Subramanian , Charles L Isbell Jr , and Andrea L Thomaz . 2016 . Exploration from demonstration for interactive reinforcement learning . In Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 447--456 . Kaushik Subramanian, Charles L Isbell Jr, and Andrea L Thomaz. 2016. Exploration from demonstration for interactive reinforcement learning. In Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 447--456."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/0267837031000155949"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11485"}],"event":{"name":"HRI '21: ACM\/IEEE International Conference on Human-Robot Interaction","location":"Boulder CO USA","acronym":"HRI '21","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Companion of the 2021 ACM\/IEEE International Conference on Human-Robot Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3434074.3446361","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3434074.3446361","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3434074.3446361","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:01Z","timestamp":1750197781000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3434074.3446361"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":26,"alternative-id":["10.1145\/3434074.3446361","10.1145\/3434074"],"URL":"https:\/\/doi.org\/10.1145\/3434074.3446361","relation":{},"subject":[],"published":{"date-parts":[[2021,3,8]]},"assertion":[{"value":"2021-03-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}