{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T13:52:10Z","timestamp":1777038730812,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":48,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,3,9]],"date-time":"2020-03-09T00:00:00Z","timestamp":1583712000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Toyota Research Institute"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,3,9]]},"DOI":"10.1145\/3319502.3374832","type":"proceedings-article","created":{"date-parts":[[2020,3,7]],"date-time":"2020-03-07T01:30:31Z","timestamp":1583544631000},"page":"43-52","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":55,"title":["When Humans Aren't Optimal"],"prefix":"10.1145","author":[{"given":"Minae","family":"Kwon","sequence":"first","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"given":"Erdem","family":"Biyik","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"given":"Aditi","family":"Talati","sequence":"additional","affiliation":[{"name":"American High School, Fremont, CA, USA"}]},{"given":"Karan","family":"Bhasin","sequence":"additional","affiliation":[{"name":"The Harker School, San Jose, CA, USA"}]},{"given":"Dylan P.","family":"Losey","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"given":"Dorsa","family":"Sadigh","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,3,9]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015430"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/RAAD.2010.5524605"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Haoyu Bai Shaojun Cai Nan Ye David Hsu and Wee Sun Lee. 2015. Intention-aware online POMDP planning for autonomous driving in a crowd. In 2015 ieee international conference on robotics and automation (icra). IEEE 454--460.  Haoyu Bai Shaojun Cai Nan Ye David Hsu and Wee Sun Lee. 2015. Intention-aware online POMDP planning for autonomous driving in a crowd. In 2015 ieee international conference on robotics and automation (icra). IEEE 454--460.","DOI":"10.1109\/ICRA.2015.7139219"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2009.07.005"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS40897.2019.8968522"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CDC40024.2019.9030169"},{"key":"e_1_3_2_2_7_1","volume-title":"Proceedings of the 3rd Conference on Robot Learning (CoRL) .","author":"Biyik Erdem","year":"2019"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.2014.7040156"},{"key":"e_1_3_2_2_9_1","unstructured":"Daniel S Brown Wonjoon Goo and Scott Niekum. 2019. Ranking-Based Reward Extrapolation without Rankings. arXiv preprint arXiv:1907.03976 (2019).  Daniel S Brown Wonjoon Goo and Scott Niekum. 2019. Ranking-Based Reward Extrapolation without Rankings. arXiv preprint arXiv:1907.03976 (2019)."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Siddhartha Chib and Edward Greenberg. 1995. Understanding the metropolis-hastings algorithm. The american statistician Vol. 49 4 (1995) 327--335.  Siddhartha Chib and Edward Greenberg. 1995. Understanding the metropolis-hastings algorithm. The american statistician Vol. 49 4 (1995) 327--335.","DOI":"10.1080\/00031305.1995.10476177"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2016.7451768"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1006\/jmps.1997.1167"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/2447556.2447672"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Anca D Dragan and Siddhartha S Srinivasa. 2012. Formalizing assistive teleoperation .MIT Press July.  Anca D Dragan and Siddhartha S Srinivasa. 2012. Formalizing assistive teleoperation .MIT Press July.","DOI":"10.15607\/RSS.2012.VIII.010"},{"key":"e_1_3_2_2_15_1","unstructured":"Espen Moen Eilertsen. 2014. Cumulative Prospect Theory and Decision Making Under Time Pressure . Master's thesis.  Espen Moen Eilertsen. 2014. Cumulative Prospect Theory and Decision Making Under Time Pressure . Master's thesis."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/3015812.3015860"},{"key":"e_1_3_2_2_17_1","volume-title":"International Conference on Machine Learning. 49--58","author":"Finn Chelsea","year":"2016"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/IVS.2013.6629472"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"crossref","unstructured":"Joseph Y Halpern Rafael Pass and Lior Seeman. 2014. Decision Theory with Resource-Bounded Agents. Topics in cognitive science Vol. 6 2 (2014) 245--257.  Joseph Y Halpern Rafael Pass and Lior Seeman. 2014. Decision Theory with Resource-Bounded Agents. Topics in cognitive science Vol. 6 2 (2014) 245--257.","DOI":"10.1111\/tops.12088"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Daniel Kahneman and Amos Tversky. 2013. Prospect theory: An analysis of decision under risk. In Handbook of the fundamentals of financial decision making: Part I. World Scientific 99--127.  Daniel Kahneman and Amos Tversky. 2013. Prospect theory: An analysis of decision under risk. In Handbook of the fundamentals of financial decision making: Part I. World Scientific 99--127.","DOI":"10.1142\/9789814417358_0006"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/IVS.2012.6232131"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2019.2898715"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Dylan P Losey Krishnan Srinivasan Ajay Mandlekar Animesh Garg and Dorsa Sadigh. 2019. Controlling Assistive Robots with Learned Latent Actions. arXiv preprint arXiv:1909.09674 (2019).  Dylan P Losey Krishnan Srinivasan Ajay Mandlekar Animesh Garg and Dorsa Sadigh. 2019. Controlling Assistive Robots with Learned Latent Actions. arXiv preprint arXiv:1909.09674 (2019).","DOI":"10.1109\/ICRA40945.2020.9197197"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/1088868314530517"},{"key":"e_1_3_2_2_25_1","volume-title":"International Conference on Machine Learning (ICML) .","author":"Ng Andrew Y","year":"2000"},{"key":"e_1_3_2_2_26_1","volume-title":"Seventh Artificial Intelligence and Interactive Digital Entertainment Conference .","author":"Dinh Nguyen Truong-Huy","year":"2011"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364917690593"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.1997.2717"},{"key":"e_1_3_2_2_29_1","unstructured":"Pedro A Ortega and Alan A Stocker. 2016. Human decision-making under limited time. In Advances in Neural Information Processing Systems. 100--108.  Pedro A Ortega and Alan A Stocker. 2016. Human decision-making under limited time. In Advances in Neural Information Processing Systems. 100--108."},{"key":"e_1_3_2_2_30_1","unstructured":"Takayuki Osogami and Makoto Otsuka. 2014. Restricted Boltzmann machines modeling human choice. In Advances in Neural Information Processing Systems. 73--81.  Takayuki Osogami and Makoto Otsuka. 2014. Restricted Boltzmann machines modeling human choice. In Advances in Neural Information Processing Systems. 73--81."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/3015812.3015939"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"crossref","unstructured":"Malayandi Palan Nicholas C Landolfi Gleb Shevchuk and Dorsa Sadigh. 2019. Learning Reward Functions by Integrating Human Demonstrations and Preferences. arXiv preprint arXiv:1906.08928 (2019).  Malayandi Palan Nicholas C Landolfi Gleb Shevchuk and Dorsa Sadigh. 2019. Learning Reward Functions by Integrating Human Demonstrations and Preferences. arXiv preprint arXiv:1906.08928 (2019).","DOI":"10.15607\/RSS.2019.XV.023"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2016.7759147"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"crossref","unstructured":"David Premack and Guy Woodruff. 1978. Does the chimpanzee have a theory of mind? Behavioral and brain sciences Vol. 1 4 (1978) 515--526.  David Premack and Guy Woodruff. 1978. Does the chimpanzee have a theory of mind? Behavioral and brain sciences Vol. 1 4 (1978) 515--526.","DOI":"10.1017\/S0140525X00076512"},{"key":"e_1_3_2_2_35_1","first-page":"2586","article-title":"Bayesian Inverse Reinforcement Learning","volume":"7","author":"Ramachandran Deepak","year":"2007","journal-title":"IJCAI"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2728606.2728628"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"crossref","unstructured":"Dorsa Sadigh Anca D Dragan Shankar Sastry and Sanjit A Seshia. 2017. Active Preference-Based Learning of Reward Functions.. In Robotics: Science and Systems .  Dorsa Sadigh Anca D Dragan Shankar Sastry and Sanjit A Seshia. 2017. Active Preference-Based Learning of Reward Functions.. In Robotics: Science and Systems .","DOI":"10.15607\/RSS.2017.XIII.053"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2016.7759036"},{"key":"e_1_3_2_2_39_1","volume-title":"Proceedings of Robotics: Science and Systems (RSS) . https:\/\/doi.org\/10","author":"Sadigh Dorsa","year":"2016"},{"key":"e_1_3_2_2_40_1","unstructured":"Herbert A Simon. 1972. Theories of bounded rationality. Decision and organization Vol. 1 1 (1972) 161--176.  Herbert A Simon. 1972. Theories of bounded rationality. Decision and organization Vol. 1 1 (1972) 161--176."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1561\/9781680832099"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00122574"},{"key":"e_1_3_2_2_43_1","volume-title":"Learning Models of Sequential Decision-Making with Partial Specification of Agent Behavior. In Thirty-Third AAAI Conference on Artificial Intelligence .","author":"Unhelkar Vaibhav V","year":"2019"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACC.2012.6315654"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.2013.6760249"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Diana L Young Adam S Goodie Daniel B Hall and Eric Wu. 2012. Decision making under time pressure modeled in a prospect theory framework. Organizational behavior and human decision processes Vol. 118 2 (2012) 179--188.  Diana L Young Adam S Goodie Daniel B Hall and Eric Wu. 2012. Decision making under time pressure modeled in a prospect theory framework. Organizational behavior and human decision processes Vol. 118 2 (2012) 179--188.","DOI":"10.1016\/j.obhdp.2012.03.005"},{"key":"e_1_3_2_2_47_1","volume-title":"Proc. AAAI. 1433--1438","author":"Ziebart Brian D."},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2009.5354147"}],"event":{"name":"HRI '20: ACM\/IEEE International Conference on Human-Robot Interaction","location":"Cambridge United Kingdom","acronym":"HRI '20","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","SIGCHI ACM Special Interest Group on Computer-Human Interaction","IEEE-RAS Robotics and Automation"]},"container-title":["Proceedings of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3319502.3374832","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3319502.3374832","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:24:01Z","timestamp":1750202641000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3319502.3374832"}},"subtitle":["Robots that Collaborate with Risk-Aware Humans"],"short-title":[],"issued":{"date-parts":[[2020,3,9]]},"references-count":48,"alternative-id":["10.1145\/3319502.3374832","10.1145\/3319502"],"URL":"https:\/\/doi.org\/10.1145\/3319502.3374832","relation":{},"subject":[],"published":{"date-parts":[[2020,3,9]]},"assertion":[{"value":"2020-03-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}