{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T15:41:20Z","timestamp":1782402080857,"version":"3.54.5"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,11,16]],"date-time":"2018-11-16T00:00:00Z","timestamp":1542326400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"<jats:p>This article presents a conceptual framework for human-robot trust which uses computational representations inspired by game theory to represent a definition of trust, derived from social psychology. This conceptual framework generates several testable hypotheses related to human-robot trust. This article examines these hypotheses and a series of experiments we have conducted which both provide support for and also conflict with our framework for trust. We also discuss the methodological challenges associated with investigating trust. The article concludes with a description of the important areas for future research on the topic of human-robot trust.<\/jats:p>","DOI":"10.1145\/3152890","type":"journal-article","created":{"date-parts":[[2018,11,19]],"date-time":"2018-11-19T13:08:27Z","timestamp":1542632907000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Modeling the Human-Robot Trust Phenomenon"],"prefix":"10.1145","volume":"8","author":[{"given":"Alan R.","family":"Wagner","sequence":"first","affiliation":[{"name":"Pennsylvania State University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Robinette","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ayanna","family":"Howard","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,11,16]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"The Evolution of Cooperation","author":"Axelrod R.","unstructured":"R. Axelrod . 1984. The Evolution of Cooperation . Basic Books , New York . R. Axelrod. 1984. The Evolution of Cooperation. Basic Books, New York."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-010-0082-7"},{"key":"e_1_2_1_3_1","volume-title":"The Logic and Limits of Trust","author":"Barber B.","unstructured":"B. Barber . 1983. The Logic and Limits of Trust . Rutgers University Press , New Brunswick, NJ . B. Barber. 1983. The Logic and Limits of Trust. Rutgers University Press, New Brunswick, NJ."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020211"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2017.2778743"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-014-0231-5"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the AAAI Spring Symposium on the Intersection of Robust Intelligence and Trust in Autonomous Systems. AAAI","author":"Carlson M. S.","unstructured":"M. S. Carlson , M. Desai , J. L. Drury , and H. A. Yanco . 2014. Identifying factors that influence trust in automated cars and medical diagnosis systems . In Proceedings of the AAAI Spring Symposium on the Intersection of Robust Intelligence and Trust in Autonomous Systems. AAAI , Palo Alto, CA. M. S. Carlson, M. Desai, J. L. Drury, and H. A. Yanco. 2014. Identifying factors that influence trust in automated cars and medical diagnosis systems. In Proceedings of the AAAI Spring Symposium on the Intersection of Robust Intelligence and Trust in Autonomous Systems. AAAI, Palo Alto, CA."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1875387"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogpsych.2010.03.001"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2010.06.030"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 8th ACM\/IEEE International Conference on Human-Robot Interaction. 251--258","author":"Desai M.","unstructured":"M. Desai , P. Kaniarasu , M. Medvedev , A. Steinfeld , and H. Yanco . 2013. Impact of robot failures and feedback on real-time trust . In Proceedings of the 8th ACM\/IEEE International Conference on Human-Robot Interaction. 251--258 . M. Desai, P. Kaniarasu, M. Medvedev, A. Steinfeld, and H. Yanco. 2013. Impact of robot failures and feedback on real-time trust. In Proceedings of the 8th ACM\/IEEE International Conference on Human-Robot Interaction. 251--258."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0046501"},{"key":"e_1_2_1_13_1","volume-title":"Nebraska Symposium on Motivation","author":"Deutsch M.","year":"1962","unstructured":"M. Deutsch . 1962 . Cooperation and trust: Some theoretical notes . In Nebraska Symposium on Motivation . University of Nebraska, Lincoln, NE, 275--315. M. Deutsch. 1962. Cooperation and trust: Some theoretical notes. In Nebraska Symposium on Motivation. University of Nebraska, Lincoln, NE, 275--315."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.76.3.473"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.geb.2004.10.009"},{"key":"e_1_2_1_16_1","volume-title":"Can we trust trust? In Trust, Making and Breaking Cooperative Relationships","author":"Gambetta D.","unstructured":"D. Gambetta . 1990. Can we trust trust? In Trust, Making and Breaking Cooperative Relationships . Basil Blackwell , Oxford, England , 213--237. D. Gambetta. 1990. Can we trust trust? In Trust, Making and Breaking Cooperative Relationships. Basil Blackwell, Oxford, England, 213--237."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720811417254"},{"key":"e_1_2_1_18_1","volume-title":"International Conference on System Sciences.","author":"Hung Y. C.","unstructured":"Y. C. Hung , A. R. Dennis , and L. Robert . 2004. Trust in virtual teams: Towards an integrative model of trust formation . In International Conference on System Sciences. Y. C. Hung, A. R. Dennis, and L. Robert. 2004. Trust in virtual teams: Towards an integrative model of trust formation. In International Conference on System Sciences."},{"key":"e_1_2_1_19_1","volume-title":"2nd Asia-Pacific Conference on Conceptual Modeling.","author":"Josang A.","unstructured":"A. Josang and S. Pope . 2005. Semantic constraints for trust transitivity . In 2nd Asia-Pacific Conference on Conceptual Modeling. A. Josang and S. Pope. 2005. Semantic constraints for trust transitivity. In 2nd Asia-Pacific Conference on Conceptual Modeling."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.47.5.956"},{"key":"e_1_2_1_21_1","volume-title":"Interpersonal Relations: A Theory of Interdependence","author":"Kelly H. H.","year":"1978","unstructured":"H. H. Kelly and J. W. Thibaut . 1978 . Interpersonal Relations: A Theory of Interdependence . John Wiley 8 Sons, New York. H. H. Kelly and J. W. Thibaut. 1978. Interpersonal Relations: A Theory of Interdependence. John Wiley 8 Sons, New York."},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"B. King-Casas D. Tomlin C. Anen C. F. Camerer S. R. Quartz and P. R. Montague. 2005. Getting to know you: Reputation and trust in two-person economic exchange. Science 308 5718 78--83. B. King-Casas D. Tomlin C. Anen C. F. Camerer S. R. Quartz and P. R. Montague. 2005. Getting to know you: Reputation and trust in two-person economic exchange. Science 308 5718 78--83.","DOI":"10.1126\/science.1108062"},{"key":"e_1_2_1_23_1","volume-title":"Modeling Human Behavior during Building Fires","author":"Kuligowski E.","unstructured":"E. Kuligowski . 2008. Modeling Human Behavior during Building Fires . National Institute of Standards and Technology (NIST) Technical Note 1619. National Institute of Standards and Technology . E. Kuligowski. 2008. Modeling Human Behavior during Building Fires. National Institute of Standards and Technology (NIST) Technical Note 1619. National Institute of Standards and Technology."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50.30392"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-010-0056-9"},{"key":"e_1_2_1_26_1","volume-title":"Trust and Power","author":"Luhmann N.","unstructured":"N. Luhmann . 1979. Trust and Power . Wiley , Chichester . N. Luhmann. 1979. Trust and Power. Wiley, Chichester."},{"key":"e_1_2_1_27_1","volume-title":"International Conference on System Science.","author":"Luna-Reyes L.","unstructured":"L. Luna-Reyes , A. M. Cresswell , and G. P. Richardson . 2004. Knowledge and the development of interpersonal trust: A dynamic model . In International Conference on System Science. L. Luna-Reyes, A. M. Cresswell, and G. P. Richardson. 2004. Knowledge and the development of interpersonal trust: A dynamic model. In International Conference on System Science."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.1995.9508080335"},{"key":"e_1_2_1_30_1","volume-title":"Cambridge, MA: MIT Press.","author":"Osborne M. J.","year":"1994","unstructured":"M. J. Osborne and A. Rubinstein . 1994 . A Course in Game Theory . Cambridge, MA: MIT Press. M. J. Osborne and A. Rubinstein. 1994. A Course in Game Theory. Cambridge, MA: MIT Press."},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1017\/S1930297500002205","article-title":"Running experiments on amazon mechanical turk","volume":"5","author":"Paolacci G.","year":"2010","unstructured":"G. Paolacci , J. Chandler , and P. G. Ipeirotis . 2010 . Running experiments on amazon mechanical turk . Judgment and Decision Making 5 , 5 (2010), 411 -- 419 G. Paolacci, J. Chandler, and P. G. Ipeirotis. 2010. Running experiments on amazon mechanical turk. Judgment and Decision Making 5, 5 (2010), 411--419","journal-title":"Judgment and Decision Making"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-014-0269-4"},{"key":"e_1_2_1_33_1","doi-asserted-by":"crossref","unstructured":"M. J. Prietula and K. M. Carley. 2001. Boundedly rational and emotional agents. In Trust and Deception in Virtual Society. Kluwer Academic 169--194. M. J. Prietula and K. M. Carley. 2001. Boundedly rational and emotional agents. In Trust and Deception in Virtual Society. Kluwer Academic 169--194.","DOI":"10.1007\/978-94-017-3614-5_9"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.49.1.95"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(02)00755-9"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2004.04.015"},{"key":"e_1_2_1_37_1","volume-title":"ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201916)","author":"Robinette R.","unstructured":"R. Robinette , R. Allen , W. Li , A. Howard , and A. R. Wagner . 2016. Overtrust of robots in emergency evacuation scenarios . In ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201916) . 101--108. R. Robinette, R. Allen, W. Li, A. Howard, and A. R. Wagner. 2016. Overtrust of robots in emergency evacuation scenarios. In ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201916). 101--108."},{"key":"e_1_2_1_38_1","volume-title":"7th International Conference on Social Robotics (ICSR\u201915)","author":"Robinette P.","unstructured":"P. Robinette , A. Howard , and A. R. Wagner . 2015. Timing is key for robot trust repair . In 7th International Conference on Social Robotics (ICSR\u201915) . 574--583. P. Robinette, A. Howard, and A. R. Wagner. 2015. Timing is key for robot trust repair. In 7th International Conference on Social Robotics (ICSR\u201915). 574--583."},{"key":"e_1_2_1_39_1","volume-title":"Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium. 78--83","author":"Robinette P.","unstructured":"P. Robinette , A. R. Wagner , and A. Howard . 2013. Building and maintaining trust between humans and guidance robots in an emergency . In Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium. 78--83 . P. Robinette, A. R. Wagner, and A. Howard. 2013. Building and maintaining trust between humans and guidance robots in an emergency. In Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium. 78--83."},{"key":"e_1_2_1_40_1","volume-title":"Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium","author":"Robinette R.","year":"2014","unstructured":"R. Robinette , A. R. Wagner , and A. Howard . 2014. Modeling human-robot trust in emergencies . In Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium , 2014 . R. Robinette, A. R. Wagner, and A. Howard. 2014. Modeling human-robot trust in emergencies. In Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium, 2014."},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","unstructured":"P. Robinette A. R. Wagner and A. Howard. 2016. Investigating human-robot trust in emergency scenarios: Methodological lessons learned. In The Intersection of Robust Intelligence (RI) and Trust in Autonomous Systems. Springer. P. Robinette A. R. Wagner and A. Howard. 2016. Investigating human-robot trust in emergency scenarios: Methodological lessons learned. In The Intersection of Robust Intelligence (RI) and Trust in Autonomous Systems. Springer.","DOI":"10.1007\/978-1-4899-7668-0_8"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2017.2648849"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.1998.926617"},{"key":"e_1_2_1_44_1","volume-title":"Artificial Intelligence: A Modern Approach. Pearson.","author":"Russell S.","year":"1995","unstructured":"S. Russell and P. Norvig . 1995 . Artificial Intelligence: A Modern Approach. Pearson. S. Russell and P. Norvig. 1995. Artificial Intelligence: A Modern Approach. Pearson."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2696454.2696497"},{"key":"e_1_2_1_46_1","volume-title":"IJCAI Workshop on Agents Learning about, from and with Other Agents.","author":"Schillo M.","unstructured":"M. Schillo and P. Funk . 1999. Learning from and about other agents in terms of social metaphors . In IJCAI Workshop on Agents Learning about, from and with Other Agents. M. Schillo and P. Funk. 1999. Learning from and about other agents in terms of social metaphors. In IJCAI Workshop on Agents Learning about, from and with Other Agents."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1080\/08839510050127579"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0034088"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8721.2007.00517.x"},{"key":"e_1_2_1_50_1","volume-title":"The Stag Hunt and the Evolution of Social Structure","author":"Skyrms B.","unstructured":"B. Skyrms . 2004. The Stag Hunt and the Evolution of Social Structure . Cambridge, UK : Cambridge University Press . B. Skyrms. 2004. The Stag Hunt and the Evolution of Social Structure. Cambridge, UK: Cambridge University Press."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0018963"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1514095.1514119"},{"key":"e_1_2_1_54_1","volume-title":"Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium, 84--89","author":"Wagner A. R.","year":"2013","unstructured":"A. R. Wagner . 2013 . Developing robots that recognize when they are being trusted . In Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium, 84--89 . A. R. Wagner. 2013. Developing robots that recognize when they are being trusted. In Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium, 84--89."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.5555\/3109842.3109847"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1075\/is.16.1.05wag"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 15th International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911)","author":"Wagner A. R.","unstructured":"A. R. Wagner and R. C. Arkin . 2006. A framework for situation-based social interaction . In Proceedings of the 15th International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911) . 291--297. A. R. Wagner and R. C. Arkin. 2006. A framework for situation-based social interaction. In Proceedings of the 15th International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911). 291--297."},{"key":"e_1_2_1_58_1","volume-title":"20th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911)","author":"Wagner A. R.","unstructured":"A. R. Wagner and R. Arkin . 2011. Recognizing situations that demand trust . In 20th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911) . Atlanta, GA. A. R. Wagner and R. Arkin. 2011. Recognizing situations that demand trust. In 20th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911). Atlanta, GA."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1038\/nn816"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-012-0144-0"},{"key":"e_1_2_1_61_1","volume-title":"Trust in Society.","author":"Yamagishi T.","unstructured":"T. Yamagishi . 2001. Trust as a form of social intelligence . In Trust in Society. , New York, NY : Russell Sage Foundation . T. Yamagishi. 2001. Trust as a form of social intelligence. In Trust in Society., New York, NY: Russell Sage Foundation."},{"key":"e_1_2_1_62_1","unstructured":"YouTube. (2016 11\/27). Retrieved from https:\/\/www.youtube.com\/watch?v=yLmxS71FIJc. YouTube. (2016 11\/27). Retrieved from https:\/\/www.youtube.com\/watch?v=yLmxS71FIJc."}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3152890","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3152890","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:20Z","timestamp":1750212680000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3152890"}},"subtitle":["A Conceptual Framework based on Risk"],"short-title":[],"issued":{"date-parts":[[2018,11,16]]},"references-count":60,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3152890"],"URL":"https:\/\/doi.org\/10.1145\/3152890","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,16]]},"assertion":[{"value":"2016-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-11-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}