{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T15:38:30Z","timestamp":1779118710839,"version":"3.51.4"},"reference-count":103,"publisher":"Walter de Gruyter GmbH","issue":"1","license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,10,14]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>There is increasing attention given to the concept of trustworthiness for artificial intelligence and robotics. However, trust is highly context-dependent, varies among cultures, and requires reflection on others\u2019 trustworthiness, appraising whether there is enough evidence to conclude that these agents deserve to be trusted. Moreover, little research exists on what happens when too much trust is placed in robots and autonomous systems. Conceptual clarity and a shared framework for approaching overtrust are missing. In this contribution, we offer an overview of pressing topics in the context of overtrust and robots and autonomous systems. Our review mobilizes insights solicited from in-depth conversations from a multidisciplinary workshop on the subject of trust in human\u2013robot interaction (HRI), held at a leading robotics conference in 2020. A broad range of participants brought in their expertise, allowing the formulation of a forward-looking research agenda on overtrust and automation biases in robotics and autonomous systems. Key points include the need for multidisciplinary understandings that are situated in an eco-system perspective, the consideration of adjacent concepts such as deception and anthropomorphization, a connection to ongoing legal discussions through the topic of liability, and a socially embedded understanding of overtrust in education and literacy matters. The article integrates diverse literature and provides a ground for common understanding for overtrust in the context of HRI.<\/jats:p>","DOI":"10.1515\/pjbr-2021-0029","type":"journal-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T20:32:25Z","timestamp":1634329945000},"page":"423-436","source":"Crossref","is-referenced-by-count":62,"title":["Overtrusting robots: Setting a research agenda to mitigate overtrust in automation"],"prefix":"10.1515","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2445-4026","authenticated-orcid":false,"given":"Alexander M.","family":"Aroyo","sequence":"first","affiliation":[{"name":"SIRRL, University of Waterloo , Waterloo , Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9762-3567","authenticated-orcid":false,"given":"Jan","family":"de Bruyne","sequence":"additional","affiliation":[{"name":"KU Leuven Centre for IT & IP Law (CiTiP) , KU Leuven, Leuven , Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6454-5251","authenticated-orcid":false,"given":"Orian","family":"Dheu","sequence":"additional","affiliation":[{"name":"KU Leuven Centre for IT & IP Law (CiTiP) , KU Leuven, Leuven , Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8325-5871","authenticated-orcid":false,"given":"Eduard","family":"Fosch-Villaronga","sequence":"additional","affiliation":[{"name":"eLaw Center for Law and Digital Technologies, Leiden University , Leiden , The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3789-3813","authenticated-orcid":false,"given":"Aleksei","family":"Gudkov","sequence":"additional","affiliation":[{"name":"Faculty of Law: School for Theory of Law and Cross-sectoral Legal Disciplines, National Research University Higher School of Economics , Moscow , Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2517-9487","authenticated-orcid":false,"given":"Holly","family":"Hoch","sequence":"additional","affiliation":[{"name":"FAA-HSG, University of St. Gallen , St. Gallen , Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1198-9849","authenticated-orcid":false,"given":"Steve","family":"Jones","sequence":"additional","affiliation":[{"name":"Department of Communication, University of Illinois Chicago , Chicago , United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4389-6006","authenticated-orcid":false,"given":"Christoph","family":"Lutz","sequence":"additional","affiliation":[{"name":"Nordic Centre for Internet and Society, BI Norwegian Business School , Nydalsveien 37 , 0484 Oslo , Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7558-6451","authenticated-orcid":false,"given":"Henrik","family":"S\u00e6tra","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Communication, \u00d8stfold University College , \u00d8stfold , Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mads","family":"Solberg","sequence":"additional","affiliation":[{"name":"Department of Health Sciences in \u00c5lesund, Norwegian University of Science and Technology , Trondheim , Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3404-7643","authenticated-orcid":false,"given":"Aurelia","family":"Tam\u00f2-Larrieux","sequence":"additional","affiliation":[{"name":"FAA-HSG, University of St. Gallen , St. Gallen , Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","published-online":{"date-parts":[[2021,10,14]]},"reference":[{"key":"2022020408211301651_j_pjbr-2021-0029_ref_001","unstructured":"European Commission, \u201cOn artificial intelligence \u2212 a European approach to excellence and trust,\u201d European Commission. Available https:\/\/ec.europa.eu\/info\/publications\/white-paper-artificial-intelligence-european-approach-excellence-and-trust_en"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_002","doi-asserted-by":"crossref","unstructured":"J. D. Lee and K. A. See, \u201cTrust in automation: designing for appropriate reliance,\u201d Hum. Factors J. Hum. Factors Ergonom Soc., vol. 46, no. 1, pp. 50\u201380, 2004.","DOI":"10.1518\/hfes.46.1.50.30392"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_003","doi-asserted-by":"crossref","unstructured":"D. Meyerson, K. E. Weick, and R. M. Kramer, \u201cSwift trust and temporary groups,\u201d in Trust Organizations: Frontiers of Theory and Research, T. Tyler, Ed., California, US: SAGE Publications, Inc, 1996, pp. 166\u2013195.","DOI":"10.4135\/9781452243610.n9"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_004","doi-asserted-by":"crossref","unstructured":"P. A. Hancock, D. R. Billings, K. E. Schaefer, J. Y. Chen, E. J. de Visser, and R. Parasuraman, \u201cA meta-analysis of factors affecting trust in human-robot interaction,\u201d Hum. Factors, vol. 53, no. 5, pp. 517\u2013527, 2011.","DOI":"10.1177\/0018720811417254"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_005","doi-asserted-by":"crossref","unstructured":"H. S. S\u00e6tra, \u201cSocial robot deception and the culture of trust,\u201d Paladyn J. Behav. Robot., vol. 12, no. 1, pp. 276\u2013286, 2021.","DOI":"10.1515\/pjbr-2021-0021"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_006","doi-asserted-by":"crossref","unstructured":"E. E. Levine and M. E. Schweitzer, \u201cProsocial lies: When deception breeds trust,\u201d Organ. Behav. Hum. Decis. Process., vol. 126, pp. 88\u2013106, 2015.","DOI":"10.1016\/j.obhdp.2014.10.007"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_007","doi-asserted-by":"crossref","unstructured":"S. C. Robinson, \u201cTrust, transparency, and openness: How inclusion of cultural values shapes Nordic national public policy strategies for artificial intelligence (AI),\u201d Technol. Soc., vol. 63, art. 101421, 2020.","DOI":"10.1016\/j.techsoc.2020.101421"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_008","doi-asserted-by":"crossref","unstructured":"H. Felzmann, E. Fosch-Villaronga, C. Lutz, and A. Tam\u00f2-Larrieux, \u201cTransparency you can trust: Transparency requirements for artificial intelligence between legal norms and contextual concerns,\u201d Big Data Soc., vol. 6, no. 1, pp. 1\u201314, 2019.","DOI":"10.1177\/2053951719860542"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_009","doi-asserted-by":"crossref","unstructured":"R. Parasuraman and V. Riley, \u201cHumans and automation: use, misuse, disuse, abuse,\u201d Hum. Factors, vol. 39, no. 2, pp. 230\u2013253, 1997.","DOI":"10.1518\/001872097778543886"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_010","unstructured":"High Level Expert Group on AI, \u201cEthics guidelines for trustworthy AI,\u201d European Commission, 2020. Available: https:\/\/op.europa.eu\/en\/publication-detail\/-\/publication\/d3988569-0434-11ea-8c1f-01aa75ed71a1"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_011","doi-asserted-by":"crossref","unstructured":"P. Robinette, W. Li, R. Allen, A. M. Howard, and A. R. Wagner, \u201cOvertrust of robots in emergency evacuation scenarios,\u201d in 11th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), 2016.","DOI":"10.1109\/HRI.2016.7451740"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_012","doi-asserted-by":"crossref","unstructured":"A. R. Wagner, J. Borenstein, and A. Howard, \u201cOvertrust in the robotic age,\u201d Commun. ACM, vol. 61, no. 9, pp. 22\u201324, 2018.","DOI":"10.1145\/3241365"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_013","doi-asserted-by":"crossref","unstructured":"K. L. Mosier, M. Dunbar, L. McDonnell, L. J. Skitka, M. Burdick, and B. Rosenblatt, \u201cAutomation bias and errors: Are teams better than individuals?,\u201d Proc. Hum. Factors Ergonom. Soc. Ann. Meet., vol. 42, no. 3, pp. 201\u2013205, 1998.","DOI":"10.1177\/154193129804200304"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_014","doi-asserted-by":"crossref","unstructured":"M. Itoh, \u201cToward overtrust-free advanced driver assistance systems,\u201d Cognit. Technol. Work., vol. 14, no. 1, pp. 51\u201360, 2012.","DOI":"10.1007\/s10111-011-0195-2"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_015","doi-asserted-by":"crossref","unstructured":"M. Moray and T. Inagaki, \u201cAttention and complacency,\u201d Theor. Issues Ergonom. Sci., vol. 1, no. 4, pp. 354\u2013365, 2000.","DOI":"10.1080\/14639220052399159"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_016","doi-asserted-by":"crossref","unstructured":"K. E. Schaefer, J. Y. Chen, J. L. Szalma, and P. A. Hancock, \u201cA meta-analysis of factors influencing the development of trust in automation,\u201d Hum. Factors, vol. 58, no. 3, pp. 377\u2013400, 2016.","DOI":"10.1177\/0018720816634228"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_017","doi-asserted-by":"crossref","unstructured":"B. M. Muir, \u201cTrust between humans and machines, and the design of decision aids,\u201d Int. J. Man-Machine Stud., vol. 27, no. 5\u20136, pp. 527\u2013539, 1987.","DOI":"10.1016\/S0020-7373(87)80013-5"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_018","doi-asserted-by":"crossref","unstructured":"M. T. Dzindolet, S. A. Peterson, R. A. Pomranky, L. G. Pierce, and H. P. Beck, \u201cThe role of trust in automation reliance,\u201d Int. J. Human-Computer Stud., vol. 58, no. 6, pp. 697\u2013718, 2003.","DOI":"10.1016\/S1071-5819(03)00038-7"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_019","doi-asserted-by":"crossref","unstructured":"M. Itoh, G. Abe, and K. Tanaka, \u201cTrust in and use of automation: their dependence on occurrence patterns of malfunctions,\u201d in IEEE SMC'99 Conference Proceedings, 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No. 99CH37028), vol. 3, 1999, pp. 715\u2013720.","DOI":"10.1109\/ICSMC.1999.823316"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_020","doi-asserted-by":"crossref","unstructured":"B. M. Muir and N. Moray, \u201cTrust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation,\u201d Ergonomics, vol. 39, no. 3, pp. 429\u2013460, 1996.","DOI":"10.1080\/00140139608964474"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_021","doi-asserted-by":"crossref","unstructured":"I. Gaudiello, E. Zibetti, S. Lefort, M. Chetouani, and S. Ivaldi, \u201cTrust as indicator of robot functional and social acceptance. An experimental study on user conformation to iCub answers,\u201d Comput Hum. Behav., vol. 61, pp. 633\u2013655, 2016.","DOI":"10.1016\/j.chb.2016.03.057"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_022","doi-asserted-by":"crossref","unstructured":"M. Salem, G. Lakatos, F. Amirabdollahian, and K. Dautenhahn, \u201cWould you trust a (faulty) robot?,\u201d in Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human-Robot Interaction, 2015.","DOI":"10.1145\/2696454.2696497"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_023","doi-asserted-by":"crossref","unstructured":"J. J. Trinckes, Jr., The Definitive Guide to Complying with the HIPAA\/HITECH Privacy and Security Rules, Boca Raton, FL: CRC Press, 2013.","DOI":"10.1201\/b13693"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_024","unstructured":"K. D. Mitnick, The Art of Deception: Controlling the Human Element of Security, New York: Wiley, 2003."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_025","doi-asserted-by":"crossref","unstructured":"B. Postnikoff and I. Goldberg, \u201cRobot social engineering,\u201d in Companion of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction, 2018.","DOI":"10.1145\/3173386.3176908"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_026","doi-asserted-by":"crossref","unstructured":"S. Booth, J. Tompkin, H. Pfister, J. Waldo, K. Gajos, and R. Nagpal, \u201cPiggybacking robots,\u201d in Proceedings of the 2017 ACM\/IEEE International Conference on Human-Robot Interaction, 2017.","DOI":"10.1145\/2909824.3020211"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_027","doi-asserted-by":"crossref","unstructured":"A. M. Aroyo, F. Rea, G. Sandini, and A. Sciutti, \u201cTrust and social engineering in human robot interaction: Will a robot make you disclose sensitive information, conform to its recommendations or gamble?,\u201d IEEE Robot. Autom. Lett., vol. 3, no. 4, pp. 3701\u20133708, 2018.","DOI":"10.1109\/LRA.2018.2856272"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_028","doi-asserted-by":"crossref","unstructured":"A. M. Aroyo, T. Kyohei, T. Koyama, H. Takahashi, F. Rea, A. Sciutti, et al., \u201cWill people morally crack under the authority of a famous wicked robot?,\u201d in 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 2018.","DOI":"10.1109\/ROMAN.2018.8525744"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_029","doi-asserted-by":"crossref","unstructured":"J. Borenstein, A. R. Wagner, and A. Howard, \u201cOvertrust of pediatric health-care robots: A preliminary survey of parent perspectives,\u201d IEEE Robot. Autom. Mag., vol. 25, no. 1, pp. 46\u201354, 2018.","DOI":"10.1109\/MRA.2017.2778743"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_030","unstructured":"European Commission, Proposal for a Regulation on AI, AI Act, 2021. Available: https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A52021PC0206"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_031","doi-asserted-by":"crossref","unstructured":"A. Martinetti, P. Chemweno, K. Nizamis, and E. Fosch-Villaronga, \u201cRedefining safety in light of human-robot interaction: A critical review of current standards and regulations,\u201d Front. Chem. Eng., vol. 3, art. 666237, 2021.","DOI":"10.3389\/fceng.2021.666237"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_032","doi-asserted-by":"crossref","unstructured":"H. Felzmann, E. Fosch-Villaronga, C. Lutz, and A. Tam\u00f2-Larrieux, \u201cTowards transparency by design for artificial intelligence,\u201d Sci. Eng. Ethics, vol. 26, no. 6, pp. 3333\u20133361, 2020.","DOI":"10.1007\/s11948-020-00276-4"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_033","doi-asserted-by":"crossref","unstructured":"G. Becker, \u201cA theory of social interactions,\u201d J. Political Econom., vol. 82, pp. 1063\u20131091, 1974.","DOI":"10.1086\/260265"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_034","unstructured":"G. Simmel, The Sociology of Georg Simmel, New York: Free Press, 1950."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_035","unstructured":"J. S. Coleman, Foundations of Social Theory, Cambridge, MA: Harvard University Press, 1990."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_036","unstructured":"D. Gambetta, Trust: Making and Breaking Co-operative Relations, Oxford: Basil Blackwell, 1988."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_037","unstructured":"P. Bourdieu, \u201cThe forms of capital,\u201d in Education: Culture, Economy, and Society, A. H. Halsey, H. Lauder, P. Brown, and A. S. Wells, Eds, Oxford: Oxford University Press, 1997."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_038","unstructured":"F. Fukuyama, Trust: The Social Virtues and the Creation of Prosperity, London: Hamish Hamilton, 1995."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_039","doi-asserted-by":"crossref","unstructured":"S. Jones, \u201cPeople, things, memory and human-machine communication,\u201d Int. J. Media Cult. Politics, vol. 10, no. 3, pp. 245\u2013258, 2014.","DOI":"10.1386\/macp.10.3.245_1"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_040","unstructured":"A. L. Guzman, \u201cThe messages of mute machines: Human-machine communication with industrial technologies,\u201d Commun. + 1, vol. 5, no. 1, art. 4, 2016."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_041","doi-asserted-by":"crossref","unstructured":"A. L. Guzman, \u201cWhat is human-machine communication, anyway,\u201d in Human-Machine Communication: Rethinking Communication, Technology, and Ourselves, A. Guzman, Ed., Bern: Peter Lang, 2018, pp. 1\u201328.","DOI":"10.3726\/b14399"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_042","doi-asserted-by":"crossref","unstructured":"E. Keymolen, \u201cOpinions when cities become smart, is there still place for trust?,\u201d Eur. Data Prot. Law Rev., vol. 5, no. 2, pp. 156\u2013159, 2019.","DOI":"10.21552\/edpl\/2019\/2\/5"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_043","doi-asserted-by":"crossref","unstructured":"D. M. Rousseau, S. B. Sitkin, R. S. Burt, and C. Camerer, \u201cNot so different after all: A cross-discipline view of trust,\u201d Acad. Manag. Rev., vol. 23, no. 3, pp. 393\u2013404, 1998.","DOI":"10.5465\/amr.1998.926617"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_044","unstructured":"G. M. Bounds and N. Malyshev, OECD Reviews of Regulatory Reform Risk and Regulatory Policy: Improving the Governance of Risk, Paris: OECD Publishing, 2010."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_045","doi-asserted-by":"crossref","unstructured":"R. R. Hoffman, M. Johnson, J. M. Bradshaw, and A. Underbrink, \u201cTrust in automation,\u201d IEEE Intell. Syst., vol. 28, no. 1, pp. 84\u201388, 2013.","DOI":"10.1109\/MIS.2013.24"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_046","unstructured":"K. Siau and W. Wang, \u201cBuilding trust in artificial intelligence, machine learning, and robotics,\u201d Cut. Bus. Technol. J., vol. 31, no. 2, pp. 47\u201353, 2018."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_047","doi-asserted-by":"crossref","unstructured":"A. Sharkey and N. Sharkey, \u201cChildren, the elderly, and interactive robots,\u201d IEEE Robot. Autom. Mag., vol. 18, no. 1, pp. 32\u201338, 2011.","DOI":"10.1109\/MRA.2010.940151"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_048","unstructured":"S. C. Levinson, \u201cNatural forms of purposeful interaction among humans: What makes interaction effective?,\u201d in Interactive Task Learning: Humans, Robots, and Agents Acquiring New Tasks through Natural Interactions, K. A. Gluck, J. E. Laird, Eds, Cambridge, MA: MIT Press, 2019, pp. 111\u2013126."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_049","unstructured":"B. Reeves and C. Nass, The Media Equation: How People Treat Computers, Television, and New Media like Real People, Cambridge, United Kingdom: Cambridge University Press, 1996."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_050","doi-asserted-by":"crossref","unstructured":"E. J. de Visser, S. S. Monfort, R. McKendrick, M. A. Smith, P. E. McKnight, F. Krueger, et al., \u201cAlmost human: Anthropomorphism increases trust resilience in cognitive agents,\u201d J. Exp. Psychol Appl., vol. 22, no. 3, pp. 331\u2013349, 2016.","DOI":"10.1037\/xap0000092"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_051","doi-asserted-by":"crossref","unstructured":"A. R. Wagner and R. C. Arkin, \u201cActing deceptively: Providing robots with the capacity for deception,\u201d Int. J. Soc. Robot., vol. 3, no. 1, pp. 5\u201326, 2011.","DOI":"10.1007\/s12369-010-0073-8"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_052","doi-asserted-by":"crossref","unstructured":"R. Hertwig and A. Ortmann, \u201cDeception in experiments: Revisiting the arguments in its defense,\u201d Ethics Behav., vol. 18, no. 1, pp. 59\u201392, 2008.","DOI":"10.1080\/10508420701712990"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_053","doi-asserted-by":"crossref","unstructured":"P. Baxter, J. Kennedy, E. Senft, S. Lemaignan and T. Belpaeme, \u201cFrom characterising three years of HRI to methodology and reporting recommendations,\u201d in 11th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), 2016.","DOI":"10.1109\/HRI.2016.7451777"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_054","doi-asserted-by":"crossref","unstructured":"L. Riek, \u201cWizard of Oz studies in HRI: a systematic review and new reporting guidelines,\u201d J. Human-Robot Interact., vol. 1, no. 1, pp. 119\u2013136, 2012.","DOI":"10.5898\/JHRI.1.1.Riek"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_055","doi-asserted-by":"crossref","unstructured":"M. Ala\u010d, J. Movellan, and F. Tanaka, \u201cWhen a robot is social: Spatial arrangements and multimodal semiotic engagement in the practice of social robotics,\u201d Soc. Stud. Sci., vol. 41, no. 6, pp. 893\u2013926, 2011.","DOI":"10.1177\/0306312711420565"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_056","doi-asserted-by":"crossref","unstructured":"M. Ala\u010d, \u201cMoving android: On social robots and body-in-interaction,\u201d Soc. Stud. Sci., vol. 39, no. 4, pp. 491\u2013528, 2009.","DOI":"10.1177\/0306312709103476"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_057","doi-asserted-by":"crossref","unstructured":"J. Shim and R. C. Arkin, \u201cA taxonomy of robot deception and its benefits in HRI,\u201d in 2013 IEEE International Conference on Systems, Man, and Cybernetics, 2013.","DOI":"10.1109\/SMC.2013.398"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_058","doi-asserted-by":"crossref","unstructured":"J. Danaher, \u201cRobot betrayal: A guide to the ethics of robotic deception,\u201d Ethics Inf. Technol., vol. 22, no. 2, pp. 117\u2013128, 2020.","DOI":"10.1007\/s10676-019-09520-3"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_059","doi-asserted-by":"crossref","unstructured":"M. Coeckelbergh, \u201cAre emotional robots deceptive?,\u201d IEEE Trans. Affect. Comput., vol. 3, no. 4, pp. 388\u2013393, 2011.","DOI":"10.1109\/T-AFFC.2011.29"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_060","doi-asserted-by":"crossref","unstructured":"E. Short, J. Hart, M. Vu, and B. Scassellati, \u201cNo fair!! An interaction with a cheating robot,\u201d in 5th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), 2010.","DOI":"10.1109\/HRI.2010.5453193"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_061","doi-asserted-by":"crossref","unstructured":"E. E. Levine and M. E. Schweitzer, \u201cProsocial lies: When deception breeds trust,\u201d Organ. Behav. Hum. Decis. Process., vol. 126, pp. 88\u2013106, 2015.","DOI":"10.1016\/j.obhdp.2014.10.007"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_062","doi-asserted-by":"crossref","unstructured":"H. Admoni and B. Scassellati, \u201cSocial eye gaze in human-robot interaction: a review,\u201d J. Human-Robot Interact., vol. 6, no. 1, pp. 25\u201363, 2017.","DOI":"10.5898\/JHRI.6.1.Admoni"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_063","doi-asserted-by":"crossref","unstructured":"A. Sharkey and N. Sharkey, \u201cWe need to talk about deception in social robotics!,\u201d Ethics Inf. Technol., pp. 1\u20138, 2020. 10.1007\/s10676-020-09573-9.","DOI":"10.1007\/s10676-020-09573-9"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_064","doi-asserted-by":"crossref","unstructured":"C. Lutz, M. Sch\u00f6ttler, and C. P. Hoffmann, \u201cThe privacy implications of social robots: Scoping review and expert interviews,\u201d Mob. Media Commun., vol. 7, no. 3, pp. 412\u2013434, 2019.","DOI":"10.1177\/2050157919843961"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_065","doi-asserted-by":"crossref","unstructured":"K. Darling, \u201c\u2018Who\u2019s Johnny?\u2019 Anthropomorphic framing in human-robot interaction, integration, and policy,\u201d Robot Ethics 2.0, P. Lin, K. Abney, and R. Jenkins, Eds, Oxford: Oxford University Press, 2017, pp. 173\u2013192.","DOI":"10.1093\/oso\/9780190652951.003.0012"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_066","unstructured":"D. Leyzberg, S. Spaulding, M. Toneva, and B. Scassellati, \u201cThe physical presence of a robot tutor increases cognitive learning gains,\u201d Proc. Annu. Meet. Cognit. Sci. Soc., vol. 34, pp. 1882\u20131887, 2012."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_067","doi-asserted-by":"crossref","unstructured":"C. Sinoo, S. van der Pal, O. A. Blanson Henkemans, A. Keizer, B. P. B. Bierman, R. Looije, et al., \u201cFriendship with a robot: Children\u2019s perception of similarity between a robot\u2019s physical and virtual embodiment that supports diabetes self-management,\u201d Patient Educ. Counseling, vol. 101, no. 7, pp. 1248\u20131255, 2018.","DOI":"10.1016\/j.pec.2018.02.008"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_068","doi-asserted-by":"crossref","unstructured":"H. S. S\u00e6tra, \u201cThe parasitic nature of social AI: Sharing minds with the mindless,\u201d Integr. Psychol Behav. Sci., vol. 54, no. 2, pp. 308\u2013326, 2020.","DOI":"10.1007\/s12124-020-09523-6"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_069","doi-asserted-by":"crossref","unstructured":"H. Admoni and B. Scassellati, \u201cSocial eye gaze in human-robot interaction: a review,\u201d J. Human-Robot Interact., vol. 6, no. 1, pp. 25\u201363, 2017.","DOI":"10.5898\/JHRI.6.1.Admoni"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_070","doi-asserted-by":"crossref","unstructured":"K. S. Haring, C. Mougenot, F. Ono, and K. Watanabe, \u201cCultural differences in perception and attitude towards robots,\u201d Int. J. Affect. Eng., vol. 13, no. 3, pp. 149\u2013157, 2014.","DOI":"10.5057\/ijae.13.149"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_071","doi-asserted-by":"crossref","unstructured":"E. Fosch-Villaronga and C. Millard, \u201cCloud robotics law and regulation,\u201d Robot. Autonom Syst., vol. 119, pp. 77\u201391, 2019.","DOI":"10.1016\/j.robot.2019.06.003"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_072","unstructured":"C. Lutz and A. Tam\u00f2, \u201cCommunicating with robots: ANTalyzing the interaction between healthcare robots and humans with regards to privacy,\u201d in Human-Machine Communication: Rethinking Communication, Technology, and Ourselves, A. Guzman, Ed., Bern: Peter Lang, 2018, pp. 145\u2013165."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_073","doi-asserted-by":"crossref","unstructured":"A. Hepp, \u201cArtificial companions, social bots and work bots: communicative robots as research objects of media and communication studies,\u201d Media Cult. Soc., vol. 42, no. 7\u20138, pp. 1410\u20131426, 2020.","DOI":"10.1177\/0163443720916412"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_074","doi-asserted-by":"crossref","unstructured":"D. H. McKnight, V. Choudhury, and C. Kacmar, \u201cDeveloping and validating trust measures for e-commerce: An integrative typology,\u201d Inf. Syst. Res., vol. 13, no. 3, pp. 334\u2013359, 2002.","DOI":"10.1287\/isre.13.3.334.81"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_075","doi-asserted-by":"crossref","unstructured":"B. C. Kok and H. Soh, \u201cTrust in robots: challenges and opportunities,\u201d Curr. Robot. Rep., vol. 1, no. 4, pp. 297\u2013309, 2020.","DOI":"10.1007\/s43154-020-00029-y"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_076","doi-asserted-by":"crossref","unstructured":"A. Howard and J. Borenstein, \u201cTrust and bias in robots,\u201d Am. Scientist, vol. 107, no. 2, p. 86, Mar\u2013Apr 2019.","DOI":"10.1511\/2019.107.2.86"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_077","doi-asserted-by":"crossref","unstructured":"W. Barfield, \u201cLiability for autonomous and artificially intelligent robots,\u201d Paladyn, J. Behav. Robot., vol. 9, no. 1, pp. 193\u2013203, 2018.","DOI":"10.1515\/pjbr-2018-0018"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_078","doi-asserted-by":"crossref","unstructured":"M. Ebers and S. Navas, Algorithms and Law, Cambridge: Cambridge University Press, 2020.","DOI":"10.1017\/9781108347846"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_079","doi-asserted-by":"crossref","unstructured":"S. Lohsse, R. Schulze, and D. Staudenmayer, Liability for Artificial Intelligence and the Internet of Things, Baden-Baden: Nomos, 2019.","DOI":"10.5771\/9783845294797"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_080","doi-asserted-by":"crossref","unstructured":"E. Tjong Tjin Tai, \u201cLiability for (semi)autonomous systems: robots and algorithms,\u201d in Research Handbook on Data Science and Law, V. Mak, E. Tjong Tjin Tai, and A. Berlee, Eds, Cheltenham: Edward Elgar, 2018, pp. 55\u201382.","DOI":"10.4337\/9781788111300.00011"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_081","unstructured":"R. Abrams and A. Kurtz, \u201cJoshua Brown, who died in self-driving accident, tested limits of his tesla,\u201d The New York Times, July 1, 2016. Available https:\/\/www.nytimes.com\/2016\/07\/02\/business\/joshua-brown-technology-enthusiast-tested-the-limits-of-his-tesla.html."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_082","doi-asserted-by":"crossref","unstructured":"J. De Bruyne and J. Tanghe, \u201cLiability for damage caused by autonomous vehicles: A Belgian perspective,\u201d J. Eur. Tort Law, vol. 8, no. 3, pp. 324\u2013371, 2018.","DOI":"10.1515\/jetl-2017-0013"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_083","doi-asserted-by":"crossref","unstructured":"M. Schellekens, \u201cSelf-driving cars and the chilling effect of liability law,\u201d Comp. Law Secur. Rev., vol. 31, no. 4, pp. 506\u2013517, 2015.","DOI":"10.1016\/j.clsr.2015.05.012"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_084","doi-asserted-by":"crossref","unstructured":"H. Surden and M. A. Williams, \u201cTechnological opacity, predictability, and self-driving cars,\u201d Cardozo Law Rev., vol. 38, pp. 121\u2013181, 2016.","DOI":"10.2139\/ssrn.2747491"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_085","unstructured":"N. Velinga, \u201cLegal aspects of automated driving: on drivers, producers, and public authorities,\u201d PhD thesis, University of Groningen, Groningen, Netherlands, 2020."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_086","unstructured":"T. Malengreau, \u201cAutomatisation de la conduite: quelles responsabilit\u00e9s en droit belge?,\u201d RGAR, vol. 5, pp. 15578\u201315607, 2019."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_087","unstructured":"J. De Bruyne, Autonome Motorvoertuigen, Bruges: Vanden Broele, 2021."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_088","unstructured":"K. Funkhouser, \u201cPaving the road ahead: autonomous vehicles, products liability, and the need for a new approach,\u201d Utah Law Rev., vol. 1, pp. 437\u2013462, 2013."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_089","unstructured":"J. Werbrouck, \u201cDe productaansprakelijkheid voor zelfrijdende motorrijtuigen,\u201d TPR, vol. 55, pp. 529\u2013604, 2018."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_090","unstructured":"D. Levalley, \u201cAutonomous vehicle liability \u2013 application of common carrier liability,\u201d Seattle Univ. Law Rev., vol. 36, pp. 5\u201326, 2013."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_091","unstructured":"G. Calabresi, The Costs of Accidents: A Legal and Economic Analysis, New Haven: Yale University Press, 1970."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_092","unstructured":"J. De Bruyne, Third-Party Certifiers, Alphen aan den Rijn: Kluwer Law International, 2019."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_093","doi-asserted-by":"crossref","unstructured":"R. A. Posner, \u201cA Theory of Negligence,\u201d J. Leg. Stud., vol. 1, no. 1, pp. 29\u201396, 1972.","DOI":"10.1086\/467478"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_094","doi-asserted-by":"crossref","unstructured":"R. C. Mayer, J. H. Davis, and F. D. Schoorman, \u201cAn integrative model of organizational trust,\u201d Acad. Manag. Rev., vol. 20, no. 3, pp. 709\u2013734, 1995.","DOI":"10.5465\/amr.1995.9508080335"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_095","unstructured":"S. Jones, \u201cCan social robots do social science? The ethics of robots in research,\u201d NordiCHI Conference, Oslo, 2018."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_096","unstructured":"a. s. franzke, A. Bechmann, M. Zimmer, C. Ess, and the Association of Internet Researchers, \u201cInternet Research: Ethical Guidelines 3.0,\u201d Association of Internet Researchers (AoIR), 2020. Available https:\/\/aoir.org\/reports\/ethics3.pdf"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_097","doi-asserted-by":"crossref","unstructured":"A. Bertolini, \u201cRobots as products: The case for a realistic analysis of robotic applications and liability rules,\u201d Law, Innov. Technol., vol. 5, no. 2, pp. 214\u2013247, 2013.","DOI":"10.5235\/17579961.5.2.214"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_098","unstructured":"R. Calo, \u201cRobotics and the lessons of cyberlaw,\u201d Calif. Law Rev., vol. 103, no. 3, pp. 513\u2013563, 2015."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_099","unstructured":"C. Gordon and T. Lutz, \u201cHaftung f\u00fcr automatisierte Entscheidungen \u2013 Herausforderungen in der Praxis,\u201d Schweizerische Z. f\u00fcr Wirtschafts- und Finanzmarktrecht, vol. l, pp. 53\u201361, 2020."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_100","unstructured":"M. F. Lohmann, \u201cRoboter als Wundert\u00fcten \u2212 eine zivilrechtliche Haftungsanalyse,\u201d Aktuelle juristische Praxis: AJP, vol. 2, pp. 152\u2013162, 2017."},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_101","doi-asserted-by":"crossref","unstructured":"S. S. Sundar and J. Kim, \u201cMachine heuristic: When we trust computers more than humans with our personal information,\u201d in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019.","DOI":"10.1145\/3290605.3300768"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_102","doi-asserted-by":"crossref","unstructured":"B. J. Dietvorst, J. P. Simmons, and C. Massey, \u201cAlgorithm aversion: People erroneously avoid algorithms after seeing them err,\u201d J. Exp. Psychology: Gen., vol. 144, no. 1, pp. 114\u2013126, 2014.","DOI":"10.1037\/xge0000033"},{"key":"2022020408211301651_j_pjbr-2021-0029_ref_103","doi-asserted-by":"crossref","unstructured":"H. Felzmann, E. Fosch-Villaronga, C. Lutz, and A. Tam\u00f2-Larrieux, \u201cRobots and transparency: The multiple dimensions of transparency in the context of robot technologies,\u201d IEEE Robot. Autom. Mag., vol. 26, no. 2, pp. 71\u201378, 2019.","DOI":"10.1109\/MRA.2019.2904644"}],"container-title":["Paladyn, Journal of Behavioral Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/pjbr-2021-0029\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/pjbr-2021-0029\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T01:03:17Z","timestamp":1725930197000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/pjbr-2021-0029\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,1]]},"references-count":103,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,2,10]]},"published-print":{"date-parts":[[2021,2,10]]}},"alternative-id":["10.1515\/pjbr-2021-0029"],"URL":"https:\/\/doi.org\/10.1515\/pjbr-2021-0029","relation":{},"ISSN":["2081-4836"],"issn-type":[{"value":"2081-4836","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,1]]}}}