{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T17:13:50Z","timestamp":1771607630210,"version":"3.50.1"},"reference-count":77,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T00:00:00Z","timestamp":1682467200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T00:00:00Z","timestamp":1682467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["788321"],"award-info":[{"award-number":["788321"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Many researchers from robotics, machine ethics, and adjacent fields seem to assume that norms represent good behavior that social robots should learn to benefit their users and society. We would like to complicate this view and present seven key troubles with norm-compliant robots: (1) norm biases, (2) paternalism (3) tyrannies of the majority, (4) pluralistic ignorance, (5) paths of least resistance, (6) outdated norms, and (7) technologically-induced norm change. Because discussions of why norm-compliant robots can be problematic are noticeably absent from the robot and machine ethics literature, this paper fills an important research gap. We argue that it is critical for researchers to take these issues into account if they wish to make norm-compliant robots.<\/jats:p>","DOI":"10.1007\/s10676-023-09701-1","type":"journal-article","created":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T06:02:30Z","timestamp":1682488950000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["The seven troubles with norm-compliant robots"],"prefix":"10.1007","volume":"25","author":[{"given":"Tom N.","family":"Coggins","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8784-7607","authenticated-orcid":false,"given":"Steffen","family":"Steinert","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,4,26]]},"reference":[{"key":"9701_CR89","doi-asserted-by":"publisher","unstructured":"Awad, E., Sohan, D., Kim, R., Schulz, J.,Henrich, S., Bonnefon, J., & Rahwan, I. (2018). The Moral Machine Experiment. Nature 563, pp. 59-64.\u00a0https:\/\/doi.org\/10.1038\/s41586-018-0637-6","DOI":"10.1038\/s41586-018-0637-6"},{"key":"9701_CR1","volume-title":"The No Club: Putting a stop to women\u2019s dead-end work","author":"L Babcock","year":"2022","unstructured":"Babcock, L., Peyser, B., Vesterlind, L., & Wiengart, L. (2022). The No Club: Putting a stop to women\u2019s dead-end work. London: Simon & Schuster."},{"key":"9701_CR2","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1007\/s10506-017-9194-9","volume":"25","author":"T Bench-Capon","year":"2017","unstructured":"Bench-Capon, T., & Modgil, S. (2017). Norms and value based reasoning: Justifying compliance and violation. Artifical Intelligence And Law, 25, 29\u201364. https:\/\/doi.org\/10.1007\/s10506-017-9194-9.","journal-title":"Artifical Intelligence And Law"},{"key":"9701_CR3","doi-asserted-by":"crossref","unstructured":"Bicchieri, C. (2005). The Grammar of Society: The Nature and Dynamics of Social norms. Cambridge University Press.","DOI":"10.1017\/CBO9780511616037"},{"key":"9701_CR4","doi-asserted-by":"crossref","unstructured":"Bicchieri, C. (2017). Norms in the wild: How to diagnose, measure, and change social norms. Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780190622046.001.0001"},{"issue":"1","key":"9701_CR5","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1017\/S0265052518000079","volume":"35","author":"C Bicchieri","year":"2018","unstructured":"Bicchieri, C., & McNally, p. (2018). Shrieking Sirens\u2014Schemata, Scripts, and social norms: How Change occurs. Social Philosophy and Policy, 35(1), 23\u201353. https:\/\/doi.org\/10.1017\/S0265052518000079.","journal-title":"Social Philosophy and Policy"},{"key":"9701_CR6","doi-asserted-by":"crossref","unstructured":"Bourdieu, p. (2013). Outline of a theory of practice (R.Nice , Trans). Cambridge University Press. (Original work published 1977)","DOI":"10.1017\/CBO9780511812507"},{"issue":"3\u20134","key":"9701_CR7","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1016\/S0921-8890(02)00373-1","volume":"42","author":"C Breazeal","year":"2003","unstructured":"Breazeal, C. (2003). Toward sociable robots. Robotics and Autonomous Systems, 42(3\u20134), 167\u2013175. https:\/\/doi.org\/10.1016\/S0921-8890(02)00373-1.","journal-title":"Robotics and Autonomous Systems"},{"key":"9701_CR8","doi-asserted-by":"crossref","unstructured":"Brennan, G., Eriksson, L., Goodin, R. E., & Southwood, N. (2013). Explaining norms (1st ed.). Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199654680.003.0001"},{"key":"9701_CR9","doi-asserted-by":"publisher","unstructured":"Brinck, I., Balkenius, C., & Johansson, B. (2016). Making Place for Social Norms in the Design of Human-Robot Interaction. In J. Seibt, M. N\u00f8rskov, & S. Schack Anderson (Eds.) What Social Robots Can and Should Do. Vol.\u00a0290 of Frontiers in Artificial Intelligence and Applications, pp.\u00a0303\u2013312. IOS Press. https:\/\/doi.org\/10.3233\/978-1-61499-708-5-303","DOI":"10.3233\/978-1-61499-708-5-303"},{"issue":"8","key":"9701_CR10","first-page":"09","volume":"114","author":"R Calo","year":"2010","unstructured":"Calo, R. (2010). People can be so fake: A new dimension to privacy and technology scholarship. Penn State Law Review, 114(8), 09\u201355. http:\/\/papers.ssrn.com\/abstract=1458637.","journal-title":"Penn State Law Review"},{"key":"9701_CR11","first-page":"187","volume-title":"Robot Ethics","author":"R Calo","year":"2011","unstructured":"Calo, R. (2011). Robots and privacy. In p.Lin, K. Abney, G. Bekey, C. Allen, & M. Scheutz (Eds.), Robot Ethics (pp. 187\u2013203). Cambridge MA: MIT Press."},{"key":"9701_CR12","doi-asserted-by":"publisher","unstructured":"Carlucci, F. M., Nardi, L., Iocchi, L., & Nardi, D. (2015). Explicit representation of social norms for social robots. 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), 4191\u20134196. https:\/\/doi.org\/10.1109\/IROS.2015.7353970","DOI":"10.1109\/IROS.2015.7353970"},{"key":"9701_CR13","doi-asserted-by":"publisher","unstructured":"Chen, Y. F., Everett, M., Liu, M., & How, J. p. (2017). Socially Aware Motion Planning with Deep Reinforcement Learning. https:\/\/doi.org\/10.48550\/ARXIV.1703.08862","DOI":"10.48550\/ARXIV.1703.08862"},{"key":"9701_CR14","doi-asserted-by":"publisher","unstructured":"Clarkson, J., Keates, S., Coleman, R., & Lebbon, C. (Eds.). (2003). Inclusive Design. Springer London. https:\/\/doi.org\/10.1007\/978-1-4471-0001-0","DOI":"10.1007\/978-1-4471-0001-0"},{"key":"9701_CR15","doi-asserted-by":"publisher","unstructured":"Coggins, T. (2023). Called Back Onstage: Dramaturgic Analysis, Privacy, and Domestic Social Robots. In R. Hakli, p. M\u00e4kel\u00e4, & J. Seibt (Ed.), Social Robots in Social Institutions. Frontiers of Artificial Intelligence and Applications, pp.\u00a0325\u2013334. IOS Press: Amsterdam. https:\/\/doi.org\/10.3233\/FAIA220632","DOI":"10.3233\/FAIA220632"},{"key":"9701_CR16","volume-title":"The Social Control of Technology","author":"D Collingridge","year":"1980","unstructured":"Collingridge, D. (1980). The Social Control of Technology. London: Frances Pinter Ltd."},{"key":"9701_CR18","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9780262036689.001.0001","volume-title":"Robot sex: Social and ethical implications","author":"J Danaher","year":"2017","unstructured":"Danaher, J. (2017). The symbolic-consequences argument in the sex robot debate. In J. Danaher, & N. McArthur (Eds.), Robot sex: Social and ethical implications. Cambridge: MIT Press."},{"key":"9701_CR19","doi-asserted-by":"crossref","unstructured":"Darling, K. (2016). Extending legal protection to social robots: The effects of anthropomorphism, empathy, and violent behavior towards robotic objects. In R. Calo, A.","DOI":"10.4337\/9781783476732.00017"},{"issue":"1480","key":"9701_CR21","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1098\/rstb.2006.2004","volume":"362","author":"K Dautenhahn","year":"2007","unstructured":"Dautenhahn, K. (2007). Socially intelligent robots: Dimensions of human\u2013robot interaction. Philosophical Transactions of the Royal Society B: Biological Sciences, 362(1480), 679\u2013704. https:\/\/doi.org\/10.1098\/rstb.2006.2004.","journal-title":"Philosophical Transactions of the Royal Society B: Biological Sciences"},{"key":"9701_CR22","doi-asserted-by":"crossref","unstructured":"De Tocqueville, A. (2010). Democracy in America. (J.T. Schleifer, Trans). Liberty Fund. (Original work published 1835).","DOI":"10.1002\/9781118011690.ch12"},{"key":"9701_CR17","doi-asserted-by":"crossref","unstructured":"D\u2019Ignazio, C., & Klein, L. F. (2020). Data Feminism. MIT Press.","DOI":"10.7551\/mitpress\/11805.001.0001"},{"key":"9701_CR23","doi-asserted-by":"crossref","unstructured":"Dobrosovestnova, A., & Hannibal, G. (2021). Working alongside service robots: challenges to workplace identity performance. Culturally sustainable social robotics. In: Proceedings of Robophilosophy 2020, vol\u00a0335, pp\u00a0148\u2013157","DOI":"10.3233\/FAIA200910"},{"key":"9701_CR24","unstructured":"Dorlin, E. (2022). Self-Defense: A Philosophy of Violence. (K. Aarrons, Trans). Verso. London. (Original Work published 2019)."},{"issue":"3\u20134","key":"9701_CR25","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/S0921-8890(02)00374-3","volume":"42","author":"BR Duffy","year":"2003","unstructured":"Duffy, B. R. (2003). Anthropomorphism and the social robot. Robotics and Autonomous Systems, 42(3\u20134), 177\u2013190. https:\/\/doi.org\/10.1016\/S0921-8890(02)00374-3.","journal-title":"Robotics and Autonomous Systems"},{"issue":"3","key":"9701_CR26","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1007\/s10982-004-3580-7","volume":"24","author":"G Dworkin","year":"2005","unstructured":"Dworkin, G. (2005). Moral Paternalism. Law and Philosophy, 24(3), 305\u2013319. https:\/\/doi.org\/10.1007\/s10982-004-3580-7.","journal-title":"Law and Philosophy"},{"issue":"3","key":"9701_CR27","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1037\/0033-295X.109.3.573","volume":"109","author":"AH Eagly","year":"2002","unstructured":"Eagly, A. H., & Karau, S. J. (2002). Role congruity theory of prejudice toward female leaders. Psychological Review, 109(3), 573\u2013598. https:\/\/doi.org\/10.1037\/0033-295X.109.3.573.","journal-title":"Psychological Review"},{"key":"9701_CR28","doi-asserted-by":"crossref","unstructured":"Elster, J. (2014). Tyranny and brutality of the majority. In J. Elster, & S. Novak (Eds.), Majority decisions. Principles and Practices (pp. 159\u2013176). Cambridge University Press.","DOI":"10.1017\/CBO9781107286160.008"},{"key":"9701_CR29","doi-asserted-by":"crossref","unstructured":"Feinberg, J. (1989). The moral limits of the criminal law. 3: Harm to self. Oxford Univ. Pr.","DOI":"10.1093\/0195059239.001.0001"},{"key":"9701_CR88","doi-asserted-by":"crossref","unstructured":"Fuse, Y., Takenouchi, H., & Tokumaru, M. (2019). A Robot Model That Obeys a Norm of a Human Group by Participating in the Group and Interacting with Its Members. IEICE Transactions on Information and Systems. E102.D. 185-194. 10.1587\/transinf.2018EDP7077.","DOI":"10.1587\/transinf.2018EDP7077"},{"key":"9701_CR30","unstructured":"Goffman, E. (1966). Behaviour in Public Places: Notes on the Social Organisation of Gatherings. The Free Press. New York."},{"key":"9701_CR31","doi-asserted-by":"crossref","unstructured":"Grill, K., & Hanna, J. (Eds.). (2018). The Routledge handbook of the philosophy of paternalism. Routledge.","DOI":"10.4324\/9781315657080"},{"issue":"1","key":"9701_CR32","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1080\/1359432X.2017.1402759","volume":"27","author":"T Hentschel","year":"2018","unstructured":"Hentschel, T., Braun, S., Peus, C., & Frey, D. (2018). The communality-bonus effect for male transformational leaders \u2013 leadership style, gender, and promotability. European Journal of Work and Organizational Psychology, 27(1), 112\u2013125. https:\/\/doi.org\/10.1080\/1359432X.2017.1402759","journal-title":"European Journal of Work and Organizational Psychology"},{"key":"9701_CR34","doi-asserted-by":"publisher","DOI":"10.1525\/9780520951853","volume-title":"The Managed Heart: Commercialization of Human feeling","author":"A Hochschild","year":"2012","unstructured":"Hochschild, A. (2012). The Managed Heart: Commercialization of Human feeling (3rd ed.). London: University of California Press.","edition":"3"},{"key":"9701_CR35","volume-title":"The second shift","author":"A Hochschild","year":"1989","unstructured":"Hochschild, A., & Machung, A. (1989). The second shift: working parents and the revolution at home.\u00a0New York City: Penguin Group."},{"issue":"1","key":"9701_CR36","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1146\/annurev-soc-121919-054658","volume":"46","author":"C Horne","year":"2020","unstructured":"Horne, C., & Mollborn, S. (2020a). Norms: An Integrated Framework. Annual Review of Sociology, 46(1), 467\u2013487. https:\/\/doi.org\/10.1146\/annurev-soc-121919-054658.","journal-title":"Annual Review of Sociology"},{"issue":"1","key":"9701_CR37","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1146\/annurev-soc-121919-054658","volume":"46","author":"C Horne","year":"2020","unstructured":"Horne, C., & Mollborn, S. (2020b). Norms: An Integrated Framework. Annual Review of Sociology, 46(1), 467\u2013487. https:\/\/doi.org\/10.1146\/annurev-soc-121919-054658.","journal-title":"Annual Review of Sociology"},{"key":"9701_CR40","doi-asserted-by":"publisher","unstructured":"Jackson, R. B., & Williams, T. (2019). Language-Capable Robots may Inadvertently Weaken Human Moral Norms. 2019 14th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), 401\u2013410. https:\/\/doi.org\/10.1109\/HRI.2019.8673123","DOI":"10.1109\/HRI.2019.8673123"},{"key":"9701_CR41","unstructured":"Johnson, A. G. (2014). The gender knot: Unraveling our patriarchal legacy (Third Edition). Temple University Press."},{"key":"9701_CR42","unstructured":"Katz, D., & Allport, F. H. (1931). Students\u2019 attitudes; a report of the Syracuse University reaction study. Craftsman Press."},{"issue":"2","key":"9701_CR43","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1007\/s10746-021-09572-9","volume":"44","author":"O Kudina","year":"2021","unstructured":"Kudina, O. (2021). Alexa, who am I?\u201d: Voice Assistants and Hermeneutic Lemniscate as the technologically mediated sense-making. Human Studies, 44(2), 233\u2013253. https:\/\/doi.org\/10.1007\/s10746-021-09572-9.","journal-title":"Human Studies"},{"key":"9701_CR46","doi-asserted-by":"publisher","unstructured":"Licoppe, C., & Rollet, N. (2020). \u00ab Je dois y aller \u00bb (pp. 220\u2013221). R\u00e9seaux. 2\u20133https:\/\/doi.org\/10.3917\/res.220.0151. Analyses de s\u00e9quences de cl\u00f4tures entre humains et robot.","DOI":"10.3917\/res.220.0151"},{"key":"9701_CR45","doi-asserted-by":"publisher","unstructured":"Li, S., van Wynsberghe, A., & Roeser, S. (2020). The Complexity of Autonomy: A Consideration of the Impacts of Care Robots on the Autonomy of Elderly Care Receivers. In M. N\u00f8rskov, J. Seibt, & O. S. Quick (Eds.), Culturally Sustainable Social Robotics\u2014Proceedings of Robophilosophy 2020 (pp.\u00a0316\u2013325). IOS Press. https:\/\/doi.org\/10.3233\/FAIA200928","DOI":"10.3233\/FAIA200928"},{"issue":"4","key":"9701_CR48","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1007\/s10676-015-9367-8","volume":"18","author":"BF Malle","year":"2016","unstructured":"Malle, B. F. (2016). Integrating robot ethics and machine morality: The study and design of moral competence in robots. Ethics and Information Technology, 18(4), 243\u2013256. https:\/\/doi.org\/10.1007\/s10676-015-9367-8.","journal-title":"Ethics and Information Technology"},{"key":"9701_CR50","doi-asserted-by":"crossref","unstructured":"Malle, B. F., Rosen, E., Chi, V. B., Berg, M., & Haas, p. (2020). General Methodology for Teaching Norms to Social Robots. The 29th IEEE International Conference on Robot and Human Interactive Communication.","DOI":"10.1109\/RO-MAN47096.2020.9223610"},{"key":"9701_CR49","doi-asserted-by":"publisher","unstructured":"Malle, B. F., & Scheutz, M. (2014). Moral competence in social robots. 2014 IEEE International Symposium on Ethics in Science, Technology and Engineering, 1\u20136. https:\/\/doi.org\/10.1109\/ETHICS.2014.6893446","DOI":"10.1109\/ETHICS.2014.6893446"},{"issue":"2","key":"9701_CR53","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1037\/0022-3514.53.2.298","volume":"53","author":"DT Miller","year":"1987","unstructured":"Miller, D. T., & McFarland, C. (1987). Pluralistic ignorance: When similarity is interpreted as dissimilarity. Journal of Personality and Social Psychology, 53(2), 298\u2013305. https:\/\/doi.org\/10.1037\/0022-3514.53.2.298.","journal-title":"Journal of Personality and Social Psychology"},{"key":"9701_CR52","unstructured":"Mill, J. S. (1985). On liberty. Penguin Classics. (Originally published 1859)"},{"key":"9701_CR54","doi-asserted-by":"publisher","unstructured":"Nahian, M. S. A., Frazier, S., Harrison, B., & Riedl, M. (2021). Training Value-Aligned Reinforcement Learning Agents Using a Normative Prior. https:\/\/doi.org\/10.48550\/ARXIV.2104.09469","DOI":"10.48550\/ARXIV.2104.09469"},{"key":"9701_CR55","doi-asserted-by":"publisher","unstructured":"Nahian, M. S. A., Frazier, S., Riedl, M., Harrison, B. Learning Norms from Stories: A Prior for Value Aligned Agents. Proceedings of the AAAI\/ACM Conference on AI, Ethics, and, & Society (2020). 124\u2013130. https:\/\/doi.org\/10.1145\/3375627.3375825","DOI":"10.1145\/3375627.3375825"},{"issue":"1","key":"9701_CR56","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1111\/0022-4537.00153","volume":"56","author":"C Nass","year":"2000","unstructured":"Nass, C., & Moon, Y. (2000). Machines and mindlessness: Social responses to computers. Journal of Social Issues, 56(1), 81\u2013103. https:\/\/doi.org\/10.1111\/0022-4537.00153.","journal-title":"Journal of Social Issues"},{"key":"9701_CR57","doi-asserted-by":"crossref","DOI":"10.5771\/9781786612281","volume-title":"Humans and Robots: Ethics, Agency and Anthropomorphism","author":"S Nyholm","year":"2020","unstructured":"Nyholm, S. (2020). Humans and Robots: Ethics, Agency and Anthropomorphism. London: Rowman and Littlefield."},{"key":"9701_CR58","unstructured":"Nyirkos, T. (2020). The tyranny of the majority: History, concepts, and challenges. Routledge."},{"issue":"1","key":"9701_CR59","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1086\/268490","volume":"43","author":"HJ O\u2019Gorman","year":"1979","unstructured":"O\u2019Gorman, H. J. (1979). White and black perceptions of racial values. Public Opinion Quarterly, 43(1), 48. https:\/\/doi.org\/10.1086\/268490.","journal-title":"Public Opinion Quarterly"},{"issue":"4","key":"9701_CR60","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1002\/1520-6696(198610)22:4<333::AID-JHBS2300220405>3.0.CO;2-X","volume":"22","author":"HJ O\u2019Gorman","year":"1986","unstructured":"O\u2019Gorman, H. J. (1986). The discovery of pluralistic ignorance: An ironic lesson. Journal of the History of the Behavioral Sciences, 22(4), 333\u2013347.","journal-title":"Journal of the History of the Behavioral Sciences"},{"key":"9701_CR62","doi-asserted-by":"publisher","unstructured":"Prentice, D. A., & Miller, D. T. (1996). Pluralistic Ignorance and the Perpetuation of Social Norms by Unwitting Actors. In Advances in Experimental Social Psychology (Vol.\u00a028, pp.\u00a0161\u2013209). Elsevier. https:\/\/doi.org\/10.1016\/S0065-2601(08)60238-5","DOI":"10.1016\/S0065-2601(08)60238-5"},{"key":"9701_CR63","doi-asserted-by":"crossref","unstructured":"Rawls, J. (1999). A Theory of Justice, revised edition. The Belknap Press of Harvard University Press. Cambridge, Massachusetts.","DOI":"10.4159\/9780674042582"},{"key":"9701_CR64","doi-asserted-by":"publisher","first-page":"690","DOI":"10.1016\/j.compeleceng.2018.02.011","volume":"69","author":"F Riaz","year":"2018","unstructured":"Riaz, F., Jabbar, S., Sajid, M., Ahmad, M., Naseer, K., & Ali, N. (2018). A collision avoidance scheme for autonomous vehicles inspired by human social norms. Computers & Electrical Engineering, 69, 690\u2013704. https:\/\/doi.org\/10.1016\/j.compeleceng.2018.02.011.","journal-title":"Computers & Electrical Engineering"},{"key":"9701_CR65","unstructured":"R\u00f6ssler, B. (2005). The Value of Privacy (R.D.V. Glasgow, Trans). Cambridge: Polity. (Original work published 2001)"},{"issue":"1","key":"9701_CR66","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/15710880701875068","volume":"4","author":"EBN Sanders","year":"2008","unstructured":"Sanders, E. B. N., & Stappers, p. J. (2008). Co-creation and the new landscapes of design. CoDesign, 4(1), 5\u201318. https:\/\/doi.org\/10.1080\/15710880701875068.","journal-title":"CoDesign"},{"key":"9701_CR67","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1007\/s10676-016-9387-z","volume":"18","author":"AJC Sharkey","year":"2016","unstructured":"Sharkey, A. J. C. (2016). Should we welcome robot teachers? Ethics And Information Technology, 18, 283\u2013297. https:\/\/doi.org\/10.1007\/s10676-016-9387-z.","journal-title":"Ethics And Information Technology"},{"key":"9701_CR68","doi-asserted-by":"publisher","unstructured":"Sharkey, N., & Sharkey, A. (2010). The crying shame of robot nannies An ethical appraisal. Interaction Studies - INTERACT STUD. 11. https:\/\/doi.org\/10.1075\/is.11.2.01sha.","DOI":"10.1075\/is.11.2.01sha"},{"key":"9701_CR69","unstructured":"Smith, M. (2019, October 5). Most smart speaker owners are rude to their devices. YouGov. https:\/\/yougov.co.uk\/topics\/technology\/articles-reports\/2019\/05\/10\/most-smart-speaker-owners-are-rude-their-devices"},{"key":"9701_CR70","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1007\/s11023-006-9030-6","volume":"16","author":"R Sparrow","year":"2006","unstructured":"Sparrow, R., & Sparrow, L. (2006). In the hands of machines? The future of aged care. Minds & Machines, 16, 141\u2013161. https:\/\/doi.org\/10.1007\/s11023-006-9030-6.","journal-title":"Minds & Machines"},{"issue":"2","key":"9701_CR71","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1162\/DESI_a_00207","volume":"29","author":"M Steen","year":"2013","unstructured":"Steen, M. (2013). Co-Design as a process of Joint Inquiry and Imagination. Design Issues, 29(2), 16\u201328. https:\/\/doi.org\/10.1162\/DESI_a_00207.","journal-title":"Design Issues"},{"key":"9701_CR87","doi-asserted-by":"crossref","unstructured":"Sunstein, R. (1996). Social Norms and Social Roles. Columbia Law, 96(4) pp. 903-968.","DOI":"10.2307\/1123430"},{"key":"9701_CR72","doi-asserted-by":"publisher","unstructured":"Swierstra, T. (2015). Identifying the normative challenges posed by technology\u2019s \u2018soft\u2019 impacts. Etikk i Praksis - Nordic Journal of Applied Ethics, 9(1), https:\/\/doi.org\/10.5324\/eip.v9i1.1838.","DOI":"10.5324\/eip.v9i1.1838"},{"key":"9701_CR73","doi-asserted-by":"publisher","unstructured":"Swierstra, T., Stemerding, D., & Boenink, M. (2009). Exploring Techno-Moral Change: The Case of the Obesity Pill. In p. Sollie & M. D\u00fcwell (Eds.), Evaluating New Technologies. Methodological Problems for the Ethical Assessment of Technology Developments, (pp. 119\u2013138). Springer. https:\/\/doi.org\/10.1007\/978-90-481-2229-5_9","DOI":"10.1007\/978-90-481-2229-5_9"},{"key":"9701_CR77","unstructured":"Tomic, S., Pecora, F., & Saffiotti, A. (2018). Norms, Institutions, and Robots. ArXiv:1807.11456 [Cs]. http:\/\/arxiv.org\/abs\/1807.11456"},{"key":"9701_CR78","unstructured":"Turkle, S. (2011). Alone together. Basic Books."},{"issue":"3","key":"9701_CR79","doi-asserted-by":"publisher","first-page":"667","DOI":"10.1007\/s11948-015-9724-3","volume":"22","author":"I van de Poel","year":"2016","unstructured":"van de Poel, I. (2016). An ethical Framework for evaluating Experimental Technology. Science and Engineering Ethics, 22(3), 667\u2013686. https:\/\/doi.org\/10.1007\/s11948-015-9724-3.","journal-title":"Science and Engineering Ethics"},{"key":"9701_CR80","doi-asserted-by":"crossref","unstructured":"van Wynsberghe, A., & Li, S. (2019). A paradigm shift for robot ethics: from HRI to human\u2013robot\u2013system interaction. Medicolegal and Bioethics:11\u201321.","DOI":"10.2147\/MB.S160348"},{"key":"9701_CR83","doi-asserted-by":"crossref","unstructured":"Wallach, W., & Allen, C. (2008). Moral machines: Teaching robots right from wrong. Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780195374049.001.0001"},{"key":"9701_CR82","doi-asserted-by":"publisher","unstructured":"Walsh, G., & Wronsky, E. (2019). AI + Co-Design: Developing a Novel Computer-supported Approach to Inclusive Design. Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing, 408\u2013412. https:\/\/doi.org\/10.1145\/3311957.3359456","DOI":"10.1145\/3311957.3359456"},{"issue":"8","key":"9701_CR84","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1089\/cyber.2018.29120.bkw","volume":"21","author":"BK Wiederhold","year":"2018","unstructured":"Wiederhold, B. K., & Cyberpsychology (2018).Behavior, and Social Networking, 21(8),471\u2013472. https:\/\/doi.org\/10.1089\/cyber.2018.29120.bkw","journal-title":"Behavior, and Social Networking"},{"key":"9701_CR85","doi-asserted-by":"crossref","unstructured":"Wright, J. (2023). Robots won\u2019t save Japan: An ethnography of Edlercare automation. Cornell University Press, ILR Press.","DOI":"10.7591\/cornell\/9781501768040.001.0001"},{"issue":"11\u201312","key":"9701_CR86","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1007\/s11199-018-0908-6","volume":"79","author":"W Zheng","year":"2018","unstructured":"Zheng, W., Surgevil, O., & Kark, R. (2018). Dancing on the Razor\u2019s edge: How top-level women leaders manage the paradoxical tensions between Agency and Communion. Sex Roles, 79(11\u201312), 633\u2013650. https:\/\/doi.org\/10.1007\/s11199-018-0908-6.","journal-title":"Sex Roles"}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09701-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10676-023-09701-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09701-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,19]],"date-time":"2024-10-19T06:03:57Z","timestamp":1729317837000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10676-023-09701-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,26]]},"references-count":77,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["9701"],"URL":"https:\/\/doi.org\/10.1007\/s10676-023-09701-1","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,26]]},"assertion":[{"value":"5 April 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 April 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"29"}}