{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T02:08:32Z","timestamp":1770516512880,"version":"3.49.0"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2017,5,26]],"date-time":"2017-05-26T00:00:00Z","timestamp":1495756800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2017,5,26]],"date-time":"2017-05-26T00:00:00Z","timestamp":1495756800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>As robots are deployed in a widening range of situations, it is necessary to develop a clearer position about whether or not they can be trusted to make good moral decisions. In this paper, we take a realistic look at recent attempts to program and to train robots to develop some form of moral competence. Examples of implemented robot behaviours that have been described as 'ethical', or 'minimally ethical' are considered, although they are found to operate only in quite constrained and limited application domains. There is a general recognition that current robots cannot be described as full moral agents, but it is less clear whether will always be the case. Concerns are raised about the insufficiently justified use of terms such as 'moral' and 'ethical' to describe the behaviours of robots that are often more related to safety considerations than to moral ones. Given the current state of the art, two possible responses are identified. The first involves continued efforts to develop robots that are capable of ethical behaviour. The second is to argue against, and to attempt to avoid, placing robots in situations that demand moral competence and an understanding of the surrounding social situation. There is something to be gained from both responses, but it is argued here that the second is the more responsible choice.<\/jats:p>","DOI":"10.1007\/s10676-017-9425-5","type":"journal-article","created":{"date-parts":[[2017,5,26]],"date-time":"2017-05-26T15:12:21Z","timestamp":1495811541000},"page":"283-295","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Can we program or train robots to be good?"],"prefix":"10.1007","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4713-2575","authenticated-orcid":false,"given":"Amanda","family":"Sharkey","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2017,5,26]]},"reference":[{"issue":"2","key":"9425_CR1","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/s10676-013-9318-1","volume":"15","author":"J Altmann","year":"2013","unstructured":"Altmann, J., Asaro, P., Sharkey, N., & Sparrow, R. (2013). Armed Military Robots: Editorial. Ethics and Information Technology, 15(2), 73\u201376.","journal-title":"Ethics and Information Technology"},{"key":"9425_CR3","volume-title":"Proceedings of the eighteenth conference on innovative applications of artificial intelligence","author":"M Anderson","year":"2006","unstructured":"Anderson, M., Anderson, S., Armen, C. (2006). MedEthEx: A prototype medical ethics advisor. In Proceedings of the eighteenth conference on innovative applications of artificial intelligence. Menlo Park, CA: AAAI Press."},{"issue":"4","key":"9425_CR4","first-page":"15","volume":"28","author":"S Anderson","year":"2007","unstructured":"Anderson, S., & Anderson, M. (2007). Machine ethics: creating an ethical intelligent agent. AI Magazine, 28(4), 15\u201326.","journal-title":"AI Magazine"},{"key":"9425_CR5","volume-title":"Governing lethal behaviour: Embedding ethics in a hybrid deliberative\/reactive robot architecture","author":"RC Arkin","year":"2007","unstructured":"Arkin, R. C. (2007). Governing lethal behaviour: Embedding ethics in a hybrid deliberative\/reactive robot architecture. Atlanta: Georgia Institute of Technology."},{"key":"9425_CR6","doi-asserted-by":"crossref","DOI":"10.1201\/9781420085952","volume-title":"Governing lethal behavior in autonomous robots","author":"RC Arkin","year":"2009","unstructured":"Arkin, R. C. (2009). Governing lethal behavior in autonomous robots. Boca Raton, FL: CRC Press."},{"issue":"886","key":"9425_CR7","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1017\/S1816383112000768","volume":"94","author":"P Asaro","year":"2012","unstructured":"Asaro, P. (2012). On banning autonomous lethal systems: human rights, automation and the dehumanizing of lethal decision-making. Special Issue on New Technologies and Warfare, International Review of the Red Cross 94(886), 687\u2013709.","journal-title":"Special Issue on New Technologies and Warfare, International Review of the Red Cross"},{"key":"9425_CR8","doi-asserted-by":"crossref","first-page":"9","DOI":"10.29173\/irie134","volume":"6","author":"PM Asaro","year":"2006","unstructured":"Asaro, P. M. (2006). What should we want from a robot ethic? International Review of Information Ethics, 6, 9\u201316.","journal-title":"International Review of Information Ethics"},{"key":"9425_CR9","first-page":"94103","volume":"29","author":"I Asimov","year":"1942","unstructured":"Asimov, I., (1942, March) Runaround. Astounding Science Fiction 29, 94\u2013103.","journal-title":"Astounding Science Fiction"},{"key":"9425_CR10","volume-title":"Principles of Biomedical Ethics","author":"TL Beauchamp","year":"1979","unstructured":"Beauchamp, T. L., & Childress, J. F. (1979). Principles of Biomedical Ethics. Oxford: Oxford University Press."},{"key":"9425_CR11","volume-title":"Superintelligence: Paths, dangers, strategies","author":"N Bostrom","year":"2014","unstructured":"Bostrom, N. (2014) Superintelligence: Paths, dangers, strategies. Oxford: Oxford University Press."},{"key":"9425_CR12","volume-title":"The glass cage: Where automation is taking us","author":"N Carr","year":"2015","unstructured":"Carr, N. (2015). The glass cage: Where automation is taking us. London: Bodley Head."},{"key":"9425_CR13","doi-asserted-by":"crossref","DOI":"10.1515\/9781400838080","volume-title":"Braintrust: What neuroscience tells us about morality","author":"PS Churchland","year":"2011","unstructured":"Churchland, P. S. (2011). Braintrust: What neuroscience tells us about morality. Oxford: Princeton University Press."},{"issue":"2","key":"9425_CR14","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1007\/s10677-009-9186-2","volume":"13","author":"M Coeckelbergh","year":"2010","unstructured":"Coeckelbergh, M. (2010). Health care, capabilities, and AI assistive technologies. Ethical Theory and Moral Practice, 13(2), 181\u2013190.","journal-title":"Ethical Theory and Moral Practice"},{"key":"9425_CR15","unstructured":"Docherty, B. (2016) Losing control: The dangers of killer robots. The Conversation, June 16th, 2016."},{"issue":"3","key":"9425_CR16","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1023\/B:MIND.0000035461.63578.9d","volume":"14","author":"L Floridi","year":"2004","unstructured":"Floridi, L., & Sanders, J. W. (2004). On the Morality of Artificial Agents. Minds and Machines, 14(3), 349\u2013379.","journal-title":"Minds and Machines"},{"key":"9425_CR17","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s10676-014-9345-6","volume":"16","author":"PC Hew","year":"2014","unstructured":"Hew, P. C. (2014). Artificial moral agents are infeasible with foreseeable technologies. Ethics and Information Technology, 16, 197\u2013206.","journal-title":"Ethics and Information Technology"},{"key":"9425_CR18","volume-title":"Report of the Special Rapporteur on extrajudicial, summary or arbitrary executions, A\/HRC\/23\/47","author":"C Heyns","year":"2013","unstructured":"Heyns, C. (2013). Report of the Special Rapporteur on extrajudicial, summary or arbitrary executions, A\/HRC\/23\/47. NewYork: United Nations"},{"issue":"4","key":"9425_CR19","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1007\/s10676-006-9111-5","volume":"8","author":"DG Johnson","year":"2006","unstructured":"Johnson, D. G. (2006) Computer Systems: Moral entities but not moral agents. Ethics and Information Technology, 8(4), 195\u2013204","journal-title":"Ethics and Information Technology"},{"key":"9425_CR20","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/s10676-008-9174-6","volume":"10","author":"DG Johnson","year":"2008","unstructured":"Johnson, D. G., & Miller, K. W. (2008). Un-making artificial moral agents. Ethics and Information Technology, 10, 123\u2013133.","journal-title":"Ethics and Information Technology"},{"key":"9425_CR21","unstructured":"Lin, P. (2013). The ethics of autonomous cars. The Atlantic, October 8th 2013. http:\/\/www.theatlantic.com\/technology\/archive\/2013\/10\/the-ethics-of-autonomous-cars\/280360 ."},{"key":"9425_CR22","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/978-3-662-45854-9_4","volume-title":"Autonomes Fahren: Technische, rechtiliche und gesellschaftliche aspekte","author":"P Lin","year":"2015","unstructured":"Lin, P. (2015). Why ethics matters for autonomous cars. In M. Maurer, J. C. Gerdes, B. Lenz, H. Winner (Eds.), Autonomes Fahren: Technische, rechtiliche und gesellschaftliche aspekte (pp. 69\u201385). Berlin Heidelberg: Springer."},{"key":"9425_CR23","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-015-9367-8","author":"BF Malle","year":"2015","unstructured":"Malle, B. F. (2015). Integrating robot ethics and machine morality: the study and design of moral competence in robots. Ethics and Information Technology. DOI: 10.1007\/s10676-015-9367-8 .","journal-title":"Ethics and Information Technology"},{"key":"9425_CR24","first-page":"30","volume-title":"Presented at the IEEE international symposium on ethics in engineering, science, and technology","author":"BF Malle","year":"2014","unstructured":"Malle, B. F., & Scheutz, M. (2014, June). Moral competence in social robots. IEEE international symposium on ethics in engineering, science, and technology. Presented at the IEEE international symposium on ethics in engineering, science, and technology (pp.\u00a030\u201335). Chicago, IL: IEEE."},{"issue":"2","key":"9425_CR25","doi-asserted-by":"crossref","first-page":"279","DOI":"10.5235\/175799611798204923","volume":"3","author":"A Matthias","year":"2011","unstructured":"Matthias, A. (2011). Algorithmic moral control of war robots: Philosophical questions. Law, Innovation and Technology, 3(2), 279\u2013301.","journal-title":"Law, Innovation and Technology"},{"key":"9425_CR26","doi-asserted-by":"publisher","DOI":"10.1007\/s11948-016-9785-y","author":"KW Miller","year":"2016","unstructured":"Miller, K. W., Wolf, M. J., & Godzinsky, F. (2016). This \u201cethical trap\u201d is for roboticists, not robots: on the issue of artificial agent ethical decision-making. Science and Engineering Ethics. doi: 10.1007\/s11948-016-9785-y .","journal-title":"Science and Engineering Ethics"},{"key":"9425_CR27","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MIS.2006.80","volume":"21","author":"JH Moor","year":"2006","unstructured":"Moor, J. H. (2006). The nature, importance, and difficulty of machine ethics. IEEE Intelligent Systems, 21, 18\u201321. doi: 10.1109\/MIS.2006.80 .","journal-title":"IEEE Intelligent Systems"},{"key":"9425_CR28","first-page":"12","volume":"72","author":"JH Moor","year":"2007","unstructured":"Moor, J. H. (2007). Four kinds of ethical robot. Philosophy Now, 72, 12\u201314.","journal-title":"Philosophy Now"},{"key":"9425_CR29","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MIS.2009.69","volume":"24","author":"RR Murphy","year":"2009","unstructured":"Murphy, R. R., & Woods, D. D. (2009). Beyond Asimov: The Three Laws of Responsible Robotics. IEE Intelligent Systems, 24, 14\u201320.","journal-title":"IEE Intelligent Systems"},{"key":"9425_CR30","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1093\/acprof:oso\/9780199539956.003.0014","volume-title":"Empathy: Philosophical and psychological perspectives","author":"JJ Prinz","year":"2011","unstructured":"Prinz, J. J. (2011) Is empathy necessary for morality? In A. Coplan & P. Goldie (Eds.) Empathy: Philosophical and psychological perspectives. Oxford: Oxford University Press, pp.\u00a0211\u2013229."},{"key":"9425_CR31","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/s10677-012-9335-x","volume":"16","author":"RC Reed","year":"2013","unstructured":"Reed, R. C. (2013). Euthyphro\u2019s elenchus experience: Ethical expertise and self-knowledge. Ethical Theory and Moral Practice, 16, 245\u2013259. doi: 10.1007\/s10677-012-9335-x .","journal-title":"Ethical Theory and Moral Practice"},{"key":"9425_CR32","unstructured":"Riedl, M.O., & Harrison, B. (2015) Using stories to teach human values to artificial agents. Paper presented at the 2nd international workshop on AI, ethics, and society. http:\/\/www.aaai.org ."},{"key":"9425_CR33","volume-title":"The right and the good","author":"WD Ross","year":"1930","unstructured":"Ross, W. D. (1930). The right and the good. Oxford: Clarendon Press."},{"key":"9425_CR34","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1038\/scientificamerican0616-58","volume":"314","author":"S Russell","year":"2016","unstructured":"Russell, S. (2016, June) Should we fear supersmart robots? Scientific American, 314, 58\u20139.","journal-title":"Scientific American"},{"key":"9425_CR35","volume-title":"New Scientist","author":"A Rutkin","year":"2014","unstructured":"Rutkin, A. (2014, September) Ethical trap: robot paralyzed by choice of who to save, New Scientist. Amsterdam: Elsevier."},{"issue":"1","key":"9425_CR36","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s10676-014-9338-5","volume":"16","author":"A Sharkey","year":"2014","unstructured":"Sharkey, A. (2014). Robots and human dignity: The effects of robot care on the dignity of older people. Ethics and Information Technology, 16(1), 53\u201375.","journal-title":"Ethics and Information Technology"},{"issue":"4","key":"9425_CR37","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1007\/s10676-016-9387-z","volume":"18","author":"A Sharkey","year":"2016","unstructured":"Sharkey, A. (2016). Should we welcome robot teachers? Ethics and Information Technology, 18(4), 283\u2013297.","journal-title":"Ethics and Information Technology"},{"issue":"1","key":"9425_CR38","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s10676-010-9234-6","volume":"14","author":"AJC Sharkey","year":"2012","unstructured":"Sharkey, A. J. C., & Sharkey, N. E. (2012). Granny and the robots: Ethical issues in robot care for the elderly. Ethics and Information Technology, 14(1), 27\u201340.","journal-title":"Ethics and Information Technology"},{"issue":"886","key":"9425_CR39","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1017\/S1816383112000732","volume":"94","author":"N Sharkey","year":"2012","unstructured":"Sharkey, N. (2012). The evitability of autonomous robot warfare. International Review of the Red Cross, 94(886), 787\u2013799.","journal-title":"International Review of the Red Cross"},{"key":"9425_CR40","unstructured":"Sharkey, N. (2016) Policing with Robots, Open Rights Group (Ed) 10\u00d710: Digital rights, the next decade."},{"issue":"2","key":"9425_CR41","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1075\/is.11.2.01sha","volume":"11","author":"NE Sharkey","year":"2010","unstructured":"Sharkey, N. E., & Sharkey, A. J. C. (2010). The crying shame of robot nannies: An ethical appraisal. Interaction Studies, 11(2), 161\u2013190.","journal-title":"Interaction Studies"},{"issue":"3","key":"9425_CR42","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/s10676-014-9344-7","volume":"16","author":"T Sorrell","year":"2014","unstructured":"Sorrell, T., & Draper, H. (2014). Robot carers, ethics and older people. Ethics and Information Technology, 16(3), 183\u2013195.","journal-title":"Ethics and Information Technology"},{"key":"9425_CR43","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1007\/s11023-006-9030-6","volume":"16","author":"R Sparrow","year":"2006","unstructured":"Sparrow, R., & Sparrow, L. (2006). In the hands of machines? The future of aged care. Mind and Machine, 16, 141\u2013161.","journal-title":"Mind and Machine"},{"issue":"12","key":"9425_CR44","doi-asserted-by":"crossref","first-page":"23","DOI":"10.29173\/irie136","volume":"6","author":"JP Sullins","year":"2006","unstructured":"Sullins, J. P. (2006). When is a robot a moral agent? International Review of Information Ethics, 6(12), 23\u201330.","journal-title":"International Review of Information Ethics"},{"key":"9425_CR45","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198713395.001.0001","volume-title":"The Future of Professions: How technology will transform the work of human experts","author":"R Susskind","year":"2015","unstructured":"Susskind, R., & Susskind, D. (2015) The Future of Professions: How technology will transform the work of human experts. Oxford: Oxford University Press."},{"key":"9425_CR46","volume-title":"Alone together","author":"S Turkle","year":"2011","unstructured":"Turkle, S. (2011). Alone together. New York: Basic Books."},{"issue":"3","key":"9425_CR47","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/s13347-011-0015-x","volume":"24","author":"S Vallor","year":"2011","unstructured":"Vallor, S. (2011). Carebots and caregivers: Sustaining the ethical ideal of care in the twenty-first century. Philosophy and Technology, 24(3), 251\u2013268.","journal-title":"Philosophy and Technology"},{"issue":"4","key":"9425_CR48","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1007\/s10676-016-9409-x","volume":"18","author":"A Van Wynsberghe","year":"2016","unstructured":"Van Wynsberghe, A. (2016). Service robots, care ethics, and design. Ethics and Information Technology, 18(4), 311\u2013321.","journal-title":"Ethics and Information Technology"},{"key":"9425_CR49","unstructured":"Vanderelst, D. & Winfield, A. (2016) The dark side of ethical robots, ARXiv:1606.02583v1 [cs.RO} 8 June 2016."},{"key":"9425_CR2","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780195374049.001.0001","volume-title":"Moral machines: Teaching robots right from wrong","author":"W Wallach","year":"2009","unstructured":"Wallach, W., & Allen, C. (2009). Moral machines: Teaching robots right from wrong. New York: Oxford University Press."},{"key":"9425_CR50","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1007\/s10676-010-9232-8","volume":"12","author":"W Wallach","year":"2010","unstructured":"Wallach, W. (2010). Robot minds and human ethics: The need for a comprehensive model of moral decision making. Ethics and Information Technology, 12, 243\u2013250. doi: 10.1007\/s10676-010-9232-8 .","journal-title":"Ethics and Information Technology"},{"key":"9425_CR51","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/978-3-319-10401-0_8","volume-title":"Advances in autonomous robotics systems","author":"AFT Winfield","year":"2014","unstructured":"Winfield, A. F. T., Blum, C., & Liu, W. (2014). Towards an ethical robot: Internal models, consequences and ethical action selection. In M. Mistry, A. Leonardis, M. Witkowski & C. Melhuish (Eds.), Advances in autonomous robotics systems (pp.\u00a085\u201396). Berlin: Springer International Publishing."}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-017-9425-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10676-017-9425-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-017-9425-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,28]],"date-time":"2022-07-28T22:18:37Z","timestamp":1659046717000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10676-017-9425-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,26]]},"references-count":51,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["9425"],"URL":"https:\/\/doi.org\/10.1007\/s10676-017-9425-5","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,5,26]]},"assertion":[{"value":"26 May 2017","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}