{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T17:21:55Z","timestamp":1778347315234,"version":"3.51.4"},"publisher-location":"Cham","reference-count":23,"publisher":"Springer International Publishing","isbn-type":[{"value":"9783030861438","type":"print"},{"value":"9783030861445","type":"electronic"}],"license":[{"start":{"date-parts":[[2021,11,24]],"date-time":"2021-11-24T00:00:00Z","timestamp":1637712000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,24]],"date-time":"2021-11-24T00:00:00Z","timestamp":1637712000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Verein zur F\u00f6rderung des digitalen Humanismus"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A long tradition in philosophy and economics equates intelligence with the ability to act rationally\u2014that is, to choose actions that can be expected to achieve one\u2019s objectives. This framework is so pervasive within AI that it would be reasonable to call it the standard model. A great deal of progress on reasoning, planning, and decision-making, as well as perception and learning, has occurred within the standard model. Unfortunately, the standard model is unworkable as a foundation for further progress because it is seldom possible to specify objectives completely and correctly in the real world. The chapter proposes a new model for AI development in which the machine\u2019s uncertainty about the true objective leads to qualitatively new modes of behavior that are more robust, controllable, and deferential to humans.<\/jats:p>","DOI":"10.1007\/978-3-030-86144-5_3","type":"book-chapter","created":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T09:02:41Z","timestamp":1637658161000},"page":"19-24","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":65,"title":["Artificial Intelligence and the Problem of Control"],"prefix":"10.1007","author":[{"given":"Stuart","family":"Russell","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,11,24]]},"reference":[{"key":"3_CR1","unstructured":"Aristotle (n.d.). Nicomachean Ethics, Book III, 3, 1112b."},{"key":"3_CR2","volume-title":"La logique, ou l\u2019art de penser","author":"A Arnauld","year":"1662","unstructured":"Arnauld, A. (1662). La logique, ou l\u2019art de penser. Paris: Chez Charles Savreux."},{"key":"3_CR3","unstructured":"Bernoulli, D. (1738). Specimen theoriae novae de mensura sortis. Proceedings of the St. Petersburg Imperial Academy of Sciences, 5, 175\u201392."},{"key":"3_CR4","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2019.8673234","volume-title":"The assistive multi-armed bandit","author":"L Chan","year":"2019","unstructured":"Chan, L., Hadfield-Menell, D., Srinivasa, S., & Dragan, A. (2019). The assistive multi-armed bandit. In Proc. Fourteenth ACM\/IEEE International Conference on Human\u2013Robot Interaction."},{"key":"3_CR5","volume-title":"Essay d\u2019analyse sur les jeux de hazard","author":"PR De Montmort","year":"1713","unstructured":"De Montmort, P. R. (1713). Essay d\u2019analyse sur les jeux de hazard, 2nd ed. Paris: Chez Jacques Quillau.","edition":"2"},{"key":"3_CR6","volume-title":"Multi-Principal Assistance Games: Definition and Collegial Mechanisms","author":"A Fickinger","year":"2020","unstructured":"Fickinger, A., Hadfield-Menell, D., Critch, A., & Russell, S. (2020). Multi-Principal Assistance Games: Definition and Collegial Mechanisms. In Proc. NeurIPS Workshop on Cooperative AI."},{"key":"3_CR7","unstructured":"Groth, O., Nitzberg, M., & Russell, S. (2019, August 15). AI algorithms need FDA-style drug trials. Wired."},{"key":"3_CR8","volume-title":"Cooperative inverse reinforcement learning","author":"D Hadfield-Menell","year":"2017","unstructured":"Hadfield-Menell, D., Dragan, A. D., Abbeel, P., & Russell, S. (2017a). Cooperative inverse reinforcement learning. In Advances in Neural Information Processing Systems 29."},{"key":"3_CR9","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/32","volume-title":"The off-switch game","author":"D Hadfield-Menell","year":"2017","unstructured":"Hadfield-Menell, D., Dragan, A. D., Abbeel, P., & Russell, S. (2017b). The off-switch game. In Proc. Twenty-Sixth International Joint Conference on Artificial Intelligence."},{"key":"3_CR10","first-page":"623","volume":"44","author":"J Harsanyi","year":"1977","unstructured":"Harsanyi, J. (1977). Morality and the theory of rational behavior. Social Research, 44, 623\u2013656.","journal-title":"Social Research"},{"key":"3_CR11","volume-title":"Possible Minds: Twenty- Five Ways of Looking at AI","author":"D Hillis","year":"2019","unstructured":"Hillis, D. (2019). The first machine intelligences. In John Brockman (ed.), Possible Minds: Twenty- Five Ways of Looking at AI. Penguin Press."},{"key":"3_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/S0313-5926(77)50008-2","volume-title":"The Social Limits to Growth","author":"F Hirsch","year":"1977","unstructured":"Hirsch, F. (1977). The Social Limits to Growth. Routledge & Kegan Paul."},{"key":"3_CR13","volume-title":"Algorithms for inverse reinforcement learning","author":"AY Ng","year":"2000","unstructured":"Ng, A. Y. & Russell, S. (2000). Algorithms for inverse reinforcement learning. In Proc. Seventeenth International Conference on Machine Learning."},{"key":"3_CR14","volume-title":"Anarchy, State, and Utopia","author":"R Nozick","year":"1974","unstructured":"Nozick, R. (1974). Anarchy, State, and Utopia. Basic Books."},{"key":"3_CR15","volume-title":"Choosing for Changing Selves","author":"R Pettigrew","year":"2020","unstructured":"Pettigrew, R. (2020). Choosing for Changing Selves. Oxford University Press."},{"key":"3_CR16","volume-title":"Learning agents for uncertain environments","author":"S Russell","year":"1998","unstructured":"Russell, S. (1998). Learning agents for uncertain environments. In Proc. Eleventh ACM Conference on Computational Learning Theory."},{"key":"3_CR17","volume-title":"Human Compatible: AI and the Problem of Control","author":"S Russell","year":"2019","unstructured":"Russell, S. (2019). Human Compatible: AI and the Problem of Control. London: Penguin."},{"key":"3_CR18","volume-title":"Artificial Intelligence: A Modern Approach (4th edition)","author":"S Russell","year":"2020","unstructured":"Russell, S. & Norvig, P. (2020). Artificial Intelligence: A Modern Approach (4th edition). Pearson."},{"key":"3_CR19","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1257\/aer.89.3.349","volume":"89","author":"A Sen","year":"1999","unstructured":"Sen, A. (1999). The Possibility of Social Choice. American Economic Review, 89, 349\u2013378.","journal-title":"American Economic Review"},{"key":"3_CR20","volume-title":"The implicit preference information in an initial state","author":"R Shah","year":"2019","unstructured":"Shah, R., Krasheninnikov, D., Alexander, J., Abbeel, P., & Dragan, A. (2019). The implicit preference information in an initial state. In Proc. Seventh International Conference on Learning Representations."},{"key":"3_CR21","volume-title":"\u201cCan digital machines think?\u201d Radio broadcast","author":"A Turing","year":"1951","unstructured":"Turing, A. (1951). \u201cCan digital machines think?\u201d Radio broadcast, BBC Third Programme. Typescript available at turingarchive.org."},{"key":"3_CR22","volume-title":"The Theory of the Leisure Class: An Economic Study of Institutions","author":"T Veblen","year":"1899","unstructured":"Veblen, T. (1899). The Theory of the Leisure Class: An Economic Study of Institutions. Macmillan."},{"key":"3_CR1000","unstructured":"von Neumann, J. and Morgenstern, O. (1944). Theory of Games and Economic Behavior. Princeton University Press."}],"container-title":["Perspectives on Digital Humanism"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-86144-5_3","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T04:53:34Z","timestamp":1643259214000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-86144-5_3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,24]]},"ISBN":["9783030861438","9783030861445"],"references-count":23,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-86144-5_3","relation":{},"subject":[],"published":{"date-parts":[[2021,11,24]]},"assertion":[{"value":"24 November 2021","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}}]}}