{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T10:25:16Z","timestamp":1776335116666,"version":"3.51.2"},"publisher-location":"Cham","reference-count":29,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031460012","type":"print"},{"value":"9783031460029","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T00:00:00Z","timestamp":1702512000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T00:00:00Z","timestamp":1702512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\u201cRationality\u201d is the principle that humans make decisions on the basis of step-by-step (algorithmic) reasoning using systematic rules of logic. An ideal \u201cexplanation\u201d for a decision is a chronicle of the steps used to arrive at the decision. Herb Simon\u2019s \u201cbounded rationality\u201d is the observation that the ability of a human brain to handle algorithmic complexity and data is limited. As a consequence, human decision-making in complex cases mixes some rationality with a great deal of intuition, relying more on Daniel Kahneman\u2019s \u201cSystem 1\u201d than \u201cSystem 2.\u201d A DNN-based AI, similarly, does not arrive at a decision through a rational process in this sense. An understanding of the mechanisms of the DNN yields little or no insight into any rational explanation for its decisions. The DNN is also operating in a manner more like System 1 than System 2. Humans, however, are quite good at constructing post hoc rationalizations of their intuitive decisions. If we demand rational explanations for AI decisions, engineers will inevitably develop AIs that are very effective at constructing such post hoc rationalizations. With their ability to handle vast amounts of data, the AIs will learn to build rationalizations using many more precedents than any human could, thereby constructing rationalizations for <jats:italic>any<\/jats:italic> decision that will become very hard to refute. The demand for explanations, therefore, could backfire, resulting in effectively ceding to the AIs much more power.<\/jats:p>","DOI":"10.1007\/978-3-031-46002-9_1","type":"book-chapter","created":{"date-parts":[[2023,12,13]],"date-time":"2023-12-13T16:02:36Z","timestamp":1702483356000},"page":"11-21","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Deep Neural Networks, Explanations, and\u00a0Rationality"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5663-0584","authenticated-orcid":false,"given":"Edward A.","family":"Lee","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,12,14]]},"reference":[{"key":"1_CR1","unstructured":"Barrat, J.: Our Final Invention: Artificial Intelligence and the End of the Human Era. St. Martin\u2019s Press (2013)"},{"key":"1_CR2","unstructured":"Bostrom, N.: Superintelligence: Paths, Dangers. Strategies. Oxford University Press, Oxford, UK (2014)"},{"key":"1_CR3","doi-asserted-by":"publisher","unstructured":"Bubeck, S., Chandrasekaran, V., et al.: Sparks of artificial general intelligence: Early experiments with GPT-4 (22 March 2023). https:\/\/doi.org\/10.48550\/arXiv.2303.12712. arXiv: 2303.12712","DOI":"10.48550\/arXiv.2303.12712"},{"key":"1_CR4","unstructured":"Chomsky, N., Roberts, I., Watumull, J.: The false promise of ChatGPT. The New York Times (8 March 2023). https:\/\/www.nytimes.com\/2023\/03\/08\/opinion\/noam-chomsky-chatgpt-ai.html"},{"issue":"17","key":"1_CR5","doi-asserted-by":"publisher","first-page":"6889","DOI":"10.1073\/pnas.1018033108","volume":"108","author":"S Danziger","year":"2011","unstructured":"Danziger, S., Levav, J., Avnaim-Pesso, L.: Extraneous factors in judicial decisions. Proc. Nat. Acad. Sci. United States . 108(17), 6889\u20136892 (2011). https:\/\/doi.org\/10.1073\/pnas.1018033108","journal-title":"Proc. Nat. Acad. Sci. United States ."},{"key":"1_CR6","doi-asserted-by":"publisher","unstructured":"Dreyfus, H.L., Dreyfus, S.E.: Mind Over Machine: The Power of Human Intuition and Expertise in the Era of the Computer. Free Press, New York (1986). https:\/\/doi.org\/10.1016\/0160-791X(84)90034-4","DOI":"10.1016\/0160-791X(84)90034-4"},{"key":"1_CR7","unstructured":"Ford, M.: Rise of the Robots \u2013 Technology and the Threat of a Jobless Future. Basic Books, New York (2015)"},{"key":"1_CR8","doi-asserted-by":"publisher","DOI":"10.1002\/ail2.61","volume":"2","author":"D Gunning","year":"2021","unstructured":"Gunning, D., Vorm, E., Wang, J.Y., Turek, M.: DARPA\u2019s explainable AI (XAI) program: a retrospective. Applied AI Letters 2, e61 (2021). https:\/\/doi.org\/10.1002\/ail2.61","journal-title":"Applied AI Letters"},{"key":"1_CR9","unstructured":"Haugeland, J.: Artificial Intelligence: The Very Idea. MIT Press, Cambridge, Mass (1985)"},{"key":"1_CR10","unstructured":"Heaven, W.D.: The inside story of how ChatGPT was built from the people who made it. MIT Technol. Rev. (023). https:\/\/www.technologyreview.com\/2023\/03\/03\/1069311\/inside-story-oral-history-how-chatgpt-built-openai\/"},{"key":"1_CR11","unstructured":"Kahneman, D.: Thinking Fast and Slow. Farrar, Straus and Giroux, New York (2011)"},{"key":"1_CR12","unstructured":"Kelly, K.: The Inevitable: Understanding the 12 Technological Forces That Will Shape Our Future. Penguin Books, New York (2016)"},{"key":"1_CR13","unstructured":"Kissinger, H.A., Schmidt, E., Huttenlocher, D.: ChatGPT heralds an intellectual revolution. Wall Street J. (2023)"},{"key":"1_CR14","volume-title":"The Structure of Scientific Revolutions","author":"TS Kuhn","year":"1962","unstructured":"Kuhn, T.S.: The Structure of Scientific Revolutions. University of Chicago Press, Chicago, IL (1962)"},{"key":"1_CR15","doi-asserted-by":"publisher","unstructured":"Lee, E.A.: What can deep neural networks teach us about embodied bounded rationality. Front. Psychol. 25 (2022). https:\/\/doi.org\/10.3389\/fpsyg.2022.761808","DOI":"10.3389\/fpsyg.2022.761808"},{"key":"1_CR16","doi-asserted-by":"crossref","unstructured":"Lee, E.A.: The Coevolution: The Entwined Futures of Humans and Machines. MIT Press, Cambridge, MA (2020)","DOI":"10.7551\/mitpress\/12307.001.0001"},{"key":"1_CR17","unstructured":"Lee, K.F.: Super-Powers: China, Silicon Valley, and the New World Order. Houghton Mifflin Harcourt Publishing Company, New York (2018)"},{"key":"1_CR18","doi-asserted-by":"publisher","first-page":"1448","DOI":"10.1038\/nn.3837","volume":"17","author":"JW Lichtman","year":"2014","unstructured":"Lichtman, J.W., Pfister, H., Shavit, N.: The big data challenges of connectomics. Nat. Neurosci. 17, 1448\u20131454 (2014). https:\/\/doi.org\/10.1038\/nn.3837","journal-title":"Nat. Neurosci."},{"key":"1_CR19","doi-asserted-by":"publisher","unstructured":"Miller, J.F., Thomson, F.: Cartesian genetic programming. In: European Conference on Genetic Programming, vol. 10802. LNCS, pp. 121\u2013132. Springer (2000). https:\/\/doi.org\/10.1007\/978-3-642-17310-3_2","DOI":"10.1007\/978-3-642-17310-3_2"},{"key":"1_CR20","doi-asserted-by":"publisher","unstructured":"Ribeiro, M.T., Singh, S., Guestrin, C.: Why should I trust you? explaining the predictions of any classifier. In: International Conference on Knowledge Discovery and Data Mining, pp. 1135\u20131144. ACM (2016). https:\/\/doi.org\/10.1145\/2939672.2939778","DOI":"10.1145\/2939672.2939778"},{"key":"1_CR21","unstructured":"Shane, J.: You look like a thing and I love you. Hachette, United Kingdom (2019)"},{"key":"1_CR22","doi-asserted-by":"publisher","unstructured":"Shumailov, I., Shumaylov, Z., Zhao, Y., Gal, Y., Papernot, N., Anderson, R.: The curse of recursion: training on generated data makes models forget (31 May 2023). https:\/\/doi.org\/10.48550\/arXiv.2305.17493. arXiv:2305.17493v2 [cs.LG]","DOI":"10.48550\/arXiv.2305.17493"},{"key":"1_CR23","unstructured":"Simon, H.A.: Theories of bounded rationality. In: McGuire, C.B., Radner, R. (eds.) Decision and Organization, pp. 161\u2013176. North-Holland Publishing Company, Amsterdam (1972)"},{"key":"1_CR24","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/BF02512227","volume":"1","author":"HA Simon","year":"2000","unstructured":"Simon, H.A.: Bounded rationality in social science: today and tomorrow. Mind Soc. 1, 25\u201339 (2000)","journal-title":"Mind Soc."},{"key":"1_CR25","unstructured":"Taleb, N.N.: The Black Swan. Random House (2010)"},{"key":"1_CR26","unstructured":"Tegmark, M.: Life 3.0: Being Human in the Age of Artificial Intelligence. Alfred A. Knopf, New York (2017)"},{"key":"1_CR27","doi-asserted-by":"publisher","unstructured":"Wachter, S., Mittelstadt, B., Floridi, L.: Why a right to explanation of automated decision-making does not exist in the general data protection regulation. International Data Privacy Law, Available at SSRN (January 24 2017). https:\/\/doi.org\/10.2139\/ssrn.2903469, https:\/\/ssrn.com\/abstract=2903469","DOI":"10.2139\/ssrn.2903469"},{"key":"1_CR28","doi-asserted-by":"publisher","unstructured":"Wilson, D.G., Cussat-Blanc, S., Luga, H., Miller, J.F.: Evolving simple programs for playing Atari games. In: The Genetic and Evolutionary Computation Conference (GECCO) (15\u201319 June 2018). https:\/\/doi.org\/10.1145\/3205455.3205578","DOI":"10.1145\/3205455.3205578"},{"key":"1_CR29","unstructured":"Zuboff, S.: The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. PublicAffairs, Hatchette Book Group (2019)"}],"container-title":["Lecture Notes in Computer Science","Bridging the Gap Between AI and Reality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-46002-9_1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,13]],"date-time":"2023-12-13T16:02:47Z","timestamp":1702483367000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-46002-9_1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,14]]},"ISBN":["9783031460012","9783031460029"],"references-count":29,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-46002-9_1","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,14]]},"assertion":[{"value":"14 December 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"AISoLA","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Bridging the Gap between AI and Reality","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Crete","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Greece","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2023","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"23 October 2023","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"28 October 2023","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"1","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"aisola2023","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/2023-aisola.isola-conference.org\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}