{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T07:52:57Z","timestamp":1775634777205,"version":"3.50.1"},"reference-count":60,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,11,17]],"date-time":"2022-11-17T00:00:00Z","timestamp":1668643200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2022,11,17]],"date-time":"2022-11-17T00:00:00Z","timestamp":1668643200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI & Soc"],"published-print":{"date-parts":[[2024,6]]},"DOI":"10.1007\/s00146-022-01585-x","type":"journal-article","created":{"date-parts":[[2022,11,17]],"date-time":"2022-11-17T06:02:46Z","timestamp":1668664966000},"page":"937-960","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Omission and commission errors underlying AI failures"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1155-2199","authenticated-orcid":false,"given":"Sasanka Sekhar","family":"Chanda","sequence":"first","affiliation":[]},{"given":"Debarag Narayan","family":"Banerjee","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,11,17]]},"reference":[{"issue":"1","key":"1585_CR1","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/BF02169161","volume":"7","author":"RL Ackoff","year":"1994","unstructured":"Ackoff RL (1994) It\u2019s a Mistake! Syst Pract 7(1):3\u20137. https:\/\/doi.org\/10.1007\/BF02169161","journal-title":"Syst Pract"},{"key":"1585_CR2","unstructured":"Allen K (2019) Chinese driver gets ticket for scratching his face. BBC. (May 24). https:\/\/www.bbc.com\/news\/blogs-news-from-elsewhere-48401901. Accessed 24 Mar 2021."},{"key":"1585_CR3","unstructured":"Angwin J, Larson J, Mattu S, Kirchner L (2016) Machine bias: there\u2019s software used across the country to predict future criminals. And it\u2019s biased against blacks. ProPublica, (May 23). www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing. Accessed 24 Mar 2021"},{"key":"1585_CR4","unstructured":"Asher-Schapiro A (2020) Questions swirl about possible racial bias in Twitter image function. The Sunday Morning Herald, (September 22). https:\/\/www.smh.com.au\/world\/north-america\/questions-swirl-about-possible-racial-bias-in-twitter-image-function-20200922-p55xwm.html. Accessed 24 Mar 2021"},{"key":"1585_CR5","unstructured":"Babic B, Cohen IG, Evgeniou T et al  (2021) When machine learning goes off the rails. Harv Bus Rev 99(1):76\u201384. https:\/\/psnet.ahrq.gov\/issue\/when-machine-learning-goes-rails-guide-managing-risks"},{"key":"1585_CR6","unstructured":"Berger Y (2017) Israel Arrests Palestinian Because Facebook Translated 'Good Morning' to 'Attack Them'. Haaretz, (October 22). https:\/\/www.haaretz.com\/israel-news\/palestinian-arrested-over-mistranslated-good-morning-facebook-post-1.5459427. Accessed 24 Mar 2021"},{"key":"1585_CR7","unstructured":"Bryen S (2020) Debris is only part of Boeing\u2019s problems. Asia Times. (February 23). https:\/\/asiatimes.com\/2020\/02\/debris-is-only-part-of-boeings-problems\/. Accessed 24 Mar 2021"},{"key":"1585_CR8","unstructured":"Cai F, Yuan Y (2021) 2020 in review: 10 AI failures. Synced Review, (January 1) Editor: Michael Sarazen https:\/\/syncedreview.com\/2021\/01\/01\/2020-in-review-10-ai-failures\/. Accessed 24 Mar 2021"},{"key":"1585_CR9","unstructured":"Campbell M (2017) Apple's Face ID with attention detection fooled by $200 mask. Apple Insider, (November 28). [https:\/\/appleinsider.com\/articles\/17\/11\/27\/apples-face-id-with-attention-detection-fooled-by-200-mask. Accessed 24 Mar 2021"},{"key":"1585_CR10","unstructured":"Cole S (2019) This Trippy T-Shirt Makes You Invisible to AI. Vice. (November 5). https:\/\/www.vice.com\/en\/article\/evj9bm\/adversarial-design-shirt-makes-you-invisible-to-ai. Accessed 24 Mar 2021"},{"key":"1585_CR11","unstructured":"Cossins D (2018) Discriminating algorithms: 5 times AI showed prejudice. NewScientist (April 27). https:\/\/www.newscientist.com\/article\/2166207-discriminating-algorithms-5-times-ai-showed-prejudice\/#ixzz6iYaTCbkt. Accessed 24 Mar 2021"},{"key":"1585_CR12","unstructured":"Cushing T (2019) NIST study of 189 facial recognition algorithms finds minorities are misidentified almost 100 times more often than white men. TechDirt (December 20). https:\/\/www.techdirt.com\/articles\/20191222\/10223143620\/nist-study-189-facial-recognition-algorithms-finds-minorities-are-misidentified-almost-100-times-more-often-than-white-men.shtml. Accessed 24 Mar 2021"},{"key":"1585_CR13","unstructured":"Das S (2020) Biggest AI goof-ups that made headlines in 2020. Analytics India Magazine, (November 26). https:\/\/analyticsindiamag.com\/biggest-ai-goof-ups-that-made-headlines-in-2020\/. Accessed 24 Mar 2021"},{"key":"1585_CR14","unstructured":"Dastin J (2018) Amazon scraps secret AI recruiting tool that showed bias against women. Reuters, (October 11). https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight-idUSKCN1MK08G. Accessed 8 Nov 2022"},{"key":"1585_CR15","unstructured":"Dickey MR (2020) Twitter and Zoom\u2019s algorithmic bias issues. TechCrunch, (September 22). https:\/\/techcrunch.com\/2020\/09\/21\/twitter-and-zoom-algorithmic-bias-issues\/. Accessed 24 Mar 2021"},{"key":"1585_CR16","doi-asserted-by":"publisher","unstructured":"Dressel J, Farid H (2018) The accuracy, fairness, and limits of predicting recidivism. Sci Adv 4(1): eaao5580. https:\/\/doi.org\/10.1126\/sciadv.aao5580https:\/\/advances.sciencemag.org\/content\/4\/1\/eaao5580.full","DOI":"10.1126\/sciadv.aao5580"},{"key":"1585_CR17","volume-title":"Explaining technical change","author":"J Elster","year":"1983","unstructured":"Elster J (1983) Explaining technical change. Cambridge University Press, Cambridge"},{"key":"1585_CR18","unstructured":"Fingas R (2017) Vietnamese firm trips up iPhone X's Face ID with elaborate mask & makeup. Apple Insider, (November 10). https:\/\/appleinsider.com\/articles\/17\/11\/10\/vietnamese-firm-trips-up-iphone-xs-face-id-with-elaborate-mask-makeup. Accessed 24 Mar 2021"},{"key":"1585_CR19","unstructured":"Greenberg A (2017) Watch a 10-Year-Old's Face Unlock His Mom's iPhone X. Wired, (November 14). https:\/\/www.wired.com\/story\/10-year-old-face-id-unlocks-mothers-iphone-x\/?mbid=social_fb. Accessed 24 Mar 2021"},{"key":"1585_CR20","unstructured":"Harwell D (2019) Federal study confirms racial bias of many facial-recognition systems, casts doubt on their expanding use. Washington Post, (December 20). https:\/\/www.washingtonpost.com\/technology\/2019\/12\/19\/federal-study-confirms-racial-bias-many-facial-recognition-systems-casts-doubt-their-expanding-use\/. Accessed 24 Mar 2021"},{"key":"1585_CR21","unstructured":"Hill K (2020) Wrongfully accused by an algorithm. New York Times, published June 24. https:\/\/www.nytimes.com\/2020\/06\/24\/technology\/facial-recognition-arrest.html. Accessed 3 Aug"},{"key":"1585_CR22","unstructured":"INFORMS (2020) Use of Machine Learning and AI at Comcast. (November 2). https:\/\/www.youtube.com\/watch?v=CxkjNA2Fuaw. Accessed 10 Aug 2021"},{"key":"1585_CR23","unstructured":"Kantrowitz A (2017) Microsoft\u2019s chatbot Zo calls the Qur'an violent and has theories about Bin Laden. BuzzFeed.News, (July 3). https:\/\/www.buzzfeednews.com\/article\/alexkantrowitz\/microsofts-chatbot-zo-calls-the-quran-violent-and-has#.xh5yOZl2N. Accessed 24 March 2021"},{"key":"1585_CR24","unstructured":"Kitching C (2017) Police raid man\u2019s home after Amazon Alexa device blasted music and \u2018held party on its own\u2019 at 2am. Mirror. https:\/\/www.mirror.co.uk\/news\/weird-news\/police-raid-mans-home-after-11490899. Accessed 8 Nov 2022"},{"key":"1585_CR25","unstructured":"Knight W (2016) Tougher Turing Test exposes chatbots\u2019 stupidity. MIT Technology Review, (July 14). https:\/\/www.technologyreview.com\/s\/601897\/tougher-turing-test-exposes-chatbots-stupidity\/. Accessed 8 Nov 2022"},{"key":"1585_CR26","doi-asserted-by":"crossref","unstructured":"Krauth O (2018) Artificial ignorance: the 10 biggest AI failures of 2017. TechRepublic, (January 4). https:\/\/www.techrepublic.com\/article\/the-10-biggest-ai-failures-of-2017\/. Accessed 24 Mar 2021","DOI":"10.12968\/sece.2017.33.10a"},{"key":"1585_CR27","unstructured":"Krisher T (2018) Uber self-driving SUV saw pedestrian but did not brake, federal report finds. Chicago Tribune, (May 24). https:\/\/www.chicagotribune.com\/business\/ct-biz-uber-self-driving-uber-car-report-20180524-story.html. Accessed 24 Mar 2021"},{"key":"1585_CR28","unstructured":"Larson J, Mattu S, Kirchner L, Angwin J (2016) How We Analyzed the COMPAS Recidivism Algorithm. ProPublica, (May 23). https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm. Accessed 24 Mar 2021"},{"key":"1585_CR29","unstructured":"Larson S (2017) Offensive chat app responses highlight AI fails. CNNMoney, (October 25). https:\/\/money.cnn.com\/2017\/10\/25\/technology\/business\/google-allo-facebook-m-offensive-responses\/index.html. Accessed 24 Mar 2021"},{"key":"1585_CR30","unstructured":"Levin S (2018) Self-driving Uber kills Arizona woman in first fatal crash involving pedestrian. The Guardian, (March 19). https:\/\/www.theguardian.com\/technology\/2018\/mar\/19\/uber-self-driving-car-kills-woman-arizona-tempe. Accessed 24 Mar 2021"},{"key":"1585_CR31","unstructured":"Luca M, Kleinberg J, Mullainathan S (2016) Algorithms need managers, too. Harv Bus Rev 96(1):96\u2013101. https:\/\/sendhil.org\/algorithms-need-managers-too\/"},{"key":"1585_CR32","unstructured":"Maeda N, Parker PM (2003) Mind over matter: a case for artificial intelligence. Insead, INS785"},{"key":"1585_CR33","unstructured":"McCausland P (2019) Self-driving Uber car that hit and killed woman did not recognize that pedestrians jaywalk. NBC News, (November 10). https:\/\/www.nbcnews.com\/tech\/tech-news\/self-driving-uber-car-hit-killed-woman-did-not-recognize-n1079281. Accessed 24 March 2021"},{"key":"1585_CR34","doi-asserted-by":"crossref","first-page":"894","DOI":"10.2307\/2084615","volume":"1","author":"RK Merton","year":"1936","unstructured":"Merton RK (1936) The unanticipated consequences of purposeful social action. Am Sociol Rev 1:894\u2013904","journal-title":"Am Sociol Rev"},{"key":"1585_CR35","unstructured":"Nachreiner C (2021) Apple's Face ID: no match for multifactor security. TechBeacon. https:\/\/techbeacon.com\/security\/apples-face-id-no-match-multifactor-security. Accessed 8 Nov 2022"},{"key":"1585_CR36","unstructured":"O\u2019Kane S (2019) Self-driving shuttle crashed in Las Vegas because manual controls were locked away. The Verge, (July 11). https:\/\/www.theverge.com\/2019\/7\/11\/20690793\/self-driving-shuttle-crash-las-vegas-manual-controls-locked-away. Accessed 24 Mar 2021"},{"key":"1585_CR37","unstructured":"Olschewski M (2017) A German Alexa owner returned home to find his Amazon device had started a 'party' at 2am, leading to police breaking down his door. Business Insider, (November 9). https:\/\/www.businessinsider.com\/amazon-alexa-started-party-2am-police-broke-down-door-2017-11?IR=T. Accessed 24 Mar 2021"},{"key":"1585_CR38","unstructured":"Oppenheim M (2018) Amazon scraps 'sexist AI' recruitment tool. The Independent, (October 11). https:\/\/www.independent.co.uk\/life-style\/gadgets-and-tech\/amazon-ai-sexist-recruitment-tool-algorithm-a8579161.html. Accessed 24 Mar 2021"},{"key":"1585_CR39","unstructured":"Owen M (2019) Face ID attention detection security defeated with glasses and tape. Apple Insider, (August 8) https:\/\/appleinsider.com\/articles\/19\/08\/08\/face-id-security-defeated-with-glasses-and-tape. Accessed 24 Mar 2021"},{"key":"1585_CR40","unstructured":"Palis C (2017) Google Instant\u2019s allegedly \u2018anti-semitic\u2019 results lead to lawsuit in France. Huffington Post, (December 6). https:\/\/www.huffpost.com\/entry\/google-instant-anti-semitic-france_n_1465430. Accessed 24 Mar 2021"},{"key":"1585_CR41","unstructured":"Paul I (2016) The Internet turns Tay, Microsoft's millennial AI chatbot, into a racist bigot. PCWorld, (March 24). https:\/\/www.pcworld.com\/article\/3048157\/the-internet-turns-tay-microsofts-millennial-ai-chatbot-into-a-racist-bigot.html. Accessed 24 Mar 2021"},{"key":"1585_CR42","unstructured":"Pollack A (1983) Technology; The computer as translator. New York Times, (April 28). https:\/\/www.nytimes.com\/1983\/04\/28\/business\/technology-the-computer-as-translator.html. Accessed 24 Mar 2021"},{"key":"1585_CR43","unstructured":"Restle B (2020) Is Twitter's image-cropping feature racist? DW, (September 28). https:\/\/www.dw.com\/en\/twitter-image-cropping-racist-algorithm\/a-55085160. Accessed 24 Mar 2021"},{"key":"1585_CR44","unstructured":"Russell SJ, Norvig P (2003) Artificial intelligence: a modern approach"},{"key":"1585_CR45","unstructured":"Satariano A, Metz C (2020) A warehouse robot learns to sort out the tricky stuff. New York Times, (January 29). https:\/\/www.nytimes.com\/2020\/01\/29\/technology\/warehouse-robot.html. Accessed 24 Mar 2021"},{"key":"1585_CR46","unstructured":"Shane J (2018) Do neural nets dream of electric sheep? https:\/\/aiweirdness.com\/post\/171451900302\/do-neural-nets-dream-of-electric-sheep. Accessed 24 Mar 2021"},{"key":"1585_CR47","unstructured":"Smith A (2017a) German police raid flat after Alexa Amazon Echo \u2018holds party on its own\u2019. Metro. https:\/\/metro.co.uk\/2017a\/11\/09\/german-police-raid-flat-after-alexa-amazon-echo-holds-party-on-its-own-7067256\/. Accessed 8 Nov 2022"},{"key":"1585_CR48","unstructured":"Smith L (2017b) Israel police mistakenly arrest Palestinian man for writing \u2018good morning\u2019 on Facebook. Yahoo!news, (October 23). https:\/\/www.yahoo.com\/news\/israel-police-mistakenly-arrest-palestinian-151403166.html. Accessed 24 Mar 2021"},{"key":"1585_CR49","unstructured":"Snow J (2018) Amazon\u2019s face recognition falsely matched 28 members of congress with mugshots. Technology & Civil Liberties Attorney, ACLU of Northern California, (July 28) https:\/\/www.aclu.org\/blog\/privacy-technology\/surveillance-technologies\/amazons-face-recognition-falsely-matched-28. Accessed 24 March 2021"},{"key":"1585_CR50","unstructured":"Stewart J (2018) Why people keep rear-ending self-driving cars. Wired, (October 18). https:\/\/www.wired.com\/story\/self-driving-car-crashes-rear-endings-why-charts-statistics\/. Accessed 24 Mar 2021"},{"key":"1585_CR51","unstructured":"Thibodeaux T (2017) Smart cities are going to be a security nightmare. Harv Bus Rev H03MUJ. Retrieved from https:\/\/hbr.org\/2017\/04\/smart-cities-are-going-to-be-a-security-nightmare. Retrived 21 June 2018"},{"key":"1585_CR52","unstructured":"Thomas A (2020) Top 8 funniest and shocking AI failures of all time. Analytics India Magazine. (March 2) https:\/\/analyticsindiamag.com\/top-8-funniest-and-shocking-ai-failures-of-all-time\/. Accessed 24 Mar 2021"},{"key":"1585_CR53","unstructured":"Toews R (2020) GPT-3 is amazing\u2014and overhyped. Forbes, (July 19) https:\/\/www.forbes.com\/sites\/robtoews\/2020\/07\/19\/gpt-3-is-amazingand-overhyped\/?sh=5e49de331b1c. Accessed 24 Mar 2021"},{"issue":"4157","key":"1585_CR54","first-page":"1124","volume":"185","author":"A Tversky","year":"1974","unstructured":"Tversky A, Kahneman D (1974) Judgment under uncertainty: heuristics and biases. Sci New Ser 185(4157):1124\u20131131","journal-title":"Sci New Ser"},{"key":"1585_CR55","unstructured":"Vaas L (2018) Uber car software detected woman before fatal crash but failed to stop. NakedSecurity.com, (May 9). https:\/\/nakedsecurity.sophos.com\/2018\/05\/09\/uber-car-software-detected-woman-before-fatal-crash-but-failed-to-stop\/. Accessed 24 Mar 2021"},{"key":"1585_CR56","unstructured":"Vincent J (2017). Magic AI: these are the optical illusions that trick, fool, and flummox computers. The Verge, (April 12). https:\/\/www.theverge.com\/2017\/4\/12\/15271874\/ai-adversarial-images-fooling-attacks-artificial-intelligence. Accessed Mar 24 2021"},{"key":"1585_CR57","unstructured":"Wamsley L (2018) Amazon Echo recorded and sent couple's conversation\u2014all without their knowledge. NPR, (May 25). https:\/\/www.npr.org\/sections\/thetwo-way\/2018\/05\/25\/614470096\/amazon-echo-recorded-and-sent-couples-conversation-all-without-their-knowledge. Accessed 24 Mar 2021"},{"key":"1585_CR58","unstructured":"Weller C (2017) The first 'Robot Citizen' in the world once said she wants to 'destroy humans. Business Insider, (October 26). https:\/\/www.inc.com\/business-insider\/sophia-humanoid-first-robot-citizen-of-the-world-saudi-arabia-2017.html. Accessed 24 Mar 2021"},{"issue":"1","key":"1585_CR59","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1108\/FS-04-2018-0034","volume":"21","author":"RV Yampolskiy","year":"2019","unstructured":"Yampolskiy RV (2019) Predicting future AI failures from historic examples. Foresight 21(1):138\u2013152","journal-title":"Foresight"},{"key":"1585_CR60","unstructured":"Zhang M (2018) Google Photos\u2019 AI Panorama Failed in the Best Way. PetaPixel, (January 23). https:\/\/petapixel.com\/2018\/01\/23\/google-photos-ai-panorama-failed-best-way\/. Accessed 24 Mar 2021"}],"container-title":["AI & SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-022-01585-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-022-01585-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-022-01585-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,8]],"date-time":"2025-04-08T19:50:18Z","timestamp":1744141818000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-022-01585-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,17]]},"references-count":60,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["1585"],"URL":"https:\/\/doi.org\/10.1007\/s00146-022-01585-x","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,17]]},"assertion":[{"value":"15 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors did not receive support from any organization for the submitted work. The authors have no relevant financial or non-financial interests to disclose. All authors contributed equally to the research presented in the manuscript. All authors read and approved the final manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}