{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T16:12:01Z","timestamp":1784131921434,"version":"3.55.0"},"reference-count":50,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T00:00:00Z","timestamp":1689811200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>There is growing expectation that artificial intelligence (AI) developers foresee and mitigate harms that might result from their creations; however, this is exceptionally difficult given the prevalence of emergent behaviors that occur when integrating AI into complex sociotechnical systems. We argue that Naturalistic Decision Making (NDM) principles, models, and tools are well-suited to tackling this challenge. Already applied in high-consequence domains, NDM tools such as the premortem, and others, have been shown to uncover a <jats:italic>reasonable<\/jats:italic> set of risks of underlying factors that would lead to ethical harms. Such NDM tools have already been used to develop AI that is more trustworthy and resilient, and can help avoid unintended consequences of AI built with noble intentions. We present predictive policing algorithms as a use case, highlighting various factors that led to ethical harms and how NDM tools could help foresee and mitigate such harms.<\/jats:p>","DOI":"10.3389\/frai.2023.1143907","type":"journal-article","created":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T23:41:08Z","timestamp":1689896468000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Foresight for ethical AI"],"prefix":"10.3389","volume":"6","author":[{"given":"Stephen L.","family":"Dorton","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren M.","family":"Ministero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Balca","family":"Alaybek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Douglas J.","family":"Bryant","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,7,20]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10506-021-09286-4","article-title":"A review of predictive policing from the perspective of fairness","volume":"30","author":"Alikhademi","year":"2021","journal-title":"Artif. Intell. Law"},{"key":"B2","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1109\/MTS.2019.2915154","article-title":"AI ethics in predictive policing: from models of threat to ethics of care","volume":"38","author":"Asaro","year":"2019","journal-title":"IEEE Technol. Soc. Mag."},{"key":"B3","doi-asserted-by":"publisher","first-page":"1514","DOI":"10.1177\/1071181322661307","article-title":"Identifying and addressing risks in the early design of a sociotechnical system through premortem","volume":"66","author":"Bettin","year":"2022","journal-title":"Proc. 2022 HFES 66th Ann. Meet."},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2102.03985","article-title":"Multisource ai scorecard table for system evaluation","author":"Blasch","year":"2021","journal-title":"arXiv."},{"key":"B5","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1007\/s11948-017-0006-0","article-title":"Self-driving cars and engineering ethics: the need for a system level analysis","volume":"25","author":"Borenstein","year":"2019","journal-title":"Sci. Eng. Ethics"},{"key":"B6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fpsyg.2022.836650","article-title":"AI and ethics when human beings collaborate with AI agents","volume":"13","author":"Ca\u00f1as","year":"2022","journal-title":"Front. Psychol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"548","DOI":"10.1080\/00140139.2015.1015623","article-title":"Advancing a sociotechnical systems approach to workplace safety \u2013 developing the conceptual framework","volume":"58","author":"Carayon","year":"2015","journal-title":"Ergonomics"},{"key":"B8","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/12549.001.0001","volume-title":"AI Ethics","author":"Coeckelbergh","year":"2020"},{"key":"B9","doi-asserted-by":"publisher","first-page":"167","DOI":"10.31228\/osf.io\/2nstf","article-title":"Servers and waiters: what matters in the law of A.I","volume":"21","author":"Cofone","year":"2018","journal-title":"Stanf. Technol. Law Rev."},{"key":"B10","doi-asserted-by":"publisher","first-page":"3","DOI":"10.17083\/ijsg.v8i4.456","article-title":"Design methodology of analytical games for knowledge acquisition","volume":"8","author":"de Rosa","year":"2021","journal-title":"Int. J. Serious Games"},{"key":"B11","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1007\/s00146-017-0730-7","article-title":"What is wrong about Robocops as consultants? A technology-centric critique of predictive policing","volume":"33","author":"Degeling","year":"2018","journal-title":"AI Soc."},{"key":"B12","doi-asserted-by":"publisher","first-page":"92","DOI":"10.54941\/ahfe1001451","article-title":"Supradyadic trust in artificial intelligence","volume":"28","author":"Dorton","year":"2022","journal-title":"Artif. Intell. Soc. Comput."},{"key":"B13","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1177\/1071181322661146","article-title":"Adaptations to trust incidents with artificial intelligence","volume":"66","author":"Dorton","year":"2022","journal-title":"Proc. HFES 66th Int. Ann. Meet."},{"key":"B14","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1177\/15553434221103718","article-title":"A naturalistic investigation of trust, AI, and intelligence work","volume":"16","author":"Dorton","year":"2022","journal-title":"J. Cogn. Eng. Decis. Mak."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/SYSTEMS8030027","article-title":"A wargame-augmented knowledge elicitation method for the agile development of novel systems","volume":"8","author":"Dorton","year":"2020","journal-title":"Systems"},{"key":"B16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ISPCE.2015.7138700","article-title":"\u201cThe pre-mortem: an alternative method of predicting failure,\u201d","volume-title":"2015 IEEE Symposium on Product Compliance Engineering (ISPCE)","author":"Eckert","year":"2015"},{"key":"B17","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1177\/1071181319631264","article-title":"Trust engineering for human-AI teams","volume":"63","author":"Ezer","year":"2019","journal-title":"Proc. Hum. Factors Ergon. Soc. Ann. Meet."},{"key":"B18","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1080\/19488289.2016.1240118","article-title":"How to catch a black swan: measuring the benefits of the premortem technique for risk identification","volume":"6","author":"Gallop","year":"2016","journal-title":"J. Enterp. Transform."},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2211.13960","article-title":"The European AI liability directives: critique of a heal-hearted approach and lessons for the future","author":"Hacker","year":"2022","journal-title":"arXiv."},{"key":"B20","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1007\/s10506-020-09260-6","article-title":"Explainable AI under contract and tort law: legal incentives and technical challenges","volume":"28","author":"Hacker","year":"2020","journal-title":"Artif. Intell. Law"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fcomp.2022.776837","article-title":"AI ethics as applied ethics","volume":"4","author":"Hallamaa","year":"2022","journal-title":"Front. Comput. Sci."},{"key":"B22","unstructured":"\u201cEthical debt in IS development, comparing ethical and technical debt,\u201d2931\n            HeimoO. I.\n            HolvitieJ.\n          Logro\u00f1o, ESUniversidad de La RiojaETHICOMP 2020: Paradigm Shifts in ICT Ethics2020"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1007\/s11023-023-09625-1","article-title":"The blueprint for an AI bill of rights: In search of enaction, at risk of inaction","author":"Hine","year":"2023","journal-title":"Minds Mach."},{"key":"B24","volume-title":"Accelerated Expertise: Training for High Proficiency in a Complex World","author":"Hoffman","year":"2014"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4153796","article-title":"Digital services act: a short primer","author":"Husovec","year":"2022","journal-title":"SSRN."},{"key":"B26","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1177\/1071181322661334","article-title":"Developing systemic contributors and adaptations diagramming (SCAD): systemic insights, multiple pragmatic implications","volume":"66","author":"Jefferies","year":"2022","journal-title":"Proc. 2022 HFES 66th Int. Ann. Meet."},{"key":"B27","first-page":"18","article-title":"Performing a project premortem","volume":"85","author":"Klein","year":"2007","journal-title":"Harv. Bus. Rev."},{"key":"B28","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/14342.001.0001","volume-title":"Snapshots of the Mind","author":"Klein","year":"2022"},{"key":"B29","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1109\/MIS.2003.1200735","article-title":"Macrocognition","volume":"18","author":"Klein","year":"2003","journal-title":"IEEE Intell. Syst."},{"key":"B30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fpsyg.2016.00054","article-title":"Macrocognition: from theory to toolbox","volume":"7","author":"Klein","year":"2016","journal-title":"Front. Psychol."},{"key":"B31","volume-title":"Decision Making in Action: Models and Methods.","author":"Klein","year":"1993"},{"key":"B32","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1109\/MITP.2011.46","article-title":"Moral responsibility for computing artifacts: \u201cThe Rules\u201d","volume":"13","author":"Miller","year":"2011","journal-title":"IT Prof."},{"key":"B33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.7238\/idp.v0i30.3223","article-title":"Predictive policing: utopia or dystopia? On attitudes towards the use of big data algorithms for law enforcement","volume":"30","author":"Mir\u00f3-Llinares","year":"2020","journal-title":"Rev. D'Internet Derecho Polit."},{"key":"B34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2053951716679679","article-title":"The ethics of algorithms: mapping the debate","volume":"3","author":"Mittelstadt","year":"2016","journal-title":"Big Data Soc."},{"key":"B35","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1177\/2327857922111009","article-title":"From reactive to proactive safety: joint activity monitoring for infection prevention","volume":"11","author":"Morey","year":"2022","journal-title":"Proc. 2022 Int. Symp. Hum. Factors Ergon. Healthc."},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1007\/s43681-022-00209-w","article-title":"The uselessness of AI ethics","author":"Munn","year":"2022","journal-title":"AI Ethics."},{"key":"B37","unstructured":"Principles of Naturalistic Decision Making"},{"key":"B38","article-title":"\u201cThe naturalistic decision making perspective,\u201d","volume-title":"Wiley Encyclopedia of Operations Research and Management Science","author":"Nemeth","year":"2010"},{"key":"B39","doi-asserted-by":"publisher","first-page":"2067","DOI":"10.1177\/1071181322661177","article-title":"The TRUSTS work system resilience framework: a foundation for resilience-aware development and transition","volume":"66","author":"Neville","year":"2022","journal-title":"Proc. 2022 HFES 66th Int. Ann. Meet."},{"key":"B40","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/s43681-020-00030-3","article-title":"Who pays for ethical debt in AI?","volume":"1","author":"Petrozzino","year":"2021","journal-title":"AI Ethics"},{"key":"B41","first-page":"15","article-title":"Dirty data, bad predictions: how civil rights violations impact police data, predictive policing systems, and justice","volume":"94","author":"Richardson","year":"2019","journal-title":"N. Y. Univ. Law Rev. Online"},{"key":"B42","first-page":"1315","article-title":"Negligence and AI's human users","volume":"100","author":"Selbst","year":"2020","journal-title":"Boston Univ. Law Rev."},{"key":"B43","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1518\/001872008X250773","article-title":"Risk, human error, and system resilience: fundamental ideas","volume":"50","author":"Sheridan","year":"2008","journal-title":"Hum. Factors"},{"key":"B44","first-page":"979","article-title":"Assuming the risks of artificial intelligence","author":"Stein","year":"2022","journal-title":"Boston Univ. Law Rev. 102"},{"key":"B45","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1001\/amajethics.2019.160","article-title":"Are current tort liability doctrines adequate for addressing injury caused by AI?","volume":"21","author":"Sullivan","year":"2019","journal-title":"AMA J. Ethics"},{"key":"B46","article-title":"\u201cEvaluating the effectiveness of the PreMortem technique on plan confidence,\u201d","volume-title":"Proceedings of the 7th International ISCRAM Conference","author":"Veinott","year":"2010"},{"key":"B47","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1080\/02684527.2021.1946952","article-title":"The impact of AI on intelligence analysis: tackling issues of collaboration, algorithmic transparency, accountability, and management","volume":"36","author":"Vogel","year":"2021","journal-title":"Intell. National Secur"},{"key":"B48","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.jarmac.2018.01.009","article-title":"Adaptive skill as the conditio sine qua non of expertise","volume":"7","author":"Ward","year":"2018","journal-title":"J. Appl. Res. Mem. Cogn."},{"key":"B49","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1080\/14639220110037452","article-title":"Anticipating the effects of technological change: a new era of dynamics for human factors","volume":"1","author":"Woods","year":"2010","journal-title":"Theor. Issues Ergon. Sci."},{"key":"B50","first-page":"1","article-title":"\u201cThe law of stretched systems in action: exploiting robots,\u201d","volume-title":"Proceedings of the 1","author":"Woods","year":"2006"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1143907\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T23:41:19Z","timestamp":1689896479000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1143907\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,20]]},"references-count":50,"alternative-id":["10.3389\/frai.2023.1143907"],"URL":"https:\/\/doi.org\/10.3389\/frai.2023.1143907","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,20]]},"article-number":"1143907"}}