{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,11]],"date-time":"2025-03-11T04:08:26Z","timestamp":1741666106483,"version":"3.38.0"},"reference-count":51,"publisher":"Cambridge University Press (CUP)","license":[{"start":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T00:00:00Z","timestamp":1741564800000},"content-version":"unspecified","delay-in-days":68,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100006234","name":"Sandia National Laboratories","doi-asserted-by":"publisher","award":["Assessing Cognitive Impacts of Errors from Machine"],"award-info":[{"award-number":["Assessing Cognitive Impacts of Errors from Machine"]}],"id":[{"id":"10.13039\/100006234","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100005595","name":"University of California","doi-asserted-by":"publisher","award":["Fellowship"],"award-info":[{"award-number":["Fellowship"]}],"id":[{"id":"10.13039\/100005595","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["AIEDAM"],"published-print":{"date-parts":[[2025]]},"abstract":"<jats:title>Abstract<\/jats:title>\n\t  <jats:p>Engineering design requires humans to make complex, multi-objective decisions involving trade-offs where it is challenging to identify the best solution. AI-embedded computational support tools are increasingly used to aid in such scenarios, enhancing the design decision-making process. However, over- or under-reliance on imperfect \u201cblackbox\u201d models may prevent optimal outcomes. To investigate AI-assisted decision-making in engineering design, two complementary experiments (<jats:italic>N<\/jats:italic> = 90) were conducted. Participants chose between pairs of aircraft jet engine brackets and were tasked with selecting the better design based on two (Experiment 1) or three (Experiment 2) competing objectives. Participants received simulated AI suggestions, which correctly suggested a better design, incorrectly suggested a worse design, or arbitrarily suggested an approximately equivalent design. At times, these suggestions were accompanied by an example-based explanation. Results demonstrate that participants follow suggestions less than expected when the model can objectively determine the better-performing alternative, often underutilizing the model\u2019s advice to their detriment. When the \u201cbetter\u201d choice is uncertain, the tendency to follow an arbitrary suggestion differs, with overutilization occurring only in the bi-objective case. There is no evidence that providing an explanation of the model\u2019s suggestion impacts decision-making. The results provide valuable insights into how engineering designers\u2019 multi-objective decisions may be affected \u2013 positively, negatively, or not at all \u2013 by computational tools meant to assist them.<\/jats:p>","DOI":"10.1017\/s0890060425000034","type":"journal-article","created":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T09:52:47Z","timestamp":1741600367000},"update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":0,"title":["Adopting \u201cblackbox\u201d engineering advice: the influence of imperfect suggestions during AI-assisted decision-making with multiple objectives"],"prefix":"10.1017","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7465-2501","authenticated-orcid":false,"given":"Ananya","family":"Nandy","sequence":"first","affiliation":[]},{"given":"David Antonio","family":"Herrera","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0850-9197","authenticated-orcid":false,"given":"Kosa","family":"Goucher-Lambert","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2025,3,10]]},"reference":[{"key":"S0890060425000034_r21","doi-asserted-by":"publisher","DOI":"10.1111\/j.0956-7976.2005.00796.x"},{"key":"S0890060425000034_r11","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.107018"},{"key":"S0890060425000034_r24","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858402"},{"key":"S0890060425000034_r46","doi-asserted-by":"publisher","DOI":"10.1115\/DETC2021-67619"},{"key":"S0890060425000034_r50","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300509"},{"key":"S0890060425000034_r15","doi-asserted-by":"publisher","DOI":"10.1177\/0956797620948841"},{"key":"S0890060425000034_r4","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5285"},{"key":"S0890060425000034_r38","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2022.2101698"},{"key":"S0890060425000034_r51","doi-asserted-by":"publisher","DOI":"10.1145\/3025171.3025219"},{"key":"S0890060425000034_r43","doi-asserted-by":"publisher","DOI":"10.1177\/17456916231181102"},{"key":"S0890060425000034_r39","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-85729-883-6_7"},{"key":"S0890060425000034_r22","doi-asserted-by":"publisher","DOI":"10.1145\/3686164"},{"key":"S0890060425000034_r42","doi-asserted-by":"publisher","DOI":"10.1017\/dsj.2022.18"},{"key":"S0890060425000034_r33","doi-asserted-by":"publisher","DOI":"10.1145\/3495013"},{"key":"S0890060425000034_r48","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2023.107714"},{"key":"S0890060425000034_r32","unstructured":"OpenAI (2021) \u2018Dall\u00b7E: Creating Images from Text. https:\/\/openai.com\/blog\/dall-e\/."},{"key":"S0890060425000034_r35","unstructured":"Poole, B , Jain, A , Barron, JT and Mildenhall, B (2022) Dreamfusion: text-to-3d using 2d diffusion. In The Eleventh International Conference on Learning Representations."},{"key":"S0890060425000034_r7","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302289"},{"key":"S0890060425000034_r23","doi-asserted-by":"publisher","DOI":"10.1017\/dsj.2021.7"},{"key":"S0890060425000034_r20","doi-asserted-by":"publisher","DOI":"10.1145\/1378773.1378804"},{"key":"S0890060425000034_r40","doi-asserted-by":"publisher","DOI":"10.2514\/6.2004-4553"},{"key":"S0890060425000034_r47","doi-asserted-by":"publisher","DOI":"10.1115\/1.2429697"},{"key":"S0890060425000034_r34","doi-asserted-by":"publisher","DOI":"10.1518\/001872097778543886"},{"key":"S0890060425000034_r8","first-page":"031113","article-title":"Machine learning-based design concept evaluation","volume":"142","author":"Camburn","year":"2020","journal-title":"Journal of Mechanical Design. American Society of Mechanical Engineers"},{"key":"S0890060425000034_r6","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-019-01242-0"},{"key":"S0890060425000034_r41","doi-asserted-by":"publisher","DOI":"10.1115\/1.4051871"},{"key":"S0890060425000034_r19","doi-asserted-by":"publisher","DOI":"10.1109\/SysCon.2012.6189466"},{"key":"S0890060425000034_r52","doi-asserted-by":"publisher","DOI":"10.1016\/j.destud.2021.100990"},{"key":"S0890060425000034_r16","first-page":"187","volume-title":"Experimental Design Research","author":"Egan","year":"2016"},{"key":"S0890060425000034_r17","volume-title":"Product Design and Development","author":"Eppinger","year":"1995"},{"key":"S0890060425000034_r29","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2018.12.005"},{"key":"S0890060425000034_r1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.07.026"},{"key":"S0890060425000034_r31","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2021.103821"},{"key":"S0890060425000034_r27","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2022.107539"},{"key":"S0890060425000034_r10","doi-asserted-by":"publisher","DOI":"10.1115\/1.4048626"},{"key":"S0890060425000034_r49","first-page":"9","volume-title":"Computer Graphics Forum","volume":"40","author":"Whalen","year":"2021"},{"key":"S0890060425000034_r28","unstructured":"Liu, H , Tian, Y , Chen, C , Feng, S , Chen, Y and Tan, C (2022) Learning human-compatible representations for case-based decision support. In The Eleventh International Conference on Learning Representations."},{"key":"S0890060425000034_r14","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"S0890060425000034_r53","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372852"},{"key":"S0890060425000034_r2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2020.106572"},{"key":"S0890060425000034_r44","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1994.2.3.221"},{"key":"S0890060425000034_r5","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33012429"},{"key":"S0890060425000034_r12","doi-asserted-by":"publisher","DOI":"10.1115\/1.4055123"},{"key":"S0890060425000034_r25","article-title":"Explaining algorithm aversion with metacognitive bandits","volume":"43","author":"Kumar","year":"2021","journal-title":"Proceedings of the Annual Meeting of the Cognitive Science Society"},{"key":"S0890060425000034_r45","first-page":"e27","article-title":"A user model to directly compare two unmodified interfaces: a study of including errors and error corrections in a cognitive user model","volume":"37","author":"Tehranchi","year":"2023","journal-title":"AI EDAM"},{"key":"S0890060425000034_r26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05363-5_9"},{"key":"S0890060425000034_r3","doi-asserted-by":"publisher","DOI":"10.2514\/6.2018-1366"},{"key":"S0890060425000034_r9","doi-asserted-by":"publisher","DOI":"10.1115\/1.4044076"},{"key":"S0890060425000034_r30","first-page":"801","volume-title":"Design Computing and Cognition\u201922.","author":"Nandy","year":"2022"},{"key":"S0890060425000034_r13","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-6940-7_15"},{"key":"S0890060425000034_r37","first-page":"298","article-title":"A decision model for making decisions under epistemic uncertainty and its application to select materials","volume":"31","author":"Shahinur","year":"2017","journal-title":"AI EDAM"}],"container-title":["Artificial Intelligence for Engineering Design, Analysis and Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0890060425000034","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T09:52:54Z","timestamp":1741600374000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0890060425000034\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"references-count":51,"alternative-id":["S0890060425000034"],"URL":"https:\/\/doi.org\/10.1017\/s0890060425000034","relation":{},"ISSN":["0890-0604","1469-1760"],"issn-type":[{"value":"0890-0604","type":"print"},{"value":"1469-1760","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025]]},"assertion":[{"value":"\u00a9 The Author(s), 2025. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http:\/\/creativecommons.org\/licenses\/by\/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}],"article-number":"e7"}}