{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T04:17:14Z","timestamp":1782965834632,"version":"3.54.5"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,11,7]],"date-time":"2024-11-07T00:00:00Z","timestamp":1730937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"German Federal Ministry for Economic Affairs and Climate Action","award":["LuFo VI-1 program, project KIEZ4-0"],"award-info":[{"award-number":["LuFo VI-1 program, project KIEZ4-0"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,11,7]]},"abstract":"<jats:p>AI is anticipated to enhance human decision-making in high-stakes domains like aviation, but adoption is often hindered by challenges such as inappropriate reliance and poor alignment with users' decision-making. Recent research suggests that a core underlying issue is the recommendation-centric design of many AI systems, i.e., they give end-to-end recommendations and ignore the rest of the decision-making process. Alternative support paradigms are rare, and it remains unclear how the few that do exist compare to recommendation-centric support. In this work, we aimed to empirically compare recommendation-centric support to an alternative paradigm, continuous support, in the context of diversions in aviation. We conducted a mixed-methods study with 32 professional pilots in a realistic setting. To ensure the quality of our study scenarios, we conducted a focus group with four additional pilots prior to the study. We found that continuous support can support pilots' decision-making in a forward direction, allowing them to think more beyond the limits of the system and make faster decisions when combined with recommendations, though the forward support can be disrupted. Participants' statements further suggest a shift in design goal away from providing recommendations, to supporting quick information gathering. Our results show ways to design more helpful and effective AI decision support that goes beyond end-to-end recommendations.<\/jats:p>","DOI":"10.1145\/3687024","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T15:52:40Z","timestamp":1731081160000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4544-7389","authenticated-orcid":false,"given":"Zelun Tony","family":"Zhang","sequence":"first","affiliation":[{"name":"fortiss GmbH &amp; LMU Munich, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0287-0945","authenticated-orcid":false,"given":"Sebastian S.","family":"Feger","sequence":"additional","affiliation":[{"name":"LMU Munich &amp; TH Rosenheim, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0432-1490","authenticated-orcid":false,"given":"Lucas","family":"Dullenkopf","sequence":"additional","affiliation":[{"name":"Airbus Defence and Space GmbH, Manching, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-5521-8730","authenticated-orcid":false,"given":"Rulu","family":"Liao","sequence":"additional","affiliation":[{"name":"LMU Munich, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3922-4578","authenticated-orcid":false,"given":"Lou","family":"S\u00fcsslin","sequence":"additional","affiliation":[{"name":"TU Wien, Vienna, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8651-6272","authenticated-orcid":false,"given":"Yuanting","family":"Liu","sequence":"additional","affiliation":[{"name":"Research Institute of the Free State of Bavaria, fortiss GmbH, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9007-9888","authenticated-orcid":false,"given":"Andreas","family":"Butz","sequence":"additional","affiliation":[{"name":"LMU Munich, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581513"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445717"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-031-02217--3_5"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/1559-8918.2018.01208"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581251"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2015.26"},{"key":"e_1_2_1_7_1","volume-title":"Virtual Workshop on Human-Centered AI Workshop at NeurIPS (HCAI @ NeurIPS '22)","author":"Bu\u00e7inca Zana","unstructured":"Zana Bu\u00e7inca, Alexandra Chouldechova, Jennifer Wortman Vaughan, and Krzysztof Z. Gajos. 2022. Beyond end predictions: stop putting machine learning first and design human-centered AI for decision support. In Virtual Workshop on Human-Centered AI Workshop at NeurIPS (HCAI @ NeurIPS '22). Virtual Event, USA, 1--4."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449287"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2021.102696"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300234"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3502289"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/0022243719851788"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581253"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14236\/ewic\/HCI2007.53"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185517"},{"key":"e_1_2_1_17_1","unstructured":"EASA. 2023. Artificial Intelligence Roadmap 2.0: A human-centric approach to AI in aviation. Technical Report. European Union Aviation Safety Agency (EASA). 36 pages. https:\/\/www.easa.europa.eu\/en\/document-library\/general-publications\/easa-artificial-intelligence-roadmap-20"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445188"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312787"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3564040"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533193"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/aaai.12182"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511138"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359152"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580694"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1108\/00022660710780650"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610067"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0901_2"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584052"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 21st Conference of the European Association for Aviation Psychology (EAAP). Avebury Aviation","author":"H\u00f6rmann Hans-J\u00fcrgen","year":"1994","unstructured":"Hans-J\u00fcrgen H\u00f6rmann. 1994. FOR-DEC - A prescriptive model for aeronautical decision making. In Proceedings of the 21st Conference of the European Association for Aviation Psychology (EAAP). Avebury Aviation, Dublin, Ireland, 17--23."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445385"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41398-021-01224-x"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395436"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517439"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3532106.3533556"},{"key":"e_1_2_1_36_1","volume-title":"Virtual Workshop on Human-Centered AI Workshop at NeurIPS (HCAI @ NeurIPS '22)","author":"Koon Sean","year":"2022","unstructured":"Sean Koon. 2022. A human-capabilities orientation for human-AI interaction design. In Virtual Workshop on Human-Centered AI Workshop at NeurIPS (HCAI @ NeurIPS '22). Virtual Event, USA, 1--5."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701399"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594087"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287590"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.3357\/AMHP.5720.2021"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2302.01241"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450681"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479552"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1518\/001872006779166334"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594001"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359204"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445315"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584033"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/for.2464"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSEC.2019.2925649"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512930"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501967"},{"key":"e_1_2_1_53_1","unstructured":"Emilie Roth Devorah Klein Christen Sushereba Katie Ernst and Lauren Militello. 2022. Methods and measures to evaluate technologies that influence aviator decision making and situation awareness. Contract Report USAARL-TECH-CR--2022--22. Applied Decision Science Cincinnati OH USA. 80 pages."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584066"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-030--21451--7_22"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-030--57321--8_24"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1518\/001872007X312469"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TTS.2020.2992669"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581075"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/3468.568744"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376624"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3422156"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1159\/000511930"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3579605"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300831"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450650"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--642--50329-0_11"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.54941\/ahfe1003844"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581393"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300468"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858373"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41551-018-0305-z"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642343"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372852"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3464385.3464696"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584056"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687024","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3687024","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T00:45:39Z","timestamp":1755737139000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,7]]},"references-count":76,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2024,11,7]]}},"alternative-id":["10.1145\/3687024"],"URL":"https:\/\/doi.org\/10.1145\/3687024","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,7]]},"assertion":[{"value":"2024-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}