{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,15]],"date-time":"2025-11-15T19:34:21Z","timestamp":1763235261451,"version":"3.44.0"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,11,7]],"date-time":"2024-11-07T00:00:00Z","timestamp":1730937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"name":"Google PhD Fellowship"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,11,7]]},"abstract":"<jats:p>UX designers and researchers who work with AI\/ML face different kinds of challenges throughout the design process. Though close collaborations with AI\/ML developers and data scientists could address some of these challenges, such interdisciplinary collaborations are non-routine and hard to realize. In this work, we investigate barriers for effective collaboration with ML practitioners, how they affect UX practice of AI\/ML applications, and what UX practitioners need to overcome these challenges. We conducted a qualitative study with 14 UX practitioners who are working on AI\/ML products as designers or researchers. Our findings show that UX practitioners face challenges in communication, understanding the model and model development processes, establishing ways to collaborate, and reconciling model-centric metrics of evaluation with user-centric outcomes. They described various needs in terms of more visibility into model development processes, access to comprehensible and contextual model information, and hypothetical tools that can potentially support collaboration with ML practitioners and enhance UX design processes. We discuss implications of this research for designing collaborative tools and empowering UX practitioners.<\/jats:p>","DOI":"10.1145\/3686986","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T15:52:40Z","timestamp":1731081160000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Analyzing Collaborative Challenges and Needs of UX Practitioners when Designing with AI\/ML"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4593-8038","authenticated-orcid":false,"given":"Meena Devii","family":"Muralikumar","sequence":"first","affiliation":[{"name":"Human Centered Design &amp; Engineering, University of Washington, Seattle, WA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5882-828X","authenticated-orcid":false,"given":"David W.","family":"McDonald","sequence":"additional","affiliation":[{"name":"Human Centered Design &amp; Engineering, University of Washington, Seattle, WA, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n. d.]. 35 Ways Real People Are Using A.I. Right Now - The New York Times. https:\/\/www.nytimes.com\/interactive\/2023\/04\/14\/upshot\/up-ai-uses.html. (Accessed on 07\/18\/2023)."},{"key":"e_1_2_1_2_1","unstructured":"[n. d.]. Humans may be more likely to believe disinformation generated by AI | MIT Technology Review. https:\/\/www.technologyreview.com\/2023\/06\/28\/1075683\/humans-may-be-more-likely-to-believedisinformation-generated-by-ai\/. (Accessed on 07\/18\/2023)."},{"key":"e_1_2_1_3_1","unstructured":"[n. d.]. The Paradox of Intelligent Assistants: Poor Usability High Adoption. https:\/\/www.nngroup.com\/articles\/ intelligent-assistants-poor-usability-high-adoption\/. (Accessed on 07\/18\/2023)."},{"key":"e_1_2_1_4_1","unstructured":"[n. d.]. People AI Guidebook ? pair.withgoogle.com. https:\/\/pair.withgoogle.com\/guidebook."},{"key":"e_1_2_1_5_1","unstructured":"[n. d.]. The 6 Levels of UX Maturity ? nngroup.com. https:\/\/www.nngroup.com\/articles\/ux-maturity-model\/."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3463934"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"volume-title":"Ethics of data and analytics","author":"Angwin Julia","key":"e_1_2_1_8_1","unstructured":"Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2022. Machine bias. In Ethics of data and analytics. Auerbach Publications, 254--264."},{"key":"e_1_2_1_9_1","unstructured":"Amid Ayobi Katarzyna Stawarz Dmitri Katz Paul Marshall Taku Yamagata Ra\u00fal Santos-Rodr\u00edguez Peter Flach and Aisling Ann O'Kane. 2021. Machine learning explanations as boundary objects: how AI researchers explain and non-experts perceive machine learning. (2021)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502102"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717718854"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581518"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/AGILE.2011.45"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3443435"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580959"},{"key":"e_1_2_1_16_1","volume-title":"Basics of qualitative research","author":"Corbin J","year":"2008","unstructured":"J Corbin and A Strauss. 2008. Basics of qualitative research. Sage Publications. Thousand Oaks, CA (2008)."},{"volume-title":"Designerly ways of knowing","author":"Cross Nigel","key":"e_1_2_1_17_1","unstructured":"Nigel Cross. 2006. Designerly ways of knowing. Springer."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2002.993937"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025739"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/192844.192878"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/99977.99987"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581273"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 28th International Conference on Intelligent User Interfaces. 337--352","author":"Kevin Feng KJ","year":"2023","unstructured":"KJ Kevin Feng and David W McDonald. 2023. Addressing UX Practitioners? Challenges in Designing ML Applications: an Interactive Machine Learning Approach. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 337--352."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.1012"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458723"},{"key":"e_1_2_1_26_1","volume-title":"2017 AAAI Spring Symposium Series.","author":"Girardin Fabien","year":"2017","unstructured":"Fabien Girardin and Neal Lathia. 2017. When user experience designers partner with data scientists. In 2017 AAAI Spring Symposium Series."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-011-3506-1_2"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/62266.62273"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/175222.175230"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/329693.329696"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021271517844"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555760"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376177"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3085571"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445735"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311957.3359512"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3299059"},{"key":"e_1_2_1_39_1","volume-title":"Challenges in enabling user control over algorithm-based services. AI & SOCIETY","author":"K\u00f6nig Pascal D","year":"2022","unstructured":"Pascal D K\u00f6nig. 2022. Challenges in enabling user control over algorithm-based services. AI & SOCIETY (2022), 1--11."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-007-9044-5"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580652"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376727"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512899"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998190"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581242"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331151"},{"key":"e_1_2_1_48_1","volume-title":"Software engineering for artificial intelligence and machine learning software: A systematic literature review. arXiv preprint arXiv:2011.03751","author":"Nascimento Elizamary","year":"2020","unstructured":"Elizamary Nascimento, Anh Nguyen-Duc, Ingrid Sundb\u00f8, and Tayana Conte. 2020. Software engineering for artificial intelligence and machine learning software: A systematic literature review. arXiv preprint arXiv:2011.03751 (2020)."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/143457.143549"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753707"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.302982"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450637"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449205"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610046"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533231"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449081"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580790"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","unstructured":"Robert Slagter. 2007. Groupware. John Wiley & Sons Ltd 16--32. https:\/\/doi.org\/10.1002\/9781118256107.ch2","DOI":"10.1002\/9781118256107.ch2"},{"key":"e_1_2_1_59_1","volume-title":"Institutional ecology,translations? and boundary objects: Amateurs and professionals in Berkeley's Museum of Vertebrate Zoology","author":"Star Susan Leigh","year":"1907","unstructured":"Susan Leigh Star and James R Griesemer. 1989. Institutional ecology,translations? and boundary objects: Amateurs and professionals in Berkeley's Museum of Vertebrate Zoology, 1907--39. Social studies of science 19, 3 (1989), 387--420."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517537"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450640"},{"key":"e_1_2_1_62_1","volume-title":"Designing Interactive Systems Conference","author":"Subramonyam Hariharan","year":"2021","unstructured":"Hariharan Subramonyam, Colleen Seifert, and Eytan Adar. 2021. Towards a process model for co-creating AI experiences. In Designing Interactive Systems Conference 2021. 1529--1543."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581278"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501943"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300415"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196730"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376301"},{"key":"e_1_2_1_68_1","volume-title":"Designing Interactive Systems Conference","author":"Ye Zining","year":"2021","unstructured":"Zining Ye, Xinran Yuan, Shaurya Gaur, Aaron Halfaker, Jodi Forlizzi, and Haiyi Zhu. 2021. Wikipedia ORES explorer: Visualizing trade-offs for designing applications with machine learning API. In Designing Interactive Systems Conference 2021. 1554--1565."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517491"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580900"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517607"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392826"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686986","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3686986","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T00:47:01Z","timestamp":1755737221000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686986"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,7]]},"references-count":72,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2024,11,7]]}},"alternative-id":["10.1145\/3686986"],"URL":"https:\/\/doi.org\/10.1145\/3686986","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2024,11,7]]},"assertion":[{"value":"2024-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}