{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:56:00Z","timestamp":1776110160732,"version":"3.50.1"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T00:00:00Z","timestamp":1618272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,4,13]]},"abstract":"<jats:p>The development of AI applications is a multidisciplinary effort, involving multiple roles collaborating with the AI developers, an umbrella term we use to include data scientists and other AI-adjacent roles on the same team. During these collaborations, there is a knowledge mismatch between AI developers, who are skilled in data science, and external stakeholders who are typically not. This difference leads to communication gaps, and the onus falls on AI developers to explain data science concepts to their collaborators. In this paper, we report on a study including analyses of both interviews with AI developers and artifacts they produced for communication. Using the analytic lens of shared mental models, we report on the types of communication gaps that AI developers face, how AI developers communicate across disciplinary and organizational boundaries, and how they simultaneously manage issues regarding trust and expectations.<\/jats:p>","DOI":"10.1145\/3449205","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T17:51:09Z","timestamp":1619113869000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":119,"title":["How AI Developers Overcome Communication Challenges in a Multidisciplinary Team"],"prefix":"10.1145","volume":"5","author":[{"given":"David","family":"Piorkowski","sequence":"first","affiliation":[{"name":"IBM Research, Yorktown Heights, NY, USA"}]},{"given":"Soya","family":"Park","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA, USA"}]},{"given":"April Yi","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}]},{"given":"Dakuo","family":"Wang","sequence":"additional","affiliation":[{"name":"IBM Research, Cambridge, MA, USA"}]},{"given":"Michael","family":"Muller","sequence":"additional","affiliation":[{"name":"IBM Research, Cambridge, MA, USA"}]},{"given":"Felix","family":"Portnoy","sequence":"additional","affiliation":[{"name":"IBM, Virginia Beach, VA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240787"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2019.00042"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818052.2855518"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942288"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2018.00018"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.88.5.866"},{"key":"e_1_2_1_7_1","volume-title":"Datahub: Collaborative data science & dataset version management at scale. arXiv preprint arXiv:1409.0798","author":"Bhardwaj Anant","year":"2014","unstructured":"Anant Bhardwaj, Souvik Bhattacherjee, Amit Chavan, Amol Deshpande, Aaron J Elmore, Samuel Madden, and Aditya G Parameswaran. 2014. Datahub: Collaborative data science & dataset version management at scale. arXiv preprint arXiv:1409.0798 (2014)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2019.8818751"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360601"},{"key":"e_1_2_1_10_1","volume-title":"mbox","author":"Arunima Chaudhary","year":"2021","unstructured":"Arunima Chaudhary et almbox. 2021. AutoText: An End-to-End AutoAI Framework for Text. In AAAI. ACM."},{"key":"e_1_2_1_11_1","volume-title":"Context and common ground. Concise Encyclopedia of Philosophy of Language and Linguistics","author":"Clark Herbert H","year":"2006","unstructured":"Herbert H Clark. 2006. Context and common ground. Concise Encyclopedia of Philosophy of Language and Linguistics (2006), 85--87."},{"key":"e_1_2_1_12_1","unstructured":"Herbert H Clark and Susan E Brennan. 1991. Grounding in communication. (1991)."},{"key":"e_1_2_1_13_1","volume-title":"Shared mental models in expert team decision making. Individual and group decision making: Current issues","author":"Converse Sharolyn","year":"1993","unstructured":"Sharolyn Converse, JA Cannon-Bowers, and E Salas. 1993. Shared mental models in expert team decision making. Individual and group decision making: Current issues, Vol. 221 (1993), 221--46."},{"key":"e_1_2_1_14_1","volume-title":"Ways of Knowing in HCI","author":"Dourish Paul","unstructured":"Paul Dourish. 2014. Reading and interpreting ethnography. In Ways of Knowing in HCI. Springer, 1--23."},{"key":"e_1_2_1_15_1","article-title":"Utilization of Self-Diagnosis Health Chatbots in Real-World Settings: Case Study","volume":"22","author":"Fan Xiangmin","year":"2020","unstructured":"Xiangmin Fan, Daren Chao, Zhan Zhang, Dakuo Wang, Xiaohua Li, and Feng Tian. 2020. Utilization of Self-Diagnosis Health Chatbots in Real-World Settings: Case Study. Journal of Medical Internet Research, Vol. 22 (2020).","journal-title":"Journal of Medical Internet Research"},{"key":"e_1_2_1_16_1","volume-title":"Hanna Wallach, Hal Daume\u00e9 III, and Kate Crawford.","author":"Gebru Timnit","year":"2018","unstructured":"Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daume\u00e9 III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2016.7739680"},{"key":"e_1_2_1_18_1","volume-title":"Experiences with Improving the Transparency of AI Models and Services. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1--8.","author":"Hind Michael","year":"2020","unstructured":"Michael Hind, Stephanie Houde, Jacquelyn Martino, Aleksandra Mojsilovic, David Piorkowski, John Richards, and Kush R Varshney. 2020. Experiences with Improving the Transparency of AI Models and Services. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1--8."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134688"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1447-0349.2006.00400.x"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311957.3359512"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173748"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884783"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3323994.3369898"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41060-018-0107-0"},{"key":"e_1_2_1_26_1","volume-title":"9 Multidisciplinary Work Challenges and Possibilities. Special Education Reformed: Inclusion-Beyond Rhetoric?","author":"Lacey Penny","year":"2002","unstructured":"Penny Lacey. 2002. 9 Multidisciplinary Work Challenges and Possibilities. Special Education Reformed: Inclusion-Beyond Rhetoric? (2002), 157."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.67.3.446"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. 179--194","author":"Lee Charlotte P","year":"2015","unstructured":"Charlotte P Lee and Drew Paine. 2015. From The Matrix to a Model of Coordinated Action (MoCA) A Conceptual Framework of and for CSCW. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. 179--194."},{"key":"e_1_2_1_29_1","volume-title":"International journal of information technology and business management","author":"Lee M","year":"2012","unstructured":"M Lee, Tristan Johnson, and Myung H Jin. 2012. Toward understanding the dynamic relationship between team and task shared mental models as determinants of team and individual performances. International journal of information technology and business management, Vol. 8, 1 (2012), 1--14."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173577"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-19034-7_14"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3361118"},{"key":"e_1_2_1_33_1","volume-title":"Mental model convergence: The shift from being an individual to being a team member. Research in multi-level issues","author":"McComb Sara A","year":"2007","unstructured":"Sara A McComb. 2007. Mental model convergence: The shift from being an individual to being a team member. Research in multi-level issues, Vol. 6 (2007), 95--147."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359174"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/0149206309356804"},{"key":"e_1_2_1_37_1","volume-title":"Human-Centered Study of Data Science Work Practices. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, W15","author":"Muller Michael","year":"2019","unstructured":"Michael Muller, Melanie Feinberg, Timothy George, Steven J Jackson, Bonnie E John, Mary Beth Kery, and Samir Passi. 2019 a. Human-Centered Study of Data Science Work Practices. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, W15."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300356"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84882-854-4_23"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142789"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Soya Park April Wang Ban Kawas Q. Vera Liao David Piorkowski and Marina Danilevsky. 2021. Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models. arxiv: 2102.00036 [cs.HC]","DOI":"10.1145\/3397481.3450637"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274405"},{"key":"e_1_2_1_43_1","volume-title":"Building data science teams.\" O'Reilly Media","author":"Patil DJ","unstructured":"DJ Patil. 2011. Building data science teams.\" O'Reilly Media, Inc.\"."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702298"},{"key":"e_1_2_1_45_1","volume-title":"Machine Teaching by Domain Experts: Towards More Humane, Inclusive, and Intelligent Machine Learning Systems. arXiv preprint arXiv:1908.08931","author":"Pinhanez Claudio","year":"2019","unstructured":"Claudio Pinhanez. 2019. Machine Teaching by Domain Experts: Towards More Humane, Inclusive, and Intelligent Machine Learning Systems. arXiv preprint arXiv:1908.08931 (2019)."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.102066"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0018822"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173606"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/1555343416682891"},{"key":"e_1_2_1_50_1","volume-title":"Computer-supported collaborative learning at the workplace","author":"Stahl Gerry","unstructured":"Gerry Stahl. 2013. Theories of collaborative cognition: Foundations for CSCL and CSCW together. In Computer-supported collaborative learning at the workplace. Springer, 43--63."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180875.1180906"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2584053"},{"key":"e_1_2_1_53_1","unstructured":"Jennifer Sukis. 2019. AI Design & Practices Guidelines. https:\/\/medium.com\/design-ibm\/ai-design-guidelines-e06f7e92d864"},{"key":"e_1_2_1_54_1","unstructured":"Christoph Treude Margaret-anne Storey and Jens Weber. 2009. Empirical studies on collaboration in software development: A systematic literature review. (2009)."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-010-9128-3"},{"key":"e_1_2_1_56_1","volume-title":"Enterprise interoperability","author":"Van der Aalst Wil MP","unstructured":"Wil MP Van der Aalst. 2014. Data scientist: The engineer of the future. In Enterprise interoperability VI. Springer, 13--26."},{"key":"e_1_2_1_57_1","volume-title":"How does Machine Learning Change Software Development Practices? IEEE Transactions on Software Engineering","author":"Wan Zhiyuan","year":"2019","unstructured":"Zhiyuan Wan, Xin Xia, David Lo, and Gail C Murphy. 2019. How does Machine Learning Change Software Development Practices? IEEE Transactions on Software Engineering (2019)."},{"key":"e_1_2_1_58_1","volume-title":"How Data Scientists Use Computational Notebooks for Real-Time Collaboration. Proceedings of the ACM on Human-Computer Interaction","volume":"3","author":"Wang April Yi","year":"2019","unstructured":"April Yi Wang, Anant Mittal, Christopher Brooks, and Steve Oney. 2019 a. How Data Scientists Use Computational Notebooks for Real-Time Collaboration. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--30."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376740"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445526"},{"key":"e_1_2_1_61_1","unstructured":"Dakuo Wang Q. Vera Liao Yunfeng Zhang Udayan Khurana Horst Samulowitz Soya Park Michael Muller and Lisa Amini. 2021 b. How Much Automation Does a Data Scientist Want?. In in submission."},{"key":"e_1_2_1_62_1","volume-title":"Proceedings of the CHI","author":"Wang Dakuo","year":"2021","unstructured":"Dakuo Wang, Liuping Wang, Zhan Zhang, Ding Wang, Haiyi Zhu, Yvonne Gao, Xiangmin Fan, and Feng Tian. 2021 c. Brilliant AI Doctor in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment. In Proceedings of the CHI 2021."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359313"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/IWESEP49350.2019.00017"},{"key":"e_1_2_1_65_1","volume-title":"Preliminary Systematic Literature Review of Machine Learning System Development Process. arXiv preprint arXiv:1910.05528","author":"Watanabe Yasuhiro","year":"2019","unstructured":"Yasuhiro Watanabe, Hironori Washizaki, Kazunori Sakamoto, Daisuke Saito, Kiyoshi Honda, Naohiko Tsuda, Yoshiaki Fukazawa, and Nobukazu Yoshioka. 2019. Preliminary Systematic Literature Review of Machine Learning System Development Process. arXiv preprint arXiv:1910.05528 (2019)."},{"key":"e_1_2_1_66_1","volume-title":"Learning to Complement Humans. arXiv preprint arXiv:2005.00582","author":"Wilder Bryan","year":"2020","unstructured":"Bryan Wilder, Eric Horvitz, and Ece Kamar. 2020. Learning to Complement Humans. arXiv preprint arXiv:2005.00582 (2020)."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/153571.214831"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025496"},{"key":"e_1_2_1_69_1","volume-title":"Same benefits, different communication patterns: Comparing Children's reading with a conversational agent vs. a human partner. Computers & Education","author":"Xu Ying","unstructured":"Ying Xu, Dakuo Wang, Penelope Collins, Hyelim Lee, and Mark Warschauer. [n.d.]. Same benefits, different communication patterns: Comparing Children's reading with a conversational agent vs. a human partner. Computers & Education, Vol. 161 ([n.,d.]), 104059."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300468"},{"key":"e_1_2_1_71_1","volume-title":"Understanding agile software development practices using shared mental models theory. Information and software technology","author":"Yu Xiaodan","year":"2014","unstructured":"Xiaodan Yu and Stacie Petter. 2014. Understanding agile software development practices using shared mental models theory. Information and software technology, Vol. 56, 8 (2014), 911--921."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392826"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449205","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449205","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:21Z","timestamp":1750195701000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449205"}},"subtitle":["A Case Study"],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":72,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2021,4,13]]}},"alternative-id":["10.1145\/3449205"],"URL":"https:\/\/doi.org\/10.1145\/3449205","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,13]]},"assertion":[{"value":"2021-04-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}