{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T02:48:26Z","timestamp":1772592506371,"version":"3.50.1"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2021,10,13]],"date-time":"2021-10-13T00:00:00Z","timestamp":1634083200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,13]]},"abstract":"<jats:p>Causal knowledge is of interest in many areas, such as statistics and machine learning, as it allows people and algorithms to predict outcomes and make data-driven decisions. Researchers in CSCW have proposed tools and workflows to externalize causal knowledge or beliefs from a group of people; however, most of the generated causal diagrams lack a deeper understanding of the causal mechanisms or could not capture diverse beliefs. By integrating narratives with causal diagrams, we implemented an interactive system that allows users to 1) write narratives to rationalize their perceived causal relationships, 2) visualize their causal models using directed diagrams, and 3) review and utilize others' causal diagrams and narratives. We conducted a user study (N=20) to learn how participants leveraged this integrated approach to externalize their perceived causal models for a given application context. Our results showed that the approach implemented in our tool enabled the externalization of users' causal beliefs (e.g., how and why a causal relationship might occur), allowed blind spots of individuals' causal reasoning to be revealed (e.g., learning new ideas from peers), and inspired their causal reasoning (e.g., revising or adding new causal relationships). We also identified the individual differences in people's causal beliefs and observed the impacts of showing others' causal models when one is building his\/her causal diagram and narratives. This work provides practical design implications for developing collaborative tools that facilitate capturing and sharing causal beliefs.<\/jats:p>","DOI":"10.1145\/3479588","type":"journal-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T02:30:11Z","timestamp":1634610611000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Narratives + Diagrams: An Integrated Approach for Externalizing and Sharing People's Causal Beliefs"],"prefix":"10.1145","volume":"5","author":[{"given":"Chi-Hsien (Eric)","family":"Yen","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haocong","family":"Cheng","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Champaign, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Grace Yu-Chun","family":"Yen","sequence":"additional","affiliation":[{"name":"University of Illinois, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian P.","family":"Bailey","sequence":"additional","affiliation":[{"name":"University of Illinois, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yun","family":"Huang","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Champaign, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Sharing knowledge and expertise: The cscw view of knowledge management. Computer Supported Cooperative Work (CSCW), 22(4--6):531--573","author":"Ackerman Mark S","year":"2013","unstructured":"Mark S Ackerman, Juri Dachtera, Volkmar Pipek, and Volker Wulf. Sharing knowledge and expertise: The cscw view of knowledge management. Computer Supported Cooperative Work (CSCW), 22(4--6):531--573, 2013."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367587"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41893-019-0467-z"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1515\/9781400871957"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1986.6312901"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.4135\/9781412956253"},{"key":"e_1_2_2_7_1","first-page":"1","volume-title":"Proceedings of the Seventh International Conference on Teaching Statistics","author":"Ben-Zvi Dani","year":"2006","unstructured":"Dani Ben-Zvi. Scaffolding students' informal inference and argumentation. In Proceedings of the Seventh International Conference on Teaching Statistics, pages 1--6. International Statistical Institute Voorburg, the Netherlands, 2006."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274293"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415164"},{"key":"e_1_2_2_10_1","volume-title":"Human Computer Interaction Consortium Workshop","author":"Billman Dorrit","year":"2006","unstructured":"Dorrit Billman, Gregorio Convertino, Jeff Shrager, P Pirolli, and J Massar. Collaborative intelligence analysis with cache and its effects on information gathering and cognitive bias. In Human Computer Interaction Consortium Workshop, 2006."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/143457.143536"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.6.4.350"},{"key":"e_1_2_2_13_1","volume-title":"Has covid-19 changed crime? crime rates in the united states during the pandemic. American journal of criminal justice, 45(4):537--545","author":"Boman John H","year":"2020","unstructured":"John H Boman and Owen Gallupe. Has covid-19 changed crime? crime rates in the united states during the pandemic. American journal of criminal justice, 45(4):537--545, 2020."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2012.2195168"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2011.6102447"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2010.5652932"},{"key":"e_1_2_2_17_1","volume-title":"A coefficient of agreement for nominal scales. Educational and psychological measurement, 20(1):37--46","author":"Cohen Jacob","year":"1960","unstructured":"Jacob Cohen. A coefficient of agreement for nominal scales. Educational and psychological measurement, 20(1):37--46, 1960."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.7208\/chicago\/9780226113821.001.0001"},{"key":"e_1_2_2_19_1","volume-title":"The nature of explanation","author":"Williams Craik Kenneth James","year":"1952","unstructured":"Kenneth James Williams Craik. The nature of explanation, volume 445. CUP Archive, 1952."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0191-8869(00)00055-6"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9540.001.0001"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557216"},{"key":"e_1_2_2_23_1","volume-title":"Tis better to construct than to receive? the effects of diagram tools on causal reasoning. Frontiers in artificial intelligence and applications, 158:93","author":"Easterday Matthew W","year":"2007","unstructured":"Matthew W Easterday, Vincent Aleven, and Richard Scheines. Tis better to construct than to receive? the effects of diagram tools on causal reasoning. Frontiers in artificial intelligence and applications, 158:93, 2007."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753502"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11023-006-9035-1"},{"key":"e_1_2_2_26_1","volume-title":"OKLAHOMA UNIV NORMAN DECISION PROCESSES LAB","author":"Gettys Charles F","year":"1980","unstructured":"Charles F Gettys, Carol Manning, Tom Mehle, and Stanley D Fisher. Hypothesis generation: A final report of three years of research. Technical report, OKLAHOMA UNIV NORMAN DECISION PROCESSES LAB, 1980."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.3115\/1119312.1119322"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/2900423.2900610"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2820071"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557229"},{"key":"e_1_2_2_31_1","first-page":"95","volume-title":"Psychology of Learning and Motivation","author":"Hagmayer York","year":"2017","unstructured":"York Hagmayer and Cilia Witteman. Causal knowledge and reasoning in decision making. In Psychology of Learning and Motivation, volume 67, pages 95--134. Elsevier, 2017."},{"key":"e_1_2_2_32_1","first-page":"336","volume-title":"Proceedings of the 31st Pacific Asia Conference on Language, Information and Computation","author":"Hanawa Kazuaki","year":"2017","unstructured":"Kazuaki Hanawa, Akira Sasaki, Naoaki Okazaki, and Kentaro Inui. A crowdsourcing approach for annotating causal relation instances in wikipedia. In Proceedings of the 31st Pacific Asia Conference on Language, Information and Computation, pages 336--345, 2017."},{"key":"e_1_2_2_33_1","volume-title":"Tacit to explicit knowledge conversion: knowledge exchange protocols. Journal of knowledge management, 5(1):107--116","author":"Herschel Richard T","year":"2001","unstructured":"Richard T Herschel, Hamid Nemati, and David Steiger. Tacit to explicit knowledge conversion: knowledge exchange protocols. Journal of knowledge management, 5(1):107--116, 2001."},{"key":"e_1_2_2_34_1","volume-title":"Psychology of intelligence analysis","author":"Heuer Richards J","year":"1999","unstructured":"Richards J Heuer. Psychology of intelligence analysis. Center for the Study of Intelligence, 1999."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMR.2008.4490137"},{"key":"e_1_2_2_36_1","volume-title":"Mental models: Towards a cognitive science of language, inference, and consciousness. Number 6","author":"Johnson-Laird Philip Nicholas","year":"1983","unstructured":"Philip Nicholas Johnson-Laird. Mental models: Towards a cognitive science of language, inference, and consciousness. Number 6. Harvard University Press, 1983."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511498497"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.309.6967.1480"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/21.278993"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0047404500000051"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/0361684310392728"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346573"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449111"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177012242"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753543"},{"issue":"112","key":"e_1_2_2_46_1","first-page":"7","article-title":"Some observations on mental models","volume":"7","author":"Norman Donald A","year":"1983","unstructured":"Donald A Norman. Some observations on mental models. Mental models, 7(112):7--14, 1983.","journal-title":"Mental models"},{"issue":"320","key":"e_1_2_2_47_1","first-page":"98","article-title":"Words or numbers? the evaluation of probability expressions in general practice","volume":"39","author":"O'Brien Bernie J","year":"1989","unstructured":"Bernie J O'Brien. Words or numbers? the evaluation of probability expressions in general practice. The Journal of the Royal College of General Practitioners, 39(320):98--100, 1989.","journal-title":"The Journal of the Royal College of General Practitioners"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1080\/09500690117425"},{"key":"e_1_2_2_49_1","volume-title":"Cambridge university press","author":"Pearl Judea","year":"2009","unstructured":"Judea Pearl. Causality. Cambridge university press, 2009."},{"key":"e_1_2_2_50_1","volume-title":"The book of why: the new science of cause and effect","author":"Pearl Judea","year":"2018","unstructured":"Judea Pearl and Dana Mackenzie. The book of why: the new science of cause and effect. Basic Books, 2018."},{"key":"e_1_2_2_51_1","volume-title":"international conference on natualistic decision making, McLean, VA","author":"Pfaff Mark S","year":"2015","unstructured":"Mark S Pfaff, Jill L Drury, and Garly L Klein. Crowdsourcing mental models using desim (descriptive to executable simulation modeling). In international conference on natualistic decision making, McLean, VA, 2015."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/1541931213601041"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1177\/1541931213601529"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/CTS.2007.4621734"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2605_1"},{"key":"e_1_2_2_56_1","volume-title":"Demystification of cognitive insight: Opportunistic assimilation and the prepared-mind hypothesis","author":"Seifert Colleen M","year":"1994","unstructured":"Colleen M Seifert, David E Meyer, Natalie Davidson, Andrea L Patalano, and Ilan Yaniv. Demystification of cognitive insight: Opportunistic assimilation and the prepared-mind hypothesis. 1994."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2757226.2757230"},{"key":"e_1_2_2_58_1","volume-title":"Columbia Journalism Review","author":"Silverman Craig","year":"2011","unstructured":"Craig Silverman. The backfire effect: More on the press's inability to debunk bad information. Columbia Journalism Review, 2011."},{"key":"e_1_2_2_59_1","volume-title":"A new dawn for citizen science. Trends in ecology & evolution, 24(9):467--471","author":"Silvertown Jonathan","year":"2009","unstructured":"Jonathan Silvertown. A new dawn for citizen science. Trends in ecology & evolution, 24(9):467--471, 2009."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195183115.001.0001"},{"key":"e_1_2_2_61_1","volume-title":"prediction, and search","author":"Spirtes Peter","year":"2000","unstructured":"Peter Spirtes, Clark N Glymour, Richard Scheines, and David Heckerman. Causation, prediction, and search. MIT press, 2000."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1037\/0278-6133.22.1.68"},{"key":"e_1_2_2_63_1","volume-title":"How to grow a mind: Statistics, structure, and abstraction. science, 331(6022):1279--1285","author":"Tenenbaum Joshua B","year":"2011","unstructured":"Joshua B Tenenbaum, Charles Kemp, Thomas L Griffiths, and Noah D Goodman. How to grow a mind: Statistics, structure, and abstraction. science, 331(6022):1279--1285, 2011."},{"key":"e_1_2_2_64_1","volume-title":"A general inductive approach for qualitative data analysis","author":"Thomas David R","year":"2003","unstructured":"David R Thomas. A general inductive approach for qualitative data analysis. 2003."},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.destud.2015.11.001"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0079-7421(08)60558-7"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.121.2.222"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0060"},{"key":"e_1_2_2_69_1","volume-title":"The visual causality analyst: An interactive interface for causal reasoning","author":"Wang Jun","year":"2015","unstructured":"Jun Wang and Klaus Mueller. The visual causality analyst: An interactive interface for causal reasoning. IEEE transactions on visualization and computer graphics, 22(1):230--239, 2015."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207709"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979407"},{"key":"e_1_2_2_72_1","volume-title":"Supporting handoff in asynchronous collaborative sensemaking using knowledge-transfer graphs","author":"Zhao Jian","year":"2017","unstructured":"Jian Zhao, Michael Glueck, Petra Isenberg, Fanny Chevalier, and Azam Khan. Supporting handoff in asynchronous collaborative sensemaking using knowledge-transfer graphs. IEEE transactions on visualization and computer graphics, 24(1):340--350, 2017."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3479588","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3479588","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:54:58Z","timestamp":1752468898000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3479588"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":72,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2021,10,13]]}},"alternative-id":["10.1145\/3479588"],"URL":"https:\/\/doi.org\/10.1145\/3479588","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,13]]},"assertion":[{"value":"2021-10-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}