{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:18:53Z","timestamp":1776107933859,"version":"3.50.1"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"7","funder":[{"name":"Guangzhou Basic Research Scheme","award":["#2024A04J4229"],"award-info":[{"award-number":["#2024A04J4229"]}]},{"name":"Guangdong Provincial Key Lab of Integrated Communication, Sensing and Computation for Ubiquitous Internet of Things","award":["#2023B1212010007"],"award-info":[{"award-number":["#2023B1212010007"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,10,18]]},"abstract":"<jats:p>Remote collaborative design has become increasingly popular, but current design tools often overlook the importance of contextual communication during synchronized design activities, which is critical for understanding the rationale and decisions behind design choices. In this paper, we introduce DesignMemo, a proof-of-concept system that integrates the verbal context of remote discussions into visual design history tracking. The system automatically labels the visual elements with an annotation, which is linked to a certain transcript of the meeting, so that the user can easily recall the context of the visual design by clicking the element. The system also integrates an LLM agent for annotation-oriented summarization based on global context tracking, so users can quickly follow the rationale of the design without reading the lengthy transcript. Our user study with 24 participants suggests that the ability to track communication context makes the iterative design process smoother and more efficient.<\/jats:p>","DOI":"10.1145\/3757579","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:32:00Z","timestamp":1760635920000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["DesignMemo: Integrating Discussion Context into Online Collaboration with Enhanced Design Rationale Tracking"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-7265-9236","authenticated-orcid":false,"given":"Boyu","family":"Li","sequence":"first","affiliation":[{"name":"The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9204-5690","authenticated-orcid":false,"given":"Linjie","family":"Qiu","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-4393-5230","authenticated-orcid":false,"given":"Duotun","family":"Wang","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1042-1630","authenticated-orcid":false,"given":"Qianxi","family":"Liu","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3294-9555","authenticated-orcid":false,"given":"Ryo","family":"Suzuki","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0356-4712","authenticated-orcid":false,"given":"Mingming","family":"Fan","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China and The Hong Kong University of Science and Technology, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5374-6330","authenticated-orcid":false,"given":"Zeyu","family":"Wang","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China and The Hong Kong University of Science and Technology, Hong Kong, China"}]}],"member":"320","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"2022. Miro. https:\/\/miro.com\/"},{"key":"e_1_2_2_2_1","unstructured":"2022. Mural. https:\/\/mural.co\/"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/VIS47514.2020.00054"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581424"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445057"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2008.10.005"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1965000"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610196"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610220"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","unstructured":"Nigel Cross. 2001. Chapter 5 - Design Cognition: Results from Protocol and Other Empirical Studies of Design Activity. In Design Knowing and Learning: Cognition in Design Education Charles M. Eastman W. Michael McCracken and Wendy C. Newstetter (Eds.). Elsevier Science Oxford 79-103. https:\/\/doi.org\/10.1016\/B978-008043868-9\/50005-X","DOI":"10.1016\/B978-008043868-9\/50005-X"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318020"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501918"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866054"},{"key":"e_1_2_2_14_1","volume-title":"Helaba: A System to Highlight Design Rationale in Collaborative Design Processes","author":"Lopez Marisela Gutierrez","year":"2015","unstructured":"Marisela Gutierrez Lopez, Mieke Haesen, Kris Luyten, and Karin Coninx. 2015. Helaba: A System to Highlight Design Rationale in Collaborative Design Processes. In Cooperative Design, Visualization, and Engineering, Yuhua Luo (Ed.). Springer International Publishing, Cham, 175-184."},{"key":"e_1_2_2_15_1","volume-title":"Human-Computer Interaction - INTERACT","author":"Lopez Marisela Gutierrez","year":"2017","unstructured":"Marisela Gutierrez Lopez, Gustavo Rovelo, Mieke Haesen, Kris Luyten, and Karin Coninx. 2017. Capturing Design Decision Rationale with Decision Cards. In Human-Computer Interaction - INTERACT 2017, Regina Bernhaupt, Girish Dalvi, Anirudha Joshi, Devanuj K. Balkrishan, Jacki O'Neill, and Marco Winckler (Eds.). Springer International Publishing, Cham, 463-482."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3148330.3148334"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348144.2348153"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1182475.1182511"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41368-023-00239-y"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/503376.503437"},{"key":"e_1_2_2_21_1","volume-title":"Augmented Conversation with Embedded Speech-Driven On-the-Fly Referencing in AR. arXiv preprint arXiv:2405.18537","author":"Jadon Shivesh","year":"2024","unstructured":"Shivesh Jadon, Mehrad Faridan, Edward Mah, Rajan Vaish, Wesley Willett, and Ryo Suzuki. 2024. Augmented Conversation with Embedded Speech-Driven On-the-Fly Referencing in AR. arXiv preprint arXiv:2405.18537 (2024)."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.destud.2005.03.001"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145260"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/503376.503378"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445715"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3654777.3676325"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-006-0457-y"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3677102"},{"key":"e_1_2_2_29_1","unstructured":"Aixin Liu Bei Feng Bing Xue Bingxuan Wang Bochao Wu Chengda Lu Chenggang Zhao Chengqi Deng Chenyu Zhang Chong Ruan et al. 2024. Deepseek-v3 Technical Report. arXiv preprint arXiv:2412.19437 (2024)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312878"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3637398"},{"key":"e_1_2_2_32_1","volume-title":"Voov Meeting. https:\/\/voovmeeting.com\/. Accessed: 2024-07-11","author":"Ltd Tencent Holdings","year":"2018","unstructured":"Tencent Holdings Ltd. 2018. Voov Meeting. https:\/\/voovmeeting.com\/. Accessed: 2024-07-11."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/67450.67497"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518904"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134719"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2009.5"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025825"},{"key":"e_1_2_2_38_1","volume-title":"A survey of design rationale systems: approaches, representation, capture and retrieval. Engineering with computers 16","author":"Regli William C","year":"2000","unstructured":"William C Regli, Xiaochun Hu, Michael Atwood, and Wei Sun. 2000. A survey of design rationale systems: approaches, representation, capture and retrieval. Engineering with computers 16 (2000), 209-235."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348144.2348173"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0142-694X(00)00018-1"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710880701875068"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.destud.2019.02.003"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2816203"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188620"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-022-09438-3"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580742"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555756"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP48485.2024.10447177"},{"key":"e_1_2_2_49_1","volume-title":"2002 AAAI Spring Symposium, Sketch Understanding Workshop","volume":"148","author":"Tversky Barbara","year":"2002","unstructured":"Barbara Tversky. 2002. What Do Sketches Say about Thinking?. In 2002 AAAI Spring Symposium, Sketch Understanding Workshop, Stanford University, AAAI Technical Report SS-02-08, Vol. 148. 151."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2307096.2307099"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3637312"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174056"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300251"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174149"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586183.3606773"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR58804.2024.00093"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274465"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581136"},{"key":"e_1_2_2_59_1","volume-title":"Zoom Video Communications","author":"Inc.","year":"2021","unstructured":"Inc. Zoom Video Communications. 2021. Zoom. https:\/\/zoom.us\/. Accessed: 2024-07-10."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757579","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:33:28Z","timestamp":1760636008000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3757579"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":59,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,10,18]]}},"alternative-id":["10.1145\/3757579"],"URL":"https:\/\/doi.org\/10.1145\/3757579","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,16]]},"assertion":[{"value":"2025-10-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}