{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T10:23:03Z","timestamp":1783592583717,"version":"3.55.0"},"reference-count":84,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Research Council of Finland, Human Automata","award":["328813"],"award-info":[{"award-number":["328813"]}]},{"name":"Research Grants Council of the Hong Kong Special Administrative Region under General Research Fund","award":["16203421"],"award-info":[{"award-number":["16203421"]}]},{"name":"Research Council of Finland, Finnish Center for Artificial Intelligence","award":["328400,345604,341763"],"award-info":[{"award-number":["328400,345604,341763"]}]},{"DOI":"10.13039\/501100006374","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62202509"],"award-info":[{"award-number":["62202509"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,4,17]]},"abstract":"<jats:p>Online design communities, where members exchange free-form views on others' designs, offer a space for beginners to learn visual design. However, the content of these communities is often unorganized for learners, containing many redundancies and irrelevant comments. In this paper, we propose a computational approach for leveraging online design communities to run a conversational agent that assists informal learning of visual elements (e.g., color and space). Our method extracts critiques, suggestions, and rationales on visual elements from comments. We present DesignQuizzer, which asks questions about visual design in UI examples and provides structured comment summaries. Two user studies demonstrate the engagement and usefulness of DesignQuizzer compared with the baseline (reading reddit.com\/r\/UI_design). We also showcase how effectively novices can apply what they learn with DesignQuizzer in a design critique task and a visual design task. We discuss how to use our approach with other communities and offer design considerations for community-powered learning support tools.<\/jats:p>","DOI":"10.1145\/3637321","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T10:05:31Z","timestamp":1714385131000},"page":"1-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["DesignQuizzer: A Community-Powered Conversational Agent for Learning Visual Design"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5700-3136","authenticated-orcid":false,"given":"Zhenhui","family":"Peng","sequence":"first","affiliation":[{"name":"Sun Yat-sen University, Zhuhai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-3892-860X","authenticated-orcid":false,"given":"Qiaoyi","family":"Chen","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Zhuhai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-3830-416X","authenticated-orcid":false,"given":"Zhiyu","family":"Shen","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Zhuhai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9847-7784","authenticated-orcid":false,"given":"Xiaojuan","family":"Ma","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology, Hong Kong, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2498-7837","authenticated-orcid":false,"given":"Antti","family":"Oulasvirta","sequence":"additional","affiliation":[{"name":"Aalto University, Helsinki, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Reddit r\/graphic_design. Accessed","year":"2022","unstructured":"2008. Reddit r\/graphic_design. Accessed in September, 2022 from https:\/\/www.reddit.com\/r\/graphic_design\/."},{"key":"e_1_2_1_2_1","volume-title":"Reddit r\/design_critiques. Accessed","year":"2022","unstructured":"2010. Reddit r\/design_critiques. Accessed in September, 2022 from https:\/\/www.reddit.com\/r\/design_critiques\/."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1341531.1341557"},{"key":"e_1_2_1_4_1","first-page":"113","article-title":"Learning Through Case Comparisons","volume":"48","author":"Alfieri Louis","year":"2013","unstructured":"Louis Alfieri, Timothy J. Nokes-Malach, and Christian D. Schunn. 2013. Learning Through Case Comparisons: A Meta-Analytic Review. Educational Psychologist 48 (2013), 113 -- 87.","journal-title":"A Meta-Analytic Review. Educational Psychologist"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543070002181"},{"key":"e_1_2_1_6_1","volume-title":"Theoretical foundations of learning environments","author":"Barab Sasha A","unstructured":"Sasha A Barab and Thomas Duffy. 2012. From practice fields to communities of practice. In Theoretical foundations of learning environments. Routledge, 29--65."},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Terry Barrett. 1988. A Comparison of The Goals of Studio Professors Conducting Critiques and Art Education Goals for Teaching Criticism.","DOI":"10.2307\/1320648"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819934"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819934"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134666"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2020.1841438"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502124"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555106"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555106"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415250"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415232"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415232"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2014.965823"},{"key":"e_1_2_1_19_1","unstructured":"Jerry Cao Chris Bank. [n. d.]. Web UI Design Best Practices: UI Design From The Experts. Accessed on September 2022 https:\/\/www.uxpin.com\/studio\/ebooks\/web-ui-design-best-practices\/."},{"key":"e_1_2_1_20_1","volume-title":"Share Once or Share Often? Exploring How Designers Approach Iteration in a Large Online Community","author":"Crain Patrick A","unstructured":"Patrick A Crain and Brian P Bailey. 2017. Share Once or Share Often? Exploring How Designers Approach Iteration in a Large Online Community. ACM, New York, NY, USA, 80--92."},{"key":"e_1_2_1_21_1","volume-title":"Flow: The psychology of optimal experience.","author":"Csikzentmihaly Mihaly","year":"1990","unstructured":"Mihaly Csikzentmihaly. 1990. Flow: The psychology of optimal experience. Vol. 1990. Harper & Row, New York, USA."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819984"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173935"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19--1423"},{"key":"e_1_2_1_25_1","volume-title":"Conversational Agents in Language Education: Where They Fit and Their Research Challenges. In International Conference on Human-Computer Interaction. Springer, 272--279","author":"Divekar Rahul R","year":"2021","unstructured":"Rahul R Divekar, Haley Lepp, Pravin Chopade, Aaron Albin, Daniel Brenner, and Vikram Ramanarayanan. 2021. Conversational Agents in Language Education: Where They Fit and Their Research Challenges. In International Conference on Human-Computer Interaction. Springer, 272--279."},{"key":"e_1_2_1_26_1","volume-title":"Accessed in September","year":"2022","unstructured":"doccano. 2022. Text Annotation for Humans. Accessed in September, 2022 from https:\/\/doccano.herokuapp.com\/."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145355"},{"key":"e_1_2_1_28_1","volume-title":"Accessed in September","author":"Face Hugging","year":"2022","unstructured":"Hugging Face. 2022. Sentence Transformers. Accessed in September, 2022 from https:\/\/huggingface.co\/sentence-transformers."},{"key":"e_1_2_1_29_1","volume-title":"Accessed in September","author":"Face Hugging","year":"2022","unstructured":"Hugging Face. 2022. Summarization. Accessed in September, 2022 from https:\/\/huggingface.co\/docs\/transformers\/tasks\/summarization."},{"key":"e_1_2_1_30_1","volume-title":"Accessed in September","author":"Face Hugging","year":"2022","unstructured":"Hugging Face. 2022. Token Classification. Accessed in September, 2022 from https:\/\/huggingface.co\/course\/chapter7\/2?fw=pt."},{"key":"e_1_2_1_31_1","unstructured":"Edmund Burke Feldman. 1994. Practical art criticism. Pearson."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025791"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174182"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3231644.3231653"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274323"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.95.2.393"},{"key":"e_1_2_1_37_1","volume-title":"Accessed in September","year":"2022","unstructured":"Google. 2022. Material Design. Accessed in September, 2022 from https:\/\/material.io\/components."},{"key":"e_1_2_1_38_1","volume-title":"Research Methods: From Theory to Practice -","author":"Gorvine Ben","year":"2017","unstructured":"Ben Gorvine, Karl Rosengren, Lisa Stein, and Kevin Biolsi. 2017. Research Methods: From Theory to Practice - Chapter 14: Analyzing Your Data II: Specific Approaches Inside Research. Oxford University Press. https:\/\/global.oup.com\/us\/companion.websites\/9780190201821\/sr\/outline\/ch14\/"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710882.2018.1563193"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441872"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0166--4115(08)62386--9"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584089"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518717"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598538"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174180"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445325"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609485"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501931"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.21606\/drs.2018.352"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134695"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025883"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134698"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505057"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724670"},{"key":"e_1_2_1_55_1","volume-title":"Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942","author":"Lan Zhenzhong","year":"2019","unstructured":"Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019. Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942 (2019)."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753667"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376590"},{"key":"e_1_2_1_58_1","volume-title":"Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74--81.","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74--81."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555555"},{"key":"e_1_2_1_60_1","volume-title":"ConceptNet-a practical commonsense reasoning tool-kit. BT technology journal 22, 4","author":"Liu Hugo","year":"2004","unstructured":"Hugo Liu and Push Singh. 2004. ConceptNet-a practical commonsense reasoning tool-kit. BT technology journal 22, 4 (2004), 211--226."},{"key":"e_1_2_1_61_1","volume-title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR abs\/1907.11692","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR abs\/1907.11692 (2019). arXiv:1907.11692 http:\/\/arxiv.org\/abs\/1907.11692"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93843-1_21"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jslw.2008.06.002"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675283"},{"key":"e_1_2_1_65_1","unstructured":"Anderson LW Krathwohl DR Airasian PW Cruikshank KA Richard Mayer Pintrich PR J. Raths and Wittrock MC. 2001. A Taxonomy for Learning Teaching and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives. Pearson; 1st edition."},{"key":"e_1_2_1_66_1","volume-title":"On a test of whether one of two random variables is stochastically larger than the other. The annals of mathematical statistics","author":"Mann Henry B","year":"1947","unstructured":"Henry B Mann and Donald R Whitney. 1947. On a test of whether one of two random variables is stochastically larger than the other. The annals of mathematical statistics (1947), 50--60."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531651"},{"key":"e_1_2_1_68_1","volume-title":"Accessed in September","year":"2021","unstructured":"MasterClass. 2021. Elements of Design: Understanding the 7 Elements of Design. Accessed in September, 2022 from https:\/\/www.masterclass.com\/articles\/elements-of-design-explained."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/347642.347758"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173629"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-014-0029--5"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319--27446--1_1"},{"key":"e_1_2_1_73_1","unstructured":"OpenAI. 2023. GPT-4 Technical Report. arXiv:2303.08774 [cs.CL]"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445380"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376695"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300328"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2022.102898"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445446"},{"key":"e_1_2_1_79_1","volume-title":"Accessed in September","year":"2022","unstructured":"Pushshift. 2022. Reddit Statistics - pushshift.io. Accessed in September, 2022 from https:\/\/pushshift.io\/."},{"key":"e_1_2_1_80_1","first-page":"1","article-title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. Journal of Machine Learning Research 21, 140 (2020), 1--67. http:\/\/jmlr.org\/papers\/v21\/20-074.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/1592761.1592779"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300587"},{"key":"e_1_2_1_83_1","volume-title":"a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108","author":"Sanh Victor","year":"2019","unstructured":"Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108 (2019)."},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2011.595621"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637321","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3637321","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:13:58Z","timestamp":1755882838000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637321"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":84,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2024,4,17]]}},"alternative-id":["10.1145\/3637321"],"URL":"https:\/\/doi.org\/10.1145\/3637321","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,17]]},"assertion":[{"value":"2024-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}