{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T22:47:55Z","timestamp":1773442075196,"version":"3.50.1"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NSF","award":["IIS-2213842"],"award-info":[{"award-number":["IIS-2213842"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,4,17]]},"abstract":"<jats:p>The widespread consumer-grade 3D printers and learning resources online enable novices to self-train in remote settings. While troubleshooting plays an essential part of 3D printing, the process remains challenging for many remote novices even with the help of well-developed online sources, such as online troubleshooting archives and online community help. We conducted a formative study with 76 active 3D printing users to learn how remote novices leverage online resources in troubleshooting and their challenges. We found that remote novices cannot fully utilize online resources. For example, the online archives statically provide general information, making it hard to search and relate their unique cases with existing descriptions. Online communities can potentially ease their struggles by providing more targeted suggestions, but a helper who can provide custom help is rather scarce, making it hard to obtain timely assistance. We propose 3DPFIX, an interactive 3D troubleshooting system powered by the pipeline to facilitate Human-AI Collaboration, designed to improve novices' 3D printing experiences and thus help them easily accumulate their domain knowledge. We built 3DPFIX that supports automated diagnosis and solution-seeking. 3DPFIX was built upon shared dialogues about failure cases from Q&amp;A discourses accumulated in online communities. We leverage social annotations (i.e., comments) to build an annotated failure image dataset for AI classifiers and extract a solution pool. Our summative study revealed that using 3DPFIX helped participants spend significantly less effort in diagnosing failures and finding a more accurate solution than relying on their common practice. We also found that 3DPFIX users learn about 3D printing domain-specific knowledge. We discuss the implications of leveraging community-driven data in developing future Human-AI Collaboration designs.<\/jats:p>","DOI":"10.1145\/3637288","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T10:05:31Z","timestamp":1714385131000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["3DPFIX: Improving Remote Novices' 3D Printing Troubleshooting through Human-AI Collaboration Design"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2332-0352","authenticated-orcid":false,"given":"Nahyun","family":"Kwon","sequence":"first","affiliation":[{"name":"Texas A&amp;M University, College Station, TX, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7298-0333","authenticated-orcid":false,"given":"Tong Steven","family":"Sun","sequence":"additional","affiliation":[{"name":"George Mason University, Fairfax, VA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8045-2001","authenticated-orcid":false,"given":"Yuyang","family":"Gao","sequence":"additional","affiliation":[{"name":"Home Depot, Atlanta, GA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2648-9989","authenticated-orcid":false,"given":"Liang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Emory University, Atlanta, GA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5551-0815","authenticated-orcid":false,"given":"Xu","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8915-481X","authenticated-orcid":false,"given":"Jeeeun","family":"Kim","sequence":"additional","affiliation":[{"name":"Texas A&amp;M University, College Station, TX, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6050-5404","authenticated-orcid":false,"given":"Sungsoo Ray","family":"Hong","sequence":"additional","affiliation":[{"name":"George Mason University, Fairfax, VA, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2009. Stack Overflow. https:\/\/stackoverflow.com"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957276.2957301"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2015.99"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"e_1_2_1_5_1","volume-title":"MATEC web of conferences","author":"Baumann Felix","unstructured":"Felix Baumann and Dieter Roller. 2016. Vision based error detection for 3D printing processes. In MATEC web of conferences, Vol. 59. EDP Sciences, 06003."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419249.3420068"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858498"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300460"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359164"},{"key":"e_1_2_1_10_1","unstructured":"Shenzhen Creality 3D Technology Co. 2020. Creality 3D Printers Official Discord Server. https:\/\/discord.com\/invite\/Ay3sBqXAG7. Accessed: 2022-01--15."},{"key":"e_1_2_1_11_1","unstructured":"Print Everything Discord Community. 2020. Print Everything Discord Server. https:\/\/discord.com\/invite\/DzZmRms8j7. Accessed: 2022-01--15."},{"key":"e_1_2_1_12_1","volume-title":"Qualitative inquiry and research design: Choosing among five approaches","author":"Creswell John W","unstructured":"John W Creswell and Cheryl N Poth. 2016. Qualitative inquiry and research design: Choosing among five approaches. Sage publications."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.promfg.2018.07.111"},{"key":"e_1_2_1_14_1","volume-title":"FDM 3D printing technology in manufacturing composite elements. Archives of metallurgy and materials","author":"Dudek PFDM","year":"2013","unstructured":"PFDM Dudek. 2013. FDM 3D printing technology in manufacturing composite elements. Archives of metallurgy and materials, Vol. 58, 4 (2013), 1415--1418."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1740-4762.2012.01039.x"},{"key":"e_1_2_1_16_1","unstructured":"Hugging Face. 2016. Hugging Face. https:\/\/huggingface.co\/. Accessed: 2021-09-05."},{"key":"e_1_2_1_17_1","unstructured":"Hugging Face. 2020. Hugging Face Documentation: Pretrained models. https:\/\/huggingface.co\/transformers\/pretrained_models.html. Accessed: 2021-09-06."},{"key":"e_1_2_1_18_1","unstructured":"Flask. 2022. Web development one drop at a time. https:\/\/flask.palletsprojects.com\/en\/2.0.x\/. Accessed: 2022-01--16."},{"key":"e_1_2_1_19_1","unstructured":"3D Printing Space Forum. 2023. https:\/\/3dprintingspace.com\/. Accessed: 2023-07--13."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300619"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01096"},{"key":"e_1_2_1_22_1","volume-title":"Dazhou Yu, and Liang Zhao.","author":"Gao Yuyang","year":"2022","unstructured":"Yuyang Gao, Siyi Gu, Junji Jiang, Sungsoo Ray Hong, Dazhou Yu, and Liang Zhao. 2022a. Going Beyond XAI: A Systematic Survey for Explanation-Guided Learning. arXiv preprint arXiv:2212.03954 (2022)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM51629.2021.00023"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539419"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555590"},{"key":"e_1_2_1_26_1","volume-title":"International Journal of E-Learning & Distance Education\/Revue internationale du e-learning et la formation \u00e0 distance","author":"Gray Betty","year":"2005","unstructured":"Betty Gray. 2005. Informal learning in an online community of practice. International Journal of E-Learning & Distance Education\/Revue internationale du e-learning et la formation \u00e0 distance, Vol. 19, 1 (2005)."},{"key":"e_1_2_1_27_1","volume-title":"Advances in psychology.","author":"Hart Sandra G","unstructured":"Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139--183."},{"key":"e_1_2_1_28_1","unstructured":"Zachary Hay. 2021. Best 3D Printing Temperatures for PLA TPU ABS & More. https:\/\/all3dp.com\/2\/the-best-printing-temperature-for-different-filaments\/"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1807184115"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173640"},{"key":"e_1_2_1_32_1","volume-title":"Irina Smoke, Sangwha Sien, Janet Ng, Mark Zachry, and Juho Kim.","author":"Hong Sungsoo","year":"2019","unstructured":"Sungsoo Hong, Minhyang Suh, Tae Soo Kim, Irina Smoke, Sangwha Sien, Janet Ng, Mark Zachry, and Juho Kim. 2019b. Design for Collaborative Information-Seeking: Understanding User Challenges and Deploying Collaborative Dynamic Queries. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--24."},{"key":"e_1_2_1_33_1","volume-title":"Towards Evaluating Exploratory Model Building Process with AutoML Systems. arXiv preprint arXiv:2009.00449","author":"Hong Sungsoo Ray","year":"2020","unstructured":"Sungsoo Ray Hong, Sonia Castelo, Vito D'Orazio, Christopher Benthune, Aecio Santos, Scott Langevin, David Jonker, Enrico Bertini, and Juliana Freire. 2020a. Towards Evaluating Exploratory Model Building Process with AutoML Systems. arXiv preprint arXiv:2009.00449 (2020)."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392878"},{"key":"e_1_2_1_35_1","volume-title":"CHI 2019 Workshop, Emerging Perspectives in Human-Centered Machine Learning. ACM.","author":"Hong Sungsoo Ray","year":"2019","unstructured":"Sungsoo Ray Hong, Jorge Piazentin Ono, Juliana Freire, and Enrico Bertini. 2019a. Disseminating Machine Learning to domain experts: Understanding challenges and opportunities in supporting a model building process. In CHI 2019 Workshop, Emerging Perspectives in Human-Centered Machine Learning. ACM."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00886"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858266"},{"key":"e_1_2_1_38_1","unstructured":"MakerBot Industries. 2008. Thingiverse. https:\/\/www.thingiverse.com\/. Accessed: 2022-01--15."},{"key":"e_1_2_1_39_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531644"},{"key":"e_1_2_1_41_1","volume-title":"Jinjuan Heidi Feng, and Harry Hochheiser","author":"Lazar Jonathan","year":"2017","unstructured":"Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann."},{"key":"e_1_2_1_42_1","first-page":"519","article-title":"AUC: a statistically consistent and more discriminating measure than accuracy","volume":"3","author":"Ling Charles X","year":"2003","unstructured":"Charles X Ling, Jin Huang, Harry Zhang, et al. 2003. AUC: a statistically consistent and more discriminating measure than accuracy. In Ijcai, Vol. 3. 519--524.","journal-title":"Ijcai"},{"key":"e_1_2_1_43_1","unstructured":"MatterHackers. 2016. 3D Printer Troubleshooting Guide. https:\/\/www.matterhackers.com\/articles\/3d-printer-troubleshooting-guide. Accessed: 2021-08--26."},{"key":"e_1_2_1_44_1","volume-title":"Embedding human knowledge in deep neural network via attention map. arXiv preprint arXiv:1905.03540","author":"Mitsuhara Masahiro","year":"2019","unstructured":"Masahiro Mitsuhara, Hiroshi Fukui, Yusuke Sakashita, Takanori Ogata, Tsubasa Hirakawa, Takayoshi Yamashita, and Hironobu Fujiyoshi. 2019. Embedding human knowledge in deep neural network via attention map. arXiv preprint arXiv:1905.03540, Vol. 5 (2019)."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718987"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753587"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702175"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.3390\/pr8111464"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518795"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/223904.223911"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of international conference on intelligence analysis","volume":"5","author":"Pirolli Peter","year":"2005","unstructured":"Peter Pirolli and Stuart Card. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of international conference on intelligence analysis, Vol. 5. McLean, VA, USA, 2--4."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1002\/isaf.1422"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jengtecman.2015.07.002"},{"key":"e_1_2_1_54_1","unstructured":"RepRap. 2021. Print Troubleshooting Pictorial Guide. https:\/\/reprap.org\/wiki\/Print_Troubleshooting_Pictorial_Guide. Accessed: 2021-08--26."},{"key":"e_1_2_1_55_1","unstructured":"Prusa Research. 2018. Prusa3D Discord Server. https:\/\/discord.com\/invite\/cjk3FuJ. Accessed: 2022-01--15."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169209"},{"key":"e_1_2_1_57_1","volume-title":"The coding manual for qualitative researchers","author":"Johnny Salda","unstructured":"Johnny Salda na. 2015. The coding manual for qualitative researchers. Sage."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328519.3329134"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_2_1_60_1","volume-title":"The craft of information visualization","author":"Shneiderman Ben","unstructured":"Ben Shneiderman. 2003. The eyes have it: A task by data type taxonomy for information visualizations. In The craft of information visualization. Elsevier, 364--371."},{"key":"e_1_2_1_61_1","volume-title":"Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034","author":"Simonyan Karen","year":"2013","unstructured":"Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 (2013)."},{"key":"e_1_2_1_62_1","unstructured":"Simplify3D. 2021. Print Quality Troubleshooting Guide. https:\/\/www.simplify3d.com\/support\/print-quality-troubleshooting\/. Accessed: 2021-08--26."},{"key":"e_1_2_1_63_1","volume-title":"The Ultimate 3D Print Quality Troubleshooting Guide","author":"D SOURCED.","year":"2022","unstructured":"3D SOURCED. 2022. The Ultimate 3D Print Quality Troubleshooting Guide 2022. https:\/\/rigid.ink\/pages\/ultimate-troubleshooting-guide. Accessed: 2021-08--26."},{"key":"e_1_2_1_64_1","unstructured":"3DPrinting Subreddit. 2010. https:\/\/www.reddit.com\/r\/3Dprinting\/. Accessed: 2022-01--15."},{"key":"e_1_2_1_65_1","unstructured":"Ender3 Subreddit. 2018. https:\/\/www.reddit.com\/r\/ender3\/. Accessed: 2022-01--15."},{"key":"e_1_2_1_66_1","unstructured":"FixMyPrint Subreddit. 2014. https:\/\/www.reddit.com\/r\/FixMyPrint\/. Accessed: 2022-01--15."},{"key":"e_1_2_1_67_1","unstructured":"Prusa3D Subreddit. 2016. https:\/\/www.reddit.com\/r\/prusa3d\/. Accessed: 2022-01--15."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610187"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124950"},{"key":"e_1_2_1_70_1","volume-title":"Illuminating the path:[the research and development agenda for visual analytics]","author":"Thomas James J","unstructured":"James J Thomas. 2005. Illuminating the path:[the research and development agenda for visual analytics]. IEEE Computer Society."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598540"},{"key":"e_1_2_1_72_1","unstructured":"Carlota V. 2019. Ai Build implements AI to detect and correct 3D printing errors in real time. https:\/\/www.3dnatives.com\/en\/ai-build-3d-printing-errors-110620195\/ Accessed: 2021-09-06)."},{"key":"e_1_2_1_73_1","unstructured":"Russell Wade Nigel P Garland and Gary Underwood. 2017. Challenges of 3d printing for home users. (2017)."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376807"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502075"},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.","author":"Yan Chuan","year":"2023","unstructured":"Chuan Yan, John Joon Young Chung, Kiheon Yoon, Yotam Gingold, Eytan Adar, and Sungsoo Ray Hong. 2023. FlatMagic: Improving Flat Colorization through AI-driven Design for Digital Comic Professionals. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems."},{"key":"e_1_2_1_78_1","unstructured":"Mark Zastrow. 2020. 3D printing gets bigger faster and stronger. https:\/\/www.nature.com\/articles\/d41586-020-00271--6 Accessed: 2021-01-08."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00688"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637288","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3637288","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:14:05Z","timestamp":1755882845000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637288"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":79,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2024,4,17]]}},"alternative-id":["10.1145\/3637288"],"URL":"https:\/\/doi.org\/10.1145\/3637288","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,17]]},"assertion":[{"value":"2024-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}