{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T18:51:35Z","timestamp":1755802295695,"version":"3.44.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:00:00Z","timestamp":1746144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,5,2]]},"abstract":"<jats:p>In recent years, the availability of easy-to-use prototyping tools has empowered designers to create GUI designs. In parallel, a broad spectrum of usability testing tools have been proposed to support the collection of quantitative test data from crowd-testers. However, test specification and results are typically disconnected from created GUI designs and, therefore, difficult to translate into improvements. In this paper, we present TESY, a prototyping assistant integrating usability test specification and resulting test data. We implement TESY as a plug-in in the prototyping tool Figma. In a controlled lab study, we compare how 34 untrained designers create prototypes, specify usability tests, and improve the prototypes using the collected test data with and without TESY. We contribute by demonstrating how TESY empowers untrained designers to create enhanced GUI designs following a usability test-driven prototyping approach. Specifically, we demonstrate how TESY's capability of tightly integrating test data provided by crowd-testers into the prototyping tool leads to more data-driven and task-focused design improvements.<\/jats:p>","DOI":"10.1145\/3711082","type":"journal-article","created":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T01:35:37Z","timestamp":1746236137000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["TESY: A Usability Test-Driven Prototyping Assistant Connecting Designers with Crowd-Testers"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8115-7592","authenticated-orcid":false,"given":"Felix","family":"Kretzer","sequence":"first","affiliation":[{"name":"human-centered systems lab, Karlsruhe Institute of Technology, Karlsruhe, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6546-4816","authenticated-orcid":false,"given":"Alexander","family":"Maedche","sequence":"additional","affiliation":[{"name":"human-centered systems lab, Karlsruhe Institute of Technology, Karlsruhe, Germany"}]}],"member":"320","published-online":{"date-parts":[[2025,5,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781498710411--35nolinkurl10.1201\/9781498710411--35"},{"key":"e_1_2_1_2_1","first-page":"2","article-title":"Analyzing and Visualizing the Criticality of Issues from Usability Tests","volume":"17","author":"Abrantes Carolina","year":"2022","unstructured":"Carolina Abrantes, \u00d3scar Mealha, Diogo Gomes, Jo\u00e3o Paulo Barraca, and Carlos Viana-Ferreira. 2022. Analyzing and Visualizing the Criticality of Issues from Usability Tests. J. Usability Studies, Vol. 17, 2 (June 2022), 65--84.","journal-title":"J. Usability Studies"},{"key":"e_1_2_1_3_1","unstructured":"Adobe Inc. 2023. Adobe Illustrator. https:\/\/www.adobe.com\/de\/products\/illustrator.html"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059454.3059477"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240838"},{"key":"e_1_2_1_6_1","unstructured":"Balsamiq SRL. 2023. Balsamiq Wireframes. https:\/\/balsamiq.com\/wireframes\/"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2791285nolinkurl10.1145\/2791285"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.18420\/muc2022-mci-ws06--264nolinkurl10.18420\/muc2022-mci-ws06--264"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518948"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208364"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1640233.1640255"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/286498.286736"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376835"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203771587nolinkurl10.4324\/9780203771587"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.7275\/BJ1P-TS64nolinkurl10.7275\/BJ1P-TS64"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126651"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126647"},{"key":"e_1_2_1_18_1","unstructured":"Figma Inc. 2023. Figma. https:\/\/www.figma.com"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300619"},{"key":"e_1_2_1_20_1","unstructured":"Google LLC. 2023. Material Design. https:\/\/m3.material.io\/"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3166.3170nolinkurl10.1145\/3166.3170"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1037\/e577632012-009"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/238386.238511nolinkurl10.1145\/238386.238511"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580994"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3474349.3480224nolinkurl10.1145\/3474349.3480224"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584089"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1897816.1897820nolinkurl10.1145\/1897816.1897820"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357197"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376715"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/279044.279051nolinkurl10.1145\/279044.279051"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544549.3585659"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702565nolinkurl10.1145\/2702123.2702565"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376327nolinkurl10.1145\/3313831.3376327"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274373nolinkurl10.1145\/3274373"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126595nolinkurl10.1145\/3126594.3126595"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1002\/meet.14504901100nolinkurl10.1002\/meet.14504901100"},{"key":"e_1_2_1_37_1","unstructured":"Marvel Prototyping Ltd. 2023. Ballpark. https:\/\/ballparkhq.com\/"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675283nolinkurl10.1145\/2675133.2675283"},{"key":"e_1_2_1_39_1","unstructured":"MAZE.DESIGN LIMITED. 2023. Maze. https:\/\/maze.co"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.2307\/249523"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2494603.2480303nolinkurl10.1145\/2494603.2480303"},{"key":"e_1_2_1_42_1","volume-title":"Usability Engineering","author":"Nielsen Jakob","year":"2029","unstructured":"Jakob Nielsen. 1993. Usability Engineering. In Usability Engineering, Jakob Nielsen (Ed.). Morgan Kaufmann, San Diego, 1--21. https:\/\/www.sciencedirect.com\/science\/article\/pii\/B9780080520292500048"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702149"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394978"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501933"},{"key":"e_1_2_1_46_1","unstructured":"Prolific Academic Ltd. [n. d.]. Prolific. www.prolific.co"},{"volume-title":"The Power of the Crowd: Performing Usability Testing Using an On-Demand Workforce","author":"Schneider Christoph","key":"e_1_2_1_47_1","unstructured":"Christoph Schneider and Terence Cheung. 2013. The Power of the Crowd: Performing Usability Testing Using an On-Demand Workforce. In Information Systems Development, Rob Pooley, Jennifer Coady, Christoph Schneider, Henry Linger, Chris Barry, and Michael Lang (Eds.). Springer New York, New York, NY, 551--560."},{"key":"e_1_2_1_48_1","unstructured":"Studio XID Inc. 2023. ProtoPie. https:\/\/www.protopie.io\/"},{"key":"e_1_2_1_49_1","unstructured":"Useberry User Testing Technologies P.C. 2023. Useberry. https:\/\/www.useberry.com\/"},{"key":"e_1_2_1_50_1","unstructured":"USER TESTING INC. 2023. UserTesting. https:\/\/www.usertesting.com\/"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/503376.503460"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531604"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711082","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3711082","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T09:18:55Z","timestamp":1755767935000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711082"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,2]]},"references-count":52,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,2]]}},"alternative-id":["10.1145\/3711082"],"URL":"https:\/\/doi.org\/10.1145\/3711082","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2025,5,2]]},"assertion":[{"value":"2025-05-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}