{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T17:23:09Z","timestamp":1776100989494,"version":"3.50.1"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2021,10,13]],"date-time":"2021-10-13T00:00:00Z","timestamp":1634083200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,13]]},"abstract":"<jats:p>The future of crowd work has been identified to depend on worker satisfaction, but we lack a thorough understanding of how worker satisfaction can be increased in microtask crowdsourcing. Prior work has shown that one solution is to build tasks that are engaging. To facilitate engagement, two methods that have received attention in recent HCI literature are the use of video games and conversational interfaces. While these are largely different techniques, they aim for the same goal of reducing worker burden and increasing engagement in a task. On one hand, video games have huge motivation potential and translating game design elements for motivational purposes has shown positive effects. Recent work in games research has shown that the use of player avatars is effective in fostering interest, enjoyment, and other aspects pertaining to intrinsic motivation. On the other hand, conversational interfaces have been argued to have advantages over traditional GUIs due to facilitating a more human-like interaction. Conversational microtasking has recently been proposed to improve worker engagement in microtask marketplaces. The contexts of games and crowd work are underlined by the need to motivate and engage participants, yet the potential of using worker avatars to promote self-identification and improve worker satisfaction in microtask crowdsourcing has remained unexplored. Addressing this knowledge gap, we carried out a between-subject study involving 360 crowd workers. We investigated how worker avatars influence quality related outcomes of workers and their perceived experience, in conventional web and novel conversational interfaces. We equipped workers with the functionality of customizing their avatars, and selecting characterizations for their avatars, to understand whether identifying with an avatar can increase the motivation of workers. We found that using worker avatars with conversational interfaces can effectively reduce cognitive workload and increase worker retention. Our results indicate the occurrence of similarity and wishful avatar identification in crowdsourcing. Our findings have important implications in alleviating workers' perceived workload and on the design of crowdsourcing microtasks.<\/jats:p>","DOI":"10.1145\/3476063","type":"journal-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T02:46:19Z","timestamp":1634611579000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Using Worker Avatars to Improve Microtask Crowdsourcing"],"prefix":"10.1145","volume":"5","author":[{"given":"Sihang","family":"Qiu","sequence":"first","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessandro","family":"Bozzon","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Max V.","family":"Birk","sequence":"additional","affiliation":[{"name":"Eindhoven University of Technology, Eindhoven, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ujwal","family":"Gadiraju","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Social robots for education: A review. Science robotics","author":"Belpaeme Tony","year":"2018","unstructured":"Tony Belpaeme, James Kennedy, Aditi Ramachandran, Brian Scassellati, and Fumihide Tanaka. 2018. Social robots for education: A review. Science robotics, Vol. 3, 21 (2018)."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365304"},{"key":"e_1_2_1_3_1","volume-title":"Advances in natural multimodal dialogue systems","author":"Bickmore Timothy","unstructured":"Timothy Bickmore and Justine Cassell. 2005. Social dialongue with embodied conversational agents. In Advances in natural multimodal dialogue systems. Springer, 23--54."},{"key":"e_1_2_1_4_1","volume-title":"Response to a relational agent by hospital patients with depressive symptoms. Interacting with computers","author":"Bickmore Timothy W","year":"2010","unstructured":"Timothy W Bickmore, Suzanne E Mitchell, Brian W Jack, Michael K Paasche-Orlow, Laura M Pfeifer, and Julie O'Donnell. 2010. Response to a relational agent by hospital patients with depressive symptoms. Interacting with computers, Vol. 22, 4 (2010), 289--298."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858062"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.2196\/10133"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2583008.2583011"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3086686"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702145"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature09304"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2658537.2658685"},{"key":"e_1_2_1_12_1","volume-title":"Flow: The psychology of optimal experience.","author":"Csikszentmihalyi Mihaly","year":"1990","unstructured":"Mihaly Csikszentmihalyi and Mihaly Csikzentmihaly. 1990. Flow: The psychology of optimal experience. Vol. 1990. Harper & Row New York."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3148148"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1504\/JDR.2016.079751"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00110"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159661"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741685"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557217"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348400"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-018-9336-y"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3119930"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2631775.2631819"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702443"},{"key":"e_1_2_1_25_1","unstructured":"Ulrich Gnewuch Stefan Morana and Alexander Maedche. 2017. Towards Designing Cooperative and Social Conversational Agents for Customer Service.. In ICIS ."},{"key":"e_1_2_1_26_1","volume-title":"Ghost work: how to stop Silicon Valley from building a new global underclass","author":"Gray Mary L","unstructured":"Mary L Gray and Siddharth Suri. 2019. Ghost work: how to stop Silicon Valley from building a new global underclass .Eamon Dolan Books."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0016997"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2948168"},{"key":"e_1_2_1_29_1","volume-title":"VASSILIS KOSTAKOS, and JORGE GONCALVES.","author":"DANULA","year":"2020","unstructured":"DANULA HETTIACHCHI, NIELS VAN BERKEL, VASSILIS KOSTAKOS, and JORGE GONCALVES. 2020. CrowdCog: A Cognitive Skill based System for Heterogeneous Task Assignment and Recommendation in Crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, Vol. 4 (2020)."},{"key":"e_1_2_1_30_1","volume-title":"Self-discrepancy: a theory relating self and affect. Psychological review","author":"Higgins E Tory","year":"1987","unstructured":"E Tory Higgins. 1987. Self-discrepancy: a theory relating self and affect. Psychological review, Vol. 94, 3 (1987), 319."},{"key":"e_1_2_1_31_1","volume-title":"Moving beyond P values: data analysis with estimation graphics. Nature methods","author":"Ho Joses","year":"2019","unstructured":"Joses Ho, Tayfun Tumkaya, Sameer Aryal, Hyungwon Choi, and Adam Claridge-Chang. 2019. Moving beyond P values: data analysis with estimation graphics. Nature methods, Vol. 16, 7 (2019), 565--566."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/08838159609364360"},{"key":"e_1_2_1_33_1","volume-title":"Young adults' wishful identification with television characters: The role of perceived similarity and character attributes. Media psychology","author":"Hoffner Cynthia","year":"2005","unstructured":"Cynthia Hoffner and Martha Buchanan. 2005. Young adults' wishful identification with television characters: The role of perceived similarity and character attributes. Media psychology, Vol. 7, 4 (2005), 325--351."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173869"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470742"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063860"},{"key":"e_1_2_1_37_1","volume-title":"An analysis of human factors and label accuracy in crowdsourcing relevance judgments. Information retrieval","author":"Kazai Gabriella","year":"2013","unstructured":"Gabriella Kazai, Jaap Kamps, and Natasa Milic-Frayling. 2013. An analysis of human factors and label accuracy in crowdsourcing relevance judgments. Information retrieval, Vol. 16, 2 (2013), 138--178."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300316"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2012.02.021"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441923"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2513383.2517033"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502057"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046878112470539"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392836"},{"key":"e_1_2_1_45_1","volume-title":"Soviet physics doklady","author":"Levenshtein Vladimir I","unstructured":"Vladimir I Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. In Soviet physics doklady, Vol. 10. Soviet Union, 707--710."},{"key":"e_1_2_1_46_1","volume-title":"Understanding and Improving Information Search","author":"Liao Q Vera","unstructured":"Q Vera Liao, Werner Geyer, Michael Muller, and Yasaman Khazaen. 2020. Conversational Interfaces for Information Search. In Understanding and Improving Information Search. Springer, 267--287."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531661"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v1i1.13076"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531663"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470708"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3320435.3320439"},{"key":"e_1_2_1_52_1","volume-title":"Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: A confirmatory factor analysis. Research quarterly for exercise and sport","author":"McAuley Edward","year":"1989","unstructured":"Edward McAuley, Terry Duncan, and Vance V Tammen. 1989. Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: A confirmatory factor analysis. Research quarterly for exercise and sport, Vol. 60, 1 (1989), 48--58."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2011.12.019"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858539"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2017.04.005"},{"key":"e_1_2_1_56_1","unstructured":"Carman Neustaedter and Elena A Fedorovskaya. 2009. Presenting identity in a virtual world through avatar appearances.. In Graphics Interface. 183--190."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376403"},{"key":"e_1_2_1_58_1","volume-title":"International Conference on Web Engineering. Springer, 381--396","author":"Qiu Sihang","year":"2020","unstructured":"Sihang Qiu, Ujwal Gadiraju, and Alessandro Bozzon. 2020 b. Just the Right Mood for HIT!. In International Conference on Web Engineering. Springer, 381--396."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3406865.3418572"},{"key":"e_1_2_1_60_1","volume-title":"Artificial intelligence in behavioral and mental health care","author":"Rizzo Albert","unstructured":"Albert Rizzo, Russell Shilling, Eric Forbell, Stefan Scherer, Jonathan Gratch, and Louis-Philippe Morency. 2016. Autonomous virtual human agents for healthcare information support and clinical interviewing. In Artificial intelligence in behavioral and mental health care. Elsevier, 53--79."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741097"},{"key":"e_1_2_1_62_1","volume-title":"The motivational pull of video games: A self-determination theory approach. Motivation and emotion","author":"Ryan Richard M","year":"2006","unstructured":"Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion, Vol. 30, 4 (2006), 344--360."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753567"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300512"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.1998.11518190"},{"key":"e_1_2_1_66_1","volume-title":"Avatar creation and video game enjoyment. Journal of Media Psychology","author":"Trepte Sabine","year":"2010","unstructured":"Sabine Trepte and Leonard Reinecke. 2010. Avatar creation and video game enjoyment. Journal of Media Psychology (2010)."},{"key":"e_1_2_1_67_1","volume-title":"Enjoyment: At the heart of media entertainment. Communication theory","author":"Vorderer Peter","year":"2004","unstructured":"Peter Vorderer, Christoph Klimmt, and Ute Ritterfeld. 2004. Enjoyment: At the heart of media entertainment. Communication theory, Vol. 14, 4 (2004), 388--408."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292522.3326010"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476063","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3476063","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T05:02:21Z","timestamp":1752469341000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476063"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":68,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2021,10,13]]}},"alternative-id":["10.1145\/3476063"],"URL":"https:\/\/doi.org\/10.1145\/3476063","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,13]]},"assertion":[{"value":"2021-10-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}