{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,21]],"date-time":"2025-06-21T12:10:10Z","timestamp":1750507810130,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":55,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3729176.3729184","type":"proceedings-article","created":{"date-parts":[[2025,6,21]],"date-time":"2025-06-21T11:30:16Z","timestamp":1750505416000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Making the Switch: Towards Intelligent Integration of Gestures As an Input Modality for Microtask Crowdsourcing"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4449-1510","authenticated-orcid":false,"given":"Garrett","family":"Allen","sequence":"first","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6189-6539","authenticated-orcid":false,"given":"Ujwal","family":"Gadiraju","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174076"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1145\/3209542.3209558","volume-title":"Proceedings of the 29th on Hypertext and Social Media","author":"Aipe Alan","year":"2018","unstructured":"Alan Aipe and Ujwal Gadiraju. 2018. Similarhits: Revealing the role of task similarity in microtask crowdsourcing. In Proceedings of the 29th on Hypertext and Social Media. 115\u2013122."},{"key":"e_1_3_3_2_4_2","first-page":"14","volume-title":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing","volume":"10","author":"Allen Garrett","year":"2022","unstructured":"Garrett Allen, Andrea Hu, and Ujwal Gadiraju. 2022. Gesticulate for Health\u2019s Sake! Understanding the Use of Gestures as an Input Modality for Microtask Crowdsourcing. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , Vol.\u00a010. 14\u201326."},{"key":"e_1_3_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3503725"},{"key":"e_1_3_3_2_6_2","first-page":"1","volume-title":"CHI Conference on Human Factors in Computing Systems","author":"Balayn Agathe","year":"2022","unstructured":"Agathe Balayn, Natasa Rikalo, Christoph Lofi, Jie Yang, and Alessandro Bozzon. 2022. How can Explainability Methods be Used to Support Bug Identification in Computer Vision Models?. In CHI Conference on Human Factors in Computing Systems. 1\u201316."},{"key":"e_1_3_3_2_7_2","volume-title":"International Conference on Extending Database Technology (EDBT)","author":"Borromeo Ria\u00a0Mae","year":"2017","unstructured":"Ria\u00a0Mae Borromeo, Thomas Laurent, Motomichi Toyama, and Sihem Amer-Yahia. 2017. Fairness and transparency in crowdsourcing. In International Conference on Extending Database Technology (EDBT)."},{"key":"e_1_3_3_2_8_2","first-page":"3143","volume-title":"Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems","author":"Cai Carrie\u00a0J","year":"2016","unstructured":"Carrie\u00a0J Cai, Shamsi\u00a0T Iqbal, and Jaime Teevan. 2016. Chain reactions: The impact of order on microtask chains. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3143\u20133154."},{"key":"e_1_3_3_2_9_2","unstructured":"Alessandro Carf\u00ec and Fulvio Mastrogiovanni. 2021. Gesture-Based Human-Machine Interaction: Taxonomy Problem Definition and Analysis. IEEE Transactions on Cybernetics (2021)."},{"key":"e_1_3_3_2_10_2","unstructured":"A Chandwani MK Chauhan and A Bhatnagar. 2019. Ergonomics assessment of office desk workers working in corporate offices. IJHSR 9 8 (2019) 367\u2013375."},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"crossref","unstructured":"Chun-Wei Chiang Anna Kasunic and Saiph Savage. 2018. Crowd coach: Peer coaching for crowd workers\u2019 skill growth. Proceedings of the ACM on Human-Computer Interaction 2 CSCW (2018) 1\u201317.","DOI":"10.1145\/3274306"},{"key":"e_1_3_3_2_12_2","doi-asserted-by":"crossref","unstructured":"Florian Daniel Pavel Kucherbaev Cinzia Cappiello Boualem Benatallah and Mohammad Allahbakhsh. 2018. Quality control in crowdsourcing: A survey of quality attributes assessment techniques and assurance actions. ACM Computing Surveys (CSUR) 51 1 (2018) 1\u201340.","DOI":"10.1145\/3148148"},{"key":"e_1_3_3_2_13_2","first-page":"1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems","author":"Groot Esra Cemre\u00a0Su de","year":"2024","unstructured":"Esra Cemre\u00a0Su de Groot and Ujwal Gadiraju. 2024. \"Are we all in the same boat?\" Customizable and Evolving Avatars to Improve Worker Engagement and Foster a Sense of Community in Online Crowd Work. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1\u201326."},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741685"},{"key":"e_1_3_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v9i1.18939"},{"key":"e_1_3_3_2_16_2","unstructured":"Neha Dubey Gaurav Dubey Himanshu Tripathi and ZA Naqvi. 2019. Ergonomics for desk job workers-an overview. Int J Health Sci Res 9 7 (2019) 257\u2013266."},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447535.3462482"},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"crossref","unstructured":"Shaoyang Fan Ujwal Gadiraju Alessandro Checco and Gianluca Demartini. 2020. CrowdCO-OP: Sharing Risks and Rewards in Crowdsourcing. Proceedings of the ACM on Human-Computer Interaction 4 CSCW2 (2020) 1\u201324.","DOI":"10.1145\/3415203"},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Ujwal Gadiraju Besnik Fetahu Ricardo Kawase Patrick Siehndel and Stefan Dietze. 2017. Using worker self-assessments for competence-based pre-selection in crowdsourcing microtasks. ACM Transactions on Computer-Human Interaction (TOCHI) 24 4 (2017) 1\u201326.","DOI":"10.1145\/3119930"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/2631775.2631819"},{"key":"e_1_3_3_2_21_2","volume-title":"Ghost work: how to stop Silicon Valley from building a new global underclass","author":"Gray Mary\u00a0L","year":"2019","unstructured":"Mary\u00a0L Gray and Siddharth Suri. 2019. Ghost work: how to stop Silicon Valley from building a new global underclass. Eamon Dolan Books."},{"key":"e_1_3_3_2_22_2","unstructured":"Lei Han Kevin Roitero Ujwal Gadiraju Cristina Sarasua Alessandro Checco Eddy Maddalena and Gianluca Demartini. 2019. The impact of task abandonment in crowdsourcing. IEEE Transactions on Knowledge and Data Engineering 33 5 (2019) 2266\u20132279."},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1177\/154193120605000909"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"crossref","unstructured":"Mokter Hossain and Ilkka Kauranen. 2015. Crowdsourcing: a comprehensive literature review. Strategic Outsourcing: An International Journal 8 1 (2015) 2\u201322.","DOI":"10.1108\/SO-12-2014-0029"},{"key":"e_1_3_3_2_25_2","unstructured":"Jeff Howe. 2006. The Rise of Crowdsourcing. https:\/\/www.wired.com\/2006\/06\/crowds\/. Accessed: 17-05-2023."},{"key":"e_1_3_3_2_26_2","unstructured":"Albert\u00a0Q Jiang Alexandre Sablayrolles Arthur Mensch Chris Bamford Devendra\u00a0Singh Chaplot Diego de\u00a0las Casas Florian Bressand Gianna Lengyel Guillaume Lample Lucile Saulnier et\u00a0al. 2023. Mistral 7B. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2310.06825 (2023)."},{"key":"e_1_3_3_2_27_2","doi-asserted-by":"crossref","unstructured":"Yuan Jin Mark Carman Ye Zhu and Yong Xiang. 2020. A technical survey on statistical modelling and design methods for crowdsourcing quality control. Artificial Intelligence 287 (2020) 103351.","DOI":"10.1016\/j.artint.2020.103351"},{"key":"e_1_3_3_2_28_2","first-page":"1","volume-title":"CHI Conference on Human Factors in Computing Systems","author":"Jung Ji-Youn","year":"2022","unstructured":"Ji-Youn Jung, Sihang Qiu, Alessandro Bozzon, and Ujwal Gadiraju. 2022. Great Chain of Agents: The Role of Metaphorical Representation of Agents in Conversational Crowdsourcing. In CHI Conference on Human Factors in Computing Systems. 1\u201322."},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"crossref","unstructured":"Kwangtaek Kim Joongrock Kim Jaesung Choi Junghyun Kim and Sangyoun Lee. 2015. Depth camera-based 3D hand gesture controls with immersive tactile feedback for natural mid-air gesture interactions. Sensors 15 1 (2015) 1022\u20131046.","DOI":"10.3390\/s150101022"},{"key":"e_1_3_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441923"},{"key":"e_1_3_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.239"},{"key":"e_1_3_3_2_32_2","first-page":"1","volume-title":"CHI Conference on Human Factors in Computing Systems Extended Abstracts","author":"Lascau Laura","year":"2022","unstructured":"Laura Lascau, Sandy\u00a0JJ Gould, Duncan\u00a0P Brumby, and Anna\u00a0L Cox. 2022. Crowdworkers\u2019 Temporal Flexibility is Being Traded for the Convenience of Requesters Through 19 \u2018Invisible Mechanisms\u2019 Employed by Crowdworking Platforms: A Comparative Analysis Study of Nine Platforms. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1\u20138."},{"key":"e_1_3_3_2_33_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/14219.001.0001","volume-title":"Cloud empires: How digital platforms are overtaking the state and how we can regain control","author":"Lehdonvirta Vili","year":"2022","unstructured":"Vili Lehdonvirta. 2022. Cloud empires: How digital platforms are overtaking the state and how we can regain control. MIT Press."},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"crossref","unstructured":"Q\u00a0Vera Liao Werner Geyer Michael Muller and Yasaman Khazaen. 2020. Conversational interfaces for information search. Understanding and Improving Information Search: A Cognitive Approach (2020) 267\u2013287.","DOI":"10.1007\/978-3-030-38825-6_13"},{"key":"e_1_3_3_2_35_2","volume-title":"First AAAI Conference on Human Computation and Crowdsourcing","author":"Mao Andrew","year":"2013","unstructured":"Andrew Mao, Ece Kamar, and Eric Horvitz. 2013. Why stop now? predicting worker engagement in online crowdsourcing. In First AAAI Conference on Human Computation and Crowdsourcing."},{"key":"e_1_3_3_2_36_2","volume-title":"Ergonomics: Man in his working environment","author":"Murrell K","year":"2012","unstructured":"K Murrell. 2012. Ergonomics: Man in his working environment. Springer Science & Business Media."},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858490"},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1018"},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584039"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"crossref","unstructured":"Heather\u00a0L O\u2019Brien Paul Cairns and Mark Hall. 2018. A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. International Journal of Human-Computer Studies 112 (2018) 28\u201339.","DOI":"10.1016\/j.ijhcs.2018.01.004"},{"key":"e_1_3_3_2_41_2","unstructured":"Tacettin\u00a0Sercan Pekin. 2017. Guidelines and principles for efficient interaction on large touchscreens with collaborative usage. (2017)."},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Worawan Poochada and Sunisa Chaiklieng. 2015. Ergonomic risk assessment among call center workers. Procedia Manufacturing 3 (2015) 4613\u20134620.","DOI":"10.1016\/j.promfg.2015.07.543"},{"key":"e_1_3_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376403"},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"crossref","unstructured":"Francis\u00a0KH Quek. 1995. Eyes in the interface. Image and vision computing 13 6 (1995) 511\u2013525.","DOI":"10.1016\/0262-8856(95)94384-C"},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300512"},{"key":"e_1_3_3_2_46_2","unstructured":"S Sheppard. 2017. Managing Data Quality in Observational Citizen Science. (2017)."},{"key":"e_1_3_3_2_47_2","first-page":"184","volume-title":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing","volume":"10","author":"Singh Aayush","year":"2022","unstructured":"Aayush Singh, Sebastian Wehkamp, and Ujwal Gadiraju. 2022. SignUpCrowd: Using Sign-Language as an Input Modality for Microtask Crowdsourcing. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , Vol.\u00a010. 184\u2013194."},{"key":"e_1_3_3_2_48_2","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/978-3-031-31642-5_9","volume-title":"Torn Many Ways: Politics, Conflict and Emotion in Research","author":"Toxtli Carlos","year":"2023","unstructured":"Carlos Toxtli and Saiph Savage. 2023. Designing AI Tools to Address Power Imbalances in Digital Labor Platforms. In Torn Many Ways: Politics, Conflict and Emotion in Research. Springer, 121\u2013137."},{"key":"e_1_3_3_2_49_2","doi-asserted-by":"crossref","unstructured":"Carlos Toxtli Siddharth Suri and Saiph Savage. 2021. Quantifying the invisible labor in crowd work. Proceedings of the ACM on Human-Computer Interaction 5 CSCW2 (2021) 1\u201326.","DOI":"10.1145\/3476060"},{"key":"e_1_3_3_2_50_2","unstructured":"Jennifer\u00a0Wortman Vaughan. 2018. Making better use of the crowd: How crowdsourcing can advance machine learning research. Journal of Machine Learning Research 18 193 (2018) 1\u201346."},{"key":"e_1_3_3_2_51_2","doi-asserted-by":"crossref","unstructured":"Tijana Vuletic Alex Duffy Laura Hay Chris McTeague Gerard Campbell and Madeleine Grealy. 2019. Systematic literature review of hand gestures used in human computer interaction interfaces. International Journal of Human-Computer Studies 129 (2019) 74\u201394.","DOI":"10.1016\/j.ijhcs.2019.03.011"},{"key":"e_1_3_3_2_52_2","doi-asserted-by":"crossref","unstructured":"Juan\u00a0Pablo Wachs Mathias K\u00f6lsch Helman Stern and Yael Edan. 2011. Vision-based hand-gesture applications. Commun. ACM 54 2 (2011) 60\u201371.","DOI":"10.1145\/1897816.1897838"},{"key":"e_1_3_3_2_53_2","first-page":"197","volume-title":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing","volume":"7","author":"Whiting Mark\u00a0E","year":"2019","unstructured":"Mark\u00a0E Whiting, Grant Hugh, and Michael\u00a0S Bernstein. 2019. Fair work: Crowd work minimum wage with one line of code. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , Vol.\u00a07. 197\u2013206."},{"key":"e_1_3_3_2_54_2","doi-asserted-by":"crossref","unstructured":"Alex\u00a0C Williams Gloria Mark Kristy Milland Edward Lank and Edith Law. 2019. The Perpetual Work Life of Crowdworkers: How Tooling Practices Increase Fragmentation in Crowdwork. Proceedings of the ACM on Human-Computer Interaction 3 CSCW (2019) 1\u201328.","DOI":"10.1145\/3359126"},{"key":"e_1_3_3_2_55_2","unstructured":"Pingmei Xu Krista\u00a0A Ehinger Yinda Zhang Adam Finkelstein Sanjeev\u00a0R Kulkarni and Jianxiong Xiao. 2015. Turkergaze: Crowdsourcing saliency with webcam based eye tracking. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1504.06755 (2015)."},{"key":"e_1_3_3_2_56_2","doi-asserted-by":"crossref","unstructured":"Yuxiang Zhao and Qinghua Zhu. 2014. Evaluation on crowdsourcing research: Current status and future direction. Information systems frontiers 16 (2014) 417\u2013434.","DOI":"10.1007\/s10796-012-9350-4"}],"event":{"name":"CHIWORK '25: Proceedings of the 4th Annual Symposium on Human-Computer Interaction for Work","location":"Amsterdam Netherlands","acronym":"CHIWORK '25"},"container-title":["Proceedings of the 4th Annual Symposium on Human-Computer Interaction for Work"],"original-title":[],"deposited":{"date-parts":[[2025,6,21]],"date-time":"2025-06-21T11:34:38Z","timestamp":1750505678000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3729176.3729184"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":55,"alternative-id":["10.1145\/3729176.3729184","10.1145\/3729176"],"URL":"https:\/\/doi.org\/10.1145\/3729176.3729184","relation":{},"subject":[],"published":{"date-parts":[[2025,6,22]]},"assertion":[{"value":"2025-06-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}