{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:39:59Z","timestamp":1776116399265,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":56,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T00:00:00Z","timestamp":1651190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,29]]},"DOI":"10.1145\/3491102.3502121","type":"proceedings-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T16:33:27Z","timestamp":1651163607000},"page":"1-16","source":"Crossref","is-referenced-by-count":54,"title":["Whose AI Dream? In search of the aspiration in data annotation."],"prefix":"10.1145","author":[{"given":"Ding","family":"Wang","sequence":"first","affiliation":[{"name":"Google Research India, India"}]},{"given":"Shantanu","family":"Prabhat","sequence":"additional","affiliation":[{"name":"Google research India, India"}]},{"given":"Nithya","family":"Sambasivan","sequence":"additional","affiliation":[{"name":"Google Research India, India"}]}],"member":"320","published-online":{"date-parts":[[2022,4,29]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.12.1.76.10122"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716652159"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432925"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/anti.12534"},{"key":"e_1_3_2_2_5_1","volume-title":"The ethnographic tradition and design. Design studies 21, 4","author":"Button Graham","year":"2000","unstructured":"Graham Button . 2000. The ethnographic tradition and design. Design studies 21, 4 ( 2000 ), 319\u2013332. Graham Button. 2000. The ethnographic tradition and design. Design studies 21, 4 (2000), 319\u2013332."},{"key":"e_1_3_2_2_6_1","volume-title":"The Production of Order and the Order of Production: Possibilities for Distributed Organisations, Work and Technology in the Print Industry","author":"Button Graham","unstructured":"Graham Button and Wes Sharrock . 1997. The Production of Order and the Order of Production: Possibilities for Distributed Organisations, Work and Technology in the Print Industry . Springer Netherlands , Dordrecht , 1\u201316. https:\/\/doi.org\/10.1007\/978-94-015-7372-6_1 Graham Button and Wes Sharrock. 1997. The Production of Order and the Order of Production: Possibilities for Distributed Organisations, Work and Technology in the Print Industry. Springer Netherlands, Dordrecht, 1\u201316. https:\/\/doi.org\/10.1007\/978-94-015-7372-6_1"},{"key":"e_1_3_2_2_7_1","unstructured":"CAC. 2021. Internet Information Service Algorithm Recommendation Management Regulations\uff08draft open for comment). http:\/\/www.cac.gov.cn\/2021-08\/27\/c_1631652502874117.htm. Accessed on 08\/24\/2021.  CAC. 2021. Internet Information Service Algorithm Recommendation Management Regulations\uff08draft open for comment). http:\/\/www.cac.gov.cn\/2021-08\/27\/c_1631652502874117.htm. Accessed on 08\/24\/2021."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445305"},{"key":"e_1_3_2_2_9_1","unstructured":"Devashish Chakravarty. 2020. Thinking about a career change during the coronavirus pandemic? Here are 8 things to consider - The Economic Times. https:\/\/economictimes.indiatimes.com\/wealth\/earn\/thinking-about-a-career-change-during-the-coronavirus-pandemic-here-are-8-things-to-consider\/articleshow\/75371025.cms. Accessed on 08\/24\/2021.  Devashish Chakravarty. 2020. Thinking about a career change during the coronavirus pandemic? Here are 8 things to consider - The Economic Times. https:\/\/economictimes.indiatimes.com\/wealth\/earn\/thinking-about-a-career-change-during-the-coronavirus-pandemic-here-are-8-things-to-consider\/articleshow\/75371025.cms. Accessed on 08\/24\/2021."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/1527476418796632"},{"key":"e_1_3_2_2_11_1","volume-title":"Doing design ethnography","author":"Crabtree Andrew","unstructured":"Andrew Crabtree , Mark Rouncefield , and Peter Tolmie . 2012. Doing design ethnography . Springer , London . Andrew Crabtree, Mark Rouncefield, and Peter Tolmie. 2012. Doing design ethnography. Springer, London."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-5346-7_1"},{"key":"e_1_3_2_2_13_1","volume-title":"Invisible labor: Hidden work in the contemporary world","author":"Crain Marion","unstructured":"Marion Crain , Winifred Poster , and Miriam Cherry . 2016. Invisible labor: Hidden work in the contemporary world . University of California Press , Oakland, CA . Marion Crain, Winifred Poster, and Miriam Cherry. 2016. Invisible labor: Hidden work in the contemporary world. University of California Press, Oakland, CA."},{"key":"e_1_3_2_2_14_1","volume-title":"The Atlas of AI","author":"Crawford Kate","unstructured":"Kate Crawford . 2021. The Atlas of AI . Yale University Press , Cambridge, MA . Kate Crawford. 2021. The Atlas of AI. Yale University Press, Cambridge, MA."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-021-01301-1"},{"key":"e_1_3_2_2_16_1","unstructured":"Goutam Das. 2020. In a season of layoffs here\u2019s where jobs can be found. https:\/\/www.livemint.com\/news\/india\/in-a-season-of-layoffs-here-s-where-jobs-can-be-found-11592915831636.html. Accessed on 08\/24\/2021.  Goutam Das. 2020. In a season of layoffs here\u2019s where jobs can be found. https:\/\/www.livemint.com\/news\/india\/in-a-season-of-layoffs-here-s-where-jobs-can-be-found-11592915831636.html. Accessed on 08\/24\/2021."},{"key":"e_1_3_2_2_17_1","volume-title":"Made to Work","author":"Pinatti de Carvalho Aparecido","unstructured":"Aparecido Fabiano\u00a0 Pinatti de Carvalho . 2020. Corollary work: The mainstay of mobile knowledge work . In Made to Work . Routledge , London , 30\u201358. Aparecido Fabiano\u00a0Pinatti de Carvalho. 2020. Corollary work: The mainstay of mobile knowledge work. In Made to Work. Routledge, London, 30\u201358."},{"key":"e_1_3_2_2_18_1","volume-title":"the Gig-Economy, and the Law. Comp. Lab. L. & Pol\u2019y J. 37","author":"De\u00a0Stefano Valerio","year":"2015","unstructured":"Valerio De\u00a0Stefano . 2015. Crowdsourcing , the Gig-Economy, and the Law. Comp. Lab. L. & Pol\u2019y J. 37 ( 2015 ), 461. Valerio De\u00a0Stefano. 2015. Crowdsourcing, the Gig-Economy, and the Law. Comp. Lab. L. & Pol\u2019y J. 37 (2015), 461."},{"key":"e_1_3_2_2_19_1","volume-title":"Data feminism","author":"D\u2019ignazio Catherine","unstructured":"Catherine D\u2019ignazio and Lauren\u00a0 F Klein . 2020. Data feminism . MIT press , Cambridge, MA . Catherine D\u2019ignazio and Lauren\u00a0F Klein. 2020. Data feminism. MIT press, Cambridge, MA."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3373157"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124855"},{"key":"e_1_3_2_2_22_1","unstructured":"Vittoria Elliott. 2021. Training self-driving cars for $1 an hour. https:\/\/restofworld.org\/2021\/self-driving-cars-outsourcing\/  Vittoria Elliott. 2021. Training self-driving cars for $1 an hour. https:\/\/restofworld.org\/2021\/self-driving-cars-outsourcing\/"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-019-09360-1"},{"key":"e_1_3_2_2_24_1","first-page":"46","article-title":"The great freelancer movement: Eight reasons why your next job will be a project","volume":"76","author":"Frey Thomas","year":"2013","unstructured":"Thomas Frey . 2013 . The great freelancer movement: Eight reasons why your next job will be a project . Journal of environmental health 76 , 5 (2013), 46 . Thomas Frey. 2013. The great freelancer movement: Eight reasons why your next job will be a project. Journal of environmental health 76, 5 (2013), 46.","journal-title":"Journal of environmental health"},{"key":"e_1_3_2_2_25_1","first-page":"12","article-title":"Datasheets for","volume":"64","author":"Gebru Timnit","year":"2021","unstructured":"Timnit Gebru , Jamie Morgenstern , Briana Vecchione , Jennifer\u00a0Wortman Vaughan , Hanna Wallach , Hal\u00a0Daum\u00e9 III, and Kate Crawford . 2021 . Datasheets for Datasets. Commun. ACM 64 , 12 (nov 2021), 86\u201392. https:\/\/doi.org\/10.1145\/3458723 Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer\u00a0Wortman Vaughan, Hanna Wallach, Hal\u00a0Daum\u00e9 III, and Kate Crawford. 2021. Datasheets for Datasets. Commun. ACM 64, 12 (nov 2021), 86\u201392. https:\/\/doi.org\/10.1145\/3458723","journal-title":"Datasets. Commun. ACM"},{"key":"e_1_3_2_2_26_1","volume-title":"Doing grounded theory: Issues and discussions. Vol.\u00a0254","author":"Glaser G","unstructured":"Barney\u00a0 G Glaser . 1998. Doing grounded theory: Issues and discussions. Vol.\u00a0254 . Sociology Press , Mill Valley, CA . Barney\u00a0G Glaser. 1998. Doing grounded theory: Issues and discussions. Vol.\u00a0254. Sociology Press, Mill Valley, CA."},{"key":"e_1_3_2_2_27_1","volume-title":"Discovery of grounded theory: Strategies for qualitative research","author":"Glaser G","unstructured":"Barney\u00a0 G Glaser and Anselm\u00a0 L Strauss . 2017. Discovery of grounded theory: Strategies for qualitative research . Routledge , London . Barney\u00a0G Glaser and Anselm\u00a0L Strauss. 2017. Discovery of grounded theory: Strategies for qualitative research. Routledge, London."},{"key":"e_1_3_2_2_28_1","volume-title":"Ghost work: How to stop Silicon Valley from building a new global underclass","author":"Gray L","unstructured":"Mary\u00a0 L Gray and Siddharth Suri . 2019. Ghost work: How to stop Silicon Valley from building a new global underclass . Eamon Dolan Books , Boston, MA . Mary\u00a0L Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass. Eamon Dolan Books, Boston, MA."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2660398.2660403"},{"key":"e_1_3_2_2_30_1","unstructured":"Sarah Holland Ahmed Hosny Sarah Newman Joshua Joseph and Kasia Chmielinski. 2018. The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards. arxiv:1805.03677\u00a0[cs.DB]  Sarah Holland Ahmed Hosny Sarah Newman Joshua Joseph and Kasia Chmielinski. 2018. The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards. arxiv:1805.03677\u00a0[cs.DB]"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470742"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372829"},{"key":"e_1_3_2_2_33_1","unstructured":"Sonam Joshi. 2019. How artificial intelligence is creating jobs in India not just stealing them | India News - Times of India. https:\/\/timesofindia.indiatimes.com\/india\/how-artificial-intelligence-is-creating-jobs-in-india-not-just-stealing-them\/articleshow\/71030863.cms. Accessed on 08\/24\/2021.  Sonam Joshi. 2019. How artificial intelligence is creating jobs in India not just stealing them | India News - Times of India. https:\/\/timesofindia.indiatimes.com\/india\/how-artificial-intelligence-is-creating-jobs-in-india-not-just-stealing-them\/articleshow\/71030863.cms. Accessed on 08\/24\/2021."},{"key":"e_1_3_2_2_34_1","unstructured":"Rakesh Kochhar. 2021. India\u2019s middle class shrinks amid COVID-19 as China sees less change | Pew Research Center. https:\/\/www.pewresearch.org\/fact-tank\/2021\/03\/18\/in-the-pandemic-indias-middle-class-shrinks-and-poverty-spreads-while-china-sees-smaller-changes\/?utm_content=buffer1aa7f&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer. Accessed on 09\/06\/2021.  Rakesh Kochhar. 2021. India\u2019s middle class shrinks amid COVID-19 as China sees less change | Pew Research Center. https:\/\/www.pewresearch.org\/fact-tank\/2021\/03\/18\/in-the-pandemic-indias-middle-class-shrinks-and-poverty-spreads-while-china-sees-smaller-changes\/?utm_content=buffer1aa7f&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer. Accessed on 09\/06\/2021."},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2012.676056"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531663"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415186"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445880"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300356"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445402"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958859"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998331"},{"key":"e_1_3_2_2_45_1","volume-title":"Fieldwork for design: theory and practice","author":"Randall David","unstructured":"David Randall , Richard Harper , and Mark Rouncefield . 2007. Fieldwork for design: theory and practice . Springer Science & Business Media , London . David Randall, Richard Harper, and Mark Rouncefield. 2007. Fieldwork for design: theory and practice. Springer Science & Business Media, London."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2820026"},{"key":"e_1_3_2_2_47_1","unstructured":"[\n  47\n  ]  Grand\u00a0View Research.2021. https:\/\/www.grandviewresearch.com\/industry-analysis\/data-annotation-tools-market  [47] Grand\u00a0View Research.2021. https:\/\/www.grandviewresearch.com\/industry-analysis\/data-annotation-tools-market"},{"key":"e_1_3_2_2_48_1","volume-title":"CHI \u201910 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA \u201910)","author":"Ross Joel","unstructured":"Joel Ross , Lilly Irani , M.\u00a0 Six Silberman , Andrew Zaldivar , and Bill Tomlinson . 2010. Who Are the Crowdworkers? Shifting Demographics in Mechanical Turk . In CHI \u201910 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA \u201910) . Association for Computing Machinery , New York, NY, USA , 2863\u20132872. https:\/\/doi.org\/10.1145\/1753846.1753873 Joel Ross, Lilly Irani, M.\u00a0Six Silberman, Andrew Zaldivar, and Bill Tomlinson. 2010. Who Are the Crowdworkers? Shifting Demographics in Mechanical Turk. In CHI \u201910 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA \u201910). Association for Computing Machinery, New York, NY, USA, 2863\u20132872. https:\/\/doi.org\/10.1145\/1753846.1753873"},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445518"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392866"},{"key":"e_1_3_2_2_51_1","unstructured":"[\n  51\n  ]  RONALD SCHMELZER KATHLEEN WALCH and MEGAN YARBROUGH.2021. https:\/\/www.cognilytica.com\/document\/data-preparation-labeling-for-ai-2020\/  [51] RONALD SCHMELZER KATHLEEN WALCH and MEGAN YARBROUGH.2021. https:\/\/www.cognilytica.com\/document\/data-preparation-labeling-for-ai-2020\/"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"crossref","unstructured":"Kjeld Schmidt. 2000. The critical role of workplace studies in CSCW. 141\u2013149\u00a0pages.  Kjeld Schmidt. 2000. The critical role of workplace studies in CSCW. 141\u2013149\u00a0pages.","DOI":"10.1017\/CBO9780511628122.007"},{"key":"e_1_3_2_2_53_1","volume-title":"Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission.Yale Journal of Law & Technology 23","author":"Slaughter Rebecca\u00a0Kelly","year":"2020","unstructured":"Rebecca\u00a0Kelly Slaughter , Janice Kopec , and Mohamad Batal . 2020. Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission.Yale Journal of Law & Technology 23 ( 2020 ), S1\u2013S1. Rebecca\u00a0Kelly Slaughter, Janice Kopec, and Mohamad Batal. 2020. Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission.Yale Journal of Law & Technology 23 (2020), S1\u2013S1."},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/223248.223263"},{"key":"e_1_3_2_2_55_1","unstructured":"Anu Thomas. 2020. Amid Automation Will We See More Data Labelling Jobs In India?https:\/\/analyticsindiamag.com\/will-we-see-more-data-labelling-jobs-in-india\/. Accessed on 08\/24\/2021.  Anu Thomas. 2020. Amid Automation Will We See More Data Labelling Jobs In India?https:\/\/analyticsindiamag.com\/will-we-see-more-data-labelling-jobs-in-india\/. Accessed on 08\/24\/2021."},{"key":"e_1_3_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025811"},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445603"},{"key":"e_1_3_2_2_58_1","unstructured":"Weijia Zhang. 2021. The Status of Chinese Data Annotation Market Needs in 2021 - An industry research report. https:\/\/www.qianzhan.com\/analyst\/detail\/220\/210508-8792d1e4.html. Accessed on 08\/24\/2021.  Weijia Zhang. 2021. The Status of Chinese Data Annotation Market Needs in 2021 - An industry research report. https:\/\/www.qianzhan.com\/analyst\/detail\/220\/210508-8792d1e4.html. Accessed on 08\/24\/2021."}],"event":{"name":"CHI '22: CHI Conference on Human Factors in Computing Systems","location":"New Orleans LA USA","acronym":"CHI '22","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3502121","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491102.3502121","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:22Z","timestamp":1750188682000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3502121"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,29]]},"references-count":56,"alternative-id":["10.1145\/3491102.3502121","10.1145\/3491102"],"URL":"https:\/\/doi.org\/10.1145\/3491102.3502121","relation":{},"subject":[],"published":{"date-parts":[[2022,4,29]]}}}