{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T13:03:01Z","timestamp":1784120581484,"version":"3.55.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T00:00:00Z","timestamp":1681430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2037348; 2037261"],"award-info":[{"award-number":["2037348; 2037261"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,4,14]]},"abstract":"<jats:p>This paper examines the rapid introduction of AI and automation technologies within essential industries amid the COVID-19 pandemic. Drawing on participant observation and interviews within two sites of waste labor in the United States, we consider the substantial effort performed by frontline workers who smooth the relationship between robotics and their social and material environment. Over the course of the research, we found workers engaged in continuous acts of calibration, troubleshooting, and repair required to support AI technologies over time. In interrogating these sites, we develop the concept of \"patchwork\": human labor that occurs in the space between what AI purports to do and what it actually accomplishes. We argue that it is necessary to consider the often-undervalued frontline work that makes up for AI's shortcomings during implementation, particularly as CSCW increasingly turns to discussions of Human-AI collaboration.<\/jats:p>","DOI":"10.1145\/3579514","type":"journal-article","created":{"date-parts":[[2023,4,16]],"date-time":"2023-04-16T17:23:07Z","timestamp":1681665787000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":69,"title":["Patchwork: The Hidden, Human Labor of AI Integration within Essential Work"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7888-2598","authenticated-orcid":false,"given":"Sarah E.","family":"Fox","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6769-8680","authenticated-orcid":false,"given":"Samantha","family":"Shorey","sequence":"additional","affiliation":[{"name":"University of Texas, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7294-484X","authenticated-orcid":false,"given":"Esther Y.","family":"Kang","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5069-2063","authenticated-orcid":false,"given":"Dominique","family":"Montiel Valle","sequence":"additional","affiliation":[{"name":"University of Texas at Austin, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8397-668X","authenticated-orcid":false,"given":"Estefania","family":"Rodriguez","sequence":"additional","affiliation":[{"name":"University of Texas at Austin, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,4,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025974"},{"key":"e_1_2_1_2_1","volume-title":"Global AI Survey","author":"Balakrishnan Tara","year":"2020","unstructured":"Tara Balakrishnan, Michael Chui, Bryce Hall, and Nicolaus Henke. 2020. Global AI Survey 2020. McKinsey & Company. Retrieved January 15, 2022 from http:\/\/ceros.mckinsey.com\/global-ai-survey-2020-a-desktop"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462065"},{"key":"e_1_2_1_4_1","first-page":"82","article-title":"What Constitutes Good ICTD Research","volume":"5","author":"Burrell Jenna","year":"2009","unstructured":"Jenna Burrell and Kentaro Toyama. 2009. What Constitutes Good ICTD Research? Information Technologies & International Development 5, 3: 82--94--94.","journal-title":"Information Technologies & International Development"},{"key":"e_1_2_1_5_1","volume-title":"The New York Times. Retrieved","author":"Casselman Ben","year":"2021","unstructured":"Ben Casselman. 2021. Pandemic Wave of Automation May Be Bad News for Workers. The New York Times. Retrieved January 16, 2022 from https:\/\/www.nytimes.com\/2021\/07\/03\/business\/economy\/automation-workers-robots-pandemic.html"},{"key":"e_1_2_1_6_1","volume-title":"Mitchell","author":"Charmaz Kathy","year":"2001","unstructured":"Kathy Charmaz and Richard G. Mitchell. 2001. Grounded Theory in Ethnography. In Handbook of Ethnography, Paul Atkinson, Amanda Coffey, Sara Delamont, Lyn Lofland, John Lofland and Professor Lyn H. Lofland (eds.). SAGE."},{"key":"e_1_2_1_7_1","volume-title":"Robots Welcome to Take Over, as Pandemic Accelerates Automation. The New York Times. Retrieved","author":"Corkery Michael","year":"2020","unstructured":"Michael Corkery and David Gelles. 2020. Robots Welcome to Take Over, as Pandemic Accelerates Automation. The New York Times. Retrieved June 4, 2020 from https:\/\/www.nytimes.com\/2020\/04\/10\/business\/coronavirus-workplace-automation.html"},{"key":"e_1_2_1_8_1","unstructured":"Cory Doctorow. 2021. When it comes to tech in the workplace we pay too much attention to what the tech does at the expense of a critical analysis of who the tech does it TO and who the tech does it FOR. @doctorow (Twitter). Retrieved January 15 2022 from https:\/\/twitter.com\/doctorow\/status\/1424775958385467401"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--1--4939-0378--8_1"},{"key":"e_1_2_1_10_1","volume-title":"Shaw","author":"Emerson Robert M.","year":"2007","unstructured":"Robert M. Emerson, Rachel I. Fretz, and Linda L. Shaw. 2007. Participant Observation and Fieldnotes. In Handbook of Ethnography, Paul Atkinson, Sara Delamont, Amanda Coffey, John Lofland and Lyn Lofland (eds.). SAGE."},{"key":"e_1_2_1_11_1","volume-title":"Shaw","author":"Emerson Robert M.","year":"2011","unstructured":"Robert M. Emerson, Rachel I. Fretz, and Linda L. Shaw. 2011. Writing Ethnographic Fieldnotes, Second Edition. University of Chicago Press, Chicago."},{"key":"e_1_2_1_12_1","volume-title":"Innofusion or diffusation? the nature of technological development in robotics","author":"Fleck James","unstructured":"James Fleck. 1988. Innofusion or diffusation? the nature of technological development in robotics. Research Centre for Social Sciences, University of Edinburgh, Edinburgh."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/0048--7333(94)90014-0"},{"key":"e_1_2_1_14_1","volume-title":"Strauss","author":"Glaser Barney G.","year":"1967","unstructured":"Barney G. Glaser and Anselm L. Strauss. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine."},{"key":"e_1_2_1_15_1","volume-title":"The New Yorker. Retrieved","author":"Goldsmith Kenneth","year":"2013","unstructured":"Kenneth Goldsmith. 2013. The Artful Accidents of Google Books. The New Yorker. Retrieved February 11, 2021 from https:\/\/www.newyorker.com\/books\/page-turner\/the-artful-accidents-of-google-books"},{"key":"e_1_2_1_16_1","volume-title":"Gray and Siddharth Suri","author":"Mary","year":"2019","unstructured":"Mary L. Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Houghton Mifflin Harcourt, Boston."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858470"},{"key":"e_1_2_1_18_1","volume-title":"Justice for \"Data Janitors.\" Public Books. Retrieved","author":"Irani Lilly","year":"2021","unstructured":"Lilly Irani. 2015. Justice for \"Data Janitors.\" Public Books. Retrieved September 5, 2021 from https:\/\/www.publicbooks.org\/justice-for-data-janitors\/"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3014390"},{"key":"e_1_2_1_20_1","volume-title":"Media Technologies: Essays on Communication, Materiality, and","author":"Jackson Steven J.","year":"2021","unstructured":"Steven J. Jackson. 2014. Rethinking Repair. In Media Technologies: Essays on Communication, Materiality, and Society, Tarleton Gillespie, Pablo J. Boczkowski and Kristen A. Foot (eds.). Retrieved February 11, 2021 from https:\/\/mitpress.universitypressscholarship.com\/view\/10.7551\/mitpress\/9780262525374.001.0001\/upso-9780262525374-chapter-11"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-019-09368--7"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702548"},{"key":"e_1_2_1_23_1","volume-title":"The future of work after COVID-19 | McKinsey. Retrieved","author":"Lund Susan","year":"2021","unstructured":"Susan Lund, Anu Madgavkar, James Manyika, Sven Smit, Kweilin Ellingrud, and Oliva Robinson. 2021. The future of work after COVID-19 | McKinsey. Retrieved March 3, 2021 from https:\/\/www.mckinsey.com\/featured-insights\/future-of-work\/the-future-of-work-after-covid-19#"},{"key":"e_1_2_1_24_1","volume-title":"Data & Society. Retrieved","author":"Mateescu Alexandra","year":"2019","unstructured":"Alexandra Mateescu and Aiha Nguyen. 2019. Workplace Monitoring & Surveillance. Data & Society. Retrieved June 16, 2020 from https:\/\/datasociety.net\/library\/explainer-workplace-monitoring-surveillance\/"},{"key":"e_1_2_1_25_1","volume-title":"Data Brief: Women and Girls of Color in Computing","author":"McAlear F","year":"2018","unstructured":"F McAlear, A Scott, K Scott, and S Weiss. 2018. Data Brief: Women and Girls of Color in Computing. Kapor Center. Retrieved from https:\/\/www.wocincomputing.org\/wp-content\/uploads\/2018\/08\/WOCinComputingDataBrief.pdf"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-044481862--1.50081--9"},{"key":"e_1_2_1_27_1","volume-title":"Talking about Machines: An Ethnography of a Modern Job","author":"Orr Julian E.","unstructured":"Julian E. Orr. 1996. Talking about Machines: An Ethnography of a Modern Job. ILR Press, Ithaca, N.Y."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.17351\/ests2020.497"},{"key":"e_1_2_1_29_1","volume-title":"Harvard Gazette. Retrieved","author":"Powell Alvin","year":"2021","unstructured":"Alvin Powell. 2021. Mark 1, rebooted: \"Progenetrix' computer moves to its new home at Science and Engineering Complex in Allston after a pandemic delay. Harvard Gazette. Retrieved October 25, 2022 from https:\/\/www.seas.harvard.edu\/news\/2021\/07\/mark-1-rebooted"},{"key":"e_1_2_1_30_1","volume-title":"The New York Times. Retrieved","author":"Prevost Lisa","year":"2020","unstructured":"Lisa Prevost. 2020. For Robots, It's a Time to Shine (and Maybe Disinfect). The New York Times. Retrieved January 16, 2022 from https:\/\/www.nytimes.com\/2020\/08\/04\/business\/robot-cleaning-coronavirus.html"},{"key":"e_1_2_1_31_1","volume-title":"Behind the Screen: Content Moderation in the Shadows of Social Media","author":"Roberts Sarah T.","unstructured":"Sarah T. Roberts. 2019. Behind the Screen: Content Moderation in the Shadows of Social Media. Yale University Press, New Haven."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531692"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-011--9146-y"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-013--9193--7"},{"key":"e_1_2_1_35_1","volume-title":"Handbook of Ethnography","author":"Smith Vicki","unstructured":"Vicki Smith. 2001. Ethnographies of Work and the Work of Ethnographers. In Handbook of Ethnography (1st ed.), Paul Atkinson, Sara Delamont, Amanda Coffey, John Lofland and Lyn Lofland (eds.). SAGE, 220--233.","edition":"1"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008651105359"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445092"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1533-8525.1988.tb01249.x"},{"key":"e_1_2_1_39_1","volume-title":"Human-machine reconfigurations: plans and situated actions","author":"Suchman Lucille Alice","unstructured":"Lucille Alice Suchman. 2007. Human-machine reconfigurations: plans and situated actions. Cambridge University Press, Cambridge; New York."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00749282"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/223248.223263"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/00027649921955335"},{"key":"e_1_2_1_43_1","article-title":"The Automation Charade","author":"Taylor Astra","year":"2018","unstructured":"Astra Taylor. 2018. The Automation Charade. Logic Magazine. Retrieved January 16, 2022 from https:\/\/logicmag.io\/failure\/the-automation-charade\/","journal-title":"Logic Magazine. Retrieved"},{"key":"e_1_2_1_44_1","volume-title":"The Atlantic. Retrieved","author":"Thompson Derek","year":"2020","unstructured":"Derek Thompson. 2020. Hygiene Theater Is a Huge Waste of Time. The Atlantic. Retrieved January 16, 2022 from https:\/\/www.theatlantic.com\/ideas\/archive\/2020\/07\/scourge-hygiene-theater\/614599\/"},{"key":"e_1_2_1_45_1","volume-title":"Except Maids and Housekeeping Cleaners","author":"US Bureau of Labor Statistics. 2019. Janitors and Cleaners","year":"2020","unstructured":"US Bureau of Labor Statistics. 2019. Janitors and Cleaners, Except Maids and Housekeeping Cleaners. US Bureau of Labor Statistics. Retrieved June 4, 2020 from https:\/\/www.bls.gov\/oes\/current\/oes372011.htm"},{"key":"e_1_2_1_46_1","volume-title":"Labor Force Characteristics of Foreign-born Workers News Release","author":"US Bureau of Labor Statistics. 2020.","year":"2020","unstructured":"US Bureau of Labor Statistics. 2020. Labor Force Characteristics of Foreign-born Workers News Release. US Bureau of Labor Statistics. Retrieved June 6, 2020 from https:\/\/www.bls.gov\/news.release\/forbrn.htm"},{"key":"e_1_2_1_47_1","volume-title":"Occupational Employment and Wages: Refuse and Recyclable Material Collectors","author":"US Bureau of Labor Statistics.","year":"2022","unstructured":"US Bureau of Labor Statistics. Occupational Employment and Wages: Refuse and Recyclable Material Collectors. US Bureau of Labor Statistics. Retrieved January 16, 2022 from https:\/\/www.bls.gov\/oes\/current\/oes537081.htm"},{"key":"e_1_2_1_48_1","volume-title":"Patching development: information politics and social change in India","author":"Veeraraghavan Rajesh","unstructured":"Rajesh Veeraraghavan. 2022. Patching development: information politics and social change in India. Oxford University Press, New York, NY."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449165"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.6092\/issn.1971--8853"},{"key":"e_1_2_1_51_1","volume-title":"Russell","author":"Vinsel Lee","year":"2020","unstructured":"Lee Vinsel and Andrew L. Russell. 2020. The Innovation Delusion: How Our Obsession with the New Has Disrupted the Work That Matters Most. Crown."},{"key":"e_1_2_1_52_1","volume-title":"Stanford Human Centered Artificial Intelligence. Retrieved","author":"Waikar Sachin","year":"2021","unstructured":"Sachin Waikar. 2021. How Has COVID Affected the AI Economy? Stanford Human Centered Artificial Intelligence. Retrieved January 15, 2022 from https:\/\/hai.stanford.edu\/news\/how-has-covid-affected-ai-economy"},{"key":"e_1_2_1_53_1","volume-title":"The American Prospect. Retrieved","author":"Whittaker Meredith","year":"2021","unstructured":"Meredith Whittaker and Lucy Suchman. 2021. The Myth of Artificial Intelligence. The American Prospect. Retrieved January 15, 2022 from https:\/\/prospect.org\/api\/content\/7fc7f7c2--5781--11ec-987e-12f1225286c6\/"},{"key":"e_1_2_1_54_1","volume-title":"Retrieved","author":"Wilson Andrew Norman","year":"2011","unstructured":"Andrew Norman Wilson. 2011. Workers Leaving the Googleplex. Retrieved January 16, 2022 from https:\/\/www.moma.org\/collection\/works\/401162"},{"key":"e_1_2_1_55_1","article-title":"Collaborative Intelligence: Humans and AI Are Joining Forces","author":"James Wilson H.","year":"2018","unstructured":"H. James Wilson and Paul R. Daugherty. 2018. Collaborative Intelligence: Humans and AI Are Joining Forces. Harvard Business Review. Retrieved June 4, 2020 from https:\/\/hbr.org\/2018\/07\/collaborative-intelligence-humans-and-ai-are-joining-forces","journal-title":"Harvard Business Review. Retrieved"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579514","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579514","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579514","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:24Z","timestamp":1750182684000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579514"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,14]]},"references-count":55,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2023,4,14]]}},"alternative-id":["10.1145\/3579514"],"URL":"https:\/\/doi.org\/10.1145\/3579514","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,14]]},"assertion":[{"value":"2023-04-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}