{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T06:22:49Z","timestamp":1782282169792,"version":"3.54.5"},"reference-count":45,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2020,7,1]],"date-time":"2020-07-01T00:00:00Z","timestamp":1593561600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CHS-1526155"],"award-info":[{"award-number":["CHS-1526155"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Big Data &amp; Society"],"published-print":{"date-parts":[[2020,7]]},"abstract":"<jats:p>How are data science systems made to work? It may seem that whether a system works is a function of its technical design, but it is also accomplished through ongoing forms of discretionary work by many actors. Based on six months of ethnographic fieldwork with a corporate data science team, we describe how actors involved in a corporate project negotiated what work the system should do, how it should work, and how to assess whether it works. These negotiations laid the foundation for how, why, and to what extent the system ultimately worked. We describe three main findings. First, how already-existing technologies are essential reference points to determine how and whether systems work. Second, how the situated resolution of development challenges continually reshapes the understanding of how and whether systems work. Third, how business goals, and especially their negotiated balance with data science imperatives, affect a system\u2019s working. We conclude with takeaways for critical data studies, orienting researchers to focus on the organizational and cultural aspects of data science, the third-party platforms underlying data science systems, and ways to engage with practitioners\u2019 imagination of how systems can and should work.<\/jats:p>","DOI":"10.1177\/2053951720939605","type":"journal-article","created":{"date-parts":[[2020,7,27]],"date-time":"2020-07-27T13:22:15Z","timestamp":1595856135000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":71,"title":["Making data science systems work"],"prefix":"10.1177","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7921-3820","authenticated-orcid":false,"given":"Samir","family":"Passi","sequence":"first","affiliation":[{"name":"Department of Information Science, Cornell University, Ithaca, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Phoebe","family":"Sengers","sequence":"additional","affiliation":[{"name":"Department of Information Science, Cornell University, Ithaca, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2020,7,27]]},"reference":[{"key":"bibr1-2053951720939605","doi-asserted-by":"crossref","unstructured":"Amershi S, Begel A, Bird C, et\u00a0al. (2019) Software engineering for machine learning: A case study. In:\n                      International conference on Software Engineering (ICSE 2019) \u2013 Software engineering in practice track\n                      , pp.291\u2013300. New York: ACM.","DOI":"10.1109\/ICSE-SEIP.2019.00042"},{"key":"bibr2-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715609066"},{"key":"bibr3-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717718854"},{"key":"bibr4-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718819569"},{"key":"bibr5-2053951720939605","doi-asserted-by":"crossref","unstructured":"Binns R, Kleek M, Van Veale M, et\u00a0al. (2018) \u2018It\u2019s reducing a human being to a percentage\u2019: Perceptions of justice in algorithmic decisions. In:\n                      Proceedings of the 2018 CHI conference on human factors in computing systems (CHI \u201918\n                      ), Montreal, Canada, pp.1\u201314. New York: ACM.","DOI":"10.1145\/3173574.3173951"},{"key":"bibr6-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1515\/9781400827145"},{"key":"bibr7-2053951720939605","first-page":"77","volume-title":"Proceedings of the 1st conference on fairness, accountability and transparency","author":"Buolamwini J","year":"2018"},{"key":"bibr8-2053951720939605","volume-title":"Constructing Grounded Theory (Introducing Qualitative Methods Series)","author":"Charmaz K","year":"2014","edition":"2"},{"key":"bibr9-2053951720939605","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvc77mp9.31"},{"key":"bibr10-2053951720939605","volume-title":"Changing Order: Replication and Induction in Scientific Practice","author":"Collins HM","year":"1985"},{"key":"bibr11-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718784083"},{"key":"bibr12-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719858751"},{"key":"bibr13-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716679677"},{"key":"bibr14-2053951720939605","volume-title":"Studies in Ethnomethodology","author":"Garfinkel H","year":"1967"},{"key":"bibr15-2053951720939605","doi-asserted-by":"publisher","DOI":"10.2307\/2983526"},{"key":"bibr16-2053951720939605","doi-asserted-by":"publisher","DOI":"10.2307\/3178066"},{"key":"bibr17-2053951720939605","first-page":"145","volume-title":"The Gender and Science Reader","author":"Harding S","year":"2001"},{"key":"bibr18-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1086\/392810"},{"key":"bibr19-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/0038038512457276"},{"key":"bibr20-2053951720939605","unstructured":"Lipton ZC, Steinhardt J (2018) Troubling trends in machine learning scholarship. arXiv 1807.03341: 1\u201315."},{"key":"bibr21-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719849444"},{"key":"bibr22-2053951720939605","doi-asserted-by":"crossref","unstructured":"Muller M, Lange I, Wang D, et\u00a0al. (2019) How data science workers work with data: Discovery, capture, curation, design, creation. In:\n                      Proceedings of the 2019 CHI conference on human factors in computing systems\n                      , pp.126:1\u2013126:15. New York: ACM.","DOI":"10.1145\/3290605.3300356"},{"key":"bibr23-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/0162243915598056"},{"key":"bibr24-2053951720939605","doi-asserted-by":"crossref","unstructured":"Paine D, Lee CP (2017) \u201cWho has plots?\u201d: Contextualizing scientific software, practice, and visualizations. In:\n                      Proceedings of the ACM on human-computer interaction\n                      , 1, CSCW, pp. 1\u201321. New York: ACM Press.","DOI":"10.1145\/3134720"},{"key":"bibr25-2053951720939605","doi-asserted-by":"crossref","unstructured":"Passi S, Barocas S (2019) Problem formulation and fairness. In:\n                      Proceedings of the ACM conference on fairness, accountability, and transparency (FAT* \u201919)\n                      , pp.39\u201348. New York: ACM.","DOI":"10.1145\/3287560.3287567"},{"key":"bibr26-2053951720939605","doi-asserted-by":"crossref","unstructured":"Passi S, Jackson SJ (2017) Data vision: Learning to see through algorithmic abstraction. In:\n                      Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing (CSCW \u201917)\n                      , pp.2436\u20132447. New York: ACM Press.","DOI":"10.1145\/2998181.2998331"},{"key":"bibr27-2053951720939605","doi-asserted-by":"crossref","unstructured":"Passi S, Jackson SJ (2018) Trust in data science: Collaboration, translation, and accountability in corporate data science projects. In:\n                      Proceedings of the ACM on human-computer interaction\n                      , 2(CSCW), pp.1\u201328. New York: ACM Press.","DOI":"10.1145\/3274405"},{"key":"bibr28-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-954X.1996.tb00420.x"},{"key":"bibr29-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1093\/icc\/dth073"},{"key":"bibr30-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716649398"},{"key":"bibr31-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-009-9098-7"},{"key":"bibr32-2053951720939605","doi-asserted-by":"crossref","unstructured":"Saltz JS, Grady NW (2017) The ambiguity of data science team roles and the need for a data science workforce framework. In:\n                      2017 IEEE international conference on big data (Big Data)\n                      , Boston, MA, pp.2355\u20132361.","DOI":"10.1109\/BigData.2017.8258190"},{"key":"bibr33-2053951720939605","doi-asserted-by":"crossref","unstructured":"Saltz JS, Shamshurin I (2015) Exploring the process of doing data science via an ethnographic study of a media advertising company. In:\n                      2015 IEEE international conference on big data (Big Data)\n                      , Santa Clara, CA, pp.2098\u20132105.","DOI":"10.1109\/BigData.2015.7363992"},{"key":"bibr34-2053951720939605","doi-asserted-by":"publisher","DOI":"10.2307\/2549460"},{"key":"bibr35-2053951720939605","doi-asserted-by":"crossref","unstructured":"Seaver N (2019) Knowing Algorithms. In Vertesi J & Ribes D (eds)\n                      DigitalSTS: A Field Guide for Science & Technology Studies\n                      . Princeton, NJ: Princeton University Press, pp. 412-422.","DOI":"10.2307\/j.ctvc77mp9.30"},{"key":"bibr36-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715608877"},{"key":"bibr37-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1515\/9781400831005"},{"key":"bibr38-2053951720939605","doi-asserted-by":"crossref","unstructured":"Steinhardt SB and Jackson SJ (2015) Anticipation work: Cultivating vision in collective practice. In:\n                      Proceedings of the 18th ACM conference on computer supported cooperative work & social computing\n                      ,\n                      CSCW \u201915\n                      , pp.443\u2013453. New York: ACM.","DOI":"10.1145\/2675133.2675298"},{"key":"bibr39-2053951720939605","volume-title":"Basics of Qualitative Research: Grounded Theory Techniques and Procedures","author":"Strauss A","year":"1990"},{"key":"bibr40-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1080\/00071310220133287"},{"key":"bibr41-2053951720939605","volume-title":"Plans and Situated Actions: The Problem of Human-Machine Communication","author":"Suchman LA","year":"1987"},{"key":"bibr42-2053951720939605","doi-asserted-by":"publisher","DOI":"10.1177\/00027649921955335"},{"key":"bibr43-2053951720939605","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1515\/9780691190600","volume-title":"DigitalSTS: A Field Guide for Science & Technology Studies","author":"Vertesi J","year":"2019"},{"key":"bibr44-2053951720939605","doi-asserted-by":"crossref","unstructured":"Wolf CT (2019) Conceptualizing care in the everyday work practices of machine learning developers. In:\n                      DIS \u201919 Companion \u2013 Companion publication of the 2019 on designing interactive systems conference 2019 companion\n                      , pp.331\u2013335. New York: ACM.","DOI":"10.1145\/3301019.3323879"},{"key":"bibr45-2053951720939605","first-page":"58","volume-title":"A Sociology of Monsters: Essays on Power, Technology and Domination","author":"Woolgar S","year":"1991"}],"container-title":["Big Data &amp; Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/2053951720939605","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/2053951720939605","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/2053951720939605","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/2053951720939605","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T12:58:02Z","timestamp":1777381082000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/2053951720939605"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7]]},"references-count":45,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,7]]}},"alternative-id":["10.1177\/2053951720939605"],"URL":"https:\/\/doi.org\/10.1177\/2053951720939605","relation":{},"ISSN":["2053-9517","2053-9517"],"issn-type":[{"value":"2053-9517","type":"print"},{"value":"2053-9517","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7]]},"article-number":"2053951720939605"}}