{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T14:27:05Z","timestamp":1776090425377,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":11,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,9]],"date-time":"2021-06-09T00:00:00Z","timestamp":1623196800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1926250, 1934464, 1922658"],"award-info":[{"award-number":["1926250, 1934464, 1922658"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ahold Delhaize"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,9]]},"DOI":"10.1145\/3448016.3452759","type":"proceedings-article","created":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T17:22:37Z","timestamp":1624036957000},"page":"2736-2739","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["MLINSPECT: A Data Distribution Debugger for Machine Learning Pipelines"],"prefix":"10.1145","author":[{"given":"Stefan","family":"Grafberger","sequence":"first","affiliation":[{"name":"University of Amsterdam, Amsterdam, Netherlands"}]},{"given":"Shubha","family":"Guha","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Amsterdam, Netherlands"}]},{"given":"Julia","family":"Stoyanovich","sequence":"additional","affiliation":[{"name":"New York University, New York City, NY, USA"}]},{"given":"Sebastian","family":"Schelter","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Amsterdam, Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2021,6,18]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"Julia Angwin Jeff Larson Surya Mattu and Lauren Kirchner. 2016. Machine bias. (ProPublica). https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing  Julia Angwin Jeff Larson Surya Mattu and Lauren Kirchner. 2016. Machine bias. (ProPublica). https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing"},{"key":"e_1_3_2_2_2_1","volume-title":"Why Is My Classifier Discriminatory? NeurIPS","author":"Chen Irene","year":"2018","unstructured":"Irene Chen , Fredrik D Johansson , and David Sontag . 2018. Why Is My Classifier Discriminatory? NeurIPS ( 2018 ), 3539--3550. Irene Chen, Fredrik D Johansson, and David Sontag. 2018. Why Is My Classifier Discriminatory? NeurIPS (2018), 3539--3550."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3376898"},{"key":"e_1_3_2_2_4_1","volume-title":"Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines. CIDR","author":"Grafberger Stefan","year":"2021","unstructured":"Stefan Grafberger , Julia Stoyanovich , and Sebastian Schelter . 2021. Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines. CIDR ( 2021 ). Stefan Grafberger, Julia Stoyanovich, and Sebastian Schelter. 2021. Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines. CIDR (2021)."},{"key":"e_1_3_2_2_5_1","unstructured":"Fotis Psallidas Yiwen Zhu Bojan Karlas etal 2019. Data Science through the looking glass and what we found there. arxiv: 1912.09536  Fotis Psallidas Yiwen Zhu Bojan Karlas et al. 2019. Data Science through the looking glass and what we found there. arxiv: 1912.09536"},{"key":"e_1_3_2_2_6_1","volume-title":"Machine Learning Systems workshop at NeurIPS .","author":"Schelter Sebastian","year":"2017","unstructured":"Sebastian Schelter , Joos-Hendrik Boese , Johannes Kirschnick , Thoralf Klein , and Stephan Seufert . 2017 . Automatically tracking metadata and provenance of machine learning experiments . In Machine Learning Systems workshop at NeurIPS . Sebastian Schelter, Joos-Hendrik Boese, Johannes Kirschnick, Thoralf Klein, and Stephan Seufert. 2017. Automatically tracking metadata and provenance of machine learning experiments. In Machine Learning Systems workshop at NeurIPS ."},{"key":"e_1_3_2_2_7_1","volume-title":"FairPrep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing Interventions. EDBT","author":"Schelter Sebastian","year":"2019","unstructured":"Sebastian Schelter , Yuxuan He , Jatin Khilnani , and Julia Stoyanovich . 2019. FairPrep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing Interventions. EDBT ( 2019 ). Sebastian Schelter, Yuxuan He, Jatin Khilnani, and Julia Stoyanovich. 2019. FairPrep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing Interventions. EDBT (2019)."},{"key":"e_1_3_2_2_8_1","volume-title":"Taming Technical Bias in Machine Learning Pipelines","author":"Schelter Sebastian","year":"2020","unstructured":"Sebastian Schelter and Julia Stoyanovich . 2020. Taming Technical Bias in Machine Learning Pipelines . IEEE Data Eng. Bull ., Vol. 43 , 4 ( 2020 ). Sebastian Schelter and Julia Stoyanovich. 2020. Taming Technical Bias in Machine Learning Pipelines. IEEE Data Eng. Bull., Vol. 43, 4 (2020)."},{"key":"e_1_3_2_2_9_1","first-page":"3474","article-title":"Responsible Data Management","volume":"13","author":"Stoyanovich Julia","year":"2020","unstructured":"Julia Stoyanovich , Bill Howe , and H.V. Jagadish . 2020 . Responsible Data Management . VLDB , Vol. 13 , 12 (2020), 3474 -- 3489 . Julia Stoyanovich, Bill Howe, and H.V. Jagadish. 2020. Responsible Data Management. VLDB, Vol. 13, 12 (2020), 3474--3489.","journal-title":"VLDB"},{"key":"e_1_3_2_2_10_1","first-page":"16","article-title":"MODELDB","volume":"41","author":"Vartak Manasi","year":"2018","unstructured":"Manasi Vartak and Samuel Madden . 2018 . MODELDB : Opportunities and Challenges in Managing Machine Learning Models. IEEE Data Eng. , Vol. 41 (2018), 16 -- 25 . Manasi Vartak and Samuel Madden. 2018. MODELDB: Opportunities and Challenges in Managing Machine Learning Models. IEEE Data Eng., Vol. 41 (2018), 16--25.","journal-title":"Opportunities and Challenges in Managing Machine Learning Models. IEEE Data Eng."},{"key":"e_1_3_2_2_11_1","first-page":"39","article-title":"Accelerating the Machine Learning Lifecycle with MLflow","volume":"41","author":"Zaharia Matei","year":"2018","unstructured":"Matei Zaharia , Andrew Chen , Aaron Davidson , Ali Ghodsi , Sue Ann Hong , Andy Konwinski , Siddharth Murching , Tomas Nykodym , Paul Ogilvie , Mani Parkhe , 2018 . Accelerating the Machine Learning Lifecycle with MLflow . IEEE Data Eng. Bull. , Vol. 41 , 4 (2018), 39 -- 45 . Matei Zaharia, Andrew Chen, Aaron Davidson, Ali Ghodsi, Sue Ann Hong, Andy Konwinski, Siddharth Murching, Tomas Nykodym, Paul Ogilvie, Mani Parkhe, et al. 2018. Accelerating the Machine Learning Lifecycle with MLflow. IEEE Data Eng. Bull., Vol. 41, 4 (2018), 39--45.","journal-title":"IEEE Data Eng. Bull."}],"event":{"name":"SIGMOD\/PODS '21: International Conference on Management of Data","location":"Virtual Event China","acronym":"SIGMOD\/PODS '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data"]},"container-title":["Proceedings of the 2021 International Conference on Management of Data"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448016.3452759","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3448016.3452759","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3448016.3452759","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:49:13Z","timestamp":1750193353000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448016.3452759"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,9]]},"references-count":11,"alternative-id":["10.1145\/3448016.3452759","10.1145\/3448016"],"URL":"https:\/\/doi.org\/10.1145\/3448016.3452759","relation":{},"subject":[],"published":{"date-parts":[[2021,6,9]]},"assertion":[{"value":"2021-06-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}