{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T12:55:04Z","timestamp":1763643304545,"version":"3.37.3"},"reference-count":19,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2021,10,27]],"date-time":"2021-10-27T00:00:00Z","timestamp":1635292800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,27]],"date-time":"2021-10-27T00:00:00Z","timestamp":1635292800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012688","name":"Universit\u00e4t Rostock","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012688","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Datenbank Spektrum"],"published-print":{"date-parts":[[2021,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Data engineering is an integral part of any data science and ML process. It consists of several subtasks that are performed to improve data quality and to transform data into a\u00a0target format suitable for analysis. The quality and correctness of the data engineering steps is therefore important to ensure the quality of the overall process.<\/jats:p><jats:p>In machine learning processes requirements such as fairness and explainability are essential. The answers to these must also be provided by the data engineering subtasks. In this article, we will show how these can be achieved by logging, monitoring and controlling the data changes in order to evaluate their correctness. However, since data preprocessing algorithms are part of any machine learning pipeline, they must obviously also guarantee that they do not produce data biases.<\/jats:p><jats:p>In this article we will briefly introduce three classes of methods for measuring data changes in data engineering and present which research questions still remain unanswered in this area.<\/jats:p>","DOI":"10.1007\/s13222-021-00392-w","type":"journal-article","created":{"date-parts":[[2021,10,27]],"date-time":"2021-10-27T07:03:32Z","timestamp":1635318212000},"page":"245-249","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Kurz erkl\u00e4rt: Measuring Data Changes in Data Engineering and their Impact on Explainability and Algorithm Fairness"],"prefix":"10.1007","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0551-8389","authenticated-orcid":false,"given":"Meike","family":"Klettke","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adrian","family":"Lutsch","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Uta","family":"St\u00f6rl","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,10,27]]},"reference":[{"key":"392_CR1","volume-title":"SIGMOD","author":"L Getoor","year":"2019","unstructured":"Getoor L (2019) Responsible data science. In: SIGMOD"},{"issue":"1","key":"392_CR2","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1145\/3422648.3422656","volume":"49","author":"L Getoor","year":"2020","unstructured":"Getoor\u00a0L (2020) Technical perspective: database repair meets algorithmic fairness. SIGMOD Rec 49(1):33. https:\/\/doi.org\/10.1145\/3422648.3422656","journal-title":"SIGMOD Rec"},{"issue":"1","key":"392_CR3","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1145\/3422648.3422657","volume":"49","author":"B Salimi","year":"2020","unstructured":"Salimi B, Howe B, Suciu D (2020) Database repair meets algorithmic fairness. SIGMOD Rec 49(1):34\u201341","journal-title":"SIGMOD Rec"},{"key":"392_CR4","volume-title":"Fairness in machine learning: from definitions to mechanisms","author":"I Valera","year":"2019","unstructured":"Valera I (2019) Fairness in machine learning: from definitions to mechanisms (Keynote LWDA)"},{"key":"392_CR5","volume-title":"PODS","author":"S Venkatasubramanian","year":"2019","unstructured":"Venkatasubramanian S (2019) Algorithmic fairness: measures, methods and representations. In: PODS"},{"key":"392_CR6","volume-title":"Ein Algorithmus hat kein Taktgef\u00fchl: Wo k\u00fcnstliche Intelligenz sich irrt, warum uns das betrifft und was wir dagegen tun k\u00f6nnen","author":"K Zweig","year":"2019","unstructured":"Zweig K (2019) Ein Algorithmus hat kein Taktgef\u00fchl: Wo k\u00fcnstliche Intelligenz sich irrt, warum uns das betrifft und was wir dagegen tun k\u00f6nnen. Heyne, Munich"},{"key":"392_CR7","unstructured":"Schelter S, Stoyanovich J (2020) Taming technical bias in machine learning pipelines. IEEE Data Eng Bull 43:39\u201350. (Special Issue on Interdisciplinary Perspectives on Fairness and Artificial Intelligence Systems)"},{"issue":"12","key":"392_CR8","doi-asserted-by":"publisher","first-page":"3474","DOI":"10.14778\/3415478.3415570","volume":"13","author":"J Stoyanovich","year":"2020","unstructured":"Stoyanovich\u00a0J, Howe\u00a0B, Jagadish\u00a0HV (2020) Responsible data management. Proc VLDB Endow 13(12):3474\u20133488","journal-title":"Proc VLDB Endow"},{"issue":"2","key":"392_CR9","doi-asserted-by":"publisher","first-page":"1487","DOI":"10.1007\/s10462-019-09709-4","volume":"53","author":"WC Lin","year":"2020","unstructured":"Lin\u00a0WC, Tsai\u00a0CF (2020) Missing value imputation: a\u00a0review and analysis of the literature. Artif Intell Rev 53(2):1487\u20131509","journal-title":"Artif Intell Rev"},{"key":"392_CR10","unstructured":"(2019) Benchmark Datasets for Entity Resolution. https:\/\/dbs.uni-leipzig.de\/research\/projects\/object_matching\/benchmark_datasets_for_entity_resolution. Accessed: 7\u00a0Oct 2021"},{"issue":"1\/2","key":"392_CR11","doi-asserted-by":"publisher","first-page":"484","DOI":"10.14778\/1920841.1920904","volume":"3","author":"H K\u00f6pcke","year":"2010","unstructured":"K\u00f6pcke\u00a0H, Thor\u00a0A, Rahm\u00a0E (2010) Evaluation of entity resolution approaches on real-world match problems. Proc VLDB Endow 3(1\/2):484\u2013493","journal-title":"Proc VLDB Endow"},{"key":"392_CR12","doi-asserted-by":"publisher","DOI":"10.2200\/S00262ED1V01Y201003DTM003","author":"F Naumann","year":"2010","unstructured":"Naumann\u00a0F, Herschel\u00a0M (2010) An\u00a0introduction to duplicate detection. Synth Lect Data Manag. https:\/\/doi.org\/10.2200\/S00262ED1V01Y201003DTM003","journal-title":"Synth Lect Data Manag"},{"key":"392_CR13","volume-title":"ADBIS","author":"A Saeedi","year":"2017","unstructured":"Saeedi A, Peukert E, Rahm E (2017) Comparative evaluation of distributed clustering schemes for multi-source entity resolution. In: ADBIS"},{"issue":"4","key":"392_CR14","doi-asserted-by":"publisher","first-page":"891","DOI":"10.1007\/s10618-015-0444-8","volume":"30","author":"GO Campos","year":"2016","unstructured":"Campos GO, Zimek A, Sander J, Campello RJGB, Micenkov\u00e1 B, Schubert E, Assent I, Houle ME (2016) On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study. Data Min Knowl Disc 30(4):891\u2013927","journal-title":"Data Min Knowl Disc"},{"key":"392_CR15","unstructured":"Rayana S (2016) ODDS library. http:\/\/odds.cs.stonybrook.edu. Accessed: 7\u00a0Oct 2021"},{"issue":"13","key":"392_CR16","doi-asserted-by":"publisher","first-page":"1367","DOI":"10.14778\/2733004.2733009","volume":"7","author":"M Poess","year":"2014","unstructured":"Poess\u00a0M, Rabl\u00a0T, Jacobsen\u00a0H, Caufield\u00a0B (2014) TPC-DI: the first industry benchmark for data integration. Proc VLDB Endow 7(13):1367\u20131378","journal-title":"Proc VLDB Endow"},{"issue":"11","key":"392_CR17","doi-asserted-by":"publisher","first-page":"1674","DOI":"10.14778\/2350229.2350279","volume":"5","author":"T Dasu","year":"2012","unstructured":"Dasu T, Loh JM (2012) Statistical distortion: consequences of data cleaning. Proc VLDB Endow 5(11):1674\u20131683","journal-title":"Proc VLDB Endow"},{"key":"392_CR18","volume-title":"Proc. CogMI. IEEE","author":"C Seifert","year":"2019","unstructured":"Seifert C, Scherzinger S, Wiese L (2019) Towards generating consumer labels for machine learning models. In: Proc. CogMI. IEEE"},{"key":"392_CR19","unstructured":"Morik\u00a0K, Kotthaus\u00a0H, Heppe\u00a0L, Heinrich\u00a0D, Fischer\u00a0R, M\u00fccke\u00a0S et al (2021) Yes we care!\u00a0\u2013 Certification for machine learning methods through the Care Label Framework. CoRR. https:\/\/arxiv.org\/abs\/2105.10197"}],"container-title":["Datenbank-Spektrum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13222-021-00392-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13222-021-00392-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13222-021-00392-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,19]],"date-time":"2021-11-19T08:30:44Z","timestamp":1637310644000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s13222-021-00392-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,27]]},"references-count":19,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,11]]}},"alternative-id":["392"],"URL":"https:\/\/doi.org\/10.1007\/s13222-021-00392-w","relation":{},"ISSN":["1618-2162","1610-1995"],"issn-type":[{"type":"print","value":"1618-2162"},{"type":"electronic","value":"1610-1995"}],"subject":[],"published":{"date-parts":[[2021,10,27]]},"assertion":[{"value":"18 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}