{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T10:30:53Z","timestamp":1776940253386,"version":"3.51.4"},"reference-count":211,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,5,5]],"date-time":"2021-05-05T00:00:00Z","timestamp":1620172800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,5]],"date-time":"2021-05-05T00:00:00Z","timestamp":1620172800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["The VLDB Journal"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The increasing use of data-driven decision support systems in industry and governments is accompanied by the discovery of a plethora of bias and unfairness issues in the outputs of these systems. Multiple computer science communities, and especially machine learning, have started to tackle this problem, often developing algorithmic solutions to mitigate biases to obtain fairer outputs. However, one of the core underlying causes for unfairness is bias in training data which is not fully covered by such approaches. Especially, bias in data is not yet a central topic in data engineering and management research. We survey research on bias and unfairness in several computer science domains, distinguishing between data management publications and other domains. This covers the creation of fairness metrics, fairness identification, and mitigation methods, software engineering approaches and biases in crowdsourcing activities. We identify relevant research gaps and show which data management activities could be repurposed to handle biases and which ones might reinforce such biases. In the second part, we argue for a novel data-centered approach overcoming the limitations of current algorithmic-centered methods. This approach focuses on eliciting and enforcing fairness requirements and constraints on data that systems are trained, validated, and used on. We argue for the need to extend database management systems to handle such constraints and mitigation methods. We discuss the associated future research directions regarding algorithms, formalization, modelling, users, and systems.<\/jats:p>","DOI":"10.1007\/s00778-021-00671-8","type":"journal-article","created":{"date-parts":[[2021,5,5]],"date-time":"2021-05-05T03:44:48Z","timestamp":1620186288000},"page":"739-768","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":80,"title":["Managing bias and unfairness in data for decision support: a survey of machine learning and data engineering approaches to identify and mitigate bias and unfairness within data management and analytics systems"],"prefix":"10.1007","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2725-5305","authenticated-orcid":false,"given":"Agathe","family":"Balayn","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christoph","family":"Lofi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Geert-Jan","family":"Houben","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,5,5]]},"reference":[{"issue":"3","key":"671_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3310231","volume":"11","author":"S Abiteboul","year":"2019","unstructured":"Abiteboul, S., Stoyanovich, J.: Transparency, fairness, data protection, neutrality: data management challenges in the face of new regulation. J. Data Inf. Qual. 11(3), 1\u20139 (2019)","journal-title":"J. Data Inf. Qual."},{"key":"671_CR2","unstructured":"Accinelli, C., Minisi, S., Catania, B.: Coverage-based rewriting for data preparation. In: EDBT\/ICDT Workshops (2020)"},{"key":"671_CR3","doi-asserted-by":"publisher","unstructured":"Aggarwal, A., Lohia, P., Nagar, S., Dey, K., Saha, D.: Black box fairness testing of machine learning models. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2019, pp. 625\u2013635. ACM, New York (2019). https:\/\/doi.org\/10.1145\/3338906.3338937","DOI":"10.1145\/3338906.3338937"},{"key":"671_CR4","doi-asserted-by":"crossref","unstructured":"Albarghouthi, A., D\u2019Antoni, L., Drews, S., Nori, A.V.: Fairsquare: probabilistic verification of program fairness. In: Proceedings of the ACM on Programming Languages (OOPSLA), Vol. 1, p. 80 (2017)","DOI":"10.1145\/3133904"},{"key":"671_CR5","doi-asserted-by":"crossref","unstructured":"Amershi, S., Begel, A., Bird, C., DeLine, R., Gall, H., Kamar, E., Nagappan, N., Nushi, B., Zimmermann, T.: Software engineering for machine learning: a case study. In: 2019 IEEE\/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), pp. 291\u2013300. IEEE (2019)","DOI":"10.1109\/ICSE-SEIP.2019.00042"},{"key":"671_CR6","doi-asserted-by":"crossref","unstructured":"Amini, A., Soleimany, A., Schwarting, W., Bhatia, S., Rus, D.: Uncovering and Mitigating Algorithmic Bias Through Learned Latent Structure (2019)","DOI":"10.1145\/3306618.3314243"},{"key":"671_CR7","doi-asserted-by":"publisher","unstructured":"Angell, R., Johnson, B., Brun, Y., Meliou, A.: Themis: automatically testing software for discrimination. In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2018, pp. 871\u2013875. ACM, New York (2018). https:\/\/doi.org\/10.1145\/3236024.3264590","DOI":"10.1145\/3236024.3264590"},{"issue":"12","key":"671_CR8","doi-asserted-by":"publisher","first-page":"3445","DOI":"10.14778\/3415478.3415566","volume":"13","author":"A Asudeh","year":"2020","unstructured":"Asudeh, A., Jagadish, H.: Fairly evaluating and scoring items in a data set. Proc. VLDB Endow. 13(12), 3445\u20133448 (2020)","journal-title":"Proc. VLDB Endow."},{"key":"671_CR9","first-page":"76","volume":"6","author":"A Asudeh","year":"2019","unstructured":"Asudeh, A., Jagadish, H., Stoyanovich, J.: Towards responsible data-driven decision making in score-based systems. Data Eng. 6, 76 (2019)","journal-title":"Data Eng."},{"issue":"3","key":"671_CR10","doi-asserted-by":"publisher","first-page":"237","DOI":"10.14778\/3291264.3291269","volume":"12","author":"A Asudeh","year":"2018","unstructured":"Asudeh, A., Jagadish, H.V., Miklau, G., Stoyanovich, J.: On obtaining stable rankings. Proc. VLDB Endow. 12(3), 237\u2013250 (2018). https:\/\/doi.org\/10.14778\/3291264.3291269","journal-title":"Proc. VLDB Endow."},{"key":"671_CR11","doi-asserted-by":"publisher","unstructured":"Asudeh, A., Jagadish, H.V., Stoyanovich, J., Das, G.: Designing fair ranking schemes. In: Proceedings of the 2019 International Conference on Management of Data, SIGMOD\u201919, pp. 1259\u20131276. ACM, New York (2019). https:\/\/doi.org\/10.1145\/3299869.3300079","DOI":"10.1145\/3299869.3300079"},{"key":"671_CR12","doi-asserted-by":"crossref","unstructured":"Asudeh, A., Jin, Z., Jagadish, H.: Assessing and remedying coverage for a given dataset. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp. 554\u2013565. IEEE (2019)","DOI":"10.1109\/ICDE.2019.00056"},{"key":"671_CR13","doi-asserted-by":"publisher","unstructured":"Aydemir, F.B., Dalpiaz, F.: A roadmap for ethics-aware software engineering. In: Proceedings of the International Workshop on Software Fairness, FairWare@ICSE 2018, Gothenburg, Sweden, May 29, 2018, pp. 15\u201321 (2018). https:\/\/doi.org\/10.1145\/3194770.3194778","DOI":"10.1145\/3194770.3194778"},{"key":"671_CR14","doi-asserted-by":"crossref","unstructured":"Abadi, D., Ailamaki, A., Andersen, D., Bailis, P., Balazinska, M., Bernstein, P., Boncz, P., Chaudhuri, S., Cheung, A., Doan, A., Dong, L., Franklin, M.J., Freire, J., Halevy, A., Hellerstein, J.M., Idreos, S., Kossmann, D., Kraska, T., Krishnamurthy, S., Markl, V., Melnik, S., Milo, T., Mohan, C.., Neumann, T., Ooi, B.C., Ozcan, F., Patel, J., Pavlo, A., Popa, R., Ramakrishnan, R., R\u00e9, C., Stonebraker, M., Suciu, D.: The Seattle Report on Database Research (2020). https:\/\/sigmodrecord.org\/2020\/02\/12\/the-seattle-report-on-database-research\/ (2020)","DOI":"10.1145\/3385658.3385668"},{"key":"671_CR15","unstructured":"Balayn, A., Mavridis, P., Bozzon, A., Timmermans, B., Szl\u00e1vik, Z.: Characterising and mitigating aggregation-bias in crowdsourced toxicity annotations (short paper). In: Proceedings of the 1st Workshop on Subjectivity, Ambiguity and Disagreement in Crowdsourcing, and Short Paper Proceedings of the 1st Workshop on Disentangling the Relation Between Crowdsourcing and Bias Management (SAD 2018 and CrowdBias 2018) co-located the 6th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2018), Z\u00fcrich, Switzerland, July 5, 2018, pp. 67\u201371 (2018). http:\/\/ceur-ws.org\/Vol-2276\/paper7.pdf"},{"key":"671_CR16","unstructured":"Barabas, C., Virza, M., Dinakar, K., Ito, J., Zittrain, J.: Interventions over predictions: reframing the ethical debate for actuarial risk assessment. In: Friedler, S.A., Wilson, C. (Eds.) Proceedings of the 1st Conference on Fairness, Accountability and Transparency, Proceedings of Machine Learning Research, vol.\u00a081, pp. 62\u201376. PMLR, New York (2018). http:\/\/proceedings.mlr.press\/v81\/barabas18a.html"},{"key":"671_CR17","doi-asserted-by":"publisher","unstructured":"Barbosa, N.A.M., Chen, M.: Rehumanized crowdsourcing: a labeling framework addressing bias and ethics in machine learning. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI\u201919, pp. 543:1\u2013543:12. ACM, New York (2019). https:\/\/doi.org\/10.1145\/3290605.3300773","DOI":"10.1145\/3290605.3300773"},{"key":"671_CR18","doi-asserted-by":"publisher","unstructured":"Barlas, P., Kleanthous, S., Kyriakou, K., Otterbacher, J.: What makes an image tagger fair? In: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization, UMAP\u201919, pp. 95\u2013103. ACM, New York (2019). https:\/\/doi.org\/10.1145\/3320435.3320442","DOI":"10.1145\/3320435.3320442"},{"key":"671_CR19","unstructured":"Barocas, S., Hardt, M., Narayanan, A.: Fairness in machine learning. NIPS Tutorial (2017)"},{"issue":"4\/5","key":"671_CR20","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1147\/JRD.2019.2942287","volume":"63","author":"RK Bellamy","year":"2019","unstructured":"Bellamy, R.K., Dey, K., Hind, M., Hoffman, S.C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovi\u0107, A., et al.: Ai fairness 360: an extensible toolkit for detecting and mitigating algorithmic bias. IBM J. Res. Dev. 63(4\/5), 4\u201311 (2019)","journal-title":"IBM J. Res. Dev."},{"key":"671_CR21","first-page":"64","volume":"6","author":"N Benabbou","year":"2019","unstructured":"Benabbou, N., Chakraborty, M., Zick, Y.: Fairness and diversity in public resource allocation problems. Data Eng. 6, 64 (2019)","journal-title":"Data Eng."},{"key":"671_CR22","doi-asserted-by":"publisher","unstructured":"Benthall, S., Haynes, B.D.: Racial categories in machine learning. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*\u201919, pp. 289\u2013298. ACM, New York (2019). https:\/\/doi.org\/10.1145\/3287560.3287575","DOI":"10.1145\/3287560.3287575"},{"key":"671_CR23","doi-asserted-by":"publisher","unstructured":"Beutel, A., Chen, J., Doshi, T., Qian, H., Wei, L., Wu, Y., Heldt, L., Zhao, Z., Hong, L., Chi, E.H., Goodrow, C.: Fairness in recommendation ranking through pairwise comparisons. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4\u20138, 2019, pp. 2212\u20132220 (2019). https:\/\/doi.org\/10.1145\/3292500.3330745","DOI":"10.1145\/3292500.3330745"},{"key":"671_CR24","unstructured":"Binns, R.: Fairness in machine learning: Lessons from political philosophy. In: Friedler, S.A., Wilson, C. (Eds.) Proceedings of the 1st Conference on Fairness, Accountability and Transparency, Proceedings of Machine Learning Research, vol.\u00a081, pp. 149\u2013159. PMLR, New York (2018). http:\/\/proceedings.mlr.press\/v81\/binns18a.html"},{"key":"671_CR25","doi-asserted-by":"publisher","unstructured":"Bird, C., Bachmann, A., Aune, E., Duffy, J., Bernstein, A., Filkov, V., Devanbu, P.: Fair and balanced? Bias in bug-fix datasets. In: Proceedings of the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, ESEC\/FSE\u201909, pp. 121\u2013130. ACM, New York (2009). https:\/\/doi.org\/10.1145\/1595696.1595716","DOI":"10.1145\/1595696.1595716"},{"key":"671_CR26","doi-asserted-by":"publisher","unstructured":"Borromeo, R.M., Laurent, T., Toyama, M., Amer-Yahia, S.: Fairness and transparency in crowdsourcing. In: Proceedings of the 20th International Conference on Extending Database Technology, EDBT 2017, Venice, Italy, March 21\u201324, 2017, pp. 466\u2013469 (2017). https:\/\/doi.org\/10.5441\/002\/edbt.2017.46","DOI":"10.5441\/002\/edbt.2017.46"},{"key":"671_CR27","unstructured":"Bourque, P., Fairley, R.E., et\u00a0al.: Guide to the software engineering body of knowledge (SWEBOK (R)): Version 3.0. IEEE Computer Society Press (2014)"},{"key":"671_CR28","doi-asserted-by":"publisher","unstructured":"Brun, Y., Meliou, A.: Software fairness. In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2018, pp. 754\u2013759. ACM, New York (2018). https:\/\/doi.org\/10.1145\/3236024.3264838","DOI":"10.1145\/3236024.3264838"},{"key":"671_CR29","unstructured":"Bulletin of the Technical Committee on Data Engineering, IEEE Computer Society: Special Issue on Fairness, Diversity, and Transparency in Data Systems, Vol. 42, No. 3 (2019). http:\/\/sites.computer.org\/debull\/A19sept\/A19SEPT-CD.pdf (2020)"},{"key":"671_CR30","unstructured":"Buolamwini, J., Gebru, T.: Gender shades: Intersectional accuracy disparities in commercial gender classification. In: Conference on Fairness, Accountability and Transparency, pp. 77\u201391 (2018)"},{"key":"671_CR31","unstructured":"Burke, R.: Multisided fairness for recommendation. arXiv preprint arXiv:1707.00093 (2017)"},{"key":"671_CR32","doi-asserted-by":"publisher","unstructured":"Calikli, G., Bener, A., Arslan, B.: An analysis of the effects of company culture, education and experience on confirmation bias levels of software developers and testers. In: Proceedings of the 32Nd ACM\/IEEE International Conference on Software Engineering\u2014Volume 2, ICSE\u201910, pp. 187\u2013190. ACM, New York (2010). https:\/\/doi.org\/10.1145\/1810295.1810326","DOI":"10.1145\/1810295.1810326"},{"key":"671_CR33","doi-asserted-by":"crossref","unstructured":"Canetti, R., Cohen, A., Dikkala, N., Ramnarayan, G., Scheffler, S., Smith, A.: From soft classifiers to hard decisions: How fair can we be? In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 309\u2013318. ACM (2019)","DOI":"10.1145\/3287560.3287561"},{"key":"671_CR34","unstructured":"Carter, A.: Cathy o\u2019neil (2016) weapons of Math Destruction: How big Data Increases Inequality and Threatens Democracy, New York, St. Martin\u2019s Press And Virginia Eubanks (2018) Automating Inequality: How High-tech Tools Profile, Police, and Punish the Poor, New York, Broadway Books (2018)"},{"key":"671_CR35","doi-asserted-by":"crossref","unstructured":"Chen, J., Kallus, N., Mao, X., Svacha, G., Udell, M.: Fairness under unawareness: assessing disparity when protected class is unobserved. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 339\u2013348. ACM (2019)","DOI":"10.1145\/3287560.3287594"},{"issue":"12","key":"671_CR36","doi-asserted-by":"publisher","first-page":"2479","DOI":"10.14778\/3407790.3407839","volume":"13","author":"Z Chen","year":"2020","unstructured":"Chen, Z., Cheng, P., Chen, L., Lin, X., Shahabi, C.: Fair task assignment in spatial crowdsourcing. Proc. VLDB Endow. 13(12), 2479\u20132492 (2020). https:\/\/doi.org\/10.14778\/3407790.3407839","journal-title":"Proc. VLDB Endow."},{"key":"671_CR37","doi-asserted-by":"publisher","unstructured":"Cho, J., Roy, S., Adams, R.: Page quality: in search of an unbiased web ranking. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, Baltimore, Maryland, USA, June 14\u201316, 2005, pp. 551\u2013562 (2005). https:\/\/doi.org\/10.1145\/1066157.1066220","DOI":"10.1145\/1066157.1066220"},{"issue":"2","key":"671_CR38","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1089\/big.2016.0047","volume":"5","author":"A Chouldechova","year":"2017","unstructured":"Chouldechova, A.: Fair prediction with disparate impact: a study of bias in recidivism prediction instruments. Big Data 5(2), 153\u2013163 (2017)","journal-title":"Big Data"},{"key":"671_CR39","unstructured":"Chu, X., Ilyas, I.F., Papotti, P.: Holistic data cleaning: putting violations into context. In: 2013 IEEE 29th International Conference on Data Engineering (ICDE), pp. 458\u2013469. IEEE (2013)"},{"key":"671_CR40","doi-asserted-by":"crossref","unstructured":"Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., Huq, A.: Algorithmic decision making and the cost of fairness. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 797\u2013806. ACM (2017)","DOI":"10.1145\/3097983.3098095"},{"key":"671_CR41","doi-asserted-by":"publisher","unstructured":"Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., Huq, A.: Algorithmic decision making and the cost of fairness. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, August 13\u201317, 2017, pp. 797\u2013806 (2017). https:\/\/doi.org\/10.1145\/3097983.3098095","DOI":"10.1145\/3097983.3098095"},{"key":"671_CR42","doi-asserted-by":"crossref","unstructured":"Coston, A., Ramamurthy, K.N., Wei, D., Varshney, K.R., Speakman, S., Mustahsan, Z., Chakraborty, S.: Fair transfer learning with missing protected attributes. In: Proceedings of the AAAI\/ACM Conference on Artificial Intelligence, Ethics, and Society, Honolulu, HI, USA (2019)","DOI":"10.1145\/3306618.3314236"},{"key":"671_CR43","doi-asserted-by":"publisher","unstructured":"Das, M., Hecht, B., Gergle, D.: The gendered geography of contributions to openstreetmap: complexities in self-focus bias. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI\u201919, pp. 563:1\u2013563:14. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3290605.3300793","DOI":"10.1145\/3290605.3300793"},{"key":"671_CR44","doi-asserted-by":"publisher","unstructured":"Diaz, M., Johnson, I., Lazar, A., Piper, A.M., Gergle, D.: Addressing age-related bias in sentiment analysis. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI\u201918, pp. 412:1\u2013412:14. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3173574.3173986","DOI":"10.1145\/3173574.3173986"},{"key":"671_CR45","doi-asserted-by":"publisher","unstructured":"Dingler, T., Choudhury, A., Kostakos, V.: Biased bots: Conversational agents to overcome polarization. In: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, UbiComp\u201918, pp. 1664\u20131668. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3267305.3274189","DOI":"10.1145\/3267305.3274189"},{"key":"671_CR46","doi-asserted-by":"crossref","unstructured":"Dinur, I., Nissim, K.: Revealing information while preserving privacy. In: Proceedings of the Twenty-Second ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, pp. 202\u2013210 (2003)","DOI":"10.1145\/773153.773173"},{"issue":"2","key":"671_CR47","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1089\/big.2016.0054","volume":"5","author":"M Drosou","year":"2017","unstructured":"Drosou, M., Jagadish, H., Pitoura, E., Stoyanovich, J.: Diversity in big data: a review. Big Data 5(2), 73\u201384 (2017)","journal-title":"Big Data"},{"key":"671_CR48","unstructured":"Dulhanty, C., Wong, A.: Auditing imagenet: towards a model-driven framework for annotating demographic attributes of large-scale image datasets. arXiv preprint arXiv:1905.01347 (2019)"},{"key":"671_CR49","doi-asserted-by":"crossref","unstructured":"Dwork, C., Hardt, M., Pitassi, T., Reingold, O., Zemel, R.: Fairness through awareness. In: Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, pp. 214\u2013226. ACM (2012)","DOI":"10.1145\/2090236.2090255"},{"key":"671_CR50","doi-asserted-by":"publisher","unstructured":"Elbassuoni, S., Amer-Yahia, S., Atie, C.E., Ghizzawi, A., Oualha, B.: Exploring fairness of ranking in online job marketplaces. In: Advances in Database Technology\u201422nd International Conference on Extending Database Technology (EDBT 2019), Lisbon, Portugal, March 26\u201329, 2019, pp. 646\u2013649 (2019). https:\/\/doi.org\/10.5441\/002\/edbt.2019.77","DOI":"10.5441\/002\/edbt.2019.77"},{"key":"671_CR51","unstructured":"Faltings, B., Jurca, R., Pu, P., Tran, B.D.: Incentives to counter bias in human computation. In: Proceedings of the Second AAAI Conference on Human Computation and Crowdsourcing, HCOMP 2014, November 2\u20134, 2014, Pittsburgh, PA, USA (2014). http:\/\/www.aaai.org\/ocs\/index.php\/HCOMP\/HCOMP14\/paper\/view\/8945"},{"key":"671_CR52","doi-asserted-by":"publisher","unstructured":"Farnadi, G., Babaki, B., Getoor, L.: Fairness in relational domains. In: Proceedings of the 2018 AAAI\/ACM Conference on AI, Ethics, and Society, AIES\u201918, p. 108\u2013114. Association for Computing Machinery, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3278721.3278733","DOI":"10.1145\/3278721.3278733"},{"key":"671_CR53","first-page":"36","volume":"6","author":"G Farnadi","year":"2019","unstructured":"Farnadi, G., Babaki, B., Getoor, L.: A declarative approach to fairness in relational domains. Data Eng. 6, 36 (2019)","journal-title":"Data Eng."},{"key":"671_CR54","doi-asserted-by":"publisher","unstructured":"Feldman, M., Friedler, S.A., Moeller, J., Scheidegger, C., Venkatasubramanian, S.: Certifying and removing disparate impact. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, NSW, Australia, August 10\u201313, 2015, pp. 259\u2013268 (2015). https:\/\/doi.org\/10.1145\/2783258.2783311","DOI":"10.1145\/2783258.2783311"},{"key":"671_CR55","first-page":"63","volume":"5","author":"K Ferryman","year":"2018","unstructured":"Ferryman, K., Pitcan, M.: Fairness in precision medicine. Data Soc. 5, 63 (2018)","journal-title":"Data Soc."},{"key":"671_CR56","doi-asserted-by":"publisher","unstructured":"Galhotra, S., Brun, Y., Meliou, A.: Fairness testing: testing software for discrimination. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, ESEC\/FSE 2017, pp. 498\u2013510. ACM, New York, NY, USA (2017). https:\/\/doi.org\/10.1145\/3106237.3106277","DOI":"10.1145\/3106237.3106277"},{"key":"671_CR57","unstructured":"Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J.W., Wallach, H., Daum\u00e9, H., III, Crawford, K.: Datasheets for Datasets"},{"key":"671_CR58","doi-asserted-by":"publisher","unstructured":"German, D.M., Robles, G., Poo-Caama\u00f1o, G., Yang, X., Iida, H., Inoue, K.: \u201cWas my contribution fairly reviewed?\u201d: a framework to study the perception of fairness in modern code reviews. In: Proceedings of the 40th International Conference on Software Engineering, ICSE\u201918, pp. 523\u2013534. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3180155.3180217","DOI":"10.1145\/3180155.3180217"},{"key":"671_CR59","doi-asserted-by":"publisher","unstructured":"Geyik, S.C., Ambler, S., Kenthapadi, K.: Fairness-aware ranking in search & recommendation systems with application to linkedin talent search. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4\u20138, 2019., pp. 2221\u20132231 (2019). https:\/\/doi.org\/10.1145\/3292500.3330691","DOI":"10.1145\/3292500.3330691"},{"key":"671_CR60","doi-asserted-by":"publisher","unstructured":"Ghizzawi, A., Marinescu, J., Elbassuoni, S., Amer-Yahia, S., Bisson, G.: Fairank: an interactive system to explore fairness of ranking in online job marketplaces. In: Advances in Database Technology\u201422nd International Conference on Extending Database Technology, EDBT 2019, Lisbon, Portugal, March 26\u201329, 2019, pp. 582\u2013585 (2019). https:\/\/doi.org\/10.5441\/002\/edbt.2019.61","DOI":"10.5441\/002\/edbt.2019.61"},{"key":"671_CR61","doi-asserted-by":"publisher","unstructured":"Glymour, B., Herington, J.: Measuring the biases that matter: the ethical and casual foundations for measures of fairness in algorithms. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*\u201919, pp. 269\u2013278. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3287560.3287573","DOI":"10.1145\/3287560.3287573"},{"key":"671_CR62","doi-asserted-by":"crossref","unstructured":"Grappiolo, C., Mart\u00ednez, H.P., Yannakakis, G.N.: Validating generic metrics of fairness in game-based resource allocation scenarios with crowdsourced annotations. In: Transactions on Computational Intelligence XIII, pp. 176\u2013200. Springer (2014)","DOI":"10.1007\/978-3-642-54455-2_8"},{"key":"671_CR63","doi-asserted-by":"publisher","unstructured":"Guan, Y., Asudeh, A., Mayuram, P., Jagadish, H.V., Stoyanovich, J., Miklau, G., Das, G.: Mithraranking: a system for responsible ranking design. In: Proceedings of the 2019 International Conference on Management of Data, SIGMOD\u201919, pp. 1913\u20131916. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3299869.3320244","DOI":"10.1145\/3299869.3320244"},{"key":"671_CR64","doi-asserted-by":"publisher","unstructured":"Guerra, P.H.C., Veloso, A., Jr., W.M., Almeida, V.A.F.: From bias to opinion: a transfer-learning approach to real-time sentiment analysis. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA, August 21\u201324, 2011, pp. 150\u2013158 (2011). https:\/\/doi.org\/10.1145\/2020408.2020438","DOI":"10.1145\/2020408.2020438"},{"key":"671_CR65","unstructured":"HireVue.com: https:\/\/www.hirevue.com\/ (2020)"},{"key":"671_CR66","doi-asserted-by":"crossref","unstructured":"Hajian, S., Bonchi, F., Castillo, C.: Algorithmic bias: From discrimination discovery to fairness-aware data mining. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2125\u20132126 (2016)","DOI":"10.1145\/2939672.2945386"},{"issue":"7","key":"671_CR67","doi-asserted-by":"publisher","first-page":"1445","DOI":"10.1109\/TKDE.2012.72","volume":"25","author":"S Hajian","year":"2012","unstructured":"Hajian, S., Domingo-Ferrer, J.: A methodology for direct and indirect discrimination prevention in data mining. IEEE Trans Knowl. Data Eng. 25(7), 1445\u20131459 (2012)","journal-title":"IEEE Trans Knowl. Data Eng."},{"issue":"5\u20136","key":"671_CR68","doi-asserted-by":"publisher","first-page":"1158","DOI":"10.1007\/s10618-014-0346-1","volume":"28","author":"S Hajian","year":"2014","unstructured":"Hajian, S., Domingo-Ferrer, J., Farr\u00e0s, O.: Generalization-based privacy preservation and discrimination prevention in data publishing and mining. Data Min. Knowl. Discov. 28(5\u20136), 1158\u20131188 (2014). https:\/\/doi.org\/10.1007\/s10618-014-0346-1","journal-title":"Data Min. Knowl. Discov."},{"issue":"6","key":"671_CR69","doi-asserted-by":"publisher","first-page":"1733","DOI":"10.1007\/s10618-014-0393-7","volume":"29","author":"S Hajian","year":"2015","unstructured":"Hajian, S., Domingo-Ferrer, J., Monreale, A., Pedreschi, D., Giannotti, F.: Discrimination- and privacy-aware patterns. Data Min. Knowl. Discov. 29(6), 1733\u20131782 (2015). https:\/\/doi.org\/10.1007\/s10618-014-0393-7","journal-title":"Data Min. Knowl. Discov."},{"key":"671_CR70","unstructured":"Hardt, M., Price, E., Srebro, N., et\u00a0al.: Equality of opportunity in supervised learning. In: Advances in Neural Information Processing Systems, pp. 3315\u20133323 (2016)"},{"key":"671_CR71","doi-asserted-by":"crossref","unstructured":"Hendricks, L.A., Burns, K., Saenko, K., Darrell, T., Rohrbach, A.: Women also snowboard: overcoming bias in captioning models. In: European Conference on Computer Vision, pp. 793\u2013811. Springer (2018)","DOI":"10.1007\/978-3-030-01219-9_47"},{"issue":"1","key":"671_CR72","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1109\/TKDE.2018.2845400","volume":"31","author":"J Hern\u00e1ndez-Gonz\u00e1lez","year":"2018","unstructured":"Hern\u00e1ndez-Gonz\u00e1lez, J., Inza, I., Lozano, J.A.: A note on the behavior of majority voting in multi-class domains with biased annotators. IEEE Trans. Knowl. Data Eng. 31(1), 195\u2013200 (2018)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"671_CR73","doi-asserted-by":"crossref","unstructured":"Herranz, L., Jiang, S., Li, X.: Scene recognition with CNNs: objects, scales and dataset bias. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 571\u2013579 (2016)","DOI":"10.1109\/CVPR.2016.68"},{"key":"671_CR74","doi-asserted-by":"publisher","unstructured":"Holstein, K., Wortman\u00a0Vaughan, J., Daum\u00e9 III, H., Dudik, M., Wallach, H.: Improving fairness in machine learning systems: What do industry practitioners need? In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI\u201919, pp. 600:1\u2013600:16. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3290605.3300830","DOI":"10.1145\/3290605.3300830"},{"key":"671_CR75","doi-asserted-by":"publisher","unstructured":"Holstein, T., Dodig-Crnkovic, G.: Avoiding the intrinsic unfairness of the trolley problem. In: Proceedings of the International Workshop on Software Fairness, FairWare\u201918, pp. 32\u201337. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3194770.3194772","DOI":"10.1145\/3194770.3194772"},{"key":"671_CR76","unstructured":"Hu, X., Wang, H., Dube, S., Vegesana, A., Yu, K., Lu, Y.H., Yin, M.: Discovering Biases in Image Datasets with the Crowd"},{"key":"671_CR77","unstructured":"Hu, X., Wang, H., Dube, S., Vegesana, A., Yu, K., Lu, Y.H., Yin, M.: Discovering biases in image datasets with the crowd. In: Proceedings of HCOMP 2019 (2019)"},{"key":"671_CR78","doi-asserted-by":"publisher","unstructured":"Hussain, W., Mougouei, D., Whittle, J.: Integrating social values into software design patterns. In: Proceedings of the International Workshop on Software Fairness, FairWare\u201918, pp. 8\u201314. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3194770.3194777","DOI":"10.1145\/3194770.3194777"},{"key":"671_CR79","doi-asserted-by":"crossref","unstructured":"Hutchinson, B., Mitchell, M.: 50 years of test (un) fairness: lessons for machine learning. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 49\u201358. ACM (2019)","DOI":"10.1145\/3287560.3287600"},{"key":"671_CR80","doi-asserted-by":"publisher","unstructured":"Hutchinson, B., Mitchell, M.: 50 years of test (un)fairness: lessons for machine learning. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*\u201919, pp. 49\u201358. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3287560.3287600","DOI":"10.1145\/3287560.3287600"},{"key":"671_CR81","doi-asserted-by":"publisher","unstructured":"Imtiaz, N., Middleton, J., Chakraborty, J., Robson, N., Bai, G., Murphy-Hill, E.R.: Investigating the effects of gender bias on github. In: Proceedings of the 41st International Conference on Software Engineering (ICSE 2019), Montreal, QC, Canada, May 25\u201331, 2019, pp. 700\u2013711 (2019). https:\/\/doi.org\/10.1109\/ICSE.2019.00079","DOI":"10.1109\/ICSE.2019.00079"},{"key":"671_CR82","doi-asserted-by":"crossref","unstructured":"Jagadish, H., Bonchi, F., Eliassi-Rad, T., Getoor, L., Gummadi, K., Stoyanovich, J.: The responsibility challenge for data. In: Proceedings of the 2019 International Conference on Management of Data, pp. 412\u2013414 (2019)","DOI":"10.1145\/3299869.3314327"},{"key":"671_CR83","unstructured":"Jagielski, M., Kearns, M., Mao, J., Oprea, A., Roth, A., Sharifi-Malvajerdi, S., Ullman, J.: Differentially private fair learning. In: International Conference on Machine Learning, pp. 3000\u20133008 (2019)"},{"key":"671_CR84","doi-asserted-by":"publisher","unstructured":"Jannach, D., Kamehkhosh, I., Bonnin, G.: Biases in automated music playlist generation: a comparison of next-track recommending techniques. In: Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization, UMAP\u201916, pp. 281\u2013285. ACM, New York, NY, USA (2016). https:\/\/doi.org\/10.1145\/2930238.2930283","DOI":"10.1145\/2930238.2930283"},{"key":"671_CR85","unstructured":"Jeffrey Dastin: Amazon scraps secret AI recruiting tool that showed bias against women. https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight\/amazon-scraps-secret-airecruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G (2020)"},{"key":"671_CR86","doi-asserted-by":"publisher","unstructured":"Jin, Z., Xu, M., Sun, C., Asudeh, A., Jagadish, H.V.: Mithracoverage: a system for investigating population bias for intersectional fairness. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, SIGMOD\u201920, p. 2721\u20132724. Association for Computing Machinery, New York, NY, USA (2020). https:\/\/doi.org\/10.1145\/3318464.3384689","DOI":"10.1145\/3318464.3384689"},{"issue":"5","key":"671_CR87","doi-asserted-by":"publisher","first-page":"526","DOI":"10.1145\/3187009.3177733","volume":"11","author":"N Johnson","year":"2018","unstructured":"Johnson, N., Near, J.P., Song, D.: Towards practical differential privacy for SQL queries. Proc. VLDB Endow. 11(5), 526\u2013539 (2018)","journal-title":"Proc. VLDB Endow."},{"key":"671_CR88","doi-asserted-by":"crossref","unstructured":"Kamar, E., Kapoor, A., Horvitz, E.: Identifying and accounting for task-dependent bias in crowdsourcing. In: Third AAAI Conference on Human Computation and Crowdsourcing (2015)","DOI":"10.1609\/hcomp.v3i1.13238"},{"issue":"1","key":"671_CR89","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1007\/s10618-017-0534-x","volume":"32","author":"T Kamishima","year":"2018","unstructured":"Kamishima, T., Akaho, S., Asoh, H., Sakuma, J.: Model-based and actual independence for fairness-aware classification. Data Min. Knowl. Discov. 32(1), 258\u2013286 (2018). https:\/\/doi.org\/10.1007\/s10618-017-0534-x","journal-title":"Data Min. Knowl. Discov."},{"key":"671_CR90","doi-asserted-by":"publisher","unstructured":"Karako, C., Manggala, P.: Using image fairness representations in diversity-based re-ranking for recommendations. In: Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization, UMAP\u201918, pp. 23\u201328. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3213586.3226206","DOI":"10.1145\/3213586.3226206"},{"key":"671_CR91","unstructured":"Kearns, M., Neel, S., Roth, A., Wu, Z.S.: Preventing fairness gerrymandering: auditing and learning for subgroup fairness. In: International Conference on Machine Learning, pp. 2564\u20132572. PMLR (2018)"},{"key":"671_CR92","doi-asserted-by":"crossref","unstructured":"Khosla, A., Zhou, T., Malisiewicz, T., Efros, A.A., Torralba, A.: Undoing the damage of dataset bias. In: European Conference on Computer Vision, pp. 158\u2013171. Springer (2012)","DOI":"10.1007\/978-3-642-33718-5_12"},{"key":"671_CR93","unstructured":"Kilbertus, N., Rojas-Carulla, M., Parascandolo, G., Hardt, M., Janzing, D., Sch\u00f6lkopf, B.: Avoiding discrimination through causal reasoning. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 656\u2013666 (2017)"},{"key":"671_CR94","doi-asserted-by":"publisher","unstructured":"Kim, J., Ryu, H., Kim, H.: To be biased or not to be: Choosing between design fixation and design intentionality. In: CHI\u201913 Extended Abstracts on Human Factors in Computing Systems, CHI EA\u201913, pp. 349\u2013354. ACM, New York, NY, USA (2013). https:\/\/doi.org\/10.1145\/2468356.2468418","DOI":"10.1145\/2468356.2468418"},{"key":"671_CR95","unstructured":"Kleinberg, J., Mullainathan, S., Raghavan, M.: Inherent trade-offs in the fair determination of risk scores. In: 8th Innovations in Theoretical Computer Science Conference (ITCS 2017). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik (2017)"},{"key":"671_CR96","doi-asserted-by":"publisher","unstructured":"Kobren, A., Saha, B., McCallum, A.: Paper matching with local fairness constraints. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD 2019), Anchorage, AK, USA, August 4\u20138, 2019, pp. 1247\u20131257 (2019). https:\/\/doi.org\/10.1145\/3292500.3330899","DOI":"10.1145\/3292500.3330899"},{"key":"671_CR97","doi-asserted-by":"publisher","unstructured":"Koene, A., Dowthwaite, L., Seth, S.: Ieee p7003&trade; standard for algorithmic bias considerations: work in progress paper. In: Proceedings of the International Workshop on Software Fairness, FairWare\u201918, pp. 38\u201341. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3194770.3194773","DOI":"10.1145\/3194770.3194773"},{"key":"671_CR98","doi-asserted-by":"crossref","unstructured":"Kortylewski, A., Egger, B., Schneider, A., Gerig, T., Morel-Forster, A., Vetter, T.: Analyzing and reducing the damage of dataset bias to face recognition with synthetic data. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2019)","DOI":"10.1109\/CVPRW.2019.00279"},{"issue":"12","key":"671_CR99","doi-asserted-by":"publisher","first-page":"2706","DOI":"10.14778\/3407790.3407855","volume":"13","author":"C Kuhlman","year":"2020","unstructured":"Kuhlman, C., Rundensteiner, E.: Rank aggregation algorithms for fair consensus. Proc. VLDB Endow. 13(12), 2706\u20132719 (2020)","journal-title":"Proc. VLDB Endow."},{"key":"671_CR100","unstructured":"Kusner, M., Loftus, J., Russell, C., Silva, R.: Counterfactual fairness. In: Advances in Neural Information Processing Systems 30 (NIPS 2017) Pre-proceedings, vol. 30 (2017)"},{"key":"671_CR101","doi-asserted-by":"publisher","unstructured":"Lahoti, P., Gummadi, K.P., Weikum, G.: ifair: learning individually fair data representations for algorithmic decision making. In: 35th IEEE International Conference on Data Engineering (ICDE 2019), Macao, China, April 8\u201311, 2019, pp. 1334\u20131345 (2019). https:\/\/doi.org\/10.1109\/ICDE.2019.00121","DOI":"10.1109\/ICDE.2019.00121"},{"key":"671_CR102","doi-asserted-by":"publisher","unstructured":"Lappas, T., Terzi, E.: Toward a fair review-management system. In: Machine Learning and Knowledge Discovery in Databases\u2014European Conference, ECML PKDD 2011, Athens, Greece, September 5\u20139, 2011, Proceedings, Part II, pp. 293\u2013309 (2011). https:\/\/doi.org\/10.1007\/978-3-642-23783-6_19","DOI":"10.1007\/978-3-642-23783-6_19"},{"issue":"11","key":"671_CR103","doi-asserted-by":"publisher","first-page":"1490","DOI":"10.1109\/TKDE.2008.77","volume":"20","author":"HW Lauw","year":"2008","unstructured":"Lauw, H.W., Lim, E.P., Wang, K.: Bias and controversy in evaluation systems. IEEE Trans. Knowl. Data Eng. 20(11), 1490\u20131504 (2008)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"671_CR104","doi-asserted-by":"crossref","unstructured":"Leavy, S.: Gender bias in artificial intelligence: The need for diversity and gender theory in machine learning. In: 2018 IEEE\/ACM 1st International Workshop on Gender Equality in Software Engineering, GE@ICSE, Gothenburg, Sweden, May 28, 2018, pp. 14\u201316 (2018). http:\/\/ieeexplore.ieee.org\/document\/8452744","DOI":"10.1145\/3195570.3195580"},{"key":"671_CR105","doi-asserted-by":"publisher","unstructured":"Lee, M.K., Baykal, S.: Algorithmic mediation in group decisions: fairness perceptions of algorithmically mediated vs. discussion-based social division. In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, CSCW\u201917, pp. 1035\u20131048. ACM, New York, NY, USA (2017). https:\/\/doi.org\/10.1145\/2998181.2998230","DOI":"10.1145\/2998181.2998230"},{"key":"671_CR106","doi-asserted-by":"publisher","unstructured":"Lee, M.K., Kim, J.T., Lizarondo, L.: A human-centered approach to algorithmic services: Considerations for fair and motivating smart community service management that allocates donations to non-profit organizations. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI\u201917, pp. 3365\u20133376. ACM, New York, NY, USA (2017). https:\/\/doi.org\/10.1145\/3025453.3025884","DOI":"10.1145\/3025453.3025884"},{"key":"671_CR107","doi-asserted-by":"publisher","unstructured":"Leit\u00e3o, R., Jakobsen, F.: A survey on user-interface design strategies to address online bias. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, CHI EA\u201918, pp. LBW084:1\u2013LBW084:6. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3170427.3188567","DOI":"10.1145\/3170427.3188567"},{"key":"671_CR108","doi-asserted-by":"crossref","unstructured":"Li, Y., Li, Y., Vasconcelos, N.: Resound: towards action recognition without representation bias. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 513\u2013528 (2018)","DOI":"10.1007\/978-3-030-01231-1_32"},{"key":"671_CR109","doi-asserted-by":"publisher","unstructured":"Li, Y., Shi, C., Zhao, H., Zhuang, F., Wu, B.: Aspect mining with rating bias. In: Machine Learning and Knowledge Discovery in Databases\u2014European Conference, ECML PKDD 2016, Riva del Garda, Italy, September 19\u201323, 2016, Proceedings, Part II, pp. 458\u2013474 (2016). https:\/\/doi.org\/10.1007\/978-3-319-46227-1_29","DOI":"10.1007\/978-3-319-46227-1_29"},{"key":"671_CR110","doi-asserted-by":"publisher","unstructured":"Liao, Q.V., Fu, W.T., Strohmaier, M.: #snowden: understanding biases introduced by behavioral differences of opinion groups on social media. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI\u201916, pp. 3352\u20133363. ACM, New York, NY, USA (2016). https:\/\/doi.org\/10.1145\/2858036.2858422","DOI":"10.1145\/2858036.2858422"},{"issue":"12","key":"671_CR111","doi-asserted-by":"publisher","first-page":"2229","DOI":"10.14778\/3407790.3407821","volume":"13","author":"Y Lin","year":"2020","unstructured":"Lin, Y., Guan, Y., Asudeh, A., Jagadish, H.: Identifying insufficient data coverage in databases with multiple relations. Proc. VLDB Endow. 13(12), 2229\u20132242 (2020)","journal-title":"Proc. VLDB Endow."},{"key":"671_CR112","doi-asserted-by":"crossref","unstructured":"Luong, B.T., Ruggieri, S., Turini, F.: k-NN as an implementation of situation testing for discrimination discovery and prevention. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 502\u2013510. ACM (2011)","DOI":"10.1145\/2020408.2020488"},{"key":"671_CR113","doi-asserted-by":"crossref","unstructured":"Machanavajjhala, A., He, X., Hay, M.: Differential privacy in the wild: a tutorial on current practices & open challenges. In: Proceedings of the 2017 ACM International Conference on Management of Data, pp. 1727\u20131730 (2017)","DOI":"10.1145\/3035918.3054779"},{"key":"671_CR114","unstructured":"Madden, S., Ouzzani, M., Tang, N., Stonebraker, M.: Dagger: a data (not code) debugger. In: CIDR (2020)"},{"key":"671_CR115","doi-asserted-by":"crossref","unstructured":"Madras, D., Creager, E., Pitassi, T., Zemel, R.: Fairness through causal awareness: learning causal latent-variable models for biased data. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 349\u2013358. ACM (2019)","DOI":"10.1145\/3287560.3287564"},{"key":"671_CR116","unstructured":"Margarita\u00a0Boyarskaya, P.I.: Fair payments in adaptive voting. In: Proceedings of HCOMP 2019 (2019)"},{"key":"671_CR117","doi-asserted-by":"crossref","unstructured":"Matsushita, Y., Lin, S., Kang, S.B., Shum, H.Y.: Estimating intrinsic images from image sequences with biased illumination. In: European Conference on Computer Vision, pp. 274\u2013286. Springer (2004)","DOI":"10.1007\/978-3-540-24671-8_22"},{"key":"671_CR118","doi-asserted-by":"crossref","unstructured":"Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I.D., Gebru, T.: Model cards for model reporting. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 220\u2013229 (2019)","DOI":"10.1145\/3287560.3287596"},{"key":"671_CR119","doi-asserted-by":"publisher","unstructured":"Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I.D., Gebru, T.: Model cards for model reporting. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT* 2019, Atlanta, GA, USA, January 29\u201331, 2019, pp. 220\u2013229 (2019). https:\/\/doi.org\/10.1145\/3287560.3287596","DOI":"10.1145\/3287560.3287596"},{"issue":"3","key":"671_CR120","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1109\/69.929904","volume":"13","author":"VS Mookerjee","year":"2001","unstructured":"Mookerjee, V.S.: Debiasing training data for inductive expert system construction. IEEE Trans. Knowl. Data Eng. 13(3), 497\u2013512 (2001)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"671_CR121","doi-asserted-by":"publisher","unstructured":"Morgan, J.S., Lampe, C., Shafiq, M.Z.: Is news sharing on twitter ideologically biased? In: Proceedings of the 2013 Conference on Computer Supported Cooperative Work, CSCW\u201913, pp. 887\u2013896. ACM, New York, NY, USA (2013). https:\/\/doi.org\/10.1145\/2441776.2441877","DOI":"10.1145\/2441776.2441877"},{"issue":"12","key":"671_CR122","doi-asserted-by":"publisher","first-page":"2829","DOI":"10.14778\/3415478.3415486","volume":"13","author":"Y Moskovitch","year":"2020","unstructured":"Moskovitch, Y., Jagadish, H.: Countata: dataset labeling using pattern counts. Proc. VLDB Endow. 13(12), 2829\u20132832 (2020)","journal-title":"Proc. VLDB Endow."},{"key":"671_CR123","doi-asserted-by":"crossref","unstructured":"Mouzannar, H., Ohannessian, M.I., Srebro, N.: From fair decision making to social equality. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp. 359\u2013368. ACM (2019)","DOI":"10.1145\/3287560.3287599"},{"key":"671_CR124","doi-asserted-by":"publisher","unstructured":"Mouzannar, H., Ohannessian, M.I., Srebro, N.: From fair decision making to social equality. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*\u201919, pp. 359\u2013368. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3287560.3287599","DOI":"10.1145\/3287560.3287599"},{"key":"671_CR125","doi-asserted-by":"publisher","unstructured":"Narwal, V., Salih, M.H., Lopez, J.A., Ortega, A., O\u2019Donovan, J., H\u00f6llerer, T., Savage, S.: Automated assistants to identify and prompt action on visual news bias. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA\u201917, pp. 2796\u20132801. ACM, New York, NY, USA (2017). https:\/\/doi.org\/10.1145\/3027063.3053227","DOI":"10.1145\/3027063.3053227"},{"key":"671_CR126","unstructured":"Official Journal of the European Union: REGULATION (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95\/46\/EC (General Data Protection Regulation. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/PDF\/?uri=CELEX:32016R0679 (2020)"},{"key":"671_CR127","doi-asserted-by":"publisher","unstructured":"Olteanu, A., K\u0131c\u0131man, E., Castillo, C.: A critical review of online social data: biases, methodological pitfalls, and ethical boundaries. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, WSDM\u201918, p. 785\u2013786. Association for Computing Machinery, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3159652.3162004","DOI":"10.1145\/3159652.3162004"},{"key":"671_CR128","unstructured":"Orr, L., Ainsworth, S., Cai, W., Jamieson, K., Balazinska, M., Suciu, D.: Mosaic: a sample-based database system for open world query processing. In: CIDR (2020)"},{"key":"671_CR129","doi-asserted-by":"crossref","unstructured":"Orr, L., Balazinska, M., Suciu, D.: Sample debiasing in the themis open world database system. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, pp. 257\u2013268 (2020)","DOI":"10.1145\/3318464.3380606"},{"key":"671_CR130","doi-asserted-by":"publisher","unstructured":"Otterbacher, J.: Crowdsourcing stereotypes: linguistic bias in metadata generated via gwap. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI\u201915, pp. 1955\u20131964. ACM, New York, NY, USA (2015). https:\/\/doi.org\/10.1145\/2702123.2702151","DOI":"10.1145\/2702123.2702151"},{"key":"671_CR131","doi-asserted-by":"crossref","unstructured":"Otterbacher, J.: Social cues, social biases: stereotypes in annotations on people images. In: Sixth AAAI Conference on Human Computation and Crowdsourcing (2018)","DOI":"10.1609\/hcomp.v6i1.13320"},{"key":"671_CR132","doi-asserted-by":"crossref","unstructured":"Otterbacher, J., Barlas, P., Kleanthous, S., Kyriakou, K.: How do we talk about other people? Group (un)fairness in natural language image descriptions. In: HCOMP 2019 (2019)","DOI":"10.1609\/hcomp.v7i1.5267"},{"key":"671_CR133","unstructured":"Practitioners guide to compas. Tech. rep., Northpointe (2012)"},{"key":"671_CR134","doi-asserted-by":"crossref","unstructured":"Panda, R., Zhang, J., Li, H., Lee, J.Y., Lu, X., Roy-Chowdhury, A.K.: Contemplating visual emotions: understanding and overcoming dataset bias. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 579\u2013595 (2018)","DOI":"10.1007\/978-3-030-01216-8_36"},{"key":"671_CR135","doi-asserted-by":"publisher","unstructured":"Park, S., Kang, S., Chung, S., Song, J.: Newscube: delivering multiple aspects of news to mitigate media bias. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI\u201909, pp. 443\u2013452. ACM, New York, NY, USA (2009). https:\/\/doi.org\/10.1145\/1518701.1518772","DOI":"10.1145\/1518701.1518772"},{"key":"671_CR136","doi-asserted-by":"publisher","unstructured":"Passi, S., Barocas, S.: Problem formulation and fairness. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*\u201919, pp. 39\u201348. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3287560.3287567","DOI":"10.1145\/3287560.3287567"},{"key":"671_CR137","doi-asserted-by":"crossref","unstructured":"Pedreshi, D., Ruggieri, S., Turini, F.: Discrimination-aware data mining. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 560\u2013568. ACM (2008)","DOI":"10.1145\/1401890.1401959"},{"key":"671_CR138","doi-asserted-by":"crossref","unstructured":"Peng, A., Nushi, B., Kiciman, E., Inkpen, K., Suri, S., Kamar, E.: What you see is what you get? the impact of representation criteria on human bias in hiring. In: HCOMP 2019 arxiv: abs\/1909.03567 (2019)","DOI":"10.1609\/hcomp.v7i1.5281"},{"key":"671_CR139","doi-asserted-by":"crossref","unstructured":"Peng, A., Nushi, B., K\u0131c\u0131man, E., Inkpen, K., Suri, S., Kamar, E.: What you see is what you get? the impact of representation criteria on human bias in hiring. In: Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, vol. 7, pp. 125\u2013134 (2019)","DOI":"10.1609\/hcomp.v7i1.5281"},{"key":"671_CR140","doi-asserted-by":"publisher","unstructured":"P\u00e9rez-Suay, A., Laparra, V., Mateo-Garcia, G., Mu\u00f1oz-Mar\u00ed, J., G\u00f3mez-Chova, L., Camps-Valls, G.: Fair kernel learning. In: Machine Learning and Knowledge Discovery in Databases\u2014European Conference, ECML PKDD 2017, Skopje, Macedonia, September 18\u201322, 2017, Proceedings, Part I, pp. 339\u2013355 (2017). https:\/\/doi.org\/10.1007\/978-3-319-71249-9_21","DOI":"10.1007\/978-3-319-71249-9_21"},{"key":"671_CR141","unstructured":"Power, D.J.: Decision Support Systems: Concepts and Resources for Managers. Greenwood Publishing Group (2002)"},{"issue":"2","key":"671_CR142","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1080\/10580530801941124","volume":"25","author":"DJ Power","year":"2008","unstructured":"Power, D.J.: Understanding data-driven decision support systems. Inf. Syst. Manag. 25(2), 149\u2013154 (2008)","journal-title":"Inf. Syst. Manag."},{"key":"671_CR143","doi-asserted-by":"crossref","unstructured":"Quadrianto, N., Sharmanska, V., Thomas, O.: Discovering fair representations in the data domain. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8227\u20138236 (2019)","DOI":"10.1109\/CVPR.2019.00842"},{"key":"671_CR144","doi-asserted-by":"publisher","unstructured":"Quattrone, G., Capra, L., De\u00a0Meo, P.: There\u2019s no such thing as the perfect map: quantifying bias in spatial crowd-sourcing datasets. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW\u201915, pp. 1021\u20131032. ACM, New York, NY, USA (2015). https:\/\/doi.org\/10.1145\/2675133.2675235","DOI":"10.1145\/2675133.2675235"},{"key":"671_CR145","doi-asserted-by":"publisher","unstructured":"Rahman, F., Posnett, D., Herraiz, I., Devanbu, P.: Sample size vs. bias in defect prediction. In: Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering, ESEC\/FSE 2013, pp. 147\u2013157. ACM, New York, NY, USA (2013). https:\/\/doi.org\/10.1145\/2491411.2491418","DOI":"10.1145\/2491411.2491418"},{"key":"671_CR146","doi-asserted-by":"crossref","unstructured":"Raji, I.D., Buolamwini, J.: Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial AI products. In: AAAI\/ACM Conference on AI Ethics and Society, vol.\u00a01 (2019)","DOI":"10.1145\/3306618.3314244"},{"key":"671_CR147","doi-asserted-by":"publisher","unstructured":"Ramadan, Q., Ahmadian, A.S., Str\u00fcber, D., J\u00fcrjens, J., Staab, S.: Model-based discrimination analysis: a position paper. In: Proceedings of the International Workshop on Software Fairness, FairWare\u201918, pp. 22\u201328. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3194770.3194775","DOI":"10.1145\/3194770.3194775"},{"key":"671_CR148","doi-asserted-by":"publisher","unstructured":"Rastogi, A.: Do biases related to geographical location influence work-related decisions in github? In: Proceedings of the 38th International Conference on Software Engineering Companion, ICSE\u201916, pp. 665\u2013667. ACM, New York, NY, USA (2016). https:\/\/doi.org\/10.1145\/2889160.2891035","DOI":"10.1145\/2889160.2891035"},{"key":"671_CR149","doi-asserted-by":"publisher","unstructured":"Robertson, R.E., Jiang, S., Joseph, K., Friedland, L., Lazer, D., Wilson, C.: Auditing partisan audience bias within google search. Proc. ACM Hum. Comput. Interact. 2(CSCW), 148:1\u2013148:22 (2018). https:\/\/doi.org\/10.1145\/3274417","DOI":"10.1145\/3274417"},{"issue":"5","key":"671_CR150","doi-asserted-by":"publisher","first-page":"582","DOI":"10.1017\/S0269888913000039","volume":"29","author":"A Romei","year":"2014","unstructured":"Romei, A., Ruggieri, S.: A multidisciplinary survey on discrimination analysis. Knowl. Eng. Rev. 29(5), 582\u2013638 (2014)","journal-title":"Knowl. Eng. Rev."},{"key":"671_CR151","doi-asserted-by":"crossref","unstructured":"Ruggieri, S., Hajian, S., Kamiran, F., Zhang, X.: Anti-discrimination analysis using privacy attack strategies. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 694\u2013710. Springer (2014)","DOI":"10.1007\/978-3-662-44851-9_44"},{"issue":"2","key":"671_CR152","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1145\/1754428.1754432","volume":"4","author":"S Ruggieri","year":"2010","unstructured":"Ruggieri, S., Pedreschi, D., Turini, F.: Data mining for discrimination discovery. ACM Trans. Knowl. Discov. Data 4(2), 9 (2010)","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"671_CR153","doi-asserted-by":"publisher","unstructured":"Ruggieri, S., Pedreschi, D., Turini, F.: DCUBE: discrimination discovery in databases. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2010), Indianapolis, IN, USA, June 6\u201310, 2010, pp. 1127\u20131130 (2010). https:\/\/doi.org\/10.1145\/1807167.1807298","DOI":"10.1145\/1807167.1807298"},{"key":"671_CR154","doi-asserted-by":"crossref","unstructured":"Ruggieri, S., Turini, F.: A KDD process for discrimination discovery. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 249\u2013253. Springer (2016)","DOI":"10.1007\/978-3-319-46131-1_28"},{"key":"671_CR155","unstructured":"Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anisfeld, A., Rodolfa, K.T., Ghani, R.: Aequitas: a bias and fairness audit toolkit. arXiv preprint arXiv:1811.05577 (2018)"},{"issue":"12","key":"671_CR156","doi-asserted-by":"publisher","first-page":"2062","DOI":"10.14778\/3229863.3236260","volume":"11","author":"B Salimi","year":"2018","unstructured":"Salimi, B., Cole, C., Li, P., Gehrke, J., Suciu, D.: Hypdb: a demonstration of detecting, explaining and resolving bias in OLAP queries. Proc. VLDB Endow. 11(12), 2062\u20132065 (2018)","journal-title":"Proc. VLDB Endow."},{"key":"671_CR157","doi-asserted-by":"publisher","unstructured":"Salimi, B., Gehrke, J., Suciu, D.: Bias in olap queries: detection, explanation, and removal. In: Proceedings of the 2018 International Conference on Management of Data, SIGMOD\u201918, pp. 1021\u20131035. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3183713.3196914","DOI":"10.1145\/3183713.3196914"},{"key":"671_CR158","unstructured":"Salimi, B., Howe, B., Suciu, D.: Data management for causal algorithmic fairness. arXiv preprint arXiv:1908.07924 (2019)"},{"issue":"1","key":"671_CR159","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1145\/3422648.3422657","volume":"49","author":"B Salimi","year":"2020","unstructured":"Salimi, B., Howe, B., Suciu, D.: Database repair meets algorithmic fairness. SIGMOD Rec. 49(1), 34\u201341 (2020). https:\/\/doi.org\/10.1145\/3422648.3422657","journal-title":"SIGMOD Rec."},{"key":"671_CR160","doi-asserted-by":"publisher","unstructured":"Salimi, B., Parikh, H., Kayali, M., Getoor, L., Roy, S., Suciu, D.: Causal relational learning. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, SIGMOD\u201920, p. 241\u2013256. Association for Computing Machinery, New York, NY, USA (2020). https:\/\/doi.org\/10.1145\/3318464.3389759","DOI":"10.1145\/3318464.3389759"},{"key":"671_CR161","doi-asserted-by":"publisher","unstructured":"Salimi, B., Rodriguez, L., Howe, B., Suciu, D.: Interventional fairness: causal database repair for algorithmic fairness. In: Proceedings of the 2019 International Conference on Management of Data, SIGMOD\u201919, pp. 793\u2013810. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3299869.3319901","DOI":"10.1145\/3299869.3319901"},{"key":"671_CR162","doi-asserted-by":"publisher","unstructured":"Salman, I.: Cognitive biases in software quality and testing. In: Proceedings of the 38th International Conference on Software Engineering Companion, ICSE\u201916, pp. 823\u2013826. ACM, New York, NY, USA (2016). https:\/\/doi.org\/10.1145\/2889160.2889265","DOI":"10.1145\/2889160.2889265"},{"key":"671_CR163","doi-asserted-by":"publisher","unstructured":"Salminen, J., Jung, S.G., Jansen, B.J.: Detecting demographic bias in automatically generated personas. In: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, CHI EA\u201919, pp. LBW0122:1\u2013LBW0122:6. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3290607.3313034","DOI":"10.1145\/3290607.3313034"},{"key":"671_CR164","unstructured":"Schelter, S., He, Y., Khilnani, J., Stoyanovich, J.: Fairprep: promoting data to a first-class citizen in studies on fairness-enhancing interventions. arXiv preprint arXiv:1911.12587 (2019)"},{"key":"671_CR165","doi-asserted-by":"publisher","unstructured":"Selbst, A.D., Boyd, D., Friedler, S.A., Venkatasubramanian, S., Vertesi, J.: Fairness and abstraction in sociotechnical systems. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT*\u201919, pp. 59\u201368. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3287560.3287598","DOI":"10.1145\/3287560.3287598"},{"key":"671_CR166","unstructured":"Shankar, S., Halpern, Y., Breck, E., Atwood, J., Wilson, J., Sculley, D.: No classification without representation: assessing geodiversity issues in open data sets for the developing world. arXiv preprint arXiv:1711.08536 (2017)"},{"key":"671_CR167","doi-asserted-by":"publisher","unstructured":"Singh, A., Joachims, T.: Fairness of exposure in rankings. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK, August 19\u201323, 2018, pp. 2219\u20132228 (2018). https:\/\/doi.org\/10.1145\/3219819.3220088","DOI":"10.1145\/3219819.3220088"},{"key":"671_CR168","doi-asserted-by":"crossref","unstructured":"Sinha, S., Agarwal, M., Vatsa, M., Singh, R., Anand, S.: Exploring bias in primate face detection and recognition. In: Proceedings of the European Conference on Computer Vision (ECCV) (2018)","DOI":"10.1007\/978-3-030-11009-3_33"},{"key":"671_CR169","doi-asserted-by":"publisher","unstructured":"Solomon, J.: Customization bias in decision support systems. In: Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI\u201914, pp. 3065\u20133074. ACM, New York, NY, USA (2014). https:\/\/doi.org\/10.1145\/2556288.2557211","DOI":"10.1145\/2556288.2557211"},{"key":"671_CR170","doi-asserted-by":"publisher","unstructured":"Sonboli, N., Burke, R.: Localized fairness in recommender systems. In: Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization, UMAP\u201919 Adjunct, pp. 295\u2013300. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3314183.3323845","DOI":"10.1145\/3314183.3323845"},{"key":"671_CR171","doi-asserted-by":"publisher","unstructured":"Spillane, B., Lawless, S., Wade, V.: Measuring bias in news websites, towards a model for personalization. In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, UMAP\u201917, pp. 387\u2013388. ACM, New York, NY, USA (2017). https:\/\/doi.org\/10.1145\/3079628.3079647","DOI":"10.1145\/3079628.3079647"},{"key":"671_CR172","unstructured":"Springer, A., Garcia-Gathright, J., Cramer, H.: Assessing and addressing algorithmic bias-but before we get there... In: 2018 AAAI Spring Symposium Series (2018)"},{"key":"671_CR173","doi-asserted-by":"publisher","unstructured":"Srivastava, M., Heidari, H., Krause, A.: Mathematical notions vs. human perception of fairness: a descriptive approach to fairness for machine learning. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4\u20138, 2019., pp. 2459\u20132468 (2019). https:\/\/doi.org\/10.1145\/3292500.3330664","DOI":"10.1145\/3292500.3330664"},{"key":"671_CR174","doi-asserted-by":"crossref","unstructured":"Stock, P., Cisse, M.: Convnets and imagenet beyond accuracy: understanding mistakes and uncovering biases. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 498\u2013512 (2018)","DOI":"10.1007\/978-3-030-01231-1_31"},{"key":"671_CR175","first-page":"13","volume":"7","author":"J Stoyanovich","year":"2019","unstructured":"Stoyanovich, J., Howe, B.: Nutritional labels for data and models. Data Eng. 7, 13 (2019)","journal-title":"Data Eng."},{"key":"671_CR176","doi-asserted-by":"publisher","unstructured":"Stoyanovich, J., Howe, B., Abiteboul, S., Miklau, G., Sahuguet, A., Weikum, G.: Fides: Towards a platform for responsible data science. In: Proceedings of the 29th International Conference on Scientific and Statistical Database Management, SSDBM\u201917, pp. 26:1\u201326:6. ACM, New York, NY, USA (2017). https:\/\/doi.org\/10.1145\/3085504.3085530","DOI":"10.1145\/3085504.3085530"},{"issue":"12","key":"671_CR177","doi-asserted-by":"publisher","first-page":"3474","DOI":"10.14778\/3415478.3415570","volume":"13","author":"J Stoyanovich","year":"2020","unstructured":"Stoyanovich, J., Howe, B., Jagadish, H.: Responsible data management. Proc. VLDB Endow 13(12), 3474\u20133488 (2020)","journal-title":"Proc. VLDB Endow"},{"key":"671_CR178","doi-asserted-by":"publisher","unstructured":"Stoyanovich, J., Yang, K., Jagadish, H.V.: Online set selection with fairness and diversity constraints. In: Proceedings of the 21th International Conference on Extending Database Technology (EDBT 2018), Vienna, Austria, March 26\u201329, 2018., pp. 241\u2013252 (2018). https:\/\/doi.org\/10.5441\/002\/edbt.2018.22","DOI":"10.5441\/002\/edbt.2018.22"},{"key":"671_CR179","doi-asserted-by":"publisher","unstructured":"Stratigi, M., Kondylakis, H., Stefanidis, K.: Fairness in group recommendations in the health domain. In: 33rd IEEE International Conference on Data Engineering (ICDE 2017), San Diego, CA, USA, April 19\u201322, 2017, pp. 1481\u20131488 (2017). https:\/\/doi.org\/10.1109\/ICDE.2017.217","DOI":"10.1109\/ICDE.2017.217"},{"key":"671_CR180","doi-asserted-by":"publisher","unstructured":"S\u00fchr, T., Biega, A.J., Zehlike, M., Gummadi, K.P., Chakraborty, A.: Two-sided fairness for repeated matchings in two-sided markets: a case study of a ride-hailing platform. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4\u20138, 2019, pp. 3082\u20133092 (2019). https:\/\/doi.org\/10.1145\/3292500.3330793","DOI":"10.1145\/3292500.3330793"},{"key":"671_CR181","doi-asserted-by":"crossref","unstructured":"Sun, C., Asudeh, A., Jagadish, H., Howe, B., Stoyanovich, J.: Mithralabel: Flexible dataset nutritional labels for responsible data science. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 2893\u20132896 (2019)","DOI":"10.1145\/3357384.3357853"},{"key":"671_CR182","unstructured":"Sun, T., Gaut, A., Tang, S., Huang, Y., ElSherief, M., Zhao, J., Mirza, D., Belding, E.M., Chang, K., Wang, W.Y.: Mitigating gender bias in natural language processing: literature review. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, ACL 2019, Florence, Italy, July 28\u2013 August 2, 2019, Volume 1: Long Papers, pp. 1630\u20131640 (2019). https:\/\/www.aclweb.org\/anthology\/P19-1159\/"},{"key":"671_CR183","doi-asserted-by":"publisher","unstructured":"Tae, K.H., Roh, Y., Oh, Y.H., Kim, H., Whang, S.E.: Data cleaning for accurate, fair, and robust models: a big data\u2014AI integration approach. In: Proceedings of the 3rd International Workshop on Data Management for End-to-End Machine Learning, DEEM\u201919, pp. 5:1\u20135:4. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3329486.3329493","DOI":"10.1145\/3329486.3329493"},{"key":"671_CR184","unstructured":"Thebault-Spieker, J., Venkatagiri, S., Mitchell, D., Hurt, C., Luther, K.: Pairwise: mitigating political bias in crowdsourced content moderation. In: Proceedings of HCOMP 2019 (2019)"},{"key":"671_CR185","doi-asserted-by":"crossref","unstructured":"Torralba, A., Efros, A.A., et\u00a0al.: Unbiased look at dataset bias. In: CVPR, vol.\u00a01, p.\u00a07. Citeseer (2011)","DOI":"10.1109\/CVPR.2011.5995347"},{"key":"671_CR186","doi-asserted-by":"publisher","unstructured":"Udeshi, S., Arora, P., Chattopadhyay, S.: Automated directed fairness testing. In: Proceedings of the 33rd ACM\/IEEE International Conference on Automated Software Engineering (ASE 2018), pp. 98\u2013108. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3238147.3238165","DOI":"10.1145\/3238147.3238165"},{"key":"671_CR187","unstructured":"Vincent, J.: Twitter taught Microsoft\u2019s AI Chatbot to be a Racist Asshole in Less than a Day. https:\/\/www.theverge.com\/2016\/3\/24\/11297050\/tay-microsoft-chatbot-racist (2020)"},{"key":"671_CR188","doi-asserted-by":"crossref","unstructured":"Vandenhof, C.: A hybrid approach to identifying unknown unknowns of predictive models. In: Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7, 180\u2013187 (2019)","DOI":"10.1609\/hcomp.v7i1.5274"},{"key":"671_CR189","doi-asserted-by":"publisher","unstructured":"Vasconcelos, M., Cardonha, C., Gon\u00e7alves, B.: Modeling epistemological principles for bias mitigation in AI systems: An illustration in hiring decisions. In: Proceedings of the 2018 AAAI\/ACM Conference on AI, Ethics, and Society, AIES\u201918, pp. 323\u2013329. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3278721.3278751","DOI":"10.1145\/3278721.3278751"},{"key":"671_CR190","doi-asserted-by":"publisher","unstructured":"Veale, M., Van\u00a0Kleek, M., Binns, R.: Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI\u201918, pp. 440:1\u2013440:14. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3173574.3174014","DOI":"10.1145\/3173574.3174014"},{"key":"671_CR191","doi-asserted-by":"publisher","unstructured":"Verma, S., Rubin, J.: Fairness definitions explained. In: Proceedings of the International Workshop on Software Fairness, FairWare\u201918, pp. 1\u20137. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3194770.3194776","DOI":"10.1145\/3194770.3194776"},{"key":"671_CR192","doi-asserted-by":"publisher","unstructured":"Vorvoreanu, M., Zhang, L., Huang, Y.H., Hilderbrand, C., Steine-Hanson, Z., Burnett, M.: From gender biases to gender-inclusive design: an empirical investigation. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI\u201919, pp. 53:1\u201353:14. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3290605.3300283","DOI":"10.1145\/3290605.3300283"},{"key":"671_CR193","doi-asserted-by":"publisher","unstructured":"Wang, Y., Redmiles, D.F.: Implicit gender biases in professional software development: an empirical study. In: Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Society (ICSE 2019), Montreal, QC, Canada, May 25\u201331, 2019, pp. 1\u201310 (2019). https:\/\/doi.org\/10.1109\/ICSE-SEIS.2019.00009","DOI":"10.1109\/ICSE-SEIS.2019.00009"},{"issue":"9","key":"671_CR194","doi-asserted-by":"publisher","first-page":"1286","DOI":"10.1109\/TKDE.2009.138","volume":"22","author":"J Weng","year":"2009","unstructured":"Weng, J., Shen, Z., Miao, C., Goh, A., Leung, C.: Credibility: how agents can handle unfair third-party testimonies in computational trust models. IEEE Trans. Knowl. Data Eng. 22(9), 1286\u20131298 (2009)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"671_CR195","doi-asserted-by":"publisher","unstructured":"Woodruff, A., Fox, S.E., Rousso-Schindler, S., Warshaw, J.: A qualitative exploration of perceptions of algorithmic fairness. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI\u201918), pp. 656:1\u2013656:14. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3173574.3174230","DOI":"10.1145\/3173574.3174230"},{"issue":"3","key":"671_CR196","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1109\/TKDE.2018.2840127","volume":"31","author":"I Yahav","year":"2018","unstructured":"Yahav, I., Shehory, O., Schwartz, D.: Comments mining with tf-idf: the inherent bias and its removal. IEEE Trans. Knowl. Data Eng. 31(3), 437\u2013450 (2018)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"671_CR197","doi-asserted-by":"crossref","unstructured":"Yamada, M., Sigal, L., Raptis, M.: No bias left behind: covariate shift adaptation for discriminative 3d pose estimation. In: European Conference on Computer Vision, pp. 674\u2013687. Springer (2012)","DOI":"10.1007\/978-3-642-33765-9_48"},{"key":"671_CR198","first-page":"49","volume":"9","author":"A Yan","year":"2019","unstructured":"Yan, A., Howe, B.: Fairness in practice: a survey on equity in urban mobility. Data Eng. 9, 49 (2019)","journal-title":"Data Eng."},{"key":"671_CR199","doi-asserted-by":"crossref","unstructured":"Yang, K., Gkatzelis, V., Stoyanovich, J.: Balanced ranking with diversity constraints. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI (2019)","DOI":"10.24963\/ijcai.2019\/836"},{"key":"671_CR200","unstructured":"Yang, K., Huang, B., Stoyanovich, J., Schelter, S.: Fairness-aware instrumentation of preprocessing pipelines for machine learning. In: HILDA workshop at SIGMOD (2020)"},{"key":"671_CR201","unstructured":"Yang, K., Loftus, J.R., Stoyanovich, J.: Causal Intersectionality for Fair Ranking (2020)"},{"key":"671_CR202","doi-asserted-by":"publisher","unstructured":"Yang, K., Qinami, K., Fei-Fei, L., Deng, J., Russakovsky, O.: Towards fairer datasets: filtering and balancing the distribution of the people subtree in the imagenet hierarchy. In: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, FAT*\u201920, pp. 547\u2013558. Association for Computing Machinery, New York, NY, USA (2020). https:\/\/doi.org\/10.1145\/3351095.3375709","DOI":"10.1145\/3351095.3375709"},{"key":"671_CR203","doi-asserted-by":"publisher","unstructured":"Yang, K., Stoyanovich, J.: Measuring fairness in ranked outputs. In: Proceedings of the 29th International Conference on Scientific and Statistical Database Management (SSDBM\u201917), pp. 22:1\u201322:6. ACM, New York, NY, USA (2017). https:\/\/doi.org\/10.1145\/3085504.3085526","DOI":"10.1145\/3085504.3085526"},{"key":"671_CR204","doi-asserted-by":"publisher","unstructured":"Yang, K., Stoyanovich, J., Asudeh, A., Howe, B., Jagadish, H., Miklau, G.: A nutritional label for rankings. In: Proceedings of the 2018 International Conference on Management of Data (SIGMOD\u201918), pp. 1773\u20131776. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3183713.3193568","DOI":"10.1145\/3183713.3193568"},{"key":"671_CR205","doi-asserted-by":"publisher","unstructured":"Yuan, S., Wu, X., Xiang, Y.: A two phase deep learning model for identifying discrimination from tweets. In: Proceedings of the 19th International Conference on Extending Database Technology (EDBT 2016), Bordeaux, France, March 15\u201316, 2016, pp. 696\u2013697 (2016). https:\/\/doi.org\/10.5441\/002\/edbt.2016.92","DOI":"10.5441\/002\/edbt.2016.92"},{"issue":"2","key":"671_CR206","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1109\/TKDE.2014.2327039","volume":"27","author":"J Zhang","year":"2014","unstructured":"Zhang, J., Wu, X., Sheng, V.S.: Imbalanced multiple noisy labeling. IEEE Trans. Knowl. Data Eng. 27(2), 489\u2013503 (2014)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"671_CR207","doi-asserted-by":"publisher","unstructured":"Zhang, L., Wu, Y., Wu, X.: Achieving non-discrimination in data release. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, August 13\u201317, 2017, pp. 1335\u20131344 (2017). https:\/\/doi.org\/10.1145\/3097983.3098167","DOI":"10.1145\/3097983.3098167"},{"key":"671_CR208","first-page":"17","volume":"8","author":"L Zhang","year":"2018","unstructured":"Zhang, L., Wu, Y., Wu, X.: Causal modeling-based discrimination discovery and removal: criteria, bounds, and algorithms. IEEE Trans. Knowl. Data Eng. 8, 17 (2018)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"671_CR209","doi-asserted-by":"publisher","unstructured":"Zhang, Y., Bellamy, R.K., Kellogg, W.A.: Designing information for remediating cognitive biases in decision-making. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI\u201915), pp. 2211\u20132220. ACM, New York, NY, USA (2015). https:\/\/doi.org\/10.1145\/2702123.2702239","DOI":"10.1145\/2702123.2702239"},{"key":"671_CR210","doi-asserted-by":"publisher","unstructured":"Zheng, Y., Dave, T., Mishra, N., Kumar, H.: Fairness in reciprocal recommendations: a speed-dating study. In: Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization (UMAP\u201918), pp. 29\u201334. ACM, New York, NY, USA (2018). https:\/\/doi.org\/10.1145\/3213586.3226207","DOI":"10.1145\/3213586.3226207"},{"issue":"4","key":"671_CR211","doi-asserted-by":"publisher","first-page":"1060","DOI":"10.1007\/s10618-017-0506-1","volume":"31","author":"I Zliobaite","year":"2017","unstructured":"Zliobaite, I.: Measuring discrimination in algorithmic decision making. Data Min. Knowl. Discov. 31(4), 1060\u20131089 (2017). https:\/\/doi.org\/10.1007\/s10618-017-0506-1","journal-title":"Data Min. Knowl. Discov."}],"container-title":["The VLDB Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00778-021-00671-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00778-021-00671-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00778-021-00671-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,26]],"date-time":"2022-12-26T10:40:08Z","timestamp":1672051208000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00778-021-00671-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,5]]},"references-count":211,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["671"],"URL":"https:\/\/doi.org\/10.1007\/s00778-021-00671-8","relation":{},"ISSN":["1066-8888","0949-877X"],"issn-type":[{"value":"1066-8888","type":"print"},{"value":"0949-877X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,5]]},"assertion":[{"value":"21 September 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 February 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 April 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 May 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}