{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T23:56:42Z","timestamp":1771027002932,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,8,27]],"date-time":"2022-08-27T00:00:00Z","timestamp":1661558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Spanish Ministry of Culture and Sports","award":["02\/UPR\/21"],"award-info":[{"award-number":["02\/UPR\/21"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Are algorithms sexist? This is a question that has been frequently appearing in the mass media, and the debate has typically been far from a scientific analysis. This paper aims at answering the question using a hybrid social and technical perspective. First a technical-oriented definition of the algorithm concept is provided, together with a more social-oriented interpretation. Secondly, several related works have been reviewed in order to clarify the state of the art in this matter, as well as to highlight the different perspectives under which the topic has been analyzed. Thirdly, we describe an illustrative numerical example possible discrimination in the banking sector due to data bias, and propose a simple but effective methodology to address it. Finally, a series of recommendations are provided with the goal of minimizing gender bias while designing and using data-algorithmic processes to support decision making in different environments.<\/jats:p>","DOI":"10.3390\/a15090303","type":"journal-article","created":{"date-parts":[[2022,8,28]],"date-time":"2022-08-28T21:22:56Z","timestamp":1661721776000},"page":"303","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Dealing with Gender Bias Issues in Data-Algorithmic Processes: A Social-Statistical Perspective"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7175-3769","authenticated-orcid":false,"given":"Juliana","family":"Castaneda","sequence":"first","affiliation":[{"name":"Computer Science Department, Universitat Oberta de Catalunya, 08018 Barcelona, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5406-2456","authenticated-orcid":false,"given":"Assumpta","family":"Jover","sequence":"additional","affiliation":[{"name":"Department of Sociology and Social Anthropology, Universitat de Val\u00e8ncia, 46022 Valencia, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8425-1381","authenticated-orcid":false,"given":"Laura","family":"Calvet","sequence":"additional","affiliation":[{"name":"Computer Science Department, Universitat Oberta de Catalunya, 08018 Barcelona, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9699-6831","authenticated-orcid":false,"given":"Sergi","family":"Yanes","sequence":"additional","affiliation":[{"name":"GenTIC, Universitat Oberta de Catalunya, 08018 Barcelona, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1392-1776","authenticated-orcid":false,"given":"Angel A.","family":"Juan","sequence":"additional","affiliation":[{"name":"Department of Applied Statistics and Operations Research, Universitat Polit\u00e8cnica de Val\u00e8ncia, 03801 Alcoy, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4803-1597","authenticated-orcid":false,"given":"Milagros","family":"Sainz","sequence":"additional","affiliation":[{"name":"GenTIC, Universitat Oberta de Catalunya, 08018 Barcelona, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,27]]},"reference":[{"key":"ref_1","unstructured":"Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems, Kaufmann."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1108\/OIR-10-2018-0332","article-title":"Situated algorithms: A sociotechnical systemic approach to bias","volume":"44","author":"Draude","year":"2019","journal-title":"Online Inf. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"375","DOI":"10.14506\/ca33.3.04","article-title":"What should an anthropology of algorithms do?","volume":"33","author":"Seaver","year":"2018","journal-title":"Cult. Anthropol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1088\/2058-7058\/34\/05\/39","article-title":"Fighting algorithmic bias","volume":"34","author":"Photopoulos","year":"2021","journal-title":"Phys. World"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ahmed, M.A., Chatterjee, M., Dadure, P., and Pakray, P. (2022, January 20). The Role of Biased Data in Computerized Gender Discrimination. Proceedings of the 2022 IEEE\/ACM 3rd International Workshop on Gender Equality, Diversity and Inclusion in Software Engineering (GEICSE), Pittsburgh, PA, USA.","DOI":"10.1145\/3524501.3527599"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kuppler, M. (2022). Predicting the future impact of Computer Science researchers: Is there a gender bias?. Scientometrics, 1\u201338.","DOI":"10.1007\/s11192-022-04337-2"},{"key":"ref_7","unstructured":"Brunet, M.E., Alkalay-Houlihan, C., Anderson, A., and Zemel, R. (2019, January 9\u201315). Understanding the origins of bias in word embeddings. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1126\/science.aal4230","article-title":"Semantics derived automatically from language corpora contain human-like biases","volume":"356","author":"Caliskan","year":"2017","journal-title":"Science"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/2053951716679679","article-title":"The ethics of algorithms: Mapping the debate","volume":"3","author":"Mittelstadt","year":"2016","journal-title":"Big Data Soc."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1007\/s00146-021-01154-8","article-title":"The ethics of algorithms: Key problems and solutions","volume":"37","author":"Tsamados","year":"2022","journal-title":"AI Soc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1575","DOI":"10.1007\/s11948-015-9734-1","article-title":"The debate on the moral responsibilities of online service providers","volume":"22","author":"Taddeo","year":"2016","journal-title":"Sci. Eng. Ethics"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gillespie, T. (2016). Algorithm. Digital Keywords, Princeton University Press. Chapter 2.","DOI":"10.1515\/9781400880553-004"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1145\/359131.359136","article-title":"Algorithm = logic + control","volume":"22","author":"Kowalski","year":"1979","journal-title":"Commun. ACM"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Moschovakis, Y.N. (2001). What is an Algorithm?. Mathematics Unlimited\u20142001 and beyond, Springer.","DOI":"10.1007\/978-3-642-56478-9_46"},{"key":"ref_15","unstructured":"Sedgewick, R., and Wayne, K. (2011). Algorithms, Addison-Wesley Professional."},{"key":"ref_16","unstructured":"Brassard, G., and Bratley, P. (1996). Fundamentals of Algorithmics, Prentice-Hall, Inc."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Skiena, S.S. (2020). The Algorithm Design Manual, Springer International Publishing.","DOI":"10.1007\/978-3-030-54256-6"},{"key":"ref_18","unstructured":"Mohri, M., Rostamizadeh, A., and Talwalkar, A. (2018). Foundations of Machine Learning, MIT Press."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nilsson, N.J. (2009). The Quest for Artificial Intelligence, Cambridge University Press.","DOI":"10.1017\/CBO9780511819346"},{"key":"ref_20","unstructured":"Pedreschi, D., Giannotti, F., Guidotti, R., Monreale, A., Ruggieri, S., and Turini, F. (February, January 27). Meaningful explanations of black box AI decision systems. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Oneto, L., and Chiappa, S. (2020). Fairness in machine learning. Recent Trends Learn from Data, Springer.","DOI":"10.1007\/978-3-030-43883-8_7"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2053951717726554","DOI":"10.1177\/2053951717726554","article-title":"Algorithmic governance: Developing a research agenda through the power of collective intelligence","volume":"4","author":"Danaher","year":"2017","journal-title":"Big Data Soc."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1177\/1461444809336551","article-title":"Power through the algorithm? Participatory web cultures and the technological unconscious","volume":"11","author":"Beer","year":"2009","journal-title":"New Media Soc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2053951717738104","DOI":"10.1177\/2053951717738104","article-title":"Algorithms as culture: Some tactics for the ethnography of algorithmic systems","volume":"4","author":"Seaver","year":"2017","journal-title":"Big Data Soc."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1080\/1369118X.2016.1154087","article-title":"Thinking critically about and researching algorithms","volume":"20","author":"Kitchin","year":"2017","journal-title":"Inf. Commun. Soc."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/s13347-019-00352-z","article-title":"Feminist AI: Can we expect our AI systems to become feminist?","volume":"33","author":"Wellner","year":"2020","journal-title":"Philos. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1353\/tech.2018.0057","article-title":"Technosystem: The Social Life of Reason by Andrew Feenberg","volume":"59","author":"Ihde","year":"2018","journal-title":"Technol. Cult."},{"key":"ref_28","unstructured":"Mitchell, T.M. (1997). Machine Learning, McGraw-Hill."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1145\/230538.230561","article-title":"Bias in computer systems","volume":"14","author":"Friedman","year":"1996","journal-title":"ACM Trans. Inf. Syst. (TOIS)"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e1356","DOI":"10.1002\/widm.1356","article-title":"Bias in data-driven artificial intelligence systems\u2014An introductory survey","volume":"10","author":"Ntoutsi","year":"2020","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3457607","article-title":"A survey on bias and fairness in machine learning","volume":"54","author":"Mehrabi","year":"2021","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"13","DOI":"10.3389\/fdata.2019.00013","article-title":"Social data: Biases, methodological pitfalls, and ethical boundaries","volume":"2","author":"Olteanu","year":"2019","journal-title":"Front. Big Data"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1145\/3209581","article-title":"Bias on the web","volume":"61","year":"2018","journal-title":"Commun. ACM"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/2.816269","article-title":"Defining the web: The politics of search engines","volume":"33","author":"Introna","year":"2000","journal-title":"Computer"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"6363","DOI":"10.1007\/s00521-019-04144-6","article-title":"Assessing gender bias in machine translation: A case study with Google translate","volume":"32","author":"Prates","year":"2020","journal-title":"Neural. Comput. Appl."},{"key":"ref_36","first-page":"4349","article-title":"Man is to computer programmer as woman is to homemaker? Debiasing word embeddings","volume":"29","author":"Bolukbasi","year":"2016","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Tatman, R. (2017, January 4). Gender and dialect bias in YouTube\u2019s automatic captions. Proceedings of the First ACL Workshop on Ethics in Natural Language Processing, Valencia, Spain.","DOI":"10.18653\/v1\/W17-1606"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Tatman, R., and Kasten, C. (2017, January 20\u201324). Effects of Talker Dialect, Gender & Race on Accuracy of Bing Speech and YouTube Automatic Captions. Proceedings of the Interspeech, Stockholm, Sweden.","DOI":"10.21437\/Interspeech.2017-1746"},{"key":"ref_39","unstructured":"Dastin, J. (2018). Amazon scraps secret AI recruiting tool that showed bias against women. Ethics of Data and Analytics, Auerbach Publications."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1086\/682955","article-title":"Beards, sandals, and other signs of rugged individualism: Masculine culture within the computing professions","volume":"30","author":"Ensmenger","year":"2015","journal-title":"Osiris"},{"key":"ref_41","unstructured":"Buolamwini, J., and Gebru, T. (2018, January 23\u201324). Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of the Conference on Fairness, Accountability and Transparency, New York, NY, USA."},{"key":"ref_42","unstructured":"R Core Team (2020). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_43","unstructured":"Therneau, T., and Atkinson, B. (2022, July 19). Rpart: Recursive Partitioning and Regression Trees; R package Version 4.1-15; 2019. Available online: https:\/\/cran.r-project.org\/web\/packages\/rpart\/index.html."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Tang, R., Du, M., Li, Y., Liu, Z., Zou, N., and Hu, X. (2021, January 19\u201323). Mitigating gender bias in captioning systems. Proceedings of the Web Conference, Ljubljana, Slovenia.","DOI":"10.1145\/3442381.3449950"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Yatskar, M., Zettlemoyer, L., and Farhadi, A. (2016, January 27\u201330). Situation recognition: Visual semantic role labeling for image understanding. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.597"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhao, J., Wang, T., Yatskar, M., Ordonez, V., and Chang, K.W. (2017). Men also like shopping: Reducing gender bias amplification using corpus-level constraints. arXiv.","DOI":"10.18653\/v1\/D17-1323"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"D\u2019Amour, A., Srinivasan, H., Atwood, J., Baljekar, P., Sculley, D., and Halpern, Y. (2020, January 27\u201330). Fairness is Not Static: Deeper Understanding of Long Term Fairness via Simulation Studies. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Barcelona, Spain.","DOI":"10.1145\/3351095.3372878"},{"key":"ref_49","first-page":"1","article-title":"A systematic review on imbalanced data challenges in machine learning: Applications and solutions","volume":"52","author":"Kaur","year":"2019","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1111\/ntwe.12210","article-title":"Job crafting for female contractors in a male-dominated profession","volume":"37","author":"Panteli","year":"2022","journal-title":"New Technol. Work. Employ."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1080\/03075079.2017.1351428","article-title":"The re-production process of gender bias: A case of ICT professors through recruitment in a gender-neutral country","volume":"44","author":"Tiainen","year":"2019","journal-title":"Stud. High. Educ."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/9\/303\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:16:22Z","timestamp":1760141782000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/9\/303"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,27]]},"references-count":51,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["a15090303"],"URL":"https:\/\/doi.org\/10.3390\/a15090303","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,27]]}}}