{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T23:57:06Z","timestamp":1785455826833,"version":"3.56.0"},"reference-count":87,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,13]],"date-time":"2023-01-13T00:00:00Z","timestamp":1673568000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Brazilian Informatics Law","award":["8248"],"award-info":[{"award-number":["8248"]}]},{"name":"Brazilian Informatics Law","award":["HP 052-21"],"award-info":[{"award-number":["HP 052-21"]}]},{"name":"SENAI\/CIMATEC","award":["8248"],"award-info":[{"award-number":["8248"]}]},{"name":"SENAI\/CIMATEC","award":["HP 052-21"],"award-info":[{"award-number":["HP 052-21"]}]},{"name":"Simpress Com\u00e9rcio, Loca\u00e7\u00e3o e Servi\u00e7os Ltda","award":["8248"],"award-info":[{"award-number":["8248"]}]},{"name":"Simpress Com\u00e9rcio, Loca\u00e7\u00e3o e Servi\u00e7os Ltda","award":["HP 052-21"],"award-info":[{"award-number":["HP 052-21"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This study examines the current knowledge on bias and unfairness in machine learning models. The systematic review followed the PRISMA guidelines and is registered on OSF plataform. The search was carried out between 2021 and early 2022 in the Scopus, IEEE Xplore, Web of Science, and Google Scholar knowledge bases and found 128 articles published between 2017 and 2022, of which 45 were chosen based on search string optimization and inclusion and exclusion criteria. We discovered that the majority of retrieved works focus on bias and unfairness identification and mitigation techniques, offering tools, statistical approaches, important metrics, and datasets typically used for bias experiments. In terms of the primary forms of bias, data, algorithm, and user interaction were addressed in connection to the preprocessing, in-processing, and postprocessing mitigation methods. The use of Equalized Odds, Opportunity Equality, and Demographic Parity as primary fairness metrics emphasizes the crucial role of sensitive attributes in mitigating bias. The 25 datasets chosen span a wide range of areas, including criminal justice image enhancement, finance, education, product pricing, and health, with the majority including sensitive attributes. In terms of tools, Aequitas is the most often referenced, yet many of the tools were not employed in empirical experiments. A limitation of current research is the lack of multiclass and multimetric studies, which are found in just a few works and constrain the investigation to binary-focused method. Furthermore, the results indicate that different fairness metrics do not present uniform results for a given use case, and that more research with varied model architectures is necessary to standardize which ones are more appropriate for a given context. We also observed that all research addressed the transparency of the algorithm, or its capacity to explain how decisions are taken.<\/jats:p>","DOI":"10.3390\/bdcc7010015","type":"journal-article","created":{"date-parts":[[2023,1,13]],"date-time":"2023-01-13T03:28:10Z","timestamp":1673580490000},"page":"15","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":264,"title":["Bias and Unfairness in Machine Learning Models: A Systematic Review on Datasets, Tools, Fairness Metrics, and Identification and Mitigation Methods"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2457-9064","authenticated-orcid":false,"given":"Tiago P.","family":"Pagano","sequence":"first","affiliation":[{"name":"Computational Modeling Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2404-0643","authenticated-orcid":false,"given":"Rafael B.","family":"Loureiro","sequence":"additional","affiliation":[{"name":"Computational Modeling Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5203-2408","authenticated-orcid":false,"given":"Fernanda V. N.","family":"Lisboa","sequence":"additional","affiliation":[{"name":"Computing Engineering Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6405-1593","authenticated-orcid":false,"given":"Rodrigo M.","family":"Peixoto","sequence":"additional","affiliation":[{"name":"Software Development Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7407-5908","authenticated-orcid":false,"given":"Guilherme A. S.","family":"Guimar\u00e3es","sequence":"additional","affiliation":[{"name":"Software Development Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4613-9342","authenticated-orcid":false,"given":"Gustavo O. R.","family":"Cruz","sequence":"additional","affiliation":[{"name":"Software Development Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5564-4781","authenticated-orcid":false,"given":"Maira M.","family":"Araujo","sequence":"additional","affiliation":[{"name":"Computing Engineering Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5949-8515","authenticated-orcid":false,"given":"Lucas L.","family":"Santos","sequence":"additional","affiliation":[{"name":"Computational Modeling Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7196-1237","authenticated-orcid":false,"given":"Marco A. S.","family":"Cruz","sequence":"additional","affiliation":[{"name":"HP Inc. Brazil R&D, Porto Alegre 90619-900, RS, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3160-3571","authenticated-orcid":false,"given":"Ewerton L. S.","family":"Oliveira","sequence":"additional","affiliation":[{"name":"HP Inc. Brazil R&D, Porto Alegre 90619-900, RS, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6505-6636","authenticated-orcid":false,"given":"Ingrid","family":"Winkler","sequence":"additional","affiliation":[{"name":"Management and Industrial Technology Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2219-0290","authenticated-orcid":false,"given":"Erick G. S.","family":"Nascimento","sequence":"additional","affiliation":[{"name":"Computational Modeling Department, SENAI CIMATEC University Center, Salvador 41650-010, BA, Brazil"},{"name":"Surrey Institute for People-Centred AI, School of Computer Science and Electronic Engineering, Faculty of Engineering and Physical Sciences, University of Surrey, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"101994","DOI":"10.1016\/j.ijinfomgt.2019.08.002","article-title":"Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy","volume":"57","author":"Dwivedi","year":"2021","journal-title":"Int. J. Inf. Manag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1146\/annurev-statistics-042720-125902","article-title":"Algorithmic Fairness: Choices, Assumptions, and Definitions","volume":"8","author":"Mitchell","year":"2021","journal-title":"Annu. Rev. Stat. Its Appl."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Verma, S., and Rubin, J. (2018, January 29). Fairness definitions explained. Proceedings of the 2018 IEEE\/ACM International Workshop on Software Fairness (Fairware), Gothenburg, Sweden.","DOI":"10.1145\/3194770.3194776"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.cirpj.2020.02.002","article-title":"Characterising the Digital Twin: A systematic literature review","volume":"29","author":"Jones","year":"2020","journal-title":"CIRP J. Manuf. Sci. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I.D., and Gebru, T. (2019, January 29\u201331). Model cards for model reporting. Proceedings of the Conference on Fairness, Accountability, and Transparency, Atlanta, GA, USA.","DOI":"10.1145\/3287560.3287596"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1145\/3512728","article-title":"Recommender systems under European AI regulations","volume":"65","author":"Tintarev","year":"2022","journal-title":"Commun. ACM"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/MSP.2021.3106615","article-title":"Integrating Psychometrics and Computing Perspectives on Bias and Fairness in Affective Computing: A case study of automated video interviews","volume":"38","author":"Booth","year":"2021","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_8","unstructured":"Schumann, C., Foster, J.S., Mattei, N., and Dickerson, J.P. (2020, January 9\u201313). We need fairness and explainability in algorithmic hiring. Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems, Auckland, New Zealand."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1093\/ijlit\/eaz006","article-title":"Cyber Gremlin: Social networking, machine learning and the global war on Al-Qaida-and IS-inspired terrorism","volume":"27","author":"Ammar","year":"2019","journal-title":"Int. J. Law Inf. Technol."},{"key":"ref_10","unstructured":"Seymour, W. (2018). Detecting bias: Does an algorithm have to be transparent in order to Be Fair?. Jo Bates Paul D. Clough Robert J\u00e4schke, Available online: https:\/\/www.cs.ox.ac.uk\/files\/11108\/process-outcome-transparency.pdf."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gade, K., Geyik, S.C., Kenthapadi, K., Mithal, V., and Taly, A. (2019, January 4\u20138). Explainable AI in industry. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3332281"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4:1","DOI":"10.1147\/JRD.2019.2942287","article-title":"AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias","volume":"63","author":"Bellamy","year":"2019","journal-title":"IBM J. Res. Dev."},{"key":"ref_13","unstructured":"Bird, S., Dud\u00edk, M., Edgar, R., Horn, B., Lutz, R., Milan, V., Sameki, M., Wallach, H., and Walker, K. (2020). Fairlearn: A toolkit for assessing and improving fairness in AI. Microsoft Tech. Rep. MSR-TR-2020-32, Available online: https:\/\/www.scinapse.io\/papers\/3030081171."},{"key":"ref_14","first-page":"56","article-title":"The what-if tool: Interactive probing of machine learning models","volume":"26","author":"Wexler","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Tenney, I., Wexler, J., Bastings, J., Bolukbasi, T., Coenen, A., Gehrmann, S., Jiang, E., Pushkarna, M., Radebaugh, C., and Reif, E. (2020). The language interpretability tool: Extensible, interactive visualizations and analysis for NLP models. arXiv.","DOI":"10.18653\/v1\/2020.emnlp-demos.15"},{"key":"ref_16","unstructured":"Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anisfeld, A., Rodolfa, K.T., and Ghani, R. (2018). Aequitas: A bias and fairness audit toolkit. arXiv."},{"key":"ref_17","unstructured":"Nielsen, A. (2020). Practical Fairness: Achieving Fair and Secure Data Models, O\u2019Reilly Media, Incorporated."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1080\/0960085X.2021.1927212","article-title":"Algorithmic bias: Review, synthesis, and future research directions","volume":"31","author":"Kordzadeh","year":"2022","journal-title":"Eur. J. Inf. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Gad, A.F., Gad, A.F., and John, S. (2018). Practical Computer Vision Applications Using Deep Learning with CNNs, Springer.","DOI":"10.1007\/978-1-4842-4167-7"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yang, Y., Gupta, A., Feng, J., Singhal, P., Yadav, V., Wu, Y., Natarajan, P., Hedau, V., and Joo, J. (2021, January 19\u201321). Enhancing fairness in face detection in computer vision systems by demographic bias mitigation. Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society, Oxford, UK.","DOI":"10.1145\/3514094.3534153"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"02004","DOI":"10.1051\/matecconf\/201927702004","article-title":"Machine translation using natural language processing","volume":"277","author":"Rishita","year":"2019","journal-title":"MATEC Web Conf."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Alkomah, F., and Ma, X. (2022). A Literature Review of Textual Hate Speech Detection Methods and Datasets. Information, 13.","DOI":"10.14569\/IJACSA.2022.01308100"},{"key":"ref_23","unstructured":"Vaswani, A., Shazeer, N.M., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention is All you Need. Proceedings of the NIPS, Long Beach, CA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"205","DOI":"10.2478\/ausi-2020-0012","article-title":"Machine learning methods for toxic comment classification: A systematic review","volume":"12","year":"2020","journal-title":"Acta Univ. Sapientiae Inform."},{"key":"ref_25","unstructured":"Liang, P.P., Wu, C., Morency, L.P., and Salakhutdinov, R. (2021, January 18\u201324). Towards understanding and mitigating social biases in language models. Proceedings of the International Conference on Machine Learning (PMLR), Virtual."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Cheng, H.T., Koc, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G., Chai, W., and Ispir, M. (2016, January 15). Wide & deep learning for recommender systems. Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, Boston, MA, USA.","DOI":"10.1145\/2988450.2988454"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MIC.2017.72","article-title":"Two decades of recommender systems at Amazon.com","volume":"21","author":"Smith","year":"2017","journal-title":"IEEE Internet Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"102646","DOI":"10.1016\/j.ipm.2021.102646","article-title":"Fairness metrics and bias mitigation strategies for rating predictions","volume":"58","author":"Ashokan","year":"2021","journal-title":"Inf. Process. Manag."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e1452","DOI":"10.1002\/widm.1452","article-title":"A survey on datasets for fairness-aware machine learning","volume":"12","author":"Roy","year":"2022","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3494672","article-title":"A Review on Fairness in Machine Learning","volume":"55","author":"Pessach","year":"2022","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_31","unstructured":"Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., and Galstyan, A. (2019). A survey on bias and fairness in machine learning. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bacelar, M. (2021). Monitoring bias and fairness in machine learning models: A review. ScienceOpen Prepr.","DOI":"10.14293\/S2199-1006.1.SOR-.PP59WRH.v1"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1007\/s00778-021-00671-8","article-title":"Managing bias and unfairness in data for decision support: A survey of machine learning and data engineering approaches to identify and mitigate bias and unfairness within data management and analytics systems","volume":"30","author":"Balayn","year":"2021","journal-title":"VLDB J."},{"key":"ref_34","unstructured":"Chouldechova, A., and Roth, A. (2018). The frontiers of fairness in machine learning. arXiv."},{"key":"ref_35","unstructured":"Suresh, H., and Guttag, J. (2019). A Framework for Understanding Unintended Consequences of Machine Learning. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1007\/s11365-020-00635-4","article-title":"The art of crafting a systematic literature review in entrepreneurship research","volume":"16","author":"Kraus","year":"2020","journal-title":"Int. Entrep. Manag. J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Pagano, T.P., Santos, V.R., Bonfim, Y.d.S., Paranhos, J.V.D., Ortega, L.L., S\u00e1, P.H.M., Nascimento, L.F.S., Winkler, I., and Nascimento, E.G.S. (2022). Machine Learning Models and Videos of Facial Regions for Estimating Heart Rate: A Review on Patents, Datasets, and Literature. Electronics, 11.","DOI":"10.3390\/electronics11091473"},{"key":"ref_39","unstructured":"Booth, A., Sutton, A., and Papaioannou, D. (2016). Systematic Approaches to a Successful Literature Review, SAGE."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.1111\/2041-210X.13268","article-title":"An automated approach to identifying search terms for systematic reviews using keyword co-occurrence networks","volume":"10","author":"Grames","year":"2019","journal-title":"Methods Ecol. Evol."},{"key":"ref_41","first-page":"158","article-title":"Global Library & Information Science Research seen through Prism of Biblioshiny","volume":"40","author":"Patil","year":"2020","journal-title":"Stud. Indian Place Names"},{"key":"ref_42","first-page":"959","article-title":"bibliometrix: An R-tool for comprehensive science mapping analysis","volume":"11","author":"Aria","year":"2017","journal-title":"J. Inf."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1093\/bjc\/azaa099","article-title":"When Politicization Stops Algorithms in Criminal Justice","volume":"61","author":"Wenzelburger","year":"2021","journal-title":"Br. J. Criminol."},{"key":"ref_44","unstructured":"Jalal, A., Karmalkar, S., Hoffmann, J., Dimakis, A., and Price, E. (2021, January 18\u201324). Fairness for image generation with uncertain sensitive attributes. Proceedings of the International Conference on Machine Learning (PMLR), Virtual."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lee, M.S.A., and Singh, J. (2021, January 19\u201321). Risk Identification Questionnaire for Detecting Unintended Bias in the Machine Learning Development Lifecycle. Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society, Virtual Event.","DOI":"10.1145\/3461702.3462572"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1177\/09637214211056906","article-title":"Psychological measurement in the information age: Machine-learned computational models","volume":"31","author":"Tay","year":"2022","journal-title":"Curr. Dir. Psychol. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Li, S., Yu, J., Du, X., Lu, Y., and Qiu, R. (2022). Fair Outlier Detection Based on Adversarial Representation Learning. Symmetry, 14.","DOI":"10.3390\/sym14020347"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1002\/pra2.7","article-title":"Dataset bias: A case study for visual question answering","volume":"56","author":"Das","year":"2019","journal-title":"Proc. Assoc. Inf. Sci. Technol."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Fontana, M., Naretto, F., Monreale, A., and Giannotti, F. (2022). Monitoring Fairness in HOLDA. Hibrid Human-Artificial Intelligence, IOS Press.","DOI":"10.3233\/FAIA220205"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Bryant, R., Cintas, C., Wambugu, I., Kinai, A., and Weldemariam, K. (2019). Analyzing bias in sensitive personal information used to train financial models. arXiv.","DOI":"10.1109\/GlobalSIP45357.2019.8969527"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Chiappa, S., and Isaac, W.S. (2018). A causal bayesian networks viewpoint on fairness. IFIP International Summer School on Privacy and Identity Management, Springer.","DOI":"10.1007\/978-3-030-16744-8_1"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Sun, W., Nasraoui, O., and Shafto, P. (2020). Evolution and impact of bias in human and machine learning algorithm interaction. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0235502"},{"key":"ref_53","unstructured":"Yang, K., Huang, B., Stoyanovich, J., and Schelter, S. (2020, January 19). Fairness-Aware Instrumentation of Preprocessing Pipelines for Machine Learning. Proceedings of the Workshop on Human-In-the-Loop Data Analytics (HILDA\u201920), Portland, OR, USA."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Paviglianiti, A., and Pasero, E. (2020, January 3\u20135). VITAL-ECG: A de-bias algorithm embedded in a gender-immune device. Proceedings of the 2020 IEEE International Workshop on Metrology for Industry 4.0 & IoT, Roma, Italy.","DOI":"10.1109\/MetroInd4.0IoT48571.2020.9138291"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Martinez Neda, B., Zeng, Y., and Gago-Masague, S. (2021, January 13\u201320). Using Machine Learning in Admissions: Reducing Human and Algorithmic Bias in the Selection Process. Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, Virtual.","DOI":"10.1145\/3408877.3439664"},{"key":"ref_56","unstructured":"Adel, T., Valera, I., Ghahramani, Z., and Weller, A. (February, January 27). One-network adversarial fairness. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_57","unstructured":"Paa\u00dfen, B., Bunge, A., Hainke, C., Sindelar, L., and Vogelsang, M. (2019, January 24\u201326). Dynamic fairness\u2014Breaking vicious cycles in automatic decision making. Proceedings of the ESANN, Bruges, Belgium."},{"key":"ref_58","unstructured":"Quadrianto, N., and Sharmanska, V. (2017, January 4\u20139). Recycling privileged learning and distribution matching for fairness. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_59","first-page":"14","article-title":"Improving machine learning fairness with sampling and adversarial learning","volume":"36","author":"Amend","year":"2021","journal-title":"J. Comput. Sci. Coll."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Cerrato, M., Esposito, R., and Puma, L.L. (April, January 30). Constraining deep representations with a noise module for fair classification. Proceedings of the 35th Annual ACM Symposium on Applied Computing, Brno, Czech Republic.","DOI":"10.1145\/3341105.3374090"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Grari, V., Ruf, B., Lamprier, S., and Detyniecki, M. (2019, January 8\u201311). Fair adversarial gradient tree boosting. Proceedings of the 2019 IEEE International Conference on Data Mining (ICDM), Beijing, China.","DOI":"10.1109\/ICDM.2019.00124"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Jain, B., Huber, M., Fegaras, L., and Elmasri, R.A. (2019, January 5\u20137). Singular race models: Addressing bias and accuracy in predicting prisoner recidivism. Proceedings of the 12th ACM International Conference on Pervasive Technologies Related to Assistive Environments, Rhodes, Greece.","DOI":"10.1145\/3316782.3322787"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"2288","DOI":"10.1007\/s11263-021-01448-w","article-title":"Mitigating Demographic Bias in Facial Datasets with Style-Based Multi-attribute Transfer","volume":"129","author":"Georgopoulos","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Jang, T., Zheng, F., and Wang, X. (2021, January 2\u20139). Constructing a Fair Classifier with Generated Fair Data. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.","DOI":"10.1609\/aaai.v35i9.16965"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Radovanovi\u0107, S., Petrovi\u0107, A., Deliba\u0161i\u0107, B., and Suknovi\u0107, M. (2020, January 24\u201326). Enforcing fairness in logistic regression algorithm. Proceedings of the 2020 International Conference on Innovations in Intelligent SysTems and Applications (INISTA), Novi Sad, Serbia.","DOI":"10.1109\/INISTA49547.2020.9194676"},{"key":"ref_66","first-page":"12091","article-title":"Fairness via Representation Neutralization","volume":"34","author":"Du","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Gitiaux, X., and Rangwala, H. (2019, January 10\u201316). mdfa: Multi-Differential Fairness Auditor for Black Box Classifiers. Proceedings of the IJCAI, Macao, China.","DOI":"10.24963\/ijcai.2019\/814"},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"115667","DOI":"10.1016\/j.eswa.2021.115667","article-title":"Improving fairness of artificial intelligence algorithms in Privileged-Group Selection Bias data settings","volume":"185","author":"Pessach","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"5940","DOI":"10.1007\/s10489-020-02089-1","article-title":"Cost-sensitive hierarchical classification via multi-scale information entropy for data with an imbalanced distribution","volume":"51","author":"Zheng","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Shi, S., Wei, S., Shi, Z., Du, Y., Fan, W., Fan, J., Conyers, Y., and Xu, F. (2020, January 14\u201318). Algorithm Bias Detection and Mitigation in Lenovo Face Recognition Engine. Proceedings of the CCF International Conference on Natural Language Processing and Chinese Computing, Zhengzhou, China.","DOI":"10.1007\/978-3-030-60457-8_36"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"101988","DOI":"10.1016\/j.telpol.2020.101988","article-title":"Harnessing artificial intelligence (AI) to increase wellbeing for all: The case for a new technology diplomacy","volume":"44","author":"Kwon","year":"2020","journal-title":"Telecommun. Policy"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Gambs, S. (2018, January 13\u201315). Privacy and Ethical Challenges in Big Data. Proceedings of the International Symposium on Foundations and Practice of Security, Montreal, QC, Canada.","DOI":"10.1007\/978-3-030-18419-3_2"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"3474","DOI":"10.14778\/3415478.3415570","article-title":"Responsible data management","volume":"13","author":"Stoyanovich","year":"2020","journal-title":"Proc. VLDB Endow."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/MIS.2020.3000681","article-title":"Fairness in Deep Learning: A Computational Perspective","volume":"36","author":"Du","year":"2021","journal-title":"IEEE Intell. Syst."},{"key":"ref_75","unstructured":"Reddy, C., Sharma, D., Mehri, S., Romero Soriano, A., Shabanian, S., and Honari, S. (2021, January 6\u201314). Benchmarking Bias Mitigation Algorithms in Representation Learning through Fairness Metrics. Proceedings of the Neural Information Processing Systems Datasets and Benchmarks, Virtual."},{"key":"ref_76","first-page":"264","article-title":"Fairness Research on Deep Learning","volume":"58","author":"Jinyin","year":"2021","journal-title":"J. Comput. Res. Dev."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1016\/j.ejor.2021.06.023","article-title":"Fairness in credit scoring: Assessment, implementation and profit implications","volume":"297","author":"Kozodoi","year":"2022","journal-title":"Eur. J. Oper. Res."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"154096","DOI":"10.1109\/ACCESS.2019.2949286","article-title":"Black-box vs. white-box: Understanding their advantages and weaknesses from a practical point of view","volume":"7","year":"2019","journal-title":"IEEE Access"},{"key":"ref_79","unstructured":"Larson, J., Mattu, S., Kirchner, L., and Angwin, J. (2016). Machine Bias, Auerbach Publications."},{"key":"ref_80","unstructured":"Dua, D., and Graff, C. (2022, December 01). UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_81","unstructured":"Cortez, P., and Silva, A.M.G. (2008, January 9\u201311). Using data mining to predict secondary school student performance. Proceedings of the 5th Annual Future Business Technology Conference, EUROSIS-ETI, Porto, Portugal."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"2473","DOI":"10.1016\/j.eswa.2007.12.020","article-title":"The comparisons of data mining techniques for the predictive accuracy of probability of default of credit card clients","volume":"36","author":"Yeh","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1111\/1475-6773.14034","article-title":"Effects of Medicaid expansion on insurance coverage and health services use among adults with disabilities newly eligible for Medicaid","volume":"57","author":"Creedon","year":"2022","journal-title":"Health Serv. Res."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"67","DOI":"10.3844\/jcssp.2019.67.77","article-title":"Obesity level estimation software based on decision trees","volume":"15","year":"2019","journal-title":"J. Comput. Sci."},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Fehrman, E., Muhammad, A.K., Mirkes, E.M., Egan, V., and Gorban, A.N. (2017). The five factor model of personality and evaluation of drug consumption risk. Data Science, Springer.","DOI":"10.1007\/978-3-319-55723-6_18"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 7\u201313). Deep Learning Face Attributes in the Wild. Proceedings of the International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.425"},{"key":"ref_87","unstructured":"Equal Credit Opportunity Act (2018). Women in the American Political System: An Encyclopedia of Women as Voters, Candidates, and Office Holders [2 Volumes], ABC-CLIO."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/7\/1\/15\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:05:07Z","timestamp":1760119507000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/7\/1\/15"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,13]]},"references-count":87,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["bdcc7010015"],"URL":"https:\/\/doi.org\/10.3390\/bdcc7010015","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,13]]}}}