{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T16:28:20Z","timestamp":1776184100275,"version":"3.50.1"},"reference-count":46,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,2,27]],"date-time":"2025-02-27T00:00:00Z","timestamp":1740614400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2018873"],"award-info":[{"award-number":["2018873"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Machine learning (ML) algorithms play a critical role in decision-making across various domains, such as healthcare, finance, education, and law enforcement. However, concerns about fairness and bias in these systems have raised significant ethical and social challenges. To address these challenges, this research utilizes two prominent fairness libraries, Fairlearn by Microsoft and AIF360 by IBM. These libraries offer comprehensive frameworks for fairness analysis, providing tools to evaluate fairness metrics, visualize results, and implement bias mitigation algorithms. The study focuses on assessing and mitigating biases for unstructured datasets using Computer Vision (CV) and Natural Language Processing (NLP) models. The primary objective is to present a comparative analysis of the performance of mitigation algorithms from the two fairness libraries. This analysis involves applying the algorithms individually, one at a time, in one of the stages of the ML lifecycle, pre-processing, in-processing, or post-processing, as well as sequentially across more than one stage. The results reveal that some sequential applications improve the performance of mitigation algorithms by effectively reducing bias while maintaining the model\u2019s performance. Publicly available datasets from Kaggle were chosen for this research, providing a practical context for evaluating fairness in real-world machine learning workflows.<\/jats:p>","DOI":"10.3390\/info16030182","type":"journal-article","created":{"date-parts":[[2025,2,27]],"date-time":"2025-02-27T05:13:58Z","timestamp":1740633238000},"page":"182","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Analyzing Fairness of Computer Vision and Natural Language Processing Models"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5201-1735","authenticated-orcid":false,"given":"Ahmed","family":"Rashed","sequence":"first","affiliation":[{"name":"Department of Physics, Shippensburg University of Pennsylvania, Franklin Science Center, 1871 Old Main Drive, Shippensburg, PA 17257, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abdelkrim","family":"Kallich","sequence":"additional","affiliation":[{"name":"Department of Physics, Shippensburg University of Pennsylvania, Franklin Science Center, 1871 Old Main Drive, Shippensburg, PA 17257, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohamed","family":"Eltayeb","sequence":"additional","affiliation":[{"name":"Department of Data Science, College of Computer and Information Systems, Islamic University of Madinah, Al Jamiah Campus, Madinah 42351, Saudi Arabia"},{"name":"Department of Computer Science, Faculty of Mathematical Sciences, University of Khartoum, Main Campus, Al-Nil Avenue, Khartoum 11115, Sudan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1111\/1475-3995.00375","article-title":"Multi\u2013objective evolutionary algorithms for the risk\u2013return trade\u2013off in bank loan management","volume":"9","author":"Mukerjee","year":"2002","journal-title":"Int. Trans. Oper. Res."},{"key":"ref_2","unstructured":"Bogen, M., and Rieke, A. (2025, February 04). Help Wanted: An Examination of Hiring Algorithms, Equity and Bias. Upturn, 2018. Techical Report. Available online: https:\/\/www.upturn.org\/static\/reports\/2018\/hiring-algorithms\/files\/Upturn%20--%20Help%20Wanted%20-%20An%20Exploration%20of%20Hiring%20Algorithms,%20Equity%20and%20Bias.pdf."},{"key":"ref_3","unstructured":"Cohen, L., Lipton, Z.C., and Mansour, Y. (2019). Efficient candidate screening under multiple tests and implications for fairness. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6889","DOI":"10.1073\/pnas.1018033108","article-title":"Extraneous factors in judicial decisions","volume":"108","author":"Danziger","year":"2011","journal-title":"Proc. Nat. Acad. Sci. USA"},{"key":"ref_5","unstructured":"O\u2019Keeffe, A., and McCarthy, M. (2010). The Routledge Handbook of Corpus Linguistics, Routledge."},{"key":"ref_6","unstructured":"Angwin, J., Larson, J., Mattu, S., and Kirchner, L. (2024, December 16). Machine Bias: There\u2019s Software Used Across the Country to Predict Future Criminals. And It\u2019s Biased Against Blacks. Available online: https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing."},{"key":"ref_7","unstructured":"O\u2019Neil, C. (2016). Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy, Crown Publishing Group."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Madaio, M.A., Stark, L., Vaughan, J.W., and Wallach, H. (2020, January 25\u201330). Co-Designing Checklists to Understand Organizational Challenges and Opportunities Around Fairness in AI. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376445"},{"key":"ref_9","unstructured":"Buolamwini, J., and Gebru, T. (2018, January 23\u201324). Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of the Conference on Fairness, Accountability and Transparency, New York, NY, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Guo, A., Kamar, E., Vaughan, J.W., Wallach, H.M., and Morris, M.R. (2019). Toward fairness in AI for people with disabilities: A research roadmap. arXiv.","DOI":"10.1145\/3386296.3386298"},{"key":"ref_11","unstructured":"Rudin, C., Wang, C., and Coker, B. (2018). The age of secrecy and unfairness in recidivism prediction. arXiv."},{"key":"ref_12","unstructured":"Bolukbasi, T., Chang, K., Zou, J., Saligrama, V., and Kalai, A. (2016). Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings. arXiv."},{"key":"ref_13","unstructured":"Rystsov, D. (2018). CASPaxos: Replicated State Machines without logs. arXiv."},{"key":"ref_14","unstructured":"Greenlees, J.P.C. (2017). The Balmer spectrum of rational equivariant cohomology theories. arXiv."},{"key":"ref_15","unstructured":"Rashed, A., Kallich, A., and Eltayeb, M. (2024). Analyzing Fairness of Classification Machine Learning Model with Structured Dataset. arXiv."},{"key":"ref_16","unstructured":"(2024, December 16). Computer Vision Dataset. Available online: https:\/\/www.kaggle.com\/datasets\/jangedoo\/utkface-new."},{"key":"ref_17","unstructured":"(2024, December 16). NLP Dataset. Available online: https:\/\/www.kaggle.com\/datasets\/prasad22\/ca-independent-medical-review."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"61829","DOI":"10.1109\/ACCESS.2023.3287195","article-title":"A survey of privacy risks and mitigation strategies in the Artificial Intelligence life cycle","volume":"11","author":"Shahriar","year":"2023","journal-title":"IEEE Access."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3457607","article-title":"A Survey on Bias and Fairness in Machine Learning","volume":"54","author":"Mehrabi","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"ref_20","first-page":"62","article-title":"A Framework for Understanding Unintended Consequences of Machine Learning","volume":"64","author":"Suresh","year":"2021","journal-title":"Commun. ACM"},{"key":"ref_21","unstructured":"Malekmohammadi, S., Taik, A., and Farnadi, G. (2024). Mitigating Disparate Impact of Differential Privacy in Federated Learning Through Robust Clustering. arXiv."},{"key":"ref_22","unstructured":"Bell, A., Fonseca, J., Abrate, C., Bonchi, F., and Stoyanovich, J. (2024). Fairness in Algorithmic Recourse Through the Lens of Substantive Equality of Opportunity. arXiv."},{"key":"ref_23","unstructured":"Xu, S., and Strohmer, T. (2024). On the (In)Compatibility between Group Fairness and Individual Fairness. arXiv."},{"key":"ref_24","unstructured":"Binns, R. (2018, January 23\u201324). Fairness in Machine Learning: Lessons from Political Philosophy. Proceedings of the 2018 Conference on Fairness, Accountability, and Transparency (FAT), New York, NY, USA."},{"key":"ref_25","unstructured":"Wu, D. (2024). The effects of data preprocessing on probability of default model fairness. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhang, B.H., Lemoine, B., and Mitchell, M. (2018, January 2\u20133). Mitigating Unwanted Biases with Adversarial Learning. Proceedings of the 2018 AAAI\/ACM Conference on AI, Ethics, and Society (AIES), New Orleans, LA, USA.","DOI":"10.1145\/3278721.3278779"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1089\/big.2016.0047","article-title":"Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction Instruments","volume":"5","author":"Chouldechova","year":"2017","journal-title":"Big Data"},{"key":"ref_28","unstructured":"Xu, D., Yuan, S., Zhang, L., and Wu, X. (2020, January 11\u201317). FairGAN: Fairness-Aware Generative Adversarial Networks. Proceedings of the 2020 International Joint Conference on Artificial Intelligence (IJCAI), Yokohama, Japan."},{"key":"ref_29","unstructured":"Nayyem, N., Rakin, A., and Wang, L. (2024). Bridging Interpretability and Robustness Using LIME-Guided Model Refinement. arXiv."},{"key":"ref_30","unstructured":"Lundberg, S.M., and Lee, S.-I. (2017, January 4\u20139). A Unified Approach to Interpreting Model Predictions. Proceedings of the 31st Conference on Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA."},{"key":"ref_31","unstructured":"Kearns, M., Neel, S., Roth, A., and Wu, Z.S. (2018, January 10\u201315). Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. Proceedings of the 35th International Conference on Machine Learning (ICML), Stockholm, Sweden."},{"key":"ref_32","unstructured":"Barocas, S., Hardt, M., and Narayanan, A. (2019, January 29\u201331). Fairness and Accountability in Machine Learning. Proceedings of the 2019 Conference on Fairness, Accountability, and Transparency, Atlanta, GA, USA."},{"key":"ref_33","unstructured":"(2024, December 16). Fairlearn by Microsoft. Available online: https:\/\/fairlearn.org\/."},{"key":"ref_34","unstructured":"(2024, December 16). AIF360 by IBM. Available online: https:\/\/aif360.readthedocs.io\/en\/stable\/."},{"key":"ref_35","unstructured":"(2024, December 16). What-If Tool by Google. Available online: https:\/\/pair-code.github.io\/what-if-tool\/."},{"key":"ref_36","unstructured":"(2024, December 16). Github of the Project. Available online: https:\/\/github.com\/mohammad2012191\/Fairness-in-Machine-Learning-Identifying-and-Mitigation-of-Bias\/."},{"key":"ref_37","unstructured":"Hardt, M., Price, E., and Srebro, N. (2024, December 16). Equality of Opportunity in Supervised Learning. In NeurIPS, 3315\u20133323. Available online: https:\/\/proceedings.neurips.cc\/paper\/2016\/hash\/9d2682367c3935defcb1f9e247a97c0d-Abstract.html."},{"key":"ref_38","unstructured":"Weerts, H., Royakkers, L., and Pechenizkiy, M. (2022). Does the end justify the means? On the moral justification of fairness-aware machine learning. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mittelstadt, B., Wachter, S., and Russell, C. (2023). The unfairness of fair machine learning: Levelling down and strict egalitarianism by default. arXiv.","DOI":"10.36645\/mtlr.30.1.unfairness"},{"key":"ref_40","unstructured":"Barocas, S., Hardt, M., and Narayanan, A. (2024, December 16). Fairness and Machine Learning. Online Resource. Available online: https:\/\/fairmlbook.org\/."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Bellamy, R.K., Dey, K., Hind, M., Hoffman, S.C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., and Mojsilovic, A. (2019). AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias. IBM J. Res. Dev.","DOI":"10.1147\/JRD.2019.2942287"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Friedler, S.A., Scheidegger, C., Venkatasubramanian, S., Choudhary, S., Hamilton, E.P., and Roth, D. (2019). A comparative study of fairness-enhancing interventions in machine learning. arXiv.","DOI":"10.1145\/3287560.3287589"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"866","DOI":"10.7326\/M18-1990","article-title":"Ensuring fairness in machine learning to advance health equity","volume":"169","author":"Rajkomar","year":"2018","journal-title":"Ann. Intern. Med."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Xu, D., Yuan, S., Zhang, L., and Wu, X. (2018, January 10\u201313). FairGAN: Fairness-aware generative adversarial networks. Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA.","DOI":"10.1109\/BigData.2018.8622525"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities, and challenges toward responsible AI","volume":"58","author":"Arrieta","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_46","unstructured":"Doshi-Velez, F., and Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/3\/182\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:43:23Z","timestamp":1760028203000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/3\/182"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,27]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["info16030182"],"URL":"https:\/\/doi.org\/10.3390\/info16030182","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,27]]}}}