{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T16:22:41Z","timestamp":1792513361034,"version":"4.5.0"},"reference-count":100,"publisher":"Association for Computing Machinery (ACM)","issue":"ISSTA","license":[{"start":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T00:00:00Z","timestamp":1750550400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,22]]},"abstract":"<jats:p>\n                    Large Language Models (LLMs) have demonstrated remarkable performance across diverse applications, yet they inadvertently absorb spurious correlations from training data, leading to stereotype associations between biased concepts and specific social groups. These associations perpetuate and even amplify harmful social biases, raising significant concerns about fairness, which is a crucial issue in software engineering. To mitigate such biases, prior studies have attempted to project model embeddings into unbiased spaces during inference. However, these approaches have shown limited effectiveness due to their weak alignment with downstream social biases. Inspired by the observation that concept cognition in LLMs is primarily represented through a linear associative memory mechanism, where key-value mapping occurs in the MLP layers, we posited that biased concepts and social groups are similarly encoded as entity (key) and information (value) pairs, which can be manipulated to promote fairer associations. To this end, we propose Fairness Mediator (FairMed), an effective and efficient bias mitigation framework that neutralizes stereotype associations. Our framework comprises two main components: a stereotype association prober and an adversarial debiasing neutralizer. The prober captures stereotype associations encoded within MLP layer activations by employing prompts centered around biased concepts (keys) to detect the emission probabilities for social groups (values). Subsequently, the adversarial debiasing neutralizer intervenes in MLP activations during inference to equalize the association probabilities among different social groups. Extensive experiments across nine protected attributes show that our FairMed significantly outperforms state-of-the-art methods in effectiveness, achieving average bias reductions of up to 84.42% and 80.36% for \ud835\udc60\n                    <jats:sub>DIS<\/jats:sub>\n                    and \ud835\udc60\n                    <jats:sub>AMB<\/jats:sub>\n                    in the BBQ metrics, respectively. Compared to the most effective baseline, FairMed presents competitive efficiency by cutting mitigation overhead by hundreds of minutes. FairMed also maintains the LLM\u2019s language understanding capabilities without compromising overall performance.\n                  <\/jats:p>","DOI":"10.1145\/3728881","type":"journal-article","created":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T10:52:56Z","timestamp":1750589576000},"page":"250-273","source":"Crossref","is-referenced-by-count":7,"title":["Fairness Mediator: Neutralize Stereotype Associations to Mitigate Bias in Large Language Models"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8227-0052","authenticated-orcid":false,"given":"Yisong","family":"Xiao","sequence":"first","affiliation":[{"name":"Beihang University, SKLCCSE, Shen Yuan Honors College, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4224-1318","authenticated-orcid":false,"given":"Aishan","family":"Liu","sequence":"additional","affiliation":[{"name":"Beihang University, SCSE, SKLCCSE, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6154-0233","authenticated-orcid":false,"given":"Siyuan","family":"Liang","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7618-3275","authenticated-orcid":false,"given":"Xianglong","family":"Liu","sequence":"additional","affiliation":[{"name":"Beihang University, SKLCCSE, Beijing, China"},{"name":"Zhongguancun Laboratory, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7225-5449","authenticated-orcid":false,"given":"Dacheng","family":"Tao","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"2017. The adult census income dataset. https:\/\/archive.ics.uci.edu\/ml\/datasets\/adult."},{"key":"e_1_3_1_3_2","doi-asserted-by":"crossref","unstructured":"Abubakar Abid Maheen Farooqi and James Zou. 2021. Persistent anti-muslim bias in large language models. In Proceedings of the 2021 AAAI\/ACM Conference on AI Ethics and Society. 298\u2013306.","DOI":"10.1145\/3461702.3462624"},{"key":"e_1_3_1_4_2","unstructured":"Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat et al. 2023. Gpt-4 technical report. arXiv:2303.08774 (2023)."},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/0025-5564(72)90075-2"},{"key":"e_1_3_1_6_2","unstructured":"Rohan Anil Andrew M Dai Orhan Firat Melvin Johnson Dmitry Lepikhin Alexandre Passos Siamak Shakeri Emanuel Taropa Paige Bailey Zhifeng Chen et al. 2023. Palm 2 technical report. arXiv:2305.10403 (2023)."},{"key":"e_1_3_1_7_2","unstructured":"Anonym. 2024. Fairness Mediator. https:\/\/sites.google.com\/view\/fairness-mediator\/home."},{"issue":"12","key":"e_1_3_1_8_2","first-page":"5087","article-title":"Biasfinder: Metamorphic test generation to uncover bias for sentiment analysis systems","volume":"48","author":"Asyrofi Muhammad Hilmi","year":"2021","unstructured":"Muhammad Hilmi Asyrofi, Zhou Yang, Imam Nur Bani Yusuf, Hong Jin Kang, Ferdian Thung, and David Lo. 2021. Biasfinder: Metamorphic test generation to uncover bias for sentiment analysis systems. IEEE Transactions on Software Engineering 48, 12 (2021), 5087\u20135101.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_1_9_2","unstructured":"Newsbeat BBC. 2019. Taylor Swift\u2019tried to sue\u2019 Microsoft over racist chatbot Tay. https:\/\/www.bbc.com\/news\/newsbeat-49645508."},{"issue":"5","key":"e_1_3_1_10_2","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1177\/0146167213520458","article-title":"Stereotype associations and emotion recognition","volume":"40","author":"Bijlstra Gijsbert","year":"2014","unstructured":"Gijsbert Bijlstra, Rob W Holland, Ron Dotsch, Kurt Hugenberg, and Daniel HJ Wigboldus. 2014. Stereotype associations and emotion recognition. Personality and Social Psychology Bulletin 40, 5 (2014), 567\u2013577.","journal-title":"Personality and Social Psychology Bulletin"},{"key":"e_1_3_1_11_2","first-page":"1877","article-title":"Language models are few-shot learners","volume":"33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877\u20131901.","journal-title":"Advances in neural information processing systems"},{"key":"e_1_3_1_12_2","doi-asserted-by":"crossref","unstructured":"Zhenpeng Chen Jie M Zhang Federica Sarro and Mark Harman. 2022. MAAT: a novel ensemble approach to addressing fairness and performance bugs for machine learning software. In Proceedings of the 30th ACM joint european software engineering conference and symposium on the foundations of software engineering. 1122\u20131134.","DOI":"10.1145\/3540250.3549093"},{"issue":"4","key":"e_1_3_1_13_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3583561","article-title":"A comprehensive empirical study of bias mitigation methods for machine learning classifiers","volume":"32","author":"Chen Zhenpeng","year":"2023","unstructured":"Zhenpeng Chen, Jie M Zhang, Federica Sarro, and Mark Harman. 2023. A comprehensive empirical study of bias mitigation methods for machine learning classifiers. ACM TOSEM 32, 4 (2023), 1\u201330.","journal-title":"ACM TOSEM"},{"issue":"5","key":"e_1_3_1_14_2","article-title":"Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality, March 2023","volume":"3","author":"Chiang Wei-Lin","year":"2023","unstructured":"Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E Gonzalez, et al. 2023. Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality, March 2023. URL https:\/\/lmsys. org\/blog\/2023-03-30-vicuna 3, 5 (2023).","journal-title":"URL https:\/\/lmsys. org\/blog\/2023-03-30-vicuna"},{"key":"e_1_3_1_15_2","unstructured":"Kate Crawford. 2017. The trouble with bias. keynote at neurips. (2017)."},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","unstructured":"Vishnu Asutosh Dasu Ashish Kumar Saeid Tizpaz-Niari and Gang Tan. 2024. NeuFair: Neural Network Fairness Repair with Dropout. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis. 1541\u20131553.","DOI":"10.1145\/3650212.3680380"},{"key":"e_1_3_1_17_2","doi-asserted-by":"crossref","unstructured":"Pieter Delobelle Ewoenam Kwaku Tokpo Toon Calders and Bettina Berendt. 2022. Measuring fairness with biased rulers: A comparative study on bias metrics for pre-trained language models. In NAACL. 1693\u20131706.","DOI":"10.18653\/v1\/2022.naacl-main.122"},{"key":"e_1_3_1_18_2","unstructured":"Jacob Devlin. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805 (2018)."},{"key":"e_1_3_1_19_2","doi-asserted-by":"crossref","unstructured":"Jwala Dhamala Tony Sun Varun Kumar Satyapriya Krishna Yada Pruksachatkun Kai-Wei Chang and Rahul Gupta. 2021. Bold: Dataset and metrics for measuring biases in open-ended language generation. In Proceedings of the 2021 ACM conference on fairness accountability and transparency. 862\u2013872.","DOI":"10.1145\/3442188.3445924"},{"key":"e_1_3_1_20_2","doi-asserted-by":"crossref","unstructured":"Xin Luna Dong Seungwhan Moon Yifan Ethan Xu Kshitiz Malik and Zhou Yu. 2023. Towards next-generation intelligent assistants leveraging llm techniques. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 5792\u20135793.","DOI":"10.1145\/3580305.3599572"},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Jessica Echterhoff Yao Liu Abeer Alessa Julian McAuley and Zexue He. 2024. Cognitive bias in decision-making with LLMs. In Findings of the Association for Computational Linguistics: EMNLP 2024. 12640\u201312653.","DOI":"10.18653\/v1\/2024.findings-emnlp.739"},{"key":"e_1_3_1_22_2","doi-asserted-by":"crossref","unstructured":"Ming Fan Wenying Wei Wuxia Jin Zijiang Yang and Ting Liu. 2022. Explanation-guided fairness testing through genetic algorithm. In Proceedings of the 44th International Conference on Software Engineering. 871\u2013882.","DOI":"10.1145\/3510003.3510137"},{"key":"e_1_3_1_23_2","doi-asserted-by":"crossref","unstructured":"Sainyam Galhotra Yuriy Brun and Alexandra Meliou. 2017. Fairness testing: testing software for discrimination. In Proceedings of the 2017 11th Joint meeting on foundations of software engineering. 498\u2013510.","DOI":"10.1145\/3106237.3106277"},{"key":"e_1_3_1_24_2","unstructured":"Isabel O Gallegos Ryan A Rossi Joe Barrow Md Mehrab Tanjim Sungchul Kim Franck Dernoncourt Tong Yu Ruiyi Zhang and Nesreen K Ahmed. 2024. Bias and fairness in large language models: A survey. Computational Linguistics (2024) 1\u201379."},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","unstructured":"Xuanqi Gao Juan Zhai Shiqing Ma Chao Shen Yufei Chen and Qian Wang. 2022. FairNeuron: improving deep neural network fairness with adversary games on selective neurons. In Proceedings of the 44th International Conference on Software Engineering. 921\u2013933.","DOI":"10.1145\/3510003.3510087"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-020-00257-z"},{"key":"e_1_3_1_27_2","doi-asserted-by":"crossref","unstructured":"Mor Geva Roei Schuster Jonathan Berant and Omer Levy. 2021. Transformer Feed-Forward Layers Are Key-Value Memories. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 5484\u20135495.","DOI":"10.18653\/v1\/2021.emnlp-main.446"},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","unstructured":"Somayeh Ghanbarzadeh Yan Huang Hamid Palangi Radames Cruz Moreno and Hamed Khanpour. 2023. Gendertuning: Empowering fine-tuning for debiasing pre-trained language models. arXiv:2307.10522 (2023).","DOI":"10.18653\/v1\/2023.findings-acl.336"},{"key":"e_1_3_1_29_2","unstructured":"Ian J Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. ArXiv (2014)."},{"key":"e_1_3_1_30_2","doi-asserted-by":"crossref","unstructured":"Wei Guo and Aylin Caliskan. 2021. Detecting emergent intersectional biases: Contextualized word embeddings contain a distribution of human-like biases. In Proceedings of the 2021 AAAI\/ACM Conference on AI Ethics and Society. 122\u2013133.","DOI":"10.1145\/3461702.3462536"},{"key":"e_1_3_1_31_2","article-title":"Equality of opportunity in supervised learning","volume":"29","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of opportunity in supervised learning. Advances in neural information processing systems 29 (2016).","journal-title":"Advances in neural information processing systems"},{"key":"e_1_3_1_32_2","unstructured":"Dan Hendrycks Collin Burns Steven Basart Andy Zou Mantas Mazeika Dawn Song and Jacob Steinhardt. 2020. Measuring Massive Multitask Language Understanding. In International Conference on Learning Representations."},{"key":"e_1_3_1_33_2","doi-asserted-by":"crossref","unstructured":"Rem Hida Masahiro Kaneko and Naoaki Okazaki. 2024. Social bias evaluation for large language models requires prompt variations. arXiv:2407.03129 (2024).","DOI":"10.18653\/v1\/2025.findings-emnlp.783"},{"issue":"1","key":"e_1_3_1_34_2","first-page":"1","article-title":"Implicit stereotypes and the predictive brain: cognition and culture in \u201cbiased\u201d person perception","volume":"3","author":"Hinton Perry","year":"2017","unstructured":"Perry Hinton. 2017. Implicit stereotypes and the predictive brain: cognition and culture in \u201cbiased\u201d person perception. Palgrave Communications 3, 1 (2017), 1\u20139.","journal-title":"Palgrave Communications"},{"key":"e_1_3_1_35_2","doi-asserted-by":"crossref","unstructured":"Valentin Hofmann Pratyusha Ria Kalluri Dan Jurafsky and Sharese King. 2024. AI generates covertly racist decisions about people based on their dialect. Nature (2024) 1\u20138.","DOI":"10.1038\/s41586-024-07856-5"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3631326"},{"key":"e_1_3_1_37_2","unstructured":"Edward J Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang and Weizhu Chen. 2021. Lora: Low-rank adaptation of large language models. arXiv:2106.09685 (2021)."},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2023.3317870"},{"key":"e_1_3_1_39_2","volume-title":"Proceedings of the Eighth Annual International Conference on Shi\u2019i Studies","author":"Amina Inloes","year":"2024","unstructured":"Amina Inloes. 2024. Artificial Intelligence and Islamic Theology: An Interview with ChatGPT. In Proceedings of the Eighth Annual International Conference on Shi\u2019i Studies. ICAS Press, 166."},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TC.1972.5008975"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729694"},{"key":"e_1_3_1_42_2","doi-asserted-by":"crossref","unstructured":"Abhishek Kumar Sarfaroz Yunusov and Ali Emami. 2024. Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 375\u2013392.","DOI":"10.18653\/v1\/2024.acl-long.23"},{"key":"e_1_3_1_43_2","unstructured":"Hector Levesque Ernest Davis and Leora Morgenstern. 2012. The winograd schema challenge. In Thirteenth international conference on the principles of knowledge representation and reasoning."},{"key":"e_1_3_1_44_2","doi-asserted-by":"crossref","unstructured":"Mike Lewis. 2019. Bart: Denoising sequence-to-sequence pre-training for natural language generation translation and comprehension. arXiv:1910.13461 (2019).","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"e_1_3_1_45_2","doi-asserted-by":"crossref","unstructured":"Tianlin Li Yue Cao Jian Zhang Shiqian Zhao Yihao Huang Aishan Liu Qing Guo and Yang Liu. 2024. RUNNER: Responsible UNfair NEuron Repair for Enhancing Deep Neural Network Fairness. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering. 1\u201313.","DOI":"10.1145\/3597503.3623334"},{"issue":"1","key":"e_1_3_1_46_2","first-page":"1","article-title":"Faire: Repairing fairness of neural networks via neuron condition synthesis","volume":"33","author":"Li Tianlin","year":"2023","unstructured":"Tianlin Li, Xiaofei Xie, Jian Wang, Qing Guo, Aishan Liu, Lei Ma, and Yang Liu. 2023. Faire: Repairing fairness of neural networks via neuron condition synthesis. ACM TOSEM 33, 1 (2023), 1\u201324.","journal-title":"ACM TOSEM"},{"key":"e_1_3_1_47_2","unstructured":"Xinyue Li Zhenpeng Chen Jie M Zhang Yiling Lou Tianlin Li Weisong Sun Yang Liu and Xuanzhe Liu. 2024. Benchmarking Bias in Large Language Models during Role-Playing. arXiv:2411.00585 (2024)."},{"key":"e_1_3_1_48_2","unstructured":"Percy Liang Rishi Bommasani Tony Lee Dimitris Tsipras Dilara Soylu Michihiro Yasunaga Yian Zhang Deepak Narayanan Yuhuai Wu Ananya Kumar et al. 2022. Holistic evaluation of language models. arXiv:2211.09110 (2022)."},{"key":"e_1_3_1_49_2","doi-asserted-by":"crossref","unstructured":"Paul Pu Liang Irene Mengze Li Emily Zheng Yao Chong Lim Ruslan Salakhutdinov and Louis-Philippe Morency. 2020. Towards debiasing sentence representations. arXiv:2007.08100 (2020).","DOI":"10.18653\/v1\/2020.acl-main.488"},{"key":"e_1_3_1_50_2","doi-asserted-by":"crossref","unstructured":"Siyuan Liang Jiawei Liang Tianyu Pang Chao Du Aishan Liu Ee-Chien Chang and Xiaochun Cao. 2024. Revisiting Backdoor Attacks against Large Vision-Language Models. arXiv preprint arXiv:2406.18844 (2024).","DOI":"10.1109\/CVPR52734.2025.00885"},{"key":"e_1_3_1_51_2","doi-asserted-by":"crossref","unstructured":"Siyuan Liang Mingli Zhu Aishan Liu Baoyuan Wu Xiaochun Cao and Ee-Chien Chang. 2023. Badclip: Dualembedding guided backdoor attack on multimodal contrastive learning. arXiv preprint arXiv:2311.12075 (2023).","DOI":"10.1109\/CVPR52733.2024.02327"},{"key":"e_1_3_1_52_2","unstructured":"Tomasz Limisiewicz David Mare\u010dek and Tom\u00e1\u0161 Musil. 2023. Debiasing algorithm through model adaptation. arXiv:2310.18913 (2023)."},{"key":"e_1_3_1_53_2","unstructured":"Aishan Liu Xianglong Liu Jiaxin Fan Yuqing Ma Anlan Zhang Huiyuan Xie and Dacheng Tao. 2019. Perceptualsensitive gan for generating adversarial patches. In AAAI."},{"key":"e_1_3_1_54_2","unstructured":"Aishan Liu Shiyu Tang Xinyun Chen Lei Huang Haotong Qin Xianglong Liu and Dacheng Tao. 2023. Towards Defending Multiple Lp-norm Bounded Adversarial Perturbations via Gated Batch Normalization. IJCV (2023)."},{"key":"e_1_3_1_55_2","unstructured":"Aishan Liu Jiakai Wang Xianglong Liu Bowen Cao Chongzhi Zhang and Hang Yu. 2020. Bias-based universal adversarial patch attack for automatic check-out. In ECCV."},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10287-022-00425-z"},{"key":"e_1_3_1_57_2","doi-asserted-by":"crossref","unstructured":"Kaiji Lu Piotr Mardziel Fangjing Wu Preetam Amancharla and Anupam Datta. 2020. Gender bias in neural natural language processing. Logic language and security: essays dedicated to Andre Scedrov on the occasion of his 65th birthday (2020) 189\u2013202.","DOI":"10.1007\/978-3-030-62077-6_14"},{"key":"e_1_3_1_58_2","unstructured":"Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras and Adrian Vladu. 2017. Towards deep learning models resistant to adversarial attacks. ArXiv (2017)."},{"key":"e_1_3_1_59_2","unstructured":"Chandler May Alex Wang Shikha Bordia Samuel R Bowman and Rachel Rudinger. 2019. On measuring social biases in sentence encoders. arXiv:1903.10561 (2019)."},{"key":"e_1_3_1_60_2","unstructured":"Nicholas Meade Elinor Poole-Dayan and Siva Reddy. 2021. An empirical survey of the effectiveness of debiasing techniques for pre-trained language models. arXiv:2110.08527 (2021)."},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.52202\/068431-1262"},{"key":"e_1_3_1_62_2","unstructured":"Kevin Meng Arnab Sen Sharma Alex J Andonian Yonatan Belinkov and David Bau. [n. d.]. Mass-Editing Memory in a Transformer. In The Eleventh International Conference on Learning Representations."},{"key":"e_1_3_1_63_2","doi-asserted-by":"crossref","unstructured":"Verya Monjezi Ashish Kumar Gang Tan Ashutosh Trivedi and Saeid Tizpaz-Niari. 2024. Causal Graph Fuzzing for Fair ML Sofware Development. In Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings. 402\u2013403.","DOI":"10.1145\/3639478.3643530"},{"key":"e_1_3_1_64_2","doi-asserted-by":"crossref","unstructured":"Verya Monjezi Ashutosh Trivedi Vladik Kreinovich and Saeid Tizpaz-Niari. 2025. Fairness Testing through Extreme Value Theory. arXiv:2501.11597 (2025).","DOI":"10.1109\/ICSE55347.2025.00070"},{"key":"e_1_3_1_65_2","doi-asserted-by":"crossref","unstructured":"Verya Monjezi Ashutosh Trivedi Gang Tan and Saeid Tizpaz-Niari. 2023. Information-theoretic testing and debugging of fairness defects in deep neural networks. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE 1571\u20131582.","DOI":"10.1109\/ICSE48619.2023.00136"},{"key":"e_1_3_1_66_2","unstructured":"Moin Nadeem Anna Bethke and Siva Reddy. 2020. StereoSet: Measuring stereotypical bias in pretrained language models. arXiv:2004.09456 (2020)."},{"key":"e_1_3_1_67_2","doi-asserted-by":"crossref","unstructured":"Nikita Nangia Clara Vania Rasika Bhalerao and Samuel R Bowman. 2020. CrowS-pairs: A challenge dataset for measuring social biases in masked language models. arXiv:2010.00133 (2020).","DOI":"10.18653\/v1\/2020.emnlp-main.154"},{"key":"e_1_3_1_68_2","doi-asserted-by":"crossref","unstructured":"Tarek Naous Michael J Ryan Alan Ritter and Wei Xu. 2024. Having Beer after Prayer? Measuring Cultural Bias in Large Language Models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 16366\u201316393.","DOI":"10.18653\/v1\/2024.acl-long.862"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001964"},{"key":"e_1_3_1_70_2","doi-asserted-by":"crossref","unstructured":"Alicia Parrish Angelica Chen Nikita Nangia Vishakh Padmakumar Jason Phang Jana Thompson Phu Mon Htut and Samuel R Bowman. 2021. BBQ: A hand-built bias benchmark for question answering. arXiv:2110.08193 (2021).","DOI":"10.18653\/v1\/2022.findings-acl.165"},{"key":"e_1_3_1_71_2","unstructured":"Alec Radford. 2018. Improving language understanding by generative pre-training. (2018)."},{"key":"e_1_3_1_72_2","doi-asserted-by":"crossref","first-page":"1180","DOI":"10.1609\/aies.v7i1.31715","article-title":"Breaking bias, building bridges: Evaluation and mitigation of social biases in llms via contact hypothesis","volume":"7","author":"Raj Chahat","year":"2024","unstructured":"Chahat Raj, Anjishnu Mukherjee, Aylin Caliskan, Antonios Anastasopoulos, and Ziwei Zhu. 2024. Breaking bias, building bridges: Evaluation and mitigation of social biases in llms via contact hypothesis. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, Vol. 7. 1180\u20131189.","journal-title":"Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society"},{"key":"e_1_3_1_73_2","doi-asserted-by":"crossref","unstructured":"Vikram V Ramaswamy Sunnie SY Kim and Olga Russakovsky. 2021. Fair attribute classification through latent space de-biasing. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. 9301\u20139310.","DOI":"10.1109\/CVPR46437.2021.00918"},{"key":"e_1_3_1_74_2","doi-asserted-by":"crossref","unstructured":"Shauli Ravfogel Yanai Elazar Hila Gonen Michael Twiton and Yoav Goldberg. 2020. Null it out: Guarding protected attributes by iterative nullspace projection. arXiv:2004.07667 (2020).","DOI":"10.18653\/v1\/2020.acl-main.647"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00434"},{"key":"e_1_3_1_76_2","unstructured":"Chenglei Si Zhe Gan Zhengyuan Yang Shuohang Wang Jianfeng Wang Jordan Boyd-Graber and Lijuan Wang. 2022. Prompting gpt-3 to be reliable. arXiv:2210.09150 (2022)."},{"issue":"12","key":"e_1_3_1_77_2","first-page":"5188","article-title":"Astraea: Grammar-based fairness testing","volume":"48","author":"Soremekun Ezekiel","year":"2022","unstructured":"Ezekiel Soremekun, Sakshi Udeshi, and Sudipta Chattopadhyay. 2022. Astraea: Grammar-based fairness testing. IEEE Transactions on Software Engineering 48, 12 (2022), 5188\u20135211.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_1_78_2","article-title":"End-to-end memory networks","volume":"28","author":"Sukhbaatar Sainbayar","year":"2015","unstructured":"Sainbayar Sukhbaatar, Jason Weston, Rob Fergus, et al. 2015. End-to-end memory networks. Advances in neural information processing systems 28 (2015).","journal-title":"Advances in neural information processing systems"},{"key":"e_1_3_1_79_2","doi-asserted-by":"crossref","unstructured":"Bing Sun Jun Sun Long H Pham and Jie Shi. 2022. Causality-based neural network repair. In Proceedings of the 44th International Conference on Software Engineering. 338\u2013349.","DOI":"10.1145\/3510003.3510080"},{"key":"e_1_3_1_80_2","doi-asserted-by":"crossref","unstructured":"Zeyu Sun Zhenpeng Chen Jie Zhang and Dan Hao. 2024. Fairness Testing of Machine Translation Systems. ACM TOSEM (2024).","DOI":"10.1145\/3664608"},{"key":"e_1_3_1_81_2","unstructured":"Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna Dumitru Erhan Ian Goodfellow and Rob Fergus. 2013. Intriguing properties of neural networks. arXiv:1312.6199 (2013)."},{"key":"e_1_3_1_82_2","unstructured":"Shiyu Tang Ruihao Gong Yan Wang Aishan Liu Jiakai Wang Xinyun Chen Fengwei Yu Xianglong Liu Dawn Song Alan Yuille et al. 2021. Robustart: Benchmarking robustness on architecture design and training techniques. ArXiv (2021)."},{"key":"e_1_3_1_83_2","doi-asserted-by":"crossref","unstructured":"Guanhong Tao Weisong Sun Tingxu Han Chunrong Fang and Xiangyu Zhang. 2022. RULER: discriminative and iterative adversarial training for deep neural network fairness. In Proceedings of the 30th acm joint european software engineering conference and symposium on the foundations of software engineering. 1173\u20131184.","DOI":"10.1145\/3540250.3549169"},{"key":"e_1_3_1_84_2","doi-asserted-by":"crossref","unstructured":"Saeid Tizpaz-Niari Ashish Kumar Gang Tan and Ashutosh Trivedi. 2022. Fairness-aware configuration of machine learning libraries. In Proceedings of the 44th International Conference on Software Engineering. 909\u2013920.","DOI":"10.1145\/3510003.3510202"},{"key":"e_1_3_1_85_2","unstructured":"Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale et al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv:2307.09288 (2023)."},{"key":"e_1_3_1_86_2","doi-asserted-by":"crossref","unstructured":"Yuxuan Wan Wenxuan Wang Pinjia He Jiazhen Gu Haonan Bai and Michael R Lyu. 2023. Biasasker: Measuring the bias in conversational ai system. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 515\u2013527.","DOI":"10.1145\/3611643.3616310"},{"key":"e_1_3_1_87_2","doi-asserted-by":"crossref","unstructured":"Jiakai Wang Aishan Liu Zixin Yin Shunchang Liu Shiyu Tang and Xianglong Liu. 2021. Dual attention suppression attack: Generate adversarial camouflage in physical world. In CVPR.","DOI":"10.1109\/CVPR46437.2021.00846"},{"key":"e_1_3_1_88_2","doi-asserted-by":"crossref","unstructured":"Wenxuan Wang Haonan Bai Jen-tse Huang Yuxuan Wan Youliang Yuan Haoyi Qiu Nanyun Peng and Michael R Lyu. 2024. New Job New Gender? Measuring the Social Bias in Image Generation Models. arXiv:2401.00763 (2024).","DOI":"10.1145\/3664647.3681433"},{"issue":"3","key":"e_1_3_1_89_2","doi-asserted-by":"crossref","first-page":"2269","DOI":"10.1109\/TMC.2023.3254553","article-title":"Location privacy-aware task offloading in mobile edge computing","volume":"23","author":"Wang Zhibo","year":"2023","unstructured":"Zhibo Wang, Yunan Sun, Defang Liu, Jiahui Hu, Xiaoyi Pang, Yuke Hu, and Kui Ren. 2023. Location privacy-aware task offloading in mobile edge computing. IEEE Transactions on Mobile Computing 23, 3 (2023), 2269\u20132283.","journal-title":"IEEE Transactions on Mobile Computing"},{"key":"e_1_3_1_90_2","doi-asserted-by":"crossref","unstructured":"Zhaohui Wang Min Zhang Jingran Yang Bojie Shao and Min Zhang. 2024. MAFT: Efficient Model-Agnostic Fairness Testing for Deep Neural Networks via Zero-Order Gradient Search. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering. 1\u201312.","DOI":"10.1145\/3597503.3639181"},{"key":"e_1_3_1_91_2","unstructured":"Kellie Webster Xuezhi Wang Ian Tenney Alex Beutel Emily Pitler Ellie Pavlick Jilin Chen Ed Chi and Slav Petrov. 2020. Measuring and reducing gendered correlations in pre-trained models. arXiv:2010.06032 (2020)."},{"key":"e_1_3_1_92_2","doi-asserted-by":"crossref","unstructured":"Yisong Xiao Aishan Liu QianJia Cheng Zhenfei Yin Siyuan Liang Jiapeng Li Jing Shao Xianglong Liu and Dacheng Tao. 2024. GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing. arXiv preprint arXiv:2407.00600 (2024).","DOI":"10.1007\/s11263-025-02556-7"},{"key":"e_1_3_1_93_2","doi-asserted-by":"crossref","unstructured":"Yisong Xiao Aishan Liu Tianlin Li and Xianglong Liu. 2023. Latent imitator: Generating natural individual discriminatory instances for black-box fairness testing. In ISSTA. 829\u2013841.","DOI":"10.1145\/3597926.3598099"},{"issue":"1","key":"e_1_3_1_94_2","article-title":"Robustmq: benchmarking robustness of quantized models","volume":"1","author":"Xiao Yisong","year":"2023","unstructured":"Yisong Xiao, Aishan Liu, Tianyuan Zhang, Haotong Qin, Jinyang Guo, and Xianglong Liu. 2023. Robustmq: benchmarking robustness of quantized models. Visual Intelligence 1, 1 (2023), 30.","journal-title":"Visual Intelligence"},{"key":"e_1_3_1_95_2","doi-asserted-by":"crossref","unstructured":"Haoyi Xiong Jiang Bian Yuchen Li Xuhong Li Mengnan Du Shuaiqiang Wang Dawei Yin and Sumi Helal. 2024. When search engine services meet large language models: visions and challenges. IEEE Transactions on Services Computing (2024).","DOI":"10.1109\/TSC.2024.3451185"},{"key":"e_1_3_1_96_2","unstructured":"Kai-Ching Yeh Jou-An Chi Da-Chen Lian and Shu-Kai Hsieh. 2023. Evaluating interfaced llm bias. In Proceedings of the 35th Conference on Computational Linguistics and Speech Processing (ROCLING 2023). 292\u2013299."},{"key":"e_1_3_1_97_2","doi-asserted-by":"crossref","unstructured":"Mengdi Zhang and Jun Sun. 2022. Adaptive fairness improvement based on causality analysis. In ESEC\/FSE. 6\u201317.","DOI":"10.1145\/3540250.3549103"},{"key":"e_1_3_1_98_2","doi-asserted-by":"crossref","unstructured":"Peixin Zhang Jingyi Wang Jun Sun Guoliang Dong Xinyu Wang Xingen Wang Jin Song Dong and Ting Dai. 2020. White-box fairness testing through adversarial sampling. In ICSE. 949\u2013960.","DOI":"10.1145\/3377811.3380331"},{"key":"e_1_3_1_99_2","doi-asserted-by":"crossref","unstructured":"Jieyu Zhao Tianlu Wang Mark Yatskar Vicente Ordonez and Kai-Wei Chang. 2018. Gender bias in coreference resolution: Evaluation and debiasing methods. arXiv:1804.06876 (2018).","DOI":"10.18653\/v1\/N18-2003"},{"key":"e_1_3_1_100_2","doi-asserted-by":"crossref","unstructured":"Haibin Zheng Zhiqing Chen Tianyu Du Xuhong Zhang Yao Cheng Shouling Ji Jingyi Wang Yue Yu and Jinyin Chen. 2022. Neuronfair: Interpretable white-box fairness testing through biased neuron identification. In Proceedings of the 44th International Conference on Software Engineering. 1519\u20131531.","DOI":"10.1145\/3510003.3510123"},{"key":"e_1_3_1_101_2","doi-asserted-by":"crossref","unstructured":"Yaowei Zheng Richong Zhang Junhao Zhang Yanhan Ye and Zheyan Luo. 2024. Llamafactory: Unified efficient fine-tuning of 100+ language models. arXiv:2403.13372 (2024).","DOI":"10.18653\/v1\/2024.acl-demos.38"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728881","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T13:51:41Z","timestamp":1787493101000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3728881"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":100,"journal-issue":{"issue":"ISSTA","published-print":{"date-parts":[[2025,6,22]]}},"alternative-id":["10.1145\/3728881"],"URL":"https:\/\/doi.org\/10.1145\/3728881","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}