{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,12]],"date-time":"2026-09-12T01:40:11Z","timestamp":1789177211153,"version":"build-2803163510"},"publisher-location":"New York, NY, USA","reference-count":98,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T00:00:00Z","timestamp":1726012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,9,11]]},"DOI":"10.1145\/3650212.3652122","type":"proceedings-article","created":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T07:44:25Z","timestamp":1726040665000},"page":"210-222","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["A Large-Scale Empirical Study on Improving the Fairness of Image Classification Models"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1066-1190","authenticated-orcid":false,"given":"Junjie","family":"Yang","sequence":"first","affiliation":[{"name":"Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1983-6572","authenticated-orcid":false,"given":"Jiajun","family":"Jiang","sequence":"additional","affiliation":[{"name":"Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9990-9120","authenticated-orcid":false,"given":"Zeyu","family":"Sun","sequence":"additional","affiliation":[{"name":"Institute of Software at Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3056-9962","authenticated-orcid":false,"given":"Junjie","family":"Chen","sequence":"additional","affiliation":[{"name":"Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,9,11]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"ICML","volume":"69","author":"Agarwal Alekh","year":"2018","unstructured":"Alekh Agarwal, Alina Beygelzimer, Miroslav Dud\u00edk, John Langford, and Hanna M. Wallach. 2018. A Reductions Approach to Fair Classification. In ICML 2018, Jennifer G. Dy and Andreas Krause (Eds.) (Proceedings of Machine Learning Research, Vol. 80). PMLR, 60\u201369. http:\/\/proceedings.mlr.press\/v80\/agarwal18a.html"},{"key":"e_1_3_2_1_2_1","volume-title":"ESEC\/FSE","author":"Aggarwal Aniya","year":"2019","unstructured":"Aniya Aggarwal, Pranay Lohia, Seema Nagar, Kuntal Dey, and Diptikalyan Saha. 2019. Black box fairness testing of machine learning models. In ESEC\/FSE 2019, Marlon Dumas, Dietmar Pfahl, Sven Apel, and Alessandra Russo (Eds.). ACM, 625\u2013635."},{"key":"e_1_3_2_1_3_1","volume-title":"ICLR","author":"An Jing","year":"2021","unstructured":"Jing An, Lexing Ying, and Yuhua Zhu. 2021. Why resampling outperforms reweighting for correcting sampling bias with stochastic gradients. In ICLR 2021. OpenReview.net."},{"key":"e_1_3_2_1_4_1","volume-title":"ESEC\/FSE","author":"Biswas Sumon","year":"2020","unstructured":"Sumon Biswas and Hridesh Rajan. 2020. Do the machine learning models on a crowd sourced platform exhibit bias? an empirical study on model fairness. In ESEC\/FSE 2020, Prem Devanbu, Myra B. Cohen, and Thomas Zimmermann (Eds.). ACM, 642\u2013653."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468536"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/972470.972474"},{"key":"e_1_3_2_1_7_1","volume-title":"ESEC\/FSE","author":"Brun Yuriy","year":"2018","unstructured":"Yuriy Brun and Alexandra Meliou. 2018. Software fairness. In ESEC\/FSE 2018, Gary T. Leavens, Alessandro Garcia, and Corina S. Pasareanu (Eds.). ACM, 754\u2013759."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2018.07.011"},{"key":"e_1_3_2_1_9_1","volume-title":"ICML","volume":"881","author":"Byrd Jonathon","year":"2019","unstructured":"Jonathon Byrd and Zachary Chase Lipton. 2019. What is the Effect of Importance Weighting in Deep Learning? In ICML 2019, Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.) (Proceedings of Machine Learning Research, Vol. 97). PMLR, 872\u2013881."},{"key":"e_1_3_2_1_10_1","volume-title":"Karthikeyan Natesan Ramamurthy, and Kush R. Varshney","author":"Calmon Fl\u00e1vio P.","year":"2017","unstructured":"Fl\u00e1vio P. Calmon, Dennis Wei, Bhanukiran Vinzamuri, Karthikeyan Natesan Ramamurthy, and Kush R. Varshney. 2017. Optimized Pre-Processing for Discrimination Prevention. In NeurIPS 2017, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 3992\u20134001."},{"key":"e_1_3_2_1_11_1","volume-title":"The zoo of Fairness metrics in Machine Learning. CoRR, abs\/2106.00467","author":"Castelnovo Alessandro","year":"2021","unstructured":"Alessandro Castelnovo, Riccardo Crupi, Greta Greco, and Daniele Regoli. 2021. The zoo of Fairness metrics in Machine Learning. CoRR, abs\/2106.00467 (2021)."},{"key":"e_1_3_2_1_12_1","unstructured":"Simon Caton and Christian Haas. 2020. Fairness in machine learning: A survey. Comput. Surveys."},{"key":"e_1_3_2_1_13_1","volume-title":"Vishnoi","author":"Celis L. Elisa","year":"2019","unstructured":"L. Elisa Celis, Lingxiao Huang, Vijay Keswani, and Nisheeth K. Vishnoi. 2019. Classification with Fairness Constraints: A Meta-Algorithm with Provable Guarantees. In FAccT 2019, danah boyd and Jamie H. Morgenstern (Eds.). ACM, 319\u2013328."},{"key":"e_1_3_2_1_14_1","volume-title":"Bias in machine learning software: why? how? what to do? In ESEC\/FSE","author":"Chakraborty Joymallya","year":"2021","unstructured":"Joymallya Chakraborty, Suvodeep Majumder, and Tim Menzies. 2021. Bias in machine learning software: why? how? what to do? In ESEC\/FSE 2021, Diomidis Spinellis, Georgios Gousios, Marsha Chechik, and Massimiliano Di Penta (Eds.). ACM, 429\u2013440."},{"key":"e_1_3_2_1_15_1","volume-title":"ESEC\/FSE","author":"Chakraborty Joymallya","year":"2020","unstructured":"Joymallya Chakraborty, Suvodeep Majumder, Zhe Yu, and Tim Menzies. 2020. Fairway: a way to build fair ML software. In ESEC\/FSE 2020, Prem Devanbu, Myra B. Cohen, and Thomas Zimmermann (Eds.). ACM, 654\u2013665."},{"key":"e_1_3_2_1_16_1","volume-title":"Software Engineering for Fairness: A Case Study with Hyperparameter Optimization. CoRR, abs\/1905.05786","author":"Chakraborty Joymallya","year":"2019","unstructured":"Joymallya Chakraborty, Tianpei Xia, Fahmid M. Fahid, and Tim Menzies. 2019. Software Engineering for Fairness: A Case Study with Hyperparameter Optimization. CoRR, abs\/1905.05786 (2019)."},{"key":"e_1_3_2_1_17_1","volume-title":"Explaining Neural Networks Semantically and Quantitatively. In ICCV","author":"Chen Runjin","year":"2019","unstructured":"Runjin Chen, Hao Chen, Ge Huang, Jie Ren, and Quanshi Zhang. 2019. Explaining Neural Networks Semantically and Quantitatively. In ICCV 2019. IEEE, 9186\u20139195."},{"key":"e_1_3_2_1_18_1","volume-title":"ICSE","author":"Chen Zhenpeng","year":"2024","unstructured":"Zhenpeng Chen, Jie Zhang, Federica Sarro, and Mark Harman. 2024. Fairness Improvement with Multiple Protected Attributes: How Far Are We? In ICSE 2024."},{"key":"e_1_3_2_1_19_1","volume-title":"Fairness Testing: A Comprehensive Survey and Analysis of Trends. CoRR, abs\/2207.10223","author":"Chen Zhenpeng","year":"2022","unstructured":"Zhenpeng Chen, Jie M. Zhang, Max Hort, Federica Sarro, and Mark Harman. 2022. Fairness Testing: A Comprehensive Survey and Analysis of Trends. CoRR, abs\/2207.10223 (2022)."},{"key":"e_1_3_2_1_20_1","volume-title":"ESEC\/FSE","author":"Chen Zhenpeng","year":"2022","unstructured":"Zhenpeng Chen, Jie M. Zhang, Federica Sarro, and Mark Harman. 2022. MAAT: a novel ensemble approach to addressing fairness and performance bugs for machine learning software. In ESEC\/FSE 2022, Abhik Roychoudhury, Cristian Cadar, and Miryung Kim (Eds.). ACM, 1122\u20131134."},{"key":"e_1_3_2_1_21_1","volume-title":"ACL","author":"Chiang David","year":"2005","unstructured":"David Chiang. 2005. A Hierarchical Phrase-Based Model for Statistical Machine Translation. In ACL 2005, Kevin Knight, Hwee Tou Ng, and Kemal Oflazer (Eds.). The Association for Computer Linguistics, 263\u2013270."},{"key":"e_1_3_2_1_22_1","volume-title":"ITCS","author":"Dwork Cynthia","year":"2012","unstructured":"Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard S. Zemel. 2012. Fairness through awareness. In ITCS 2012, Shafi Goldwasser (Ed.). ACM, 214\u2013226."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_3_2_1_24_1","volume-title":"RE","author":"Finkelstein Anthony","year":"2008","unstructured":"Anthony Finkelstein, Mark Harman, S. Afshin Mansouri, Jian Ren, and Yuanyuan Zhang. 2008. \"Fairness Analysis\" in Requirements Assignments. In RE 2008. IEEE Computer Society, 115\u2013124."},{"key":"e_1_3_2_1_25_1","volume-title":"FAccT","author":"Friedler Sorelle A.","year":"2019","unstructured":"Sorelle A. Friedler, Carlos Scheidegger, Suresh Venkatasubramanian, Sonam Choudhary, Evan P. Hamilton, and Derek Roth. 2019. A comparative study of fairness-enhancing interventions in machine learning. In FAccT 2019, danah boyd and Jamie H. Morgenstern (Eds.). ACM, 329\u2013338."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106277"},{"key":"e_1_3_2_1_27_1","volume-title":"Credit risk assessment using statistical and machine learning: basic methodology and risk modeling applications. Computational economics, 15","author":"Galindo Jorge","year":"2000","unstructured":"Jorge Galindo and Pablo Tamayo. 2000. Credit risk assessment using statistical and machine learning: basic methodology and risk modeling applications. Computational economics, 15 (2000), 107\u2013143."},{"key":"e_1_3_2_1_28_1","volume-title":"Woods","author":"Gonz\u00e1lez Rafael C.","year":"2008","unstructured":"Rafael C. Gonz\u00e1lez and Richard E. Woods. 2008. Digital image processing, 3rd Edition. Pearson Education.","edition":"3"},{"key":"e_1_3_2_1_29_1","volume-title":"ACM","author":"Grabowicz Przemyslaw A.","year":"2022","unstructured":"Przemyslaw A. Grabowicz, Nicholas Perello, and Aarshee Mishra. 2022. Marrying Fairness and Explainability in Supervised Learning. In FAccT 2022. ACM, 1905\u20131916."},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction, 3, CSCW","author":"Green Ben","year":"2019","unstructured":"Ben Green and Yiling Chen. 2019. The principles and limits of algorithm-in-the-loop decision making. Proceedings of the ACM on Human-Computer Interaction, 3, CSCW (2019), 1\u201324."},{"key":"e_1_3_2_1_31_1","volume-title":"FairRec: Fairness Testing for Deep Recommender Systems. In ISSTA","author":"Guo Huizhong","year":"2023","unstructured":"Huizhong Guo, Jinfeng Li, Jingyi Wang, Xiangyu Liu, Dongxia Wang, Zehong Hu, Rong Zhang, and Hui Xue. 2023. FairRec: Fairness Testing for Deep Recommender Systems. In ISSTA 2023, Ren\u00e9 Just and Gordon Fraser (Eds.). ACM, 310\u2013321."},{"key":"e_1_3_2_1_32_1","volume-title":"NeurIPS","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of Opportunity in Supervised Learning. In NeurIPS 2016, Daniel D. Lee, Masashi Sugiyama, Ulrike von Luxburg, Isabelle Guyon, and Roman Garnett (Eds.). 3315\u20133323."},{"key":"e_1_3_2_1_33_1","unstructured":"Mercedeh Harirchian Fereshteh Amin Saeed Rouhani Aref Aligholipour and Vahid Amiri Lord. 2022. AI-enabled exploration of Instagram profiles predicts soft skills and personality traits to empower hiring decisions. arXiv preprint arXiv:2212.07069."},{"key":"e_1_3_2_1_34_1","volume-title":"Deep Residual Learning for Image Recognition. In CVPR","author":"He Kaiming","year":"2016","unstructured":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR 2016. IEEE Computer Society, 770\u2013778."},{"key":"e_1_3_2_1_35_1","volume-title":"NeurIPS","author":"Hong Youngkyu","year":"2021","unstructured":"Youngkyu Hong and Eunho Yang. 2021. Unbiased Classification through Bias-Contrastive and Bias-Balanced Learning. In NeurIPS 2021, Marc\u2019Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan (Eds.). 26449\u201326461."},{"key":"e_1_3_2_1_36_1","first-page":"1043","article-title":"Racial equity in algorithmic criminal justice","volume":"68","author":"Huq Aziz Z","year":"2018","unstructured":"Aziz Z Huq. 2018. Racial equity in algorithmic criminal justice. Duke LJ, 68 (2018), 1043.","journal-title":"Duke LJ"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3233\/IDA-2002-6504"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Jiajun Jiang Junjie Yang Yingyi Zhang Zan Wang Hanmo You and Junjie Chen. 2023. A Post-Training Framework for Improving the Performance of Deep Learning Models via Model Transformation. ACM Transactions on Software Engineering and Methodology.","DOI":"10.1145\/3630011"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.1987.1663532"},{"key":"e_1_3_2_1_40_1","volume-title":"Learning Fair Classifiers with Partially Annotated Group Labels. In CVPR","author":"Jung Sangwon","year":"2022","unstructured":"Sangwon Jung, Sanghyuk Chun, and Taesup Moon. 2022. Learning Fair Classifiers with Partially Annotated Group Labels. In CVPR 2022. IEEE, 10338\u201310347."},{"key":"e_1_3_2_1_41_1","volume-title":"Fair Feature Distillation for Visual Recognition. In CVPR","author":"Jung Sangwon","year":"2021","unstructured":"Sangwon Jung, Donggyu Lee, Taeeon Park, and Taesup Moon. 2021. Fair Feature Distillation for Visual Recognition. In CVPR 2021. Computer Vision Foundation \/ IEEE, 12115\u201312124."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-011-0463-8"},{"key":"e_1_3_2_1_43_1","volume-title":"Decision Theory for Discrimination-Aware Classification. In ICDM","author":"Kamiran Faisal","year":"2012","unstructured":"Faisal Kamiran, Asim Karim, and Xiangliang Zhang. 2012. Decision Theory for Discrimination-Aware Classification. In ICDM 2012, Mohammed Javeed Zaki, Arno Siebes, Jeffrey Xu Yu, Bart Goethals, Geoffrey I. Webb, and Xindong Wu (Eds.). IEEE Computer Society, 924\u2013929."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33486-3_3"},{"key":"e_1_3_2_1_45_1","volume-title":"ECCV","author":"Kehrenberg Thomas","year":"2020","unstructured":"Thomas Kehrenberg, Myles Bartlett, Oliver Thomas, and Novi Quadrianto. 2020. Null-Sampling for Interpretable and Fair Representations. In ECCV 2020, Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm (Eds.) (Lecture Notes in Computer Science, Vol. 12371). Springer, 565\u2013580."},{"key":"e_1_3_2_1_46_1","volume-title":"Multiaccuracy: Black-Box Post-Processing for Fairness in Classification. In AIES","author":"Kim Michael P.","year":"2019","unstructured":"Michael P. Kim, Amirata Ghorbani, and James Y. Zou. 2019. Multiaccuracy: Black-Box Post-Processing for Fairness in Classification. In AIES 2019, Vincent Conitzer, Gillian K. Hadfield, and Shannon Vallor (Eds.). ACM, 247\u2013254."},{"key":"e_1_3_2_1_47_1","first-page":"79","article-title":"Europarl","volume":"2005","author":"Koehn Philipp","year":"2005","unstructured":"Philipp Koehn. 2005. Europarl: A Parallel Corpus for Statistical Machine Translation. In MTSummit 2005. 79\u201386.","journal-title":"A Parallel Corpus for Statistical Machine Translation. In MTSummit"},{"key":"e_1_3_2_1_48_1","volume-title":"Moses: Open Source Toolkit for Statistical Machine Translation. In ACL","author":"Koehn Philipp","year":"2007","unstructured":"Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open Source Toolkit for Statistical Machine Translation. In ACL 2007, John Carroll, Antal van den Bosch, and Annie Zaenen (Eds.). The Association for Computational Linguistics."},{"key":"e_1_3_2_1_49_1","volume-title":"Training Data Debugging for the Fairness of Machine Learning Software. In ICSE","author":"Li Yanhui","year":"2022","unstructured":"Yanhui Li, Linghan Meng, Lin Chen, Li Yu, Di Wu, Yuming Zhou, and Baowen Xu. 2022. Training Data Debugging for the Fairness of Machine Learning Software. In ICSE 2022. ACM, 2215\u20132227."},{"key":"e_1_3_2_1_50_1","volume-title":"ECCV","volume":"432","author":"Lin Xiaofeng","year":"2022","unstructured":"Xiaofeng Lin, Seungbae Kim, and Jungseock Joo. 2022. FairGRAPE: Fairness-Aware GRAdient Pruning mEthod for Face Attribute Classification. In ECCV 2022, Shai Avidan, Gabriel J. Brostow, Moustapha Ciss\u00e9, Giovanni Maria Farinella, and Tal Hassner (Eds.) (Lecture Notes in Computer Science, Vol. 13673). Springer, 414\u2013432."},{"key":"e_1_3_2_1_51_1","volume-title":"Manish Bhide, Diptikalyan Saha, Kush R. Varshney, and Ruchir Puri.","author":"Lohia Pranay Kr.","year":"2019","unstructured":"Pranay Kr. Lohia, Karthikeyan Natesan Ramamurthy, Manish Bhide, Diptikalyan Saha, Kush R. Varshney, and Ruchir Puri. 2019. Bias Mitigation Post-processing for Individual and Group Fairness. In ICASSP 2019. IEEE, 2847\u20132851."},{"key":"e_1_3_2_1_52_1","volume-title":"Sathya N. Ravi, and Vikas Singh.","author":"Lokhande Vishnu Suresh","year":"2020","unstructured":"Vishnu Suresh Lokhande, Aditya Kumar Akash, Sathya N. Ravi, and Vikas Singh. 2020. FairALM: Augmented Lagrangian Method for Training Fair Models with Little Regret. In ECCV 2020, Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm (Eds.) (Lecture Notes in Computer Science, Vol. 12357). Springer, 365\u2013381."},{"key":"e_1_3_2_1_53_1","volume-title":"Last-Layer Fairness Fine-tuning is Simple and Effective for Neural Networks. CoRR, abs\/2304.03935","author":"Mao Yuzhen","year":"2023","unstructured":"Yuzhen Mao, Zhun Deng, Huaxiu Yao, Ting Ye, Kenji Kawaguchi, and James Zou. 2023. Last-Layer Fairness Fine-tuning is Simple and Effective for Neural Networks. CoRR, abs\/2304.03935 (2023)."},{"key":"e_1_3_2_1_54_1","volume-title":"A Survey on Bias and Fairness in Machine Learning. ACM Comput. Surv., 54, 6","author":"Mehrabi Ninareh","year":"2022","unstructured":"Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2022. A Survey on Bias and Fairness in Machine Learning. ACM Comput. Surv., 54, 6 (2022), 115:1\u2013115:35."},{"key":"e_1_3_2_1_55_1","volume-title":"Rog\u00e9rio Schmidt Feris, and John R. Smith","author":"Merler Michele","year":"2019","unstructured":"Michele Merler, Nalini K. Ratha, Rog\u00e9rio Schmidt Feris, and John R. Smith. 2019. Diversity in Faces. CoRR, abs\/1901.10436 (2019)."},{"key":"e_1_3_2_1_56_1","volume-title":"ESEC\/FSE","author":"Nguyen Giang","year":"2023","unstructured":"Giang Nguyen, Sumon Biswas, and Hridesh Rajan. 2023. Fix Fairness, Don\u2019t Ruin Accuracy: Performance Aware Fairness Repair using AutoML. In ESEC\/FSE 2023, Satish Chandra, Kelly Blincoe, and Paolo Tonella (Eds.). ACM, 502\u2013514."},{"key":"e_1_3_2_1_57_1","unstructured":"Girish Keshav Palshikar Rajiv Srivastava Mahek Shah and Sachin Pawar. 2018. Automatic Shortlisting of Candidates in Recruitment.. In ProfS\/KG4IR\/Data: Search@ SIGIR. 5\u201311."},{"key":"e_1_3_2_1_58_1","volume-title":"Fair Contrastive Learning for Facial Attribute Classification. In CVPR","author":"Park Sungho","year":"2022","unstructured":"Sungho Park, Jewook Lee, Pilhyeon Lee, Sunhee Hwang, Dohyung Kim, and Hyeran Byun. 2022. Fair Contrastive Learning for Facial Attribute Classification. In CVPR 2022. IEEE, 10379\u201310388."},{"key":"e_1_3_2_1_59_1","volume-title":"ICST Workshops","author":"Patel Ankita Ramjibhai","year":"2022","unstructured":"Ankita Ramjibhai Patel, Jaganmohan Chandrasekaran, Yu Lei, Raghu N. Kacker, and D. Richard Kuhn. 2022. A Combinatorial Approach to Fairness Testing of Machine Learning Models. In ICST Workshops 2022. IEEE, 94\u2013101."},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_1_61_1","volume-title":"Weinberger","author":"Pleiss Geoff","year":"2017","unstructured":"Geoff Pleiss, Manish Raghavan, Felix Wu, Jon M. Kleinberg, and Kilian Q. Weinberger. 2017. On Fairness and Calibration. In NeurIPS 2017, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 5680\u20135689."},{"key":"e_1_3_2_1_62_1","volume-title":"Plummer","author":"Qraitem Maan","year":"2022","unstructured":"Maan Qraitem, Kate Saenko, and Bryan A. Plummer. 2022. Bias Mimicking: A Simple Sampling Approach for Bias Mitigation. CoRR, abs\/2209.15605 (2022)."},{"key":"e_1_3_2_1_63_1","volume-title":"Discovering Fair Representations in the Data Domain. In CVPR","author":"Quadrianto Novi","year":"2019","unstructured":"Novi Quadrianto, Viktoriia Sharmanska, and Oliver Thomas. 2019. Discovering Fair Representations in the Data Domain. In CVPR 2019. Computer Vision Foundation \/ IEEE, 8227\u20138236."},{"key":"e_1_3_2_1_64_1","volume-title":"Fair Attribute Classification Through Latent Space De-Biasing. In CVPR","author":"Ramaswamy Vikram V.","year":"2021","unstructured":"Vikram V. Ramaswamy, Sunnie S. Y. Kim, and Olga Russakovsky. 2021. Fair Attribute Classification Through Latent Space De-Biasing. In CVPR 2021. Computer Vision Foundation \/ IEEE, 9301\u20139310."},{"key":"e_1_3_2_1_65_1","first-page":"42","article-title":"The artificial intelligence recruitment process: How technological advancements have reshaped job application and selection practices","volume":"7","author":"Rodney Harriet","year":"2019","unstructured":"Harriet Rodney, Katarina Valaskova, and Pavol Durana. 2019. The artificial intelligence recruitment process: How technological advancements have reshaped job application and selection practices. Psychosociological Issues in Human Resource Management, 7, 1 (2019), 42\u201347.","journal-title":"Psychosociological Issues in Human Resource Management"},{"key":"e_1_3_2_1_66_1","volume-title":"FairBatch: Batch Selection for Model Fairness. In ICLR","author":"Roh Yuji","year":"2021","unstructured":"Yuji Roh, Kangwook Lee, Steven Euijong Whang, and Changho Suh. 2021. FairBatch: Batch Selection for Model Fairness. In ICLR 2021. OpenReview.net."},{"key":"e_1_3_2_1_67_1","volume-title":"ICSE","author":"Royce W. W.","year":"1987","unstructured":"W. W. Royce. 1987. Managing the Development of Large Software Systems: Concepts and Techniques. In ICSE 1987, William E. Riddle, Robert M. Balzer, and Kouichi Kishida (Eds.). ACM Press, 328\u2013339."},{"key":"e_1_3_2_1_68_1","volume-title":"Image processing, analysis and machine vision : by Milan Sonka, Vaclav Hlavac and Roger Boyle","author":"Saarinen Kari","year":"1993","unstructured":"Kari Saarinen. 1994. Image processing, analysis and machine vision : by Milan Sonka, Vaclav Hlavac and Roger Boyle. Publisher: Chapman & Hall, 2-6 Boundary Row, London SE1 8HN, UK, 1993, xix+555 pp., ISBN 0-412-45570-6. Signal Process., 35, 1 (1994), 102\u2013104."},{"key":"e_1_3_2_1_69_1","volume-title":"Tatsunori B. Hashimoto, and Percy Liang.","author":"Sagawa Shiori","year":"2019","unstructured":"Shiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, and Percy Liang. 2019. Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization. CoRR, abs\/1911.08731 (2019)."},{"key":"e_1_3_2_1_70_1","volume-title":"Pang Wei Koh, and Percy Liang","author":"Sagawa Shiori","year":"2020","unstructured":"Shiori Sagawa, Aditi Raghunathan, Pang Wei Koh, and Percy Liang. 2020. An Investigation of Why Overparameterization Exacerbates Spurious Correlations. CoRR, abs\/2005.04345 (2020)."},{"key":"e_1_3_2_1_71_1","volume-title":"Interventional Fairness: Causal Database Repair for Algorithmic Fairness. In SIGMOD","author":"Salimi Babak","year":"2019","unstructured":"Babak Salimi, Luke Rodriguez, Bill Howe, and Dan Suciu. 2019. Interventional Fairness: Causal Database Repair for Algorithmic Fairness. In SIGMOD 2019, Peter A. Boncz, Stefan Manegold, Anastasia Ailamaki, Amol Deshpande, and Tim Kraska (Eds.). ACM, 793\u2013810."},{"key":"e_1_3_2_1_72_1","volume-title":"FLAC: Fairness-Aware Representation Learning by Suppressing Attribute-Class Associations. CoRR, abs\/2304.14252","author":"Sarridis Ioannis","year":"2023","unstructured":"Ioannis Sarridis, Christos Koutlis, Symeon Papadopoulos, and Christos Diou. 2023. FLAC: Fairness-Aware Representation Learning by Suppressing Attribute-Class Associations. CoRR, abs\/2304.14252 (2023)."},{"key":"e_1_3_2_1_73_1","first-page":"1","article-title":"Natural Test Generation for Precise Testing of Question Answering Software. In ASE 2022","volume":"71","author":"Shen Qingchao","year":"2022","unstructured":"Qingchao Shen, Junjie Chen, Jie M. Zhang, Haoyu Wang, Shuang Liu, and Menghan Tian. 2022. Natural Test Generation for Precise Testing of Question Answering Software. In ASE 2022. ACM, 71:1\u201371:12.","journal-title":"ACM"},{"key":"e_1_3_2_1_74_1","volume-title":"Interpretable Compositional Convolutional Neural Networks. In IJCAI","author":"Shen Wen","year":"2021","unstructured":"Wen Shen, Zhihua Wei, Shikun Huang, Binbin Zhang, Jiaqi Fan, Ping Zhao, and Quanshi Zhang. 2021. Interpretable Compositional Convolutional Neural Networks. In IJCAI 2021, Zhi-Hua Zhou (Ed.). ijcai.org, 2971\u20132978."},{"key":"e_1_3_2_1_75_1","first-page":"5188","article-title":"Astraea","volume":"48","author":"Soremekun Ezekiel O.","year":"2022","unstructured":"Ezekiel O. Soremekun, Sakshi Udeshi, and Sudipta Chattopadhyay. 2022. Astraea: Grammar-Based Fairness Testing. IEEE Trans. Software Eng., 48, 12 (2022), 5188\u20135211.","journal-title":"Grammar-Based Fairness Testing. IEEE Trans. Software Eng."},{"key":"e_1_3_2_1_76_1","first-page":"75","article-title":"The case for an international court of Civil Justice","volume":"67","author":"Steinitz Maya","year":"2014","unstructured":"Maya Steinitz. 2014. The case for an international court of Civil Justice. Stan. L. Rev. Online, 67 (2014), 75.","journal-title":"Stan. L. Rev. Online"},{"key":"e_1_3_2_1_77_1","volume-title":"Causality-Based Neural Network Repair. In ICSE","author":"Sun Bing","year":"2022","unstructured":"Bing Sun, Jun Sun, Long H. Pham, and Tie Shi. 2022. Causality-Based Neural Network Repair. In ICSE 2022. ACM, 338\u2013349."},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380420"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510206"},{"key":"e_1_3_2_1_80_1","volume-title":"Fairness-aware Configuration of Machine Learning Libraries. In ICSE","author":"Tizpaz-Niari Saeid","year":"2022","unstructured":"Saeid Tizpaz-Niari, Ashish Kumar, Gang Tan, and Ashutosh Trivedi. 2022. Fairness-aware Configuration of Machine Learning Libraries. In ICSE 2022. ACM, 909\u2013920."},{"key":"e_1_3_2_1_81_1","volume-title":"Simultaneous Deep Transfer Across Domains and Tasks. In ICCV","author":"Tzeng Eric","year":"2015","unstructured":"Eric Tzeng, Judy Hoffman, Trevor Darrell, and Kate Saenko. 2015. Simultaneous Deep Transfer Across Domains and Tasks. In ICCV 2015. IEEE Computer Society, 4068\u20134076."},{"key":"e_1_3_2_1_82_1","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s43681-020-00025-0","article-title":"Job candidates\u2019 reactions to AI-enabled job application processes","volume":"1","author":"van Esch Patrick","year":"2021","unstructured":"Patrick van Esch, J Stewart Black, and Denni Arli. 2021. Job candidates\u2019 reactions to AI-enabled job application processes. AI and Ethics, 1 (2021), 119\u2013130.","journal-title":"AI and Ethics"},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.09.009"},{"key":"e_1_3_2_1_84_1","volume-title":"A comparative assessment of ensemble learning for credit scoring. Expert systems with applications, 38, 1","author":"Wang Gang","year":"2011","unstructured":"Gang Wang, Jinxing Hao, Jian Ma, and Hongbing Jiang. 2011. A comparative assessment of ensemble learning for credit scoring. Expert systems with applications, 38, 1 (2011), 223\u2013230."},{"key":"e_1_3_2_1_85_1","volume-title":"Fairness-aware Adversarial Perturbation Towards Bias Mitigation for Deployed Deep Models. In CVPR","author":"Wang Zhibo","year":"2022","unstructured":"Zhibo Wang, Xiaowei Dong, Henry Xue, Zhifei Zhang, Weifeng Chiu, Tao Wei, and Kui Ren. 2022. Fairness-aware Adversarial Perturbation Towards Bias Mitigation for Deployed Deep Models. In CVPR 2022. IEEE, 10369\u201310378."},{"key":"e_1_3_2_1_86_1","volume-title":"Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigation. In CVPR","author":"Wang Zeyu","year":"2020","unstructured":"Zeyu Wang, Klint Qinami, Ioannis Christos Karakozis, Kyle Genova, Prem Nair, Kenji Hata, and Olga Russakovsky. 2020. Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigation. In CVPR 2020. Computer Vision Foundation \/ IEEE, 8916\u20138925."},{"key":"e_1_3_2_1_87_1","volume-title":"ESEC\/FSE","author":"Wang Zan","year":"2020","unstructured":"Zan Wang, Ming Yan, Junjie Chen, Shuang Liu, and Dongdi Zhang. 2020. Deep learning library testing via effective model generation. In ESEC\/FSE 2020, Prem Devanbu, Myra B. Cohen, and Thomas Zimmermann (Eds.). ACM, 788\u2013799."},{"key":"e_1_3_2_1_88_1","volume-title":"Fairlearn: Assessing and Improving Fairness of AI Systems. CoRR, abs\/2303.16626","author":"Weerts Hilde J. P.","year":"2023","unstructured":"Hilde J. P. Weerts, Miroslav Dud\u00edk, Richard Edgar, Adrin Jalali, Roman Lutz, and Michael Madaio. 2023. Fairlearn: Assessing and Improving Fairness of AI Systems. CoRR, abs\/2303.16626 (2023)."},{"key":"e_1_3_2_1_89_1","volume-title":"The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Pearson_correlation_coefficient&oldid=1177721736","author":"Wikipedia","unstructured":"Wikipedia contributors. 2023. Pearson correlation coefficient \u2014 Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Pearson_correlation_coefficient&oldid=1177721736"},{"key":"e_1_3_2_1_90_1","volume-title":"Consistent Instance False Positive Improves Fairness in Face Recognition. In CVPR","author":"Xu Xingkun","year":"2021","unstructured":"Xingkun Xu, Yuge Huang, Pengcheng Shen, Shaoxin Li, Jilin Li, Feiyue Huang, Yong Li, and Zhen Cui. 2021. Consistent Instance False Positive Improves Fairness in Face Recognition. In CVPR 2021. Computer Vision Foundation \/ IEEE, 578\u2013586."},{"key":"e_1_3_2_1_91_1","doi-asserted-by":"crossref","first-page":"2013652","DOI":"10.1080\/08839514.2021.2013652","article-title":"Human Judges in the era of artificial intelligence: challenges and opportunities","volume":"36","author":"Xu Zichun","year":"2022","unstructured":"Zichun Xu. 2022. Human Judges in the era of artificial intelligence: challenges and opportunities. Applied Artificial Intelligence, 36, 1 (2022), 2013652.","journal-title":"Applied Artificial Intelligence"},{"key":"e_1_3_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE59848.2023.00077"},{"key":"e_1_3_2_1_93_1","volume-title":"Improving Fairness in Image Classification via Sketching. CoRR, abs\/2211.00168","author":"Yao Ruichen","year":"2022","unstructured":"Ruichen Yao, Ziteng Cui, Xiaoxiao Li, and Lin Gu. 2022. Improving Fairness in Image Classification via Sketching. CoRR, abs\/2211.00168 (2022)."},{"key":"e_1_3_2_1_94_1","volume-title":"Regression Fuzzing for Deep Learning Systems. In ICSE","author":"You Hanmo","year":"2023","unstructured":"Hanmo You, Zan Wang, Junjie Chen, Shuang Liu, and Shuochuan Li. 2023. Regression Fuzzing for Deep Learning Systems. In ICSE 2023. IEEE, 82\u201394."},{"key":"e_1_3_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278779"},{"key":"e_1_3_2_1_96_1","unstructured":"Guanhua Zhang Yihua Zhang Yang Zhang Wenqi Fan Qing Li Sijia Liu and Shiyu Chang. 2022. Fairness Reprogramming. In NeurIPS."},{"key":"e_1_3_2_1_97_1","volume-title":"ESEC\/FSE","author":"Zhang Mengdi","year":"2022","unstructured":"Mengdi Zhang and Jun Sun. 2022. Adaptive fairness improvement based on causality analysis. In ESEC\/FSE 2022, Abhik Roychoudhury, Cristian Cadar, and Miryung Kim (Eds.). ACM, 6\u201317."},{"key":"e_1_3_2_1_98_1","volume-title":"MM","author":"Zhang Yi","year":"2020","unstructured":"Yi Zhang and Jitao Sang. 2020. Towards Accuracy-Fairness Paradox: Adversarial Example-based Data Augmentation for Visual Debiasing. In MM 2020, Chang Wen Chen, Rita Cucchiara, Xian-Sheng Hua, Guo-Jun Qi, Elisa Ricci, Zhengyou Zhang, and Roger Zimmermann (Eds.). ACM, 4346\u20134354."}],"event":{"name":"ISSTA '24: 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Vienna Austria","acronym":"ISSTA '24","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","AITO"]},"container-title":["Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3652122","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3650212.3652122","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T18:50:06Z","timestamp":1750272606000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3652122"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,11]]},"references-count":98,"alternative-id":["10.1145\/3650212.3652122","10.1145\/3650212"],"URL":"https:\/\/doi.org\/10.1145\/3650212.3652122","relation":{},"subject":[],"published":{"date-parts":[[2024,9,11]]},"assertion":[{"value":"2024-09-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}