{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T01:43:38Z","timestamp":1787017418966,"version":"3.56.0"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,9,11]],"date-time":"2023-09-11T00:00:00Z","timestamp":1694390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"U.S. Department of Commerce, National Institute of Standards and Technology","award":["60NANB18D227"],"award-info":[{"award-number":["60NANB18D227"]}]},{"name":"National Science Foundation","award":["IIS2046381; IIS1850023; IIS1927486"],"award-info":[{"award-number":["IIS2046381; IIS1850023; IIS1927486"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2023,9,30]]},"abstract":"<jats:p>\n                    Currently, there is a surge of interest in\n                    <jats:italic>fair Artificial Intelligence (AI) and Machine Learning (ML)<\/jats:italic>\n                    research which aims to mitigate discriminatory bias in AI algorithms, e.g., along lines of gender, age, and race. While most research in this domain focuses on developing fair AI algorithms, in this work, we examine the challenges which arise when humans and fair AI interact. Our results show that due to an apparent conflict between human preferences and fairness, a fair AI algorithm on its own may be insufficient to achieve its intended results in the real world. Using college major recommendation as a case study, we build a fair AI recommender by employing gender debiasing machine learning techniques. Our offline evaluation showed that the debiased recommender makes fairer career recommendations without sacrificing its accuracy in prediction. Nevertheless, an online user study of more than 200 college students revealed that participants on average prefer the original biased system over the debiased system. Specifically, we found that perceived gender disparity is a determining factor for the acceptance of a recommendation. In other words, we cannot fully address the gender bias issue in AI recommendations without addressing the gender bias in humans. We conducted a follow-up survey to gain additional insights into the effectiveness of various design options that can help participants to overcome their own biases. Our results suggest that making fair AI explainable is crucial for increasing its adoption in the real world.\n                  <\/jats:p>","DOI":"10.1145\/3611313","type":"journal-article","created":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T07:53:54Z","timestamp":1690876434000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["When Biased Humans Meet Debiased AI: A Case Study in College Major Recommendation"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-7589-4670","authenticated-orcid":false,"given":"Clarice","family":"Wang","sequence":"first","affiliation":[{"name":"University of Pennsylvania, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-7766-4908","authenticated-orcid":false,"given":"Kathryn","family":"Wang","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-7788-1498","authenticated-orcid":false,"given":"Andrew Y.","family":"Bian","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5276-5708","authenticated-orcid":false,"given":"Rashidul","family":"Islam","sequence":"additional","affiliation":[{"name":"University of Maryland, Baltimore County, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-5069-8383","authenticated-orcid":false,"given":"Kamrun Naher","family":"Keya","sequence":"additional","affiliation":[{"name":"University of Maryland, Baltimore County, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0935-4182","authenticated-orcid":false,"given":"James","family":"Foulds","sequence":"additional","affiliation":[{"name":"University of Maryland, Baltimore County, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5989-8543","authenticated-orcid":false,"given":"Shimei","family":"Pan","sequence":"additional","affiliation":[{"name":"University of Maryland, Baltimore County, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,9,11]]},"reference":[{"key":"e_1_3_2_2_1","article-title":"A reductions approach to fair classification","author":"Agarwal Alekh","year":"2018","unstructured":"Alekh Agarwal, Alina Beygelzimer, Miroslav Dud\u00edk, John Langford, and Hanna Wallach. 2018. A reductions approach to fair classification. arXiv preprint arXiv:1803.02453 (2018).","journal-title":"arXiv preprint arXiv:1803.02453"},{"key":"e_1_3_2_3_1","first-page":"1","article-title":"Discrimination through optimization: How Facebook\u2019s ad delivery can lead to biased outcomes","volume":"3","author":"Ali Muhammad","year":"2019","unstructured":"Muhammad Ali, Piotr Sapiezynski, Miranda Bogen, Aleksandra Korolova, Alan Mislove, and Aaron Rieke. 2019. Discrimination through optimization: How Facebook\u2019s ad delivery can lead to biased outcomes. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1\u201330.","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"e_1_3_2_4_1","article-title":"Machine bias: There\u2019s software used across the country to predict future criminals. And it\u2019s biased against Blacks","volume":"23","author":"Angwin J.","year":"2016","unstructured":"J. Angwin, J. Larson, S. Mattu, and L. Kirchner. 2016. Machine bias: There\u2019s software used across the country to predict future criminals. And it\u2019s biased against Blacks. ProPublica, May 23 (2016).","journal-title":"ProPublica, May"},{"key":"e_1_3_2_5_1","unstructured":"ASCA. 2021. Student-to-School-Counselor Ratio 2020\u20132021. https:\/\/www.schoolcounselor.org\/getmedia\/238f136e-ec52-4bf2-94b6-f24c39447022\/Ratios-20-21-Alpha.pdf"},{"issue":"2","key":"e_1_3_2_6_1","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1037\/0033-295X.84.2.191","article-title":"Self-efficacy: Toward a unifying theory of behavioral change.","volume":"84","author":"Bandura Albert","year":"1977","unstructured":"Albert Bandura. 1977. Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review 84, 2 (1977), 191.","journal-title":"Psychological Review"},{"issue":"4","key":"e_1_3_2_7_1","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/0146-6402(78)90012-7","article-title":"Reflections on self-efficacy","volume":"1","author":"Bandura Albert","year":"1978","unstructured":"Albert Bandura. 1978. Reflections on self-efficacy. Advances in Behaviour Research and Therapy 1, 4 (1978), 237\u2013269.","journal-title":"Advances in Behaviour Research and Therapy"},{"key":"e_1_3_2_8_1","first-page":"1","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems","author":"Barbosa Nat\u00e3 M.","year":"2019","unstructured":"Nat\u00e3 M. Barbosa and Monchu Chen. 2019. Rehumanized crowdsourcing: A labeling framework addressing bias and ethics in machine learning. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201312."},{"key":"e_1_3_2_9_1","first-page":"671","article-title":"Big data\u2019s disparate impact","volume":"104","author":"Barocas S.","year":"2016","unstructured":"S. Barocas and A. D. Selbst. 2016. Big data\u2019s disparate impact. Cal. L. Rev. 104 (2016), 671.","journal-title":"Cal. L. Rev."},{"issue":"4","key":"e_1_3_2_10_1","first-page":"4:1\u20134:15","article-title":"AI fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias.","volume":"63","author":"Bellamy Rachel K. E.","year":"2019","unstructured":"Rachel K. E. Bellamy, Kuntal Dey, Michael Hind, Samuel C. Hoffman, Stephanie Houde, Kalapriya Kannan, Pranay Lohia, Jacquelyn Martino, Sameep Mehta, Aleksandra Mojsilovic, Seema Nagar, Karthikeyan Natesan Ramamurthy, John T. Richards, Diptikalyan Saha, Prasanna Sattigeri, Moninder Singh, Kush R. Varshney, and Yunfeng Zhang. 2019. AI fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias. IBM J. Res. Dev. 63, 4\/5 (2019), 4:1\u20134:15.","journal-title":"IBM J. Res. Dev."},{"key":"e_1_3_2_11_1","first-page":"993","article-title":"Latent Dirichlet allocation","volume":"3","author":"Blei David M.","year":"2003","unstructured":"David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. Journal of Machine Learning Research 3 (2003), 993\u20131022.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_12_1","volume-title":"Advances in NeurIPS","author":"Bolukbasi T.","year":"2016","unstructured":"T. Bolukbasi, K.-W. Chang, J. Y. Zou, V. Saligrama, and A. T. Kalai. 2016. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In Advances in NeurIPS."},{"key":"e_1_3_2_13_1","unstructured":"T. Buonocore. 2019. Man is to doctor as woman is to nurse: The gender bias of word embeddings. https:\/\/towardsdatascience.com\/gender-bias-word-embeddings-76d9806a0e17"},{"key":"e_1_3_2_14_1","volume-title":"AI Now 2017 Symposium Report","author":"Campolo A.","year":"2017","unstructured":"A. Campolo, M. Sanfilippo, M. Whittaker, A. Selbst K. Crawford, and S. Barocas. 2017. AI Now 2017 Symposium Report. AI Now."},{"key":"e_1_3_2_15_1","first-page":"1","volume-title":"Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Chen Jiawei","year":"2020","unstructured":"Jiawei Chen, Anbang Xu, Zhe Liu, Yufan Guo, Xiaotong Liu, Yingbei Tong, Rama Akkiraju, and John M. Carroll. 2020. A general methodology to quantify biases in natural language data. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u20139."},{"issue":"6","key":"e_1_3_2_16_1","doi-asserted-by":"crossref","first-page":"1691","DOI":"10.1086\/321299","article-title":"Gender and the career choice process: The role of biased self-assessments","volume":"106","author":"Correll Shelley J.","year":"2001","unstructured":"Shelley J. Correll. 2001. Gender and the career choice process: The role of biased self-assessments. American Journal of Sociology 106, 6 (2001), 1691\u20131730.","journal-title":"American Journal of Sociology"},{"key":"e_1_3_2_17_1","first-page":"1","volume-title":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","author":"Cramer Henriette","year":"2019","unstructured":"Henriette Cramer, Jean Garcia-Gathright, Sravana Reddy, Aaron Springer, and Romain Takeo Bouyer. 2019. Translation, tracks & data: An algorithmic bias effort in practice. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u20138."},{"key":"e_1_3_2_18_1","first-page":"139","article-title":"Demarginalizing the intersection of race and sex: A Black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics","author":"Crenshaw K.","year":"1989","unstructured":"K. Crenshaw. 1989. Demarginalizing the intersection of race and sex: A Black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. U. Chi. Legal F. (1989), 139\u2013167.","journal-title":"U. Chi. Legal F."},{"key":"e_1_3_2_19_1","first-page":"1","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Cryan Jenna","year":"2020","unstructured":"Jenna Cryan, Shiliang Tang, Xinyi Zhang, Miriam Metzger, Haitao Zheng, and Ben Y. Zhao. 2020. Detecting gender stereotypes: Lexicon vs. supervised learning methods. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u201311."},{"key":"e_1_3_2_20_1","article-title":"Amazon scraps secret AI recruiting tool that showed bias against women","author":"Dastin J.","year":"2018","unstructured":"J. Dastin. 2018. Amazon scraps secret AI recruiting tool that showed bias against women. Reuters (2018). https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight\/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G","journal-title":"Reuters"},{"key":"e_1_3_2_21_1","unstructured":"Sunipa Dev and Jeff Phillips. 2019. Attenuating Bias in Word Vectors. arxiv:1901.07656 [cs.CL]."},{"key":"e_1_3_2_22_1","first-page":"1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems","author":"D\u00edaz Mark","year":"2018","unstructured":"Mark D\u00edaz, Isaac Johnson, Amanda Lazar, Anne Marie Piper, and Darren Gergle. 2018. Addressing age-related bias in sentiment analysis. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1\u201314."},{"key":"e_1_3_2_23_1","doi-asserted-by":"crossref","unstructured":"Jonathan Dodge Q. Vera Liao Yunfeng Zhang Rachel K. E. Bellamy and Casey Dugan. 2019. Explaining models: An empirical study of how explanations impact fairness judgment(IUI\u201919). Association for Computing Machinery New York NY USA 275\u201385.","DOI":"10.1145\/3301275.3302310"},{"key":"e_1_3_2_24_1","first-page":"214","volume-title":"Proceedings of ITCS","author":"Dwork C.","year":"2012","unstructured":"C. Dwork, M. Hardt, T. Pitassi, O. Reingold, and R. Zemel. 2012. Fairness through awareness. In Proceedings of ITCS. ACM, 214\u2013226."},{"issue":"2","key":"e_1_3_2_25_1","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1037\/h0058073","article-title":"The relationship between the judged desirability of a trait and the probability that the trait will be endorsed.","volume":"37","author":"Edwards Allen L.","year":"1953","unstructured":"Allen L. Edwards. 1953. The relationship between the judged desirability of a trait and the probability that the trait will be endorsed. Journal of Applied Psychology 37, 2 (1953), 90.","journal-title":"Journal of Applied Psychology"},{"issue":"3","key":"e_1_3_2_26_1","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1037\/h0048547","article-title":"Social desirability in the MMPI.","volume":"20","author":"Fordyce Wilbert E.","year":"1956","unstructured":"Wilbert E. Fordyce. 1956. Social desirability in the MMPI. Journal of Consulting Psychology 20, 3 (1956), 171.","journal-title":"Journal of Consulting Psychology"},{"key":"e_1_3_2_27_1","doi-asserted-by":"crossref","first-page":"1918","DOI":"10.1109\/ICDE48307.2020.00203","volume-title":"2020 IEEE 36th International Conference on Data Engineering (ICDE)","author":"Foulds James R.","year":"2020","unstructured":"James R. Foulds, Rashidul Islam, Kamrun Naher Keya, and Shimei Pan. 2020a. An intersectional definition of fairness. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). IEEE, 1918\u20131921."},{"key":"e_1_3_2_28_1","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1137\/1.9781611976236.48","volume-title":"Proceedings of the 2020 SIAM International Conference on Data Mining","author":"Foulds James R.","year":"2020","unstructured":"James R. Foulds, Rashidul Islam, Kamrun Naher Keya, and Shimei Pan. 2020b. Bayesian modeling of intersectional fairness: The variance of bias. In Proceedings of the 2020 SIAM International Conference on Data Mining. SIAM, 424\u2013432."},{"key":"e_1_3_2_29_1","article-title":"On formalizing fairness in prediction with machine learning","author":"Gajane Pratik","year":"2017","unstructured":"Pratik Gajane and Mykola Pechenizkiy. 2017. On formalizing fairness in prediction with machine learning. arXiv preprint arXiv:1710.03184 (2017).","journal-title":"arXiv preprint arXiv:1710.03184"},{"key":"e_1_3_2_30_1","first-page":"365","article-title":"Gender, power dynamics, and social interaction","volume":"5","author":"Glick Peter","year":"1999","unstructured":"Peter Glick and Susan T. Fiske. 1999. Gender, power dynamics, and social interaction. Revisioning Gender 5 (1999), 365\u2013398.","journal-title":"Revisioning Gender"},{"key":"e_1_3_2_31_1","doi-asserted-by":"crossref","first-page":"1464","DOI":"10.1037\/0022-3514.74.6.1464","article-title":"Measuring individual differences in implicit cognition: The implicit association test","volume":"74","author":"Greenwald A. G.","year":"1998","unstructured":"A. G. Greenwald, D. E. McGhee, and J. L. Schwartz. 1998. Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology 74 (1998), 1464\u20131480.","journal-title":"Journal of Personality and Social Psychology"},{"key":"e_1_3_2_32_1","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1037\/0022-3514.85.2.197","article-title":"Understanding and using the implicit association test: I. An improved scoring algorithm","volume":"85","author":"Greenwald A. G.","year":"2003","unstructured":"A. G. Greenwald, B. A. Nosek, and M. R. Banaji. 2003. Understanding and using the implicit association test: I. An improved scoring algorithm. Journal of Personality and Social Psychology 85 (2003), 197\u2013216.","journal-title":"Journal of Personality and Social Psychology"},{"key":"e_1_3_2_33_1","first-page":"3315","volume-title":"Advances in NeurIPS","author":"Hardt M.","year":"2016","unstructured":"M. Hardt, E. Price, and N. Srebro. 2016. Equality of opportunity in supervised learning. In Advances in NeurIPS. 3315\u20133323."},{"key":"e_1_3_2_34_1","first-page":"1661","volume-title":"Proceedings of the 24th ACM International on Conference on Information and Knowledge Management","author":"He Xiangnan","year":"2015","unstructured":"Xiangnan He, Tao Chen, Min-Yen Kan, and Xiao Chen. 2015. TriRank: Review-aware explainable recommendation by modeling aspects. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 1661\u20131670."},{"key":"e_1_3_2_35_1","first-page":"173","volume-title":"Proceedings of the 26th International Conference on World Wide Web","author":"He Xiangnan","year":"2017","unstructured":"Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173\u2013182."},{"key":"e_1_3_2_36_1","first-page":"549","volume-title":"Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"He Xiangnan","year":"2016","unstructured":"Xiangnan He, Hanwang Zhang, Min-Yen Kan, and Tat-Seng Chua. 2016. Fast matrix factorization for online recommendation with implicit feedback. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. 549\u2013558."},{"issue":"3","key":"e_1_3_2_37_1","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/S40037-014-0128-X","article-title":"Career decisions and gender: The illusion of choice?","volume":"3","author":"Hill Elspeth J. R.","year":"2014","unstructured":"Elspeth J. R. Hill and James A. Giles. 2014. Career decisions and gender: The illusion of choice? Perspectives on Medical Education 3, 3 (2014), 151\u2013154.","journal-title":"Perspectives on Medical Education"},{"key":"e_1_3_2_38_1","first-page":"2511","volume-title":"Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems","author":"Hou Youyang","year":"2017","unstructured":"Youyang Hou, Cliff Lampe, Maximilian Bulinski, and James J. Prescott. 2017. Factors in fairness and emotion in online case resolution systems. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2511\u20132522."},{"issue":"5","key":"e_1_3_2_39_1","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1007\/s11948-017-9975-2","article-title":"The ugly truth about ourselves and our robot creations: The problem of bias and social inequity","volume":"24","author":"Howard Ayanna","year":"2018","unstructured":"Ayanna Howard and Jason Borenstein. 2018. The ugly truth about ourselves and our robot creations: The problem of bias and social inequity. Science and Engineering Ethics 24, 5 (2018), 1521\u20131536.","journal-title":"Science and Engineering Ethics"},{"issue":"2","key":"e_1_3_2_40_1","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1037\/0033-2909.107.2.139","article-title":"Gender differences in mathematics performance: A meta-analysis.","volume":"107","author":"Hyde Janet S.","year":"1990","unstructured":"Janet S. Hyde, Elizabeth Fennema, and Susan J. Lamon. 1990. Gender differences in mathematics performance: A meta-analysis. Psychological Bulletin 107, 2 (1990), 139.","journal-title":"Psychological Bulletin"},{"key":"e_1_3_2_41_1","article-title":"Mitigating demographic biases in social media-based recommender systems","author":"Islam Rashidul","year":"2019","unstructured":"Rashidul Islam, Kamrun Naher Keya, Shimei Pan, and James Foulds. 2019a. Mitigating demographic biases in social media-based recommender systems. KDD (Social Impact Track) (2019).","journal-title":"KDD (Social Impact Track)"},{"key":"e_1_3_2_42_1","volume-title":"KDD (Social Impact Track)","author":"Islam Rashidul","year":"2019","unstructured":"Rashidul Islam, Kamrun Naher Keya, Shimei Pan, and James Foulds.2019b. Mitigating demographic biases in social media-based recommender systems. In KDD (Social Impact Track)."},{"key":"e_1_3_2_43_1","first-page":"586","volume-title":"Can We Obtain Fairness For Free?","author":"Islam Rashidul","year":"2021","unstructured":"Rashidul Islam, Shimei Pan, and James R. Foulds. 2021. Can We Obtain Fairness For Free?Association for Computing Machinery, New York, NY, USA, 586\u2013596."},{"key":"e_1_3_2_44_1","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1145\/3025453.3026015","volume-title":"Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems","author":"Johnson Isaac","year":"2017","unstructured":"Isaac Johnson, Connor McMahon, Johannes Sch\u00f6ning, and Brent Hecht. 2017. The effect of population and\u201d structural\u201d biases on social media-based algorithms: A case study in geolocation inference across the urban-rural spectrum. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1167\u20131178."},{"key":"e_1_3_2_45_1","first-page":"3819","volume-title":"Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems","author":"Kay Matthew","year":"2015","unstructured":"Matthew Kay, Cynthia Matuszek, and Sean A. Munson. 2015. Unequal representation and gender stereotypes in image search results for occupations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 3819\u20133828."},{"issue":"8","key":"e_1_3_2_46_1","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/MC.2009.263","article-title":"Matrix factorization techniques for recommender systems","volume":"42","author":"Koren Yehuda","year":"2009","unstructured":"Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30\u201337.","journal-title":"Computer"},{"issue":"4","key":"e_1_3_2_47_1","doi-asserted-by":"crossref","first-page":"2025","DOI":"10.1007\/s11135-011-9640-9","article-title":"Determinants of social desirability bias in sensitive surveys: A literature review","volume":"47","author":"Krumpal Ivar","year":"2013","unstructured":"Ivar Krumpal. 2013. Determinants of social desirability bias in sensitive surveys: A literature review. Quality & Quantity 47, 4 (2013), 2025\u20132047.","journal-title":"Quality & Quantity"},{"key":"e_1_3_2_48_1","doi-asserted-by":"crossref","unstructured":"Max Kuhn and Kjell Johnson. 2013. Applied Predictive Modeling . Vol. 26. Springer.","DOI":"10.1007\/978-1-4614-6849-3"},{"key":"e_1_3_2_49_1","first-page":"4066","volume-title":"Advances in Neural Information Processing Systems 30","author":"Kusner Matt J.","year":"2017","unstructured":"Matt J. Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. 2017. Counterfactual fairness. In Advances in Neural Information Processing Systems 30, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). 4066\u20134076."},{"issue":"2","key":"e_1_3_2_50_1","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1177\/0361684318806302","article-title":"Helping and hindering undergraduate women\u2019s STEM motivation: Experiences with STEM encouragement, STEM-related gender bias, and sexual harassment","volume":"43","author":"Leaper Campbell","year":"2019","unstructured":"Campbell Leaper and Christine R. Starr. 2019. Helping and hindering undergraduate women\u2019s STEM motivation: Experiences with STEM encouragement, STEM-related gender bias, and sexual harassment. Psychology of Women Quarterly 43, 2 (2019), 165\u2013183.","journal-title":"Psychology of Women Quarterly"},{"issue":"1","key":"e_1_3_2_51_1","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1006\/jvbe.1994.1027","article-title":"Toward a unifying social cognitive theory of career and academic interest, choice, and performance","volume":"45","author":"Lent Robert W.","year":"1994","unstructured":"Robert W. Lent, Steven D. Brown, and Gail Hackett. 1994. Toward a unifying social cognitive theory of career and academic interest, choice, and performance. Journal of Vocational Behavior 45, 1 (1994), 79\u2013122.","journal-title":"Journal of Vocational Behavior"},{"issue":"1","key":"e_1_3_2_52_1","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1111\/j.1471-6402.2006.00260.x","article-title":"\u201cSomeone like me can be successful\u201d: Do college students need same-gender role models?","volume":"30","author":"Lockwood Penelope","year":"2006","unstructured":"Penelope Lockwood. 2006. \u201cSomeone like me can be successful\u201d: Do college students need same-gender role models? Psychology of Women Quarterly 30, 1 (2006), 36\u201346.","journal-title":"Psychology of Women Quarterly"},{"key":"e_1_3_2_53_1","first-page":"1","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Madaio Michael A.","year":"2020","unstructured":"Michael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, and Hanna Wallach. 2020. Co-designing checklists to understand organizational challenges and opportunities around fairness in AI. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u201314."},{"key":"e_1_3_2_54_1","unstructured":"Ronald McQuaid and Sue Bond. 2004. Gender stereotyping in career choice. European Commission. Employment Research Institute and Careers Scotland ."},{"issue":"2","key":"e_1_3_2_55_1","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1037\/0033-2909.91.2.324","article-title":"Sex differences in math achievement: Toward a model of academic choice.","volume":"91","author":"Meece Judith L.","year":"1982","unstructured":"Judith L. Meece, Jacquelynne E. Parsons, Caroline M. Kaczala, and Susan B. Goff. 1982. Sex differences in math achievement: Toward a model of academic choice. Psychological Bulletin 91, 2 (1982), 324.","journal-title":"Psychological Bulletin"},{"key":"e_1_3_2_56_1","article-title":"A survey on bias and fairness in machine learning","author":"Mehrabi Ninareh","year":"2019","unstructured":"Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2019. A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635 (2019).","journal-title":"arXiv preprint arXiv:1908.09635"},{"key":"e_1_3_2_57_1","first-page":"1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems","author":"Metaxa-Kakavouli Dana\u00eb","year":"2018","unstructured":"Dana\u00eb Metaxa-Kakavouli, Kelly Wang, James A. Landay, and Jeff Hancock. 2018. Gender-inclusive design: Sense of belonging and bias in web interfaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1\u20136."},{"key":"e_1_3_2_58_1","article-title":"How targeted ads and dynamic pricing can perpetuate bias","author":"Miller Alex P.","year":"2010","unstructured":"Alex P. Miller and Kartik Hosanagar. 2010. How targeted ads and dynamic pricing can perpetuate bias. Harvard Business Review (2010).","journal-title":"Harvard Business Review"},{"key":"e_1_3_2_59_1","doi-asserted-by":"crossref","DOI":"10.18574\/nyu\/9781479833641.001.0001","volume-title":"Algorithms of Oppression: How Search Engines Reinforce Racism","author":"Noble S. U.","year":"2018","unstructured":"S. U. Noble. 2018. Algorithms of Oppression: How Search Engines Reinforce Racism. NYU Press."},{"issue":"6","key":"e_1_3_2_60_1","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1521\/soco.19.6.625.20886","article-title":"The go\/no-go association task","volume":"19","author":"Nosek B. A.","year":"2001","unstructured":"B. A. Nosek and M. R. Banaji. 2001. The go\/no-go association task. Social Cognition 19, 6 (2001), 161\u2013176.","journal-title":"Social Cognition"},{"key":"e_1_3_2_61_1","doi-asserted-by":"crossref","first-page":"6620","DOI":"10.1145\/3025453.3025727","volume-title":"Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems","author":"Otterbacher Jahna","year":"2017","unstructured":"Jahna Otterbacher, Jo Bates, and Paul Clough. 2017. Competent men and warm women: Gender stereotypes and backlash in image search results. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 6620\u20136631."},{"key":"e_1_3_2_62_1","first-page":"1","volume-title":"Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Salminen Joni","year":"2020","unstructured":"Joni Salminen, Soon-gyo Jung, Shammur Chowdhury, and Bernard J. Jansen. 2020. Analyzing demographic bias in artificially generated facial pictures. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u20138."},{"key":"e_1_3_2_63_1","first-page":"1","volume-title":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","author":"Salminen Joni","year":"2019","unstructured":"Joni Salminen, Soon-Gyo Jung, and Bernard J. Jansen. 2019. Detecting demographic bias in automatically generated personas. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u20136."},{"key":"e_1_3_2_64_1","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1145\/371920.372071","volume-title":"Proceedings of the 10th International Conference on World Wide Web","author":"Sarwar Badrul","year":"2001","unstructured":"Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web. 285\u2013295."},{"key":"e_1_3_2_65_1","first-page":"1","volume-title":"Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Skinner Zoe","year":"2020","unstructured":"Zoe Skinner, Stacey Brown, and Greg Walsh. 2020. Children of color\u2019s perceptions of fairness in AI: An exploration of equitable and inclusive co-design. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u20138."},{"key":"e_1_3_2_66_1","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1145\/2043932.2043957","volume-title":"Proceedings of the Fifth ACM Conference on Recommender Systems","author":"Steck Harald","year":"2011","unstructured":"Harald Steck. 2011. Item popularity and recommendation accuracy. In Proceedings of the Fifth ACM Conference on Recommender Systems. 125\u2013132."},{"key":"e_1_3_2_67_1","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1145\/3383313.3418488","volume-title":"RecSys\u201920: Proceedings of the 14th ACM Conference on Recommender Systems","author":"Stein Samuel A.","year":"2020","unstructured":"Samuel A. Stein, Gary M. Weiss, Yiwen Chen, and Daniel D. Leeds. 2020. A college major recommendation system. In RecSys\u201920: Proceedings of the 14th ACM Conference on Recommender Systems. 640\u2013644."},{"key":"e_1_3_2_68_1","first-page":"1","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Strengers Yolande","year":"2020","unstructured":"Yolande Strengers, Lizhen Qu, Qiongkai Xu, and Jarrod Knibbe. 2020. Adhering, steering, and queering: Treatment of gender in natural language generation. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u201314."},{"issue":"1","key":"e_1_3_2_69_1","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1086\/461792","article-title":"Sixteen kindergartners\u2019 gender-related views of careers","volume":"95","author":"Stroeher Susan Kochenberger","year":"1994","unstructured":"Susan Kochenberger Stroeher. 1994. Sixteen kindergartners\u2019 gender-related views of careers. The Elementary School Journal 95, 1 (1994), 95\u2013103.","journal-title":"The Elementary School Journal"},{"key":"e_1_3_2_70_1","unstructured":"Harini Suresh and John V. Guttag. 2019. A Framework for Understanding Unintended Consequences of Machine Learning. arxiv:1901.10002 [cs.LG]."},{"key":"e_1_3_2_71_1","first-page":"1","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems","author":"Vorvoreanu Mihaela","year":"2019","unstructured":"Mihaela Vorvoreanu, Lingyi Zhang, Yun-Han Huang, Claudia Hilderbrand, Zoe Steine-Hanson, and Margaret Burnett. 2019. From gender biases to gender-inclusive design: An empirical investigation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201314."},{"key":"e_1_3_2_72_1","first-page":"1","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Wang Ruotong","year":"2020","unstructured":"Ruotong Wang, F. Maxwell Harper, and Haiyi Zhu. 2020. Factors influencing perceived fairness in algorithmic decision-making: Algorithm outcomes, development procedures, and individual differences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u201314."},{"key":"e_1_3_2_73_1","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1007\/s11199-006-9078-z","article-title":"Implicit and explicit occupational gender stereotypes","volume":"55","author":"White Michael","year":"2006","unstructured":"Michael White and Gwendolen White. 2006. Implicit and explicit occupational gender stereotypes. Sex Roles 55 (082006), 259\u2013266.","journal-title":"Sex Roles"},{"key":"e_1_3_2_74_1","first-page":"1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems","author":"Woodruff Allison","year":"2018","unstructured":"Allison Woodruff, Sarah E. Fox, Steven Rousso-Schindler, and Jeffrey Warshaw. 2018. A qualitative exploration of perceptions of algorithmic fairness. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1\u201314."},{"key":"e_1_3_2_75_1","article-title":"Learning non-discriminatory predictors","author":"Woodworth Blake","year":"2017","unstructured":"Blake Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, and Nathan Srebro. 2017. Learning non-discriminatory predictors. arXiv preprint arXiv:1702.06081 (2017).","journal-title":"arXiv preprint arXiv:1702.06081"},{"key":"e_1_3_2_76_1","volume-title":"Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)","author":"Yadalam Tanya V.","year":"2020","unstructured":"Tanya V. Yadalam, Vaishnavi M. Gowda, Vanditha Shiva Kumar, Disha Girish, and Namratha M. 2020. Career recommendation systems using content based filtering. In Proceedings of the Fifth International Conference on Communication and Electronics Systems (ICCES 2020)."},{"key":"e_1_3_2_77_1","first-page":"1","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Yan Jing Nathan","year":"2020","unstructured":"Jing Nathan Yan, Ziwei Gu, Hubert Lin, and Jeffrey M. Rzeszotarski. 2020. Silva: Interactively assessing machine learning fairness using causality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u201313."},{"key":"e_1_3_2_78_1","series-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","first-page":"2925","author":"Yao Sirui","year":"2017","unstructured":"Sirui Yao and Bert Huang. 2017. Beyond parity: Fairness objectives for collaborative filtering. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS\u201917). Curran Associates Inc., Red Hook, NY, USA, 2925\u20132934."},{"key":"e_1_3_2_79_1","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.1145\/3038912.3052660","volume-title":"Proceedings of the 26th International Conference on World Wide Web","author":"Zafar Muhammad Bilal","year":"2017","unstructured":"Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez Rodriguez, and Krishna P. Gummadi. 2017. Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment. In Proceedings of the 26th International Conference on World Wide Web. 1171\u20131180."},{"key":"e_1_3_2_80_1","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1145\/3278721.3278779","volume-title":"Proceedings of the 2018 AAAI\/ACM Conference on AI, Ethics, and Society","author":"Zhang Brian Hu","year":"2018","unstructured":"Brian Hu Zhang, Blake Lemoine, and Margaret Mitchell. 2018. Mitigating unwanted biases with adversarial learning. In Proceedings of the 2018 AAAI\/ACM Conference on AI, Ethics, and Society. 335\u2013340."}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3611313","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3611313","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T18:50:54Z","timestamp":1750272654000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3611313"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,11]]},"references-count":79,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9,30]]}},"alternative-id":["10.1145\/3611313"],"URL":"https:\/\/doi.org\/10.1145\/3611313","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,11]]},"assertion":[{"value":"2022-06-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-17","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}