{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T00:55:08Z","timestamp":1776128108617,"version":"3.50.1"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>\n            Ensuring fairness in artificial intelligence (AI) is important to counteract bias and discrimination in far-reaching applications. Recent work has started to investigate how humans judge fairness and how to support machine learning experts in making their AI models fairer. Drawing inspiration from an Explainable AI approach called\n            <jats:italic>explanatory debugging<\/jats:italic>\n            used in interactive machine learning, our work explores designing interpretable and interactive human-in-the-loop interfaces that allow ordinary end-users without any technical or domain background to identify potential fairness issues and possibly fix them in the context of loan decisions. Through workshops with end-users, we co-designed and implemented a prototype system that allowed end-users to see why predictions were made, and then to change weights on features to \u201cdebug\u201d fairness issues. We evaluated the use of this prototype system through an online study. To investigate the implications of diverse human values about fairness around the globe, we also explored how cultural dimensions might play a role in using this prototype. Our results contribute to the design of interfaces to allow end-users to be involved in judging and addressing AI fairness through a human-in-the-loop approach.\n          <\/jats:p>","DOI":"10.1145\/3514258","type":"journal-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T06:31:43Z","timestamp":1651127503000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":61,"title":["Toward Involving End-users in Interactive Human-in-the-loop AI Fairness"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6813-9952","authenticated-orcid":false,"given":"Yuri","family":"Nakao","sequence":"first","affiliation":[{"name":"Research Center for AI Ethics, Fujitsu Limited, Kawasaki, Japan"}]},{"given":"Simone","family":"Stumpf","sequence":"additional","affiliation":[{"name":"University of Glasgow, Glasgow, UK"}]},{"given":"Subeida","family":"Ahmed","sequence":"additional","affiliation":[{"name":"City, University of London, London, UK"}]},{"given":"Aisha","family":"Naseer","sequence":"additional","affiliation":[{"name":"Fujitsu Research of Europe Ltd., Hayes, UK"}]},{"given":"Lorenzo","family":"Strappelli","sequence":"additional","affiliation":[{"name":"City, University of London, London, UK"}]}],"member":"320","published-online":{"date-parts":[[2022,7,26]]},"reference":[{"key":"e_1_3_2_2_2","volume-title":"FairML: ToolBox for Diagnosing Bias in Predictive Modeling","author":"Adebayo Julius A.","year":"2016","unstructured":"Julius A. Adebayo. 2016. FairML: ToolBox for Diagnosing Bias in Predictive Modeling. Master\u2019s thesis. Massachusetts Institute of Technology."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338937"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2934262"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-019-00931-w"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3322276.3323697"},{"issue":"3","key":"e_1_3_2_7_2","first-page":"671","article-title":"Big data\u2019s disparate impact","volume":"104","author":"Barocas Solon","year":"2016","unstructured":"Solon Barocas and Andrew D. Selbst. 2016. Big data\u2019s disparate impact. Cal. Law Rev. 104, 3 (2016), 671\u2013732. http:\/\/www.jstor.org\/stable\/24758720.","journal-title":"Cal. Law Rev."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942287"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI16234_05"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372864"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173951"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature15703"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.47.3.564"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377498"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2015.26"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/VAST47406.2019.8986948"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300234"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055064"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3376898"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450644"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302310"},{"key":"e_1_3_2_23_2","unstructured":"Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. Retrieved from https:\/\/arXiv:1702.08608."},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172961"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978965"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287589"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106277"},{"key":"e_1_3_2_29_2","volume-title":"Proceedings of the 10th International Workshop on Artificial Intelligence and Statistics","author":"Geiger Dan","year":"2005","unstructured":"Dan Geiger and Christopher Meek. 2005. Structured variational inference procedures and their realizations. In Proceedings of the 10th International Workshop on Artificial Intelligence and Statistics. The Society for Artificial Intelligence and Statistics."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359152"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.59"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aay7120"},{"key":"e_1_3_2_33_2","volume-title":"Beyond Culture","author":"Hall Edward Twitchell","year":"1976","unstructured":"Edward Twitchell Hall. 1976. Beyond Culture. Anchor."},{"key":"e_1_3_2_34_2","series-title":"Human Mental Workload","first-page":"139","volume-title":"Advances in Psychology","author":"Hart Sandra G.","year":"1988","unstructured":"Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (task load index): Results of empirical and theoretical research. In Advances in Psychology, Peter A. Hancock and Najmedin Meshkati (Ed.). Human Mental Workload, Vol. Volume 52. North-Holland, 139\u2013183. Retrieved from http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0166411508623869."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1038\/466029a"},{"key":"e_1_3_2_36_2","unstructured":"Robert R. Hoffman Shane T. Mueller Gary Klein and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. Retrieved from http:\/\/arxiv.org\/abs\/1812.04608."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018726702055011921"},{"issue":"1","key":"e_1_3_2_38_2","article-title":"Dimensionalizing cultures: The hofstede model in context","volume":"2","author":"Hofstede Geert","year":"2011","unstructured":"Geert Hofstede. 2011. Dimensionalizing cultures: The hofstede model in context. Online Read. Psychol. Cult. 2, 1 (2011), 2307\u20130919.","journal-title":"Online Read. Psychol. Cult."},{"key":"e_1_3_2_39_2","volume-title":"Cultures and Organizations: Software of the Mind","author":"Hofstede Geert","year":"2010","unstructured":"Geert Hofstede, Gert Jan Hofstede, and Michael Minkov. 2010. Cultures and Organizations: Software of the Mind. Vol. 3. McGraw-Hill, New York."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1080\/13602381003637609"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"issue":"2","key":"e_1_3_2_42_2","doi-asserted-by":"crossref","first-page":"96","DOI":"10.17705\/1thci.00130","article-title":"ICIS 2019 SIGHCI workshop panel report: Human- computer interaction challenges and opportunities for fair, trustworthy and ethical artificial intelligence","volume":"12","author":"Jr. Lionel P. Robert","year":"2020","unstructured":"Lionel P. Robert Jr., Gaurav Bansal, and Christoph L\u00fctge. 2020. ICIS 2019 SIGHCI workshop panel report: Human- computer interaction challenges and opportunities for fair, trustworthy and ethical artificial intelligence. AIS Trans. Hum.-Comput. Interact. 12, 2 (2020), 96\u2013108.","journal-title":"AIS Trans. Hum.-Comput. Interact."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2007.01.004"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395539"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/2983270"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701399"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207678"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2010.15"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2013.6645235"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/1502650.1502678"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718756684"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359284"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359283"},{"key":"e_1_3_2_54_2","first-page":"555","volume-title":"Handbook of Organizational Justice","author":"Leung Kwok","year":"2008","unstructured":"Kwok Leung. 2008. How generalizable are justice effects across cultures? In Handbook of Organizational Justice, Jerald Greenberg and Jason A. Colquitt (Eds.). Psychology Press, New York, NY, 555\u2013586. https:\/\/psycnet.apa.org\/record\/2005-03594-021."},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519023"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376257"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhm.2004.12.003"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018726702551004"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.4159\/harvard.9780674863507"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1753873"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1080\/15710880701875068"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025926"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314248"},{"key":"e_1_3_2_65_2","volume-title":"Cross-Cultural Organizational Justice: When Are Fairness Perceptions Universal or Culturally Dependent?","author":"Silvernail Kirk D.","year":"2016","unstructured":"Kirk D. Silvernail. 2016. Cross-Cultural Organizational Justice: When Are Fairness Perceptions Universal or Culturally Dependent?Ph. D. Dissertation. University of Massachusetts-Amherst, Massachusetts."},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330664"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.03.004"},{"key":"e_1_3_2_68_2","volume-title":"Joint Proceedings of the ACM IUI 2021 Workshops","author":"Stumpf Simone","year":"2021","unstructured":"Simone Stumpf, Lorenzo Strappelli, Subeida Ahmed, Yuri Nakao, Aisha Naseer, Giulia Del Gamba, and Daniele Regoli. 2021. Design methods for artificial intelligence fairness and transparency. In Joint Proceedings of the ACM IUI 2021 Workshops. CEUR.org, College Station, TX."},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450662"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174014"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.23919\/FAIRWARE.2018.8452913"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.clsr.2021.105567"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300831"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376813"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376813"},{"issue":"1","key":"e_1_3_2_76_2","first-page":"56","article-title":"The what-if tool: Interactive probing of machine learning models","volume":"26","author":"Wexler J.","year":"2020","unstructured":"J. Wexler, M. Pushkarna, T. Bolukbasi, M. Wattenberg, F. Vi\u00e9gas, and J. Wilson. 2020. The what-if tool: Interactive probing of machine learning models. IEEE Trans. Visual. Comput. Graph. 26, 1 (2020), 56\u201365.","journal-title":"IEEE Trans. Visual. Comput. Graph."},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174230"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3322276.3322304"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376447"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376447"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395528"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3375627.3375862"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514258","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514258","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:14Z","timestamp":1750183814000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514258"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":81,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3514258"],"URL":"https:\/\/doi.org\/10.1145\/3514258","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"2021-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-07-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}