{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T10:53:50Z","timestamp":1774436030624,"version":"3.50.1"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2022,6,10]],"date-time":"2022-06-10T00:00:00Z","timestamp":1654819200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,10]],"date-time":"2022-06-10T00:00:00Z","timestamp":1654819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Ranking systems have an unprecedented influence on how and what information people access, and their impact on our society is being analyzed from different perspectives, such as users\u2019 discrimination. A notable example is represented by reputation-based ranking systems, a class of systems that rely on users\u2019 reputation to generate a non-personalized item-ranking, proved to be biased against certain demographic classes. To safeguard that a given sensitive user\u2019s attribute does not systematically affect the reputation of that user, prior work has operationalized a reputation independence constraint on this class of systems. In this paper, we uncover that guaranteeing reputation independence for a single sensitive attribute is not enough. When mitigating biases based on one sensitive attribute (e.g., gender), the final ranking might still be biased against certain demographic groups formed based on another attribute (e.g., age). Hence, we propose a novel approach to introduce reputation independence for multiple sensitive attributes simultaneously. We then analyze the extent to which our approach impacts on discrimination and other important properties of the ranking system, such as its quality and robustness against attacks. Experiments on two real-world datasets show that our approach leads to less biased rankings with respect to multiple users\u2019 sensitive attributes, without affecting the system\u2019s quality and robustness.<\/jats:p>","DOI":"10.1007\/s10994-022-06173-0","type":"journal-article","created":{"date-parts":[[2022,6,10]],"date-time":"2022-06-10T00:02:33Z","timestamp":1654819353000},"page":"3769-3796","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Robust reputation independence in ranking systems for multiple sensitive attributes"],"prefix":"10.1007","volume":"111","author":[{"given":"Guilherme","family":"Ramos","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6053-3015","authenticated-orcid":false,"given":"Ludovico","family":"Boratto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mirko","family":"Marras","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,6,10]]},"reference":[{"issue":"1","key":"6173_CR1","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1007\/s11257-019-09256-1","volume":"30","author":"H Abdollahpouri","year":"2020","unstructured":"Abdollahpouri, H., Adomavicius, G., Burke, R., Guy, I., Jannach, D., Kamishima, T., Krasnodebski, J., & Pizzato, L. A. (2020). Multistakeholder recommendation: Survey and research directions. User Modeling and User-Adapted Interaction, 30(1), 127\u2013158. https:\/\/doi.org\/10.1007\/s11257-019-09256-1","journal-title":"User Modeling and User-Adapted Interaction"},{"issue":"1","key":"6173_CR2","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/s11280-013-0242-4","volume":"18","author":"M Allahbakhsh","year":"2015","unstructured":"Allahbakhsh, M., Ignjatovic, A., Motahari-Nezhad, H. R., & Benatallah, B. (2015). Robust evaluation of products and reviewers in social rating systems. World Wide Web, 18(1), 73\u2013109.","journal-title":"World Wide Web"},{"key":"6173_CR3","doi-asserted-by":"crossref","unstructured":"Biega, A. J., Gummadi, K. P., & Weikum, G. (2018). Equity of attention: Amortizing individual fairness in rankings. In International ACM conference on research & development in information retrieval (pp. 405\u2013414). ACM.","DOI":"10.1145\/3209978.3210063"},{"key":"6173_CR4","doi-asserted-by":"publisher","unstructured":"Boratto, L. (2016). Group recommender systems. In S. Sen, W. Geyer, J. Freyne, P. Castells (Eds) Proceedings of the 10th ACM conference on recommender systems, Boston, MA, USA, September 15\u201319, 2016 (pp. 427\u2013428). ACM. https:\/\/doi.org\/10.1145\/2959100.2959197","DOI":"10.1145\/2959100.2959197"},{"issue":"3","key":"6173_CR5","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1007\/s11257-021-09294-8","volume":"31","author":"L Boratto","year":"2021","unstructured":"Boratto, L., Fenu, G., & Marras, M. (2021). Interplay between upsampling and regularization for provider fairness in recommender systems. User Modeling and User-Adapted Interaction, 31(3), 421\u2013455. https:\/\/doi.org\/10.1007\/s11257-021-09294-8","journal-title":"User Modeling and User-Adapted Interaction"},{"issue":"4","key":"6173_CR6","doi-asserted-by":"publisher","first-page":"1812","DOI":"10.1137\/090748196","volume":"31","author":"C De Kerchove","year":"2010","unstructured":"De Kerchove, C., & Van Dooren, P. (2010). Iterative filtering in reputation systems. SIAM Journal on Matrix Analysis and Applications, 31(4), 1812\u20131834.","journal-title":"SIAM Journal on Matrix Analysis and Applications"},{"key":"6173_CR7","doi-asserted-by":"crossref","unstructured":"Diaz, F., Mitra, B., Ekstrand, M. D., Biega, A. J., & Carterette, B. (2020). Evaluating stochastic rankings with expected exposure. CoRR arXiv:abs\/2004.13157","DOI":"10.1145\/3340531.3411962"},{"key":"6173_CR8","doi-asserted-by":"crossref","unstructured":"Ekstrand, M. D., Burke, R., & Diaz, F. (2019). Fairness and discrimination in retrieval and recommendation. In International ACM SIGIR conference on research and development in information retrieval (pp. 1403\u20131404). ACM","DOI":"10.1145\/3331184.3331380"},{"issue":"1","key":"6173_CR9","first-page":"26","volume":"1","author":"J Gama","year":"2020","unstructured":"Gama, J., & Jorge, A. (2020). The new spring for artificial intelligence. INESC TEC Science & Society, 1(1), 26\u201329.","journal-title":"INESC TEC Science & Society"},{"key":"6173_CR10","doi-asserted-by":"crossref","unstructured":"Ge, Y., Knittel, C. R., MacKenzie, D., & Zoepf, S. (2016). Racial and gender discrimination in transportation network companies. National Bureau of Economic Research, Inc. NBER Working Papers 22776.","DOI":"10.3386\/w22776"},{"key":"6173_CR11","doi-asserted-by":"crossref","unstructured":"Hajian, S., Bonchi, F., & Castillo, C. (2016). Algorithmic bias: From discrimination discovery to fairness-aware data mining. In ACM SIGKDD international conf. on knowledge discovery and data mining (pp. 2125\u20132126). ACM.","DOI":"10.1145\/2939672.2945386"},{"key":"6173_CR12","doi-asserted-by":"crossref","unstructured":"Hannak, A., Wagner, C., Garc\u00eda, D., Mislove, A., Strohmaier, M., & Wilson, C. (2017). Bias in online freelance marketplaces: Evidence from taskrabbit and fiverr. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing, CSCW 2017 (pp. 1914\u20131933). ACM.","DOI":"10.1145\/2998181.2998327"},{"issue":"4","key":"6173_CR13","first-page":"1","volume":"5","author":"FM Harper","year":"2015","unstructured":"Harper, F. M., & Konstan, J. A. (2015). The movielens datasets: History and context. ACM Transactions on Interactive Intelligent Systems (TIIS), 5(4), 1\u201319.","journal-title":"ACM Transactions on Interactive Intelligent Systems (TIIS)"},{"key":"6173_CR32","doi-asserted-by":"publisher","DOI":"10.1145\/3462210","author":"S Ja","year":"2021","unstructured":"Ja, S., Ramos, G., Boratto, L., & Caleiro, C. (2021). A robust reputation-based group ranking system and its resistance to bribery. ACM Transactions on Knowledge Discovery from Data (TKDD). https:\/\/doi.org\/10.1145\/3462210.","journal-title":"ACM Transactions on Knowledge Discovery from Data (TKDD)"},{"key":"6173_CR14","doi-asserted-by":"crossref","unstructured":"Joachims, T., Swaminathan, A., & Schnabel, T. (2017). Unbiased learning-to-rank with biased feedback. In Proceedings of the tenth ACM international conference on web search and data mining (pp. 781\u2013789).","DOI":"10.1145\/3018661.3018699"},{"key":"6173_CR15","doi-asserted-by":"crossref","unstructured":"Jones, D., & Linardi, S. (2012). Gender differences in reputation concerns: Prosocial behavior in the field & lab. Working paper, Tech rep.","DOI":"10.1596\/1813-9450-5956"},{"issue":"1\/2","key":"6173_CR16","doi-asserted-by":"publisher","first-page":"81","DOI":"10.2307\/2332226","volume":"30","author":"MG Kendall","year":"1938","unstructured":"Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30(1\/2), 81\u201393.","journal-title":"Biometrika"},{"key":"6173_CR17","unstructured":"Kleinberg, J. M., Mullainathan, S., & Raghavan, M. (2017). Inherent trade-offs in the fair determination of risk scores. In 8th innovations in theoretical computer science conference, ITCS 2017, Schloss Dagstuhl - Leibniz-Zentrum f\u00fcr Informatik, LIPIcs (Vol.\u00a067, pp. 43:1\u201343:23)."},{"issue":"1\u20132","key":"6173_CR18","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1007\/s10791-018-9341-2","volume":"22","author":"J Kulshrestha","year":"2019","unstructured":"Kulshrestha, J., Eslami, M., Messias, J., Zafar, M. B., Ghosh, S., Gummadi, K. P., & Karahalios, K. (2019). Search bias quantification: Investigating political bias in social media and web search. Information Retrieval Journal, 22(1\u20132), 188\u2013227.","journal-title":"Information Retrieval Journal"},{"issue":"3","key":"6173_CR19","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1007\/s10115-014-0780-9","volume":"44","author":"B Li","year":"2015","unstructured":"Li, B., Li, R. H., King, I., Lyu, M. R., & Yu, J. X. (2015). A topic-biased user reputation model in rating systems. Knowledge and Information Systems, 44(3), 581\u2013607.","journal-title":"Knowledge and Information Systems"},{"key":"6173_CR20","doi-asserted-by":"crossref","unstructured":"Li, R., Yu, J. X., Huang, X., & Cheng, H. (2012a). Robust reputation-based ranking on bipartite rating networks. In Proceedings of the twelfth SIAM international conference on data mining, SIAM \/ Omnipress (pp. 612\u2013623).","DOI":"10.1137\/1.9781611972825.53"},{"key":"6173_CR21","doi-asserted-by":"crossref","unstructured":"Li, R. H., Xu\u00a0Yu, J., Huang, X., & Cheng, H. (2012b). Robust reputation-based ranking on bipartite rating networks. In Proceedings of the 2012 SIAM international conference on data mining (pp. 612\u2013623). SIAM.","DOI":"10.1137\/1.9781611972825.53"},{"key":"6173_CR22","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-021-00271-1","author":"M Marras","year":"2021","unstructured":"Marras, M., Boratto, L., & Ramos, G. (2021). Equality of learning opportunity via individual fairness in personalized recommendations. International Journal of Artificial Intelligence in Education. https:\/\/doi.org\/10.1007\/s40593-021-00271-1.","journal-title":"International Journal of Artificial Intelligence in Education"},{"issue":"4","key":"6173_CR23","doi-asserted-by":"publisher","first-page":"1997","DOI":"10.1007\/s10664-019-09685-x","volume":"24","author":"A May","year":"2019","unstructured":"May, A., Wachs, J., & Hann\u00e1k, A. (2019). Gender differences in participation and reward on stack overflow. Empirical Software Engineering, 24(4), 1997\u20132019.","journal-title":"Empirical Software Engineering"},{"issue":"4","key":"6173_CR24","doi-asserted-by":"publisher","first-page":"48004","DOI":"10.1209\/0295-5075\/91\/48004","volume":"91","author":"M Medo","year":"2010","unstructured":"Medo, M., & Wakeling, J. R. (2010). The effect of discrete vs continuous-valued ratings on reputation and ranking systems. EPL (Europhysics Letters), 91(4), 48004.","journal-title":"EPL (Europhysics Letters)"},{"key":"6173_CR25","doi-asserted-by":"publisher","unstructured":"Mehrotra, R., McInerney, J., Bouchard, H., Lalmas, M., & Diaz, F. (2018). Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems. In Proceedings of the 27th ACM international conference on information and knowledge management, CIKM 2018. (pp 2243\u20132251). ACM. https:\/\/doi.org\/10.1145\/3269206.3272027","DOI":"10.1145\/3269206.3272027"},{"issue":"3","key":"6173_CR26","doi-asserted-by":"publisher","first-page":"801","DOI":"10.1111\/j.1083-6101.2007.00351.x","volume":"12","author":"B Pan","year":"2007","unstructured":"Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., & Granka, L. (2007). In google we trust: Users\u2019 decisions on rank, position, and relevance. Journal of Computer-Mediated Communication, 12(3), 801\u2013823.","journal-title":"Journal of Computer-Mediated Communication"},{"key":"6173_CR27","doi-asserted-by":"crossref","unstructured":"Ramos, G., & Boratto, L. (2020). Reputation (in)dependence in ranking systems: Demographics influence over output disparities. In Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, SIGIR 2020 (pp. 2061\u20132064). ACM.","DOI":"10.1145\/3397271.3401278"},{"issue":"2","key":"6173_CR28","first-page":"102058","volume":"57","author":"G Ramos","year":"2020","unstructured":"Ramos, G., Boratto, L., & Caleiro, C. (2020). On the negative impact of social influence in recommender systems: A study of bribery in collaborative hybrid algorithms. Processing & Management, 57(2), 102058.","journal-title":"Processing & Management"},{"issue":"11","key":"6173_CR29","doi-asserted-by":"publisher","first-page":"1775","DOI":"10.1007\/s10994-018-5743-z","volume":"107","author":"C Rebelo de S\u00e1","year":"2018","unstructured":"Rebelo de S\u00e1, C., Duivesteijn, W., Azevedo, P. J., Jorge, A. M., Soares, C., & Knobbe, A. J. (2018). Discovering a taste for the unusual: Exceptional models for preference mining. Machine Learning, 107(11), 1775\u20131807. https:\/\/doi.org\/10.1007\/s10994-018-5743-z.","journal-title":"Machine Learning"},{"issue":"1","key":"6173_CR30","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1109\/TDSC.2014.2316816","volume":"12","author":"M Rezvani","year":"2014","unstructured":"Rezvani, M., Ignjatovic, A., Bertino, E., & Jha, S. (2014). Secure data aggregation technique for wireless sensor networks in the presence of collusion attacks. IEEE Transactions on Dependable and Secure Computing, 12(1), 98\u2013110.","journal-title":"IEEE Transactions on Dependable and Secure Computing"},{"key":"6173_CR31","doi-asserted-by":"crossref","unstructured":"Sapiezynski, P., Zeng, W., Robertson, R. E., Mislove, A., & Wilson, C. (2019). Quantifying the impact of user attention on fair group representation in ranked lists. CoRR arXiv:abs\/1901.10437","DOI":"10.1145\/3308560.3317595"},{"key":"6173_CR33","doi-asserted-by":"crossref","unstructured":"Singh, A., & Joachims, T. (2018). Fairness of exposure in rankings. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, KDD 2018 (pp. 2219\u20132228). ACM.","DOI":"10.1145\/3219819.3220088"},{"issue":"6","key":"6173_CR34","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1007\/s10708-013-9492-z","volume":"78","author":"M Stephens","year":"2013","unstructured":"Stephens, M. (2013). Gender and the geoweb: Divisions in the production of user-generated cartographic information. GeoJournal, 78(6), 981\u2013996.","journal-title":"GeoJournal"},{"key":"6173_CR35","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/j.knosys.2016.09.033","volume":"115","author":"K Su","year":"2017","unstructured":"Su, K., Xiao, B., Liu, B., Zhang, H., & Zhang, Z. (2017). Tap: A personalized trust-aware qos prediction approach for web service recommendation. Knowledge-Based Systems, 115, 55\u201365.","journal-title":"Knowledge-Based Systems"},{"key":"6173_CR36","doi-asserted-by":"crossref","unstructured":"Thebault-Spieker, J., Terveen, L. G., & Hecht, B. J. (2015). Avoiding the south side and the suburbs: The geography of mobile crowdsourcing markets. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing, CSCW 2015 (pp. 265\u2013275). ACM.","DOI":"10.1145\/2675133.2675278"},{"key":"6173_CR37","doi-asserted-by":"crossref","unstructured":"Tibermacine, O., Tibermacine, C., & Kerdoudi, M. L. (2019). Reputation evaluation with malicious feedback prevention using a hits-based model. In 2019 international conf. on web services, ICWS 2019, IEEE (pp. 180\u2013187).","DOI":"10.1109\/ICWS.2019.00039"},{"key":"6173_CR38","doi-asserted-by":"crossref","unstructured":"Wachs, J., Hann\u00e1k, A., V\u00f6r\u00f6s, A., & Dar\u00f3czy, B. (2017). Why do men get more attention? exploring factors behind success in an online design community. CoRR arXiv:abs\/1705.02972","DOI":"10.1609\/icwsm.v11i1.14888"},{"issue":"1","key":"6173_CR39","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1140\/epjds\/s13688-016-0066-4","volume":"5","author":"C Wagner","year":"2016","unstructured":"Wagner, C., Graells-Garrido, E., Garc\u00eda, D., & Menczer, F. (2016). Women through the glass ceiling: Gender asymmetries in wikipedia. EPJ Data Science, 5(1), 5.","journal-title":"EPJ Data Science"},{"issue":"6","key":"6173_CR40","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0217933","volume":"14","author":"J Xu","year":"2019","unstructured":"Xu, J., Du, X., Cai, W., Zhu, C., & Chen, Y. (2019). Meurep: A novel user reputation calculation approach in personalized cloud services. PloS One, 14(6), e0217933.","journal-title":"PloS One"},{"key":"6173_CR41","unstructured":"Yadav, H., Du, Z., & Joachims, T. (2019). Fair learning-to-rank from implicit feedback. CoRR arXiv:abs\/1911.08054"},{"issue":"2","key":"6173_CR42","doi-asserted-by":"publisher","first-page":"732","DOI":"10.1016\/j.physa.2006.04.057","volume":"371","author":"YK Yu","year":"2006","unstructured":"Yu, Y. K., Zhang, Y. C., Laureti, P., & Moret, L. (2006). Decoding information from noisy, redundant, and intentionally distorted sources. Physica A: Statistical Mechanics and its Applications, 371(2), 732\u2013744.","journal-title":"Physica A: Statistical Mechanics and its Applications"},{"key":"6173_CR43","doi-asserted-by":"crossref","unstructured":"Zehlike, M., & Castillo, C. (2020). Reducing disparate exposure in ranking: A learning to rank approach. In WWW \u201920: The web conference 2020, ACM\/IW3C2 (pp. 2849\u20132855).","DOI":"10.1145\/3366424.3380048"},{"key":"6173_CR44","doi-asserted-by":"crossref","unstructured":"Zehlike, M., Bonchi, F., Castillo, C., Hajian, S., Megahed, M., & Baeza-Yates, R. (2017). Fa*ir: A fair top-k ranking algorithm. In ACM conference on information and knowledge management. (pp. 1569\u20131578). ACM.","DOI":"10.1145\/3132847.3132938"},{"key":"6173_CR45","doi-asserted-by":"crossref","unstructured":"Ziegler, C. N., McNee. S. M., Konstan, J. A., & Lausen, G. (2005). Improving recommendation lists through topic diversification. In Proceedings of the 14th international conference on World Wide Web (pp. 22\u201332).","DOI":"10.1145\/1060745.1060754"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-022-06173-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-022-06173-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-022-06173-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,7]],"date-time":"2023-02-07T21:02:21Z","timestamp":1675803741000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-022-06173-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,10]]},"references-count":45,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["6173"],"URL":"https:\/\/doi.org\/10.1007\/s10994-022-06173-0","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,10]]},"assertion":[{"value":"1 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 December 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 February 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 June 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors confirm there are no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable, since no human participant was involved in the evaluation of our study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable, since all datasets used in this study are released by third parties.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The work uses publicly available and non-identifiable information of the users. No ethical approval was needed.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}