{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,31]],"date-time":"2026-10-31T00:20:31Z","timestamp":1793406031724,"version":"4.5.0"},"reference-count":62,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,12,7]],"date-time":"2021-12-07T00:00:00Z","timestamp":1638835200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,7]],"date-time":"2021-12-07T00:00:00Z","timestamp":1638835200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Inf Retrieval J"],"published-print":{"date-parts":[[2022,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Providing users with relevant search results has been the primary focus of information retrieval research. However, focusing on relevance alone can lead to undesirable side effects. For example, small differences between the relevance scores of documents that are ranked by relevance alone can result in large differences in the exposure that the authors of relevant documents receive, i.e., the likelihood that the documents will be seen by searchers. Therefore, developing fair ranking techniques to try to ensure that search results are not dominated, for example, by certain information sources is of growing interest, to mitigate against such biases. In this work, we argue that generating fair rankings can be cast as a search results diversification problem across a number of assumed fairness groups, where groups can represent the demographics or other characteristics of information sources. In the context of academic search, as in the TREC Fair Ranking Track, which aims to be fair to <jats:italic>unknown<\/jats:italic> groups of authors, we evaluate three well-known search results diversification approaches from the literature to generate rankings that are fair to multiple assumed fairness groups, e.g. early-career researchers vs. highly-experienced authors. Our experiments on the 2019 and 2020 TREC datasets show that explicit search results diversification is a viable approach for generating effective rankings that are fair to information sources. In particular, we show that building on xQuAD diversification as a fairness component can result in a significant (<jats:inline-formula><jats:alternatives><jats:tex-math>$$p&lt;0.05$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:mrow>\n                    <mml:mi>p<\/mml:mi>\n                    <mml:mo>&lt;<\/mml:mo>\n                    <mml:mn>0.05<\/mml:mn>\n                  <\/mml:mrow>\n                <\/mml:math><\/jats:alternatives><\/jats:inline-formula>) increase (up to \u00a050% in our experiments) in the fairness of exposure that authors from unknown protected groups receive.<\/jats:p>","DOI":"10.1007\/s10791-021-09399-z","type":"journal-article","created":{"date-parts":[[2021,12,7]],"date-time":"2021-12-07T05:01:13Z","timestamp":1638853273000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Search results diversification for effective fair ranking in academic search"],"prefix":"10.1007","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1266-5996","authenticated-orcid":false,"given":"Graham","family":"McDonald","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3143-279X","authenticated-orcid":false,"given":"Craig","family":"Macdonald","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4701-3223","authenticated-orcid":false,"given":"Iadh","family":"Ounis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,12,7]]},"reference":[{"key":"9399_CR1","doi-asserted-by":"publisher","unstructured":"Abebe, R., Barocas, S., Kleinberg, J. M., Levy, K., Raghavan, M., & Robinson, D. G. (2020). Roles for computing in social change. In Proceedings of the FAT* Conference on Fairness, Accountability, and Transparency, Barcelona, Spain, January 27\u201330, 2020, ACM, pp. 252\u2013260. https:\/\/doi.org\/10.1145\/3351095.3372871.","DOI":"10.1145\/3351095.3372871"},{"key":"9399_CR2","doi-asserted-by":"publisher","unstructured":"Agrawal, R., Gollapudi, S., Halverson, A., & Ieong, S. (2009). Diversifying search results. In Proceedings of the Second International Conference on Web Search and Web Data Mining, WSDM 2009, Barcelona, Spain, February 9\u201311, 2009, ACM, pp. 5\u201314. https:\/\/doi.org\/10.1145\/1498759.1498766.","DOI":"10.1145\/1498759.1498766"},{"key":"9399_CR3","doi-asserted-by":"publisher","unstructured":"Ammar, W., Groeneveld, D., Bhagavatula, C., Beltagy, I., Crawford, M., Downey, D., Dunkelberger, J., Elgohary, A., Feldman, S., Ha, V., Kinney, R., Kohlmeier, S., Lo, K., Murray, T., Ooi, H., Peter, M. E., Power, J., Skjonsberg, S., Wang, L. L., Wilhelm, C., Yuan, Z., van Zuylen, M., & Etzioni, O. (2018). Construction of the literature graph in semantic scholar. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018, New Orleans, Louisiana, USA, June 1-6, 2018, Volume 3 (Industry Papers), Association for Computational Linguistics, pp. 84\u201391. https:\/\/doi.org\/10.18653\/v1\/n18-3011.","DOI":"10.18653\/v1\/n18-3011"},{"issue":"6","key":"9399_CR4","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1145\/3209581","volume":"61","author":"R Baeza-Yates","year":"2018","unstructured":"Baeza-Yates, R. (2018). Bias on the web. Communication in ACM, 61(6), 54\u201361. https:\/\/doi.org\/10.1145\/3209581","journal-title":"Communication in ACM"},{"key":"9399_CR5","unstructured":"Belkin, N. J., & Robertson, S. E. (1976). Some ethical implications of theoretical research in information science. InThe ASIS Annual Meeting."},{"key":"9399_CR6","doi-asserted-by":"publisher","unstructured":"Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the FAccT \u201921: 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event \/ Toronto, Canada, March 3\u201310, 2021, ACM, pp. 610\u2013623. https:\/\/doi.org\/10.1145\/3442188.3445922.","DOI":"10.1145\/3442188.3445922"},{"key":"9399_CR7","doi-asserted-by":"publisher","unstructured":"Biega, A. J., Gummadi, K. P., & Weikum, G. (2018). Equity of attention: Amortizing individual fairness in rankings. In: Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08\u201312, 2018, ACM, pp. 405\u2013414. https:\/\/doi.org\/10.1145\/3209978.3210063.","DOI":"10.1145\/3209978.3210063"},{"key":"9399_CR8","unstructured":"Biega, A. J., Diaz, F., Ekstrand, M. D., & Kohlmeier, S. (2020). Overview of the TREC 2019 fair ranking track. CoRR arXiv:abs\/2003.11650."},{"key":"9399_CR9","unstructured":"Biega, A. J., Diaz, F., Ekstrand, M. D., Feldman, S., & Kohlmeier, S. (2021). Overview of the TREC 2020 fair ranking track. CoRR arXiv:abs\/2108.05135."},{"key":"9399_CR10","unstructured":"Bolukbasi, T., Chang, K., Zou, J. Y., Saligrama, V., & Kalai, A. T. (2016). Man is to computer programmer as woman is to homemaker? debiasing word embeddings. In Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, December 5\u201310, 2016, Barcelona, Spain, pp. 4349\u20134357."},{"issue":"2","key":"9399_CR11","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1145\/792550.792552","volume":"36","author":"AZ Broder","year":"2002","unstructured":"Broder, A. Z. (2002). A taxonomy of web search. SIGIR Forum, 36(2), 3\u201310. https:\/\/doi.org\/10.1145\/792550.792552","journal-title":"SIGIR Forum"},{"issue":"2","key":"9399_CR12","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1007\/s10618-010-0190-x","volume":"21","author":"T Calders","year":"2010","unstructured":"Calders, T., & Verwer, S. (2010). Three naive bayes approaches for discrimination-free classification. Data Mining and Knowledge Discovery, 21(2), 277\u2013292. https:\/\/doi.org\/10.1007\/s10618-010-0190-x","journal-title":"Data Mining and Knowledge Discovery"},{"key":"9399_CR13","doi-asserted-by":"publisher","unstructured":"Carbonell, J. G., & Goldstein, J. (1998). The use of MMR, diversity-based reranking for reordering documents and producing summaries. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 24\u201328, 1998, Melbourne, Australia, ACM, pp. 335\u2013336. https:\/\/doi.org\/10.1145\/290941.291025.","DOI":"10.1145\/290941.291025"},{"issue":"2","key":"9399_CR14","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1145\/3308774.3308783","volume":"52","author":"C Castillo","year":"2018","unstructured":"Castillo, C. (2018). Fairness and transparency in ranking. SIGIR Forum, 52(2), 64\u201371. https:\/\/doi.org\/10.1145\/3308774.3308783","journal-title":"SIGIR Forum"},{"key":"9399_CR15","doi-asserted-by":"publisher","unstructured":"Celis, L. E., Straszak, D., & Vishnoi, N. K. (2018). Ranking with fairness constraints. In: Proceedings of the 45th International Colloquium on Automata, Languages, and Programming, ICALP 2018, July 9\u201313, 2018, Prague, Czech Republic, LIPIcs, vol. 107, pp. 28:1\u201328:15. https:\/\/doi.org\/10.4230\/LIPIcs.ICALP.2018.28.","DOI":"10.4230\/LIPIcs.ICALP.2018.28"},{"key":"9399_CR16","doi-asserted-by":"publisher","unstructured":"Chen, H., & Karger, D. R. (2006). Less is more: probabilistic models for retrieving fewer relevant documents. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6\u201311, 2006, ACM, pp. 429\u2013436. https:\/\/doi.org\/10.1145\/1148170.1148245","DOI":"10.1145\/1148170.1148245"},{"issue":"2","key":"9399_CR17","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1089\/big.2016.0047","volume":"5","author":"A Chouldechova","year":"2017","unstructured":"Chouldechova, A. (2017). Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big Data, 5(2), 153\u2013163. https:\/\/doi.org\/10.1089\/big.2016.0047","journal-title":"Big Data"},{"issue":"1","key":"9399_CR18","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1145\/3274784.3274788","volume":"52","author":"JS Culpepper","year":"2018","unstructured":"Culpepper, J. S., Diaz, F., & Smucker, M. D. (2018). Research frontiers in information retrieval: Report from the third strategic workshop on information retrieval in Lorne (SWIRL 2018). SIGIR Forum, 52(1), 34\u201390. https:\/\/doi.org\/10.1145\/3274784.3274788","journal-title":"SIGIR Forum"},{"key":"9399_CR19","doi-asserted-by":"publisher","unstructured":"Dang, V., & Croft, W. B. (2012). Diversity by proportionality: an election-based approach to search result diversification. In Proceedings of the 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR \u201912, Portland, OR, USA, August 12-16, 2012, ACM, pp. 65\u201374. https:\/\/doi.org\/10.1145\/2348283.2348296.","DOI":"10.1145\/2348283.2348296"},{"key":"9399_CR20","doi-asserted-by":"publisher","unstructured":"De-Arteaga, M., Romanov, A., Wallach, H. M., Chayes, J. T., Borgs, C., Chouldechova, A., Geyik, S. C., Kenthapadi, K., & Kalai, A. T. (2019). Bias in bios: A case study of semantic representation bias in a high-stakes setting. In Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT* 2019, Atlanta, GA, USA, January 29\u201331, 2019, ACM, pp. 120\u2013128. https:\/\/doi.org\/10.1145\/3287560.3287572.","DOI":"10.1145\/3287560.3287572"},{"key":"9399_CR21","doi-asserted-by":"publisher","unstructured":"Diaz, F., Mitra, B., Ekstrand, M. D., Biega, A. J., & Carterette, B. (2020). Evaluating stochastic rankings with expected exposure. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management, Virtual Event, Ireland, October 19\u201323, 2020, ACM, pp. 275\u2013284. https:\/\/doi.org\/10.1145\/3340531.3411962.","DOI":"10.1145\/3340531.3411962"},{"issue":"293","key":"9399_CR22","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1080\/01621459.1961.10482090","volume":"56","author":"OJ Dunn","year":"1961","unstructured":"Dunn, O. J. (1961). Multiple comparisons among means. Journal of the American statistical association, 56(293), 52\u201364.","journal-title":"Journal of the American statistical association"},{"key":"9399_CR23","doi-asserted-by":"publisher","unstructured":"Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. S. (2012). Fairness through awareness. In: Proceedings of the Innovations in Theoretical Computer Science Conference, Cambridge, MA, USA, January 8\u201310, 2012, ACM, pp. 214\u2013226. https:\/\/doi.org\/10.1145\/2090236.2090255.","DOI":"10.1145\/2090236.2090255"},{"key":"9399_CR24","doi-asserted-by":"publisher","unstructured":"Ekstrand, M. D., Burke, R., & Diaz, F. (2019). Fairness and discrimination in retrieval and recommendation. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019, ACM, pp 1403\u20131404, https:\/\/doi.org\/10.1145\/3331184.3331380.","DOI":"10.1145\/3331184.3331380"},{"key":"9399_CR25","doi-asserted-by":"publisher","unstructured":"Epstein, R., Robertson, R. E., Lazer, D., & Wilson, C. (2017). Suppressing the search engine manipulation effect (SEME). ACM on Human-Computer Interaction 1(CSCW), 42:1\u201342:22. https:\/\/doi.org\/10.1145\/3134677.","DOI":"10.1145\/3134677"},{"key":"9399_CR26","doi-asserted-by":"publisher","unstructured":"Gao, R., & Shah, C. (2020). Toward creating a fairer ranking in search engine results. Information Processing and Management 57(1). https:\/\/doi.org\/10.1016\/j.ipm.2019.102138.","DOI":"10.1016\/j.ipm.2019.102138"},{"issue":"7","key":"9399_CR27","doi-asserted-by":"publisher","first-page":"1445","DOI":"10.1109\/TKDE.2012.72","volume":"25","author":"S Hajian","year":"2013","unstructured":"Hajian, S., & Domingo-Ferrer, J. (2013). A methodology for direct and indirect discrimination prevention in data mining. IEEE Transactions on Knowledge and Data Engineering, 25(7), 1445\u20131459. https:\/\/doi.org\/10.1109\/TKDE.2012.72.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"9399_CR28","unstructured":"Hardt, M., Price, E., & Srebro, N. (2016). Equality of opportunity in supervised learning. In Proceedings of the Neural Information Processing Systems Annual Conference, December 5\u201310, 2016, Barcelona, Spain, pp. 3315\u20133323"},{"key":"9399_CR29","unstructured":"He, B., Macdonald, C., Ounis, I., Peng, J., & Santos, R. L. T. (2008). University of Glasgow at TREC 2008: Experiments in blog, enterprise, and relevance feedback tracks with Terrier. In Proceedings of the Seventeenth Text REtrieval Conference, TREC 2008, Gaithersburg, Maryland, USA, November 18\u201321, 2008, NIST Special Publication, vol. 500\u2013277. http:\/\/trec.nist.gov\/pubs\/trec17\/papers\/uglasgow.blog.ent.rf.rev.pdf"},{"issue":"4","key":"9399_CR30","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1145\/582415.582418","volume":"20","author":"K J\u00e4rvelin","year":"2002","unstructured":"J\u00e4rvelin, K., & Kek\u00e4l\u00e4inen, J. (2002). Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems, 20(4), 422\u2013446. https:\/\/doi.org\/10.1145\/582415.582418.","journal-title":"ACM Transactions on Information Systems"},{"key":"9399_CR31","doi-asserted-by":"publisher","unstructured":"Kamiran, F., & Calders, T. (2009). Classifying without discriminating. In Proceedings of the 2nd International Conference on Computer, Control and Communication, IEEE, pp. 1\u20136. https:\/\/doi.org\/10.1109\/IC4.2009.4909197.","DOI":"10.1109\/IC4.2009.4909197"},{"key":"9399_CR32","doi-asserted-by":"publisher","unstructured":"Kamishima, T., Akaho, S., & Sakuma, J. (2011). Fairness-aware learning through regularization approach. In Proceedings of the 11th International Conference on Data Mining Workshops, Vancouver, BC, Canada, December 11, 2011, IEEE Computer Society, pp. 643\u2013650. https:\/\/doi.org\/10.1109\/ICDMW.2011.83.","DOI":"10.1109\/ICDMW.2011.83"},{"key":"9399_CR33","doi-asserted-by":"publisher","unstructured":"Kay, M., Matuszek, C., & Munson, S. A. (2015). Unequal representation and gender stereotypes in image search results for occupations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18\u201323, 2015, ACM, pp. 3819\u20133828. https:\/\/doi.org\/10.1145\/2702123.2702520.","DOI":"10.1145\/2702123.2702520"},{"key":"9399_CR34","unstructured":"Kleinberg, J. M., Mullainathan, S., & Raghavan, M. (2016). Inherent trade-offs in the fair determination of risk scores. CoRR arXiv:abs\/1609.05807."},{"key":"9399_CR35","unstructured":"Macdonald, C., McCreadie, R., Santos, R. L. T., & Ounis, I. (2012). From puppy to maturity: Experiences in developing Terrier. In Proceedings of the SIGIR 2012 Workshop on Open Source Information Retrieval, OSIR@SIGIR 2012, Portland, Oregon, USA, 16th August 2012, University of Otago, Dunedin, New Zealand, pp. 60\u201363."},{"key":"9399_CR36","doi-asserted-by":"publisher","unstructured":"Mehrotra, R., Anderson, A., Diaz, F., Sharma, A., Wallach, H. M., & Yilmaz, E. (2017). Auditing search engines for differential satisfaction across demographics. In Proceedings of the 26th International Conference on World Wide Web Companion, Perth, Australia, April 3-7, 2017, ACM, pp. 626\u2013633. https:\/\/doi.org\/10.1145\/3041021.3054197.","DOI":"10.1145\/3041021.3054197"},{"key":"9399_CR37","doi-asserted-by":"publisher","unstructured":"Mehrotra, R., McInerney, J., Bouchard, H., Lalmas, M., & Diaz, F. (2018). Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22\u201326, 2018, ACM, pp. 2243\u20132251. https:\/\/doi.org\/10.1145\/3269206.3272027.","DOI":"10.1145\/3269206.3272027"},{"key":"9399_CR38","doi-asserted-by":"publisher","unstructured":"Morik, M., Singh, A., Hong, J., & Joachims, T. (2020). Controlling fairness and bias in dynamic learning-to-rank. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25\u201330, 2020, ACM, pp. 429\u2013438. https:\/\/doi.org\/10.1145\/3397271.3401100","DOI":"10.1145\/3397271.3401100"},{"key":"9399_CR39","unstructured":"Olteanu, A., Garcia-Gathright, J., de\u00a0Rijke, M., & Ekstrand, M. D. (2019a). In: Proceedings of FACTS-IR. CoRR arXiv:abs\/1907.05755."},{"issue":"2","key":"9399_CR40","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1145\/3458553.3458556","volume":"53","author":"A Olteanu","year":"2019","unstructured":"Olteanu, A., Garcia-Gathright, J., de Rijke, M., Ekstrand, M. D., Roegiest, A., Lipani, A., et al. (2019). FACTS-IR: Fairness, accountability, confidentiality, transparency, and safety in information retrieval. SIGIR Forum, 53(2), 20\u201343. https:\/\/doi.org\/10.1145\/3458553.3458556.","journal-title":"SIGIR Forum"},{"key":"9399_CR41","unstructured":"Ounis, I., Amati, G., Plachouras, V., He, B., Macdonald, C., & Lioma, C. (2006). Terrier: A high performance and scalable information retrieval platform. In Proceedings of the SIGIR 2006 Workshop on Open Source Information Retrieval, OSIR@SIGIR 2006, Seattle, WA, USA, August 2006, pp. 18\u201325."},{"key":"9399_CR42","doi-asserted-by":"publisher","unstructured":"Pedreschi, D., Ruggieri, S., & Turini, F. (2008). Discrimination-aware data mining. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, Nevada, USA, August 24\u201327, 2008, ACM, pp. 560\u2013568. https:\/\/doi.org\/10.1145\/1401890.1401959.","DOI":"10.1145\/1401890.1401959"},{"key":"9399_CR43","unstructured":"Pleiss, G., Raghavan, M., Wu, F., Kleinberg, J. M., & Weinberger, K. Q. (2017). On fairness and calibration. In Proceedings of the Advances in Neural Information Processing Systems Conference, December 4\u20139, 2017, Long Beach, CA, USA, pp. 5680\u20135689."},{"key":"9399_CR44","doi-asserted-by":"publisher","unstructured":"Radlinski, F., & Dumais, S. T. (2006). Improving personalized web search using result diversification. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6\u201311, 2006, ACM, pp. 691\u2013692. https:\/\/doi.org\/10.1145\/1148170.1148320.","DOI":"10.1145\/1148170.1148320"},{"key":"9399_CR45","doi-asserted-by":"publisher","unstructured":"Radlinski, F., Kleinberg, R., & Joachims, T. (2008). Learning diverse rankings with multi-armed bandits. In Proceedings of the Twenty-Fifth International Conference on Machine Learning, Helsinki, Finland, June 5-9, 2008, ACM, ACM International Conference Proceeding Series, vol. 307, pp. 784\u2013791. https:\/\/doi.org\/10.1145\/1390156.1390255.","DOI":"10.1145\/1390156.1390255"},{"key":"9399_CR46","doi-asserted-by":"publisher","unstructured":"Richardson, M., Dominowska, E., & Ragno, R. (2007). Predicting clicks: estimating the click-through rate for new ads. In Proceedings of the 16th International Conference on World Wide Web, WWW 2007, Banff, Alberta, Canada, May 8\u201312, 2007, ACM, pp. 521\u2013530. https:\/\/doi.org\/10.1145\/1242572.1242643.","DOI":"10.1145\/1242572.1242643"},{"key":"9399_CR47","doi-asserted-by":"crossref","unstructured":"Robertson, S. E. (1977). The probability ranking principle in IR. Journal of documentation.","DOI":"10.1108\/eb026647"},{"key":"9399_CR48","doi-asserted-by":"publisher","unstructured":"Santos, R. L. T., Peng, J., Macdonald, C., & Ounis, I. (2010). Explicit search result diversification through sub-queries. In: Proceedings of the 32nd European Conference on Information Retrieval, Milton Keynes, UK, March 28-31, 2010. Proceedings, Springer, Lecture Notes in Computer Science, vol. 5993, pp. 87\u201399. https:\/\/doi.org\/10.1007\/978-3-642-12275-0_11.","DOI":"10.1007\/978-3-642-12275-0_11"},{"issue":"1","key":"9399_CR49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/1500000040","volume":"9","author":"RLT Santos","year":"2015","unstructured":"Santos, R. L. T., MacDonald, C., & Ounis, I. (2015). Search result diversification. Foundations and Trends in Information Retrieval, 9(1), 1\u201390. https:\/\/doi.org\/10.1561\/1500000040.","journal-title":"Foundations and Trends in Information Retrieval"},{"key":"9399_CR50","doi-asserted-by":"publisher","unstructured":"Sapiezynski, P., Zeng, W., Robertson, R. E., Mislove, A., & Wilson, C. (2019). Quantifying the impact of user attentionon fair group representation in ranked lists. In: Companion of The 2019 World Wide Web Conference, WWW 2019, San Francisco, CA, USA, May 13\u201317, 2019, ACM, pp. 553\u2013562. https:\/\/doi.org\/10.1145\/3308560.3317595.","DOI":"10.1145\/3308560.3317595"},{"key":"9399_CR51","doi-asserted-by":"publisher","unstructured":"Singh, A., & Joachims, T. (2018). Fairness of exposure in rankings. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK, August 19\u201323, 2018, ACM, pp. 2219\u20132228. https:\/\/doi.org\/10.1145\/3219819.3220088.","DOI":"10.1145\/3219819.3220088"},{"key":"9399_CR52","unstructured":"Singh, A., & Joachims, T. (2019). Policy learning for fairness in ranking. CoRR arXiv:abs\/1902.04056."},{"key":"9399_CR53","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1145\/1328964.1328965","volume":"41","author":"K Sp\u00e4rck-Jones","year":"2007","unstructured":"Sp\u00e4rck-Jones, K., Robertson, S. E., & Sanderson, M. (2007). Ambiguous requests: Implications for retrieval tests, systems and theories. In ACM SIGIR Forum, 41, 8\u201317. https:\/\/doi.org\/10.1145\/1328964.1328965","journal-title":"In ACM SIGIR Forum"},{"key":"9399_CR54","doi-asserted-by":"publisher","unstructured":"Wang, J., & Zhu, J. (2009). Portfolio theory of information retrieval. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19\u201323, 2009, ACM, pp. 115\u2013122. https:\/\/doi.org\/10.1145\/1571941.1571963.","DOI":"10.1145\/1571941.1571963"},{"key":"9399_CR55","doi-asserted-by":"publisher","unstructured":"White, R. (2013). Beliefs and biases in web search. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR \u201913, Dublin, Ireland\u2014July 28\u2014August 01, 2013, ACM, pp. 3\u201312. https:\/\/doi.org\/10.1145\/2484028.2484053.","DOI":"10.1145\/2484028.2484053"},{"key":"9399_CR56","unstructured":"Woodworth, B. E., Gunasekar, S., Ohannessian, M. I., & Srebro, N. (2017). Learning non-discriminatory predictors. CoRR arXiv:abs\/1702.06081."},{"key":"9399_CR57","unstructured":"Yadav, H., Du, Z., & Joachims, T. (2019). Fair learning-to-rank from implicit feedback. CoRR arXiv:abs\/1911.08054."},{"key":"9399_CR58","doi-asserted-by":"publisher","unstructured":"Yang, K., & Stoyanovich, J. (2017). Measuring fairness in ranked outputs. In: Proceedings of the 29th International Conference on Scientific and Statistical Database Management, Chicago, IL, USA, June 27\u201329, 2017, ACM, pp. 22:1\u201322:6. https:\/\/doi.org\/10.1145\/3085504.3085526.","DOI":"10.1145\/3085504.3085526"},{"issue":"3","key":"9399_CR59","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1002\/asi.24403","volume":"72","author":"S Yigit-Sert","year":"2021","unstructured":"Yigit-Sert, S., Altingovde, I. S., Macdonald, C., Ounis, I., & Ulusoy, \u00d6. (2021). Explicit diversification of search results across multiple dimensions for educational search. The Journal of the Association for Information Science and Technology, 72(3), 315\u2013330. https:\/\/doi.org\/10.1002\/asi.24403.","journal-title":"The Journal of the Association for Information Science and Technology"},{"key":"9399_CR60","doi-asserted-by":"publisher","unstructured":"Zafar, M. B., Valera, I., Gomez-Rodriguez, M., & Gummadi, K. P. (2017). Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment. In: Proceedings of the 26th International Conference on World Wide Web, WWW 2017, Perth, Australia, April 3\u20137, 2017, ACM, pp. 1171\u20131180. https:\/\/doi.org\/10.1145\/3038912.3052660.","DOI":"10.1145\/3038912.3052660"},{"key":"9399_CR61","doi-asserted-by":"publisher","unstructured":"Zehlike, M., Bonchi, F., Castillo, C., Hajian, S., Megahed, M., & Baeza-Yates, R. (2017). FA*IR: A fair top-k ranking algorithm. In: Proceedings of the 2017 ACM Conference on Information and Knowledge Management, CIKM 2017, Singapore, November 06\u201310, 2017, ACM, pp. 1569\u20131578. https:\/\/doi.org\/10.1145\/3132847.3132938.","DOI":"10.1145\/3132847.3132938"},{"key":"9399_CR62","unstructured":"Zemel, R. S., Wu, Y., Swersky, K., Pitassi, T., & Dwork, C. (2013). Learning fair representations. In Proceedings of the 30th International Conference on Machine Learning, ICML 2013, Atlanta, GA, USA, 16\u201321 June 2013, JMLR.org, JMLR Workshop and Conference Proceedings, vol.\u00a028, pp. 325\u2013333. http:\/\/proceedings.mlr.press\/v28\/zemel13.html."}],"container-title":["Information Retrieval Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10791-021-09399-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10791-021-09399-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10791-021-09399-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,9]],"date-time":"2022-02-09T06:44:54Z","timestamp":1644389094000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10791-021-09399-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,7]]},"references-count":62,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,3]]}},"alternative-id":["9399"],"URL":"https:\/\/doi.org\/10.1007\/s10791-021-09399-z","relation":{},"ISSN":["1386-4564","1573-7659"],"issn-type":[{"value":"1386-4564","type":"print"},{"value":"1573-7659","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,7]]},"assertion":[{"value":"25 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"None.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}