{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T16:20:35Z","timestamp":1761582035254,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":58,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,1,27]],"date-time":"2020-01-27T00:00:00Z","timestamp":1580083200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Amazon Research Award"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,1,27]]},"DOI":"10.1145\/3351095.3375234","type":"proceedings-article","created":{"date-parts":[[2020,12,8]],"date-time":"2020-12-08T21:36:21Z","timestamp":1607463381000},"page":"618-628","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Model agnostic interpretability of rankers via intent modelling"],"prefix":"10.1145","author":[{"given":"Jaspreet","family":"Singh","sequence":"first","affiliation":[{"name":"L3S Research Center, Hannover, Germany"}]},{"given":"Avishek","family":"Anand","sequence":"additional","affiliation":[{"name":"L3S Research Center, Hannover, Germany"}]}],"member":"320","published-online":{"date-parts":[[2020,1,27]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1411509.1411513"},{"key":"e_1_3_2_1_2_1","volume-title":"A causal framework for explaining the predictions of black-box sequence-to-sequence models. arXiv preprint arXiv:1707.01943","author":"Alvarez-Melis David","year":"2017","unstructured":"David Alvarez-Melis and Tommi S Jaakkola . 2017. A causal framework for explaining the predictions of black-box sequence-to-sequence models. arXiv preprint arXiv:1707.01943 ( 2017 ). David Alvarez-Melis and Tommi S Jaakkola. 2017. A causal framework for explaining the predictions of black-box sequence-to-sequence models. arXiv preprint arXiv:1707.01943 (2017)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835610"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331211"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-44781-0_8"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788613"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959153"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/11431053_30"},{"volume-title":"Language modeling for information retrieval","author":"Bruce Croft W","key":"e_1_3_2_1_9_1","unstructured":"W Bruce Croft and John Lafferty . 2013. Language modeling for information retrieval . Vol. 13 . Springer Science & Business Media . W Bruce Croft and John Lafferty. 2013. Language modeling for information retrieval. Vol. 13. Springer Science & Business Media."},{"key":"e_1_3_2_1_10_1","volume-title":"Real Time Image Saliency for Black Box Classifiers. arXiv preprint arXiv:1705.07857","author":"Dabkowski Piotr","year":"2017","unstructured":"Piotr Dabkowski and Yarin Gal . 2017. Real Time Image Saliency for Black Box Classifiers. arXiv preprint arXiv:1705.07857 ( 2017 ). Piotr Dabkowski and Yarin Gal. 2017. Real Time Image Saliency for Black Box Classifiers. arXiv preprint arXiv:1705.07857 (2017)."},{"key":"e_1_3_2_1_11_1","volume-title":"Neural Ranking Models with Weak Supervision. arXiv preprint arXiv:1704.08803","author":"Dehghani Mostafa","year":"2017","unstructured":"Mostafa Dehghani , Hamed Zamani , Aliaksei Severyn , Jaap Kamps , and W Bruce Croft . 2017. Neural Ranking Models with Weak Supervision. arXiv preprint arXiv:1704.08803 ( 2017 ). Mostafa Dehghani, Hamed Zamani, Aliaksei Severyn, Jaap Kamps, and W Bruce Croft. 2017. Neural Ranking Models with Weak Supervision. arXiv preprint arXiv:1704.08803 (2017)."},{"key":"e_1_3_2_1_12_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018). Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1035"},{"key":"e_1_3_2_1_14_1","unstructured":"Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. (2017).  Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. (2017)."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331312"},{"key":"e_1_3_2_1_16_1","volume-title":"A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Franco Turini , Fosca Giannotti , and Dino Pedreschi . 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 ( 2018 ), 93. Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 (2018), 93."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983769"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1012294.1012297"},{"key":"e_1_3_2_1_19_1","volume-title":"A Position-Aware Deep Model for Relevance Matching in Information Retrieval. arXiv preprint arXiv:1704.03940","author":"Hui Kai","year":"2017","unstructured":"Kai Hui , Andrew Yates , Klaus Berberich , and Gerard de Melo . 2017. A Position-Aware Deep Model for Relevance Matching in Information Retrieval. arXiv preprint arXiv:1704.03940 ( 2017 ). Kai Hui, Andrew Yates, Klaus Berberich, and Gerard de Melo. 2017. A Position-Aware Deep Model for Relevance Matching in Information Retrieval. arXiv preprint arXiv:1704.03940 (2017)."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K17-1010"},{"key":"e_1_3_2_1_21_1","unstructured":"Been Kim Rajiv Khanna and Oluwasanmi O Koyejo. 2016. Examples are not enough learn to criticize! criticism for interpretability. In Advances in Neural Information Processing Systems. 2280--2288.  Been Kim Rajiv Khanna and Oluwasanmi O Koyejo. 2016. Examples are not enough learn to criticize! criticism for interpretability. In Advances in Neural Information Processing Systems. 2280--2288."},{"key":"e_1_3_2_1_22_1","volume-title":"Understanding black-box predictions via influence functions. arXiv preprint arXiv:1703.04730","author":"Koh Pang Wei","year":"2017","unstructured":"Pang Wei Koh and Percy Liang . 2017. Understanding black-box predictions via influence functions. arXiv preprint arXiv:1703.04730 ( 2017 ). Pang Wei Koh and Percy Liang. 2017. Understanding black-box predictions via influence functions. arXiv preprint arXiv:1703.04730 (2017)."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/383952.383972"},{"key":"e_1_3_2_1_24_1","volume-title":"Rationalizing neural predictions. arXiv preprint arXiv:1606.04155","author":"Lei Tao","year":"2016","unstructured":"Tao Lei , Regina Barzilay , and Tommi Jaakkola . 2016. Rationalizing neural predictions. arXiv preprint arXiv:1606.04155 ( 2016 ). Tao Lei, Regina Barzilay, and Tommi Jaakkola. 2016. Rationalizing neural predictions. arXiv preprint arXiv:1606.04155 (2016)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1214\/15-AOAS848"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1478"},{"key":"e_1_3_2_1_27_1","volume-title":"Visualizing and understanding neural models in nlp. arXiv preprint arXiv:1506.01066","author":"Li Jiwei","year":"2015","unstructured":"Jiwei Li , Xinlei Chen , Eduard Hovy , and Dan Jurafsky . 2015. Visualizing and understanding neural models in nlp. arXiv preprint arXiv:1506.01066 ( 2015 ). Jiwei Li, Xinlei Chen, Eduard Hovy, and Dan Jurafsky. 2015. Visualizing and understanding neural models in nlp. arXiv preprint arXiv:1506.01066 (2015)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Tie-Yan Liu etal 2009. Learning to rank for information retrieval. Foundations and Trends\u00ae in Information Retrieval 3 3 (2009) 225--331.  Tie-Yan Liu et al. 2009. Learning to rank for information retrieval. Foundations and Trends\u00ae in Information Retrieval 3 3 (2009) 225--331.","DOI":"10.1561\/1500000016"},{"key":"e_1_3_2_1_29_1","unstructured":"Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems. 4765--4774.  Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems. 4765--4774."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1211"},{"key":"e_1_3_2_1_31_1","volume-title":"Neural Models for Information Retrieval. arXiv preprint arXiv:1705.01509","author":"Mitra Bhaskar","year":"2017","unstructured":"Bhaskar Mitra and Nick Craswell . 2017. Neural Models for Information Retrieval. arXiv preprint arXiv:1705.01509 ( 2017 ). Bhaskar Mitra and Nick Craswell. 2017. Neural Models for Information Retrieval. arXiv preprint arXiv:1705.01509 (2017)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.290995"},{"key":"e_1_3_2_1_33_1","volume-title":"Interpretable machine learning: definitions, methods, and applications. arXiv preprint arXiv:1901.04592","author":"Murdoch W James","year":"2019","unstructured":"W James Murdoch , Chandan Singh , Karl Kumbier , Reza Abbasi-Asl , and Bin Yu. 2019. Interpretable machine learning: definitions, methods, and applications. arXiv preprint arXiv:1901.04592 ( 2019 ). W James Murdoch, Chandan Singh, Karl Kumbier, Reza Abbasi-Asl, and Bin Yu. 2019. Interpretable machine learning: definitions, methods, and applications. arXiv preprint arXiv:1901.04592 (2019)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872518.2889361"},{"key":"e_1_3_2_1_35_1","volume-title":"MS MARCO: A Human-Generated MAchine Reading COmprehension Dataset.","author":"Nguyen Tri","year":"2016","unstructured":"Tri Nguyen , Mir Rosenberg , Xia Song , Jianfeng Gao , Saurabh Tiwary , Rangan Majumder , and Li Deng . 2016 . MS MARCO: A Human-Generated MAchine Reading COmprehension Dataset. (2016). Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A Human-Generated MAchine Reading COmprehension Dataset. (2016)."},{"key":"e_1_3_2_1_36_1","volume-title":"Task-oriented query reformulation with reinforcement learning. arXiv preprint arXiv:1704.04572","author":"Nogueira Rodrigo","year":"2017","unstructured":"Rodrigo Nogueira and Kyunghyun Cho . 2017. Task-oriented query reformulation with reinforcement learning. arXiv preprint arXiv:1704.04572 ( 2017 ). Rodrigo Nogueira and Kyunghyun Cho. 2017. Task-oriented query reformulation with reinforcement learning. arXiv preprint arXiv:1704.04572 (2017)."},{"key":"e_1_3_2_1_37_1","volume-title":"Semantic modelling with long-short-term memory for information retrieval. arXiv preprint arXiv:1412.6629","author":"Palangi Hamid","year":"2014","unstructured":"Hamid Palangi , Li Deng , Yelong Shen , Jianfeng Gao , Xiaodong He , Jianshu Chen , Xinying Song , and R Ward . 2014. Semantic modelling with long-short-term memory for information retrieval. arXiv preprint arXiv:1412.6629 ( 2014 ). Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, and R Ward. 2014. Semantic modelling with long-short-term memory for information retrieval. arXiv preprint arXiv:1412.6629 (2014)."},{"key":"e_1_3_2_1_38_1","volume-title":"SIGIR workshop on Neural Information Retrieval (NeuIR-16)","author":"Pang Liang","year":"2016","unstructured":"Liang Pang , Yanyan Lan , Jiafeng Guo , Jun Xu , and Xueqi Cheng . 2016 . A Study of MatchPyramid Models on Ad-hoc Retrieval . SIGIR workshop on Neural Information Retrieval (NeuIR-16) arXiv:1606.04648 (2016). arXiv:1606.04648 http:\/\/arxiv.org\/abs\/1606.04648 Liang Pang, Yanyan Lan, Jiafeng Guo, Jun Xu, and Xueqi Cheng. 2016. A Study of MatchPyramid Models on Ad-hoc Retrieval. SIGIR workshop on Neural Information Retrieval (NeuIR-16) arXiv:1606.04648 (2016). arXiv:1606.04648 http:\/\/arxiv.org\/abs\/1606.04648"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291008"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/160688.160713"},{"key":"e_1_3_2_1_41_1","volume-title":"Model-agnostic interpretability of machine learning. arXiv preprint arXiv:1606.05386","author":"Ribeiro Marco Tulio","year":"2016","unstructured":"Marco Tulio Ribeiro , Sameer Singh , and Carlos Guestrin . 2016. Model-agnostic interpretability of machine learning. arXiv preprint arXiv:1606.05386 ( 2016 ). Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. Model-agnostic interpretability of machine learning. arXiv preprint arXiv:1606.05386 (2016)."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11491"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026866"},{"key":"e_1_3_2_1_45_1","volume-title":"Relevance feedback in information retrieval. The Smart retrieval system-experiments in automatic document processing","author":"Rocchio Joseph","year":"1971","unstructured":"Joseph Rocchio . 1971. Relevance feedback in information retrieval. The Smart retrieval system-experiments in automatic document processing ( 1971 ), 313--323. Joseph Rocchio. 1971. Relevance feedback in information retrieval. The Smart retrieval system-experiments in automatic document processing (1971), 313--323."},{"key":"e_1_3_2_1_46_1","volume-title":"Finding Influential Training Samples for Gradient Boosted Decision Trees. In International Conference on Machine Learning. 4584--4592","author":"Sharchilev Boris","year":"2018","unstructured":"Boris Sharchilev , Yury Ustinovskiy , Pavel Serdyukov , and Maarten Rijke . 2018 . Finding Influential Training Samples for Gradient Boosted Decision Trees. In International Conference on Machine Learning. 4584--4592 . Boris Sharchilev, Yury Ustinovskiy, Pavel Serdyukov, and Maarten Rijke. 2018. Finding Influential Training Samples for Gradient Boosted Decision Trees. In International Conference on Machine Learning. 4584--4592."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2567948.2577348"},{"key":"e_1_3_2_1_48_1","volume-title":"Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034","author":"Simonyan Karen","year":"2013","unstructured":"Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 ( 2013 ). Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 (2013)."},{"key":"e_1_3_2_1_49_1","volume-title":"Posthoc Interpretability of Learning to Rank Models using Secondary Training Data. arXiv preprint arXiv:1806.11330","author":"Singh Jaspreet","year":"2018","unstructured":"Jaspreet Singh and Avishek Anand . 2018. Posthoc Interpretability of Learning to Rank Models using Secondary Training Data. arXiv preprint arXiv:1806.11330 ( 2018 ). Jaspreet Singh and Avishek Anand. 2018. Posthoc Interpretability of Learning to Rank Models using Secondary Training Data. arXiv preprint arXiv:1806.11330 (2018)."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290620"},{"key":"e_1_3_2_1_51_1","volume-title":"Faithfully Explaining Rankings in a News Recommender System. arXiv preprint arXiv:1805.05447","author":"Hoeve Maartje","year":"2018","unstructured":"Maartje ter Hoeve , Anne Schuth , Daan Odijk , and Maarten de Rijke . 2018. Faithfully Explaining Rankings in a News Recommender System. arXiv preprint arXiv:1805.05447 ( 2018 ). Maartje ter Hoeve, Anne Schuth, Daan Odijk, and Maarten de Rijke. 2018. Faithfully Explaining Rankings in a News Recommender System. arXiv preprint arXiv:1805.05447 (2018)."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"crossref","unstructured":"George Tsatsaronis Georgios Balikas Prodromos Malakasiotis Ioannis Partalas Matthias Zschunke Michael R Alvers Dirk Weissenborn Anastasia Krithara Sergios Petridis Dimitris Polychronopoulos etal 2015. An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition. BMC bioinformatics 16 1 (2015) 138.  George Tsatsaronis Georgios Balikas Prodromos Malakasiotis Ioannis Partalas Matthias Zschunke Michael R Alvers Dirk Weissenborn Anastasia Krithara Sergios Petridis Dimitris Polychronopoulos et al. 2015. An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition. BMC bioinformatics 16 1 (2015) 138.","DOI":"10.1186\/s12859-015-0564-6"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331377"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.5555\/188490.188508"},{"key":"e_1_3_2_1_55_1","volume-title":"TREC: Experiment and evaluation in information retrieval.","author":"Voorhees Ellen M","year":"2005","unstructured":"Ellen M Voorhees , Donna K Harman , 2005 . TREC: Experiment and evaluation in information retrieval. Vol. 63 . MIT press Cambridge . Ellen M Voorhees, Donna K Harman, et al. 2005. TREC: Experiment and evaluation in information retrieval. Vol. 63. MIT press Cambridge."},{"key":"e_1_3_2_1_56_1","volume-title":"International Conference on Machine Learning. 2048--2057","author":"Xu Kelvin","year":"2015","unstructured":"Kelvin Xu , Jimmy Ba , Ryan Kiros , Kyunghyun Cho , Aaron Courville , Ruslan Salakhudinov , Rich Zemel , and Yoshua Bengio . 2015 . Show, attend and tell: Neural image caption generation with visual attention . In International Conference on Machine Learning. 2048--2057 . Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. 2015. Show, attend and tell: Neural image caption generation with visual attention. In International Conference on Machine Learning. 2048--2057."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1571954"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331649"}],"event":{"name":"FAT* '20: Conference on Fairness, Accountability, and Transparency","sponsor":["ACM Association for Computing Machinery"],"location":"Barcelona Spain","acronym":"FAT* '20"},"container-title":["Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3351095.3375234","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3351095.3375234","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:22Z","timestamp":1750200082000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3351095.3375234"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,27]]},"references-count":58,"alternative-id":["10.1145\/3351095.3375234","10.1145\/3351095"],"URL":"https:\/\/doi.org\/10.1145\/3351095.3375234","relation":{},"subject":[],"published":{"date-parts":[[2020,1,27]]},"assertion":[{"value":"2020-01-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}