{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T13:49:49Z","timestamp":1773323389214,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,8]]},"DOI":"10.1145\/3437963.3441772","type":"proceedings-article","created":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T04:34:28Z","timestamp":1615005268000},"page":"472-480","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Bias-Variance Decomposition for Ranking"],"prefix":"10.1145","author":[{"given":"Pannaga","family":"Shivaswamy","sequence":"first","affiliation":[{"name":"Netflix Inc., Los Gatos, CA, USA"}]},{"given":"Ashok","family":"Chandrashekar","sequence":"additional","affiliation":[{"name":"Netflix Inc., Los Gatos, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,3,8]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Mart'in Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dan Man\u00e9 Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. http:\/\/tensorflow.org\/ Software available from tensorflow.org.  Mart'in Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dan Man\u00e9 Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. http:\/\/tensorflow.org\/ Software available from tensorflow.org."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623362"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209581"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1903070116"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102363"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273513"},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Gordon","unstructured":"Gordon V. Cormack and Maura R. Grossman. 2019. Quantifying Bias and Variance of System Rankings . In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval ( Paris, France) (SIGIR'19). Association for Computing Machinery, New York, NY, USA, 1089--1092. https:\/\/doi.org\/10.1145\/3331184.3331356 Gordon V. Cormack and Maura R. Grossman. 2019. Quantifying Bias and Variance of System Rankings. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (Paris, France) (SIGIR'19). Association for Computing Machinery, New York, NY, USA, 1089--1092. https:\/\/doi.org\/10.1145\/3331184.3331356"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959190"},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann","author":"Domingos Pedro","year":"2000","unstructured":"Pedro Domingos . 2000 a. A Unified Bias-Variance Decomposition and its Applications . In Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann , San Francisco, CA, 231--238. Pedro Domingos. 2000 a. A Unified Bias-Variance Decomposition and its Applications. In Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann, San Francisco, CA, 231--238."},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence. AAAI Press, 564--569","author":"Domingos Pedro","year":"2000","unstructured":"Pedro Domingos . 2000 b. A Unified Bias-Variance Decomposition for Zero-One and Squared Loss . In Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence. AAAI Press, 564--569 . Pedro Domingos. 2000 b. A Unified Bias-Variance Decomposition for Zero-One and Squared Loss. In Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence. AAAI Press, 564--569."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1992.4.1.1"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2843948"},{"key":"e_1_3_2_1_14_1","volume-title":"The Elements of Statistical Learning","author":"Hastie Trevor","unstructured":"Trevor Hastie , Robert Tibshirani , and Jerome Friedman . 2001. The Elements of Statistical Learning . Springer New York Inc ., New York, NY, USA. Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2001. The Elements of Statistical Learning .Springer New York Inc., New York, NY, USA."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775067"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018699"},{"key":"e_1_3_2_1_17_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba . 2014 . Adam : A Method for Stochastic Optimization . arxiv: 1412.6980 [cs.LG] Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. arxiv: 1412.6980 [cs.LG]"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/3091696.3091730"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835676"},{"key":"e_1_3_2_1_20_1","volume-title":"Introduction to Information Retrieval","author":"Manning Christopher D.","unstructured":"Christopher D. Manning , Prabhakar Raghavan , and Hinrich Sch\u00fctze . 2008. Introduction to Information Retrieval . Cambridge University Press , USA. Christopher D. Manning, Prabhakar Raghavan, and Hinrich Sch\u00fctze. 2008. Introduction to Information Retrieval. Cambridge University Press, USA."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401100"},{"key":"e_1_3_2_1_22_1","volume-title":"A Modern Take on the Bias-Variance Tradeoff in Neural Networks. arxiv","author":"Neal Brady","year":"1810","unstructured":"Brady Neal , Sarthak Mittal , Aristide Baratin , Vinayak Tantia , Matthew Scicluna , Simon Lacoste-Julien , and Ioannis Mitliagkas . 2018. A Modern Take on the Bias-Variance Tradeoff in Neural Networks. arxiv : 1810 .08591 [cs.LG] Brady Neal, Sarthak Mittal, Aristide Baratin, Vinayak Tantia, Matthew Scicluna, Simon Lacoste-Julien, and Ioannis Mitliagkas. 2018. A Modern Take on the Bias-Variance Tradeoff in Neural Networks. arxiv: 1810.08591 [cs.LG]"},{"key":"e_1_3_2_1_23_1","unstructured":"David. Pfau. 2013. A generalized bias-variance decomposition for bregman divergences. http:\/\/davidpfau.com\/assets\/generalized_bvd_proof.pdf  David. Pfau. 2013. A generalized bias-variance decomposition for bregman divergences. http:\/\/davidpfau.com\/assets\/generalized_bvd_proof.pdf"},{"key":"e_1_3_2_1_24_1","volume-title":"abs\/1306.2597","author":"Qin Tao","year":"2013","unstructured":"Tao Qin and Tie-Yan Liu . 2013. Introducing LETOR 4.0 Datasets . Co RR , Vol . abs\/1306.2597 ( 2013 ). http:\/\/arxiv.org\/abs\/1306.2597 Tao Qin and Tie-Yan Liu. 2013. Introducing LETOR 4.0 Datasets. CoRR, Vol. abs\/1306.2597 (2013). http:\/\/arxiv.org\/abs\/1306.2597"},{"key":"e_1_3_2_1_25_1","volume-title":"1999 Ninth International Conference on Artificial Neural Networks ICANN 99","volume":"1","author":"Ralf Herbrich","year":"1999","unstructured":"Herbrich Ralf , Thore Graepel , and Klaus Obermayer . 1999 . Support vector learning for ordinal regression . In 1999 Ninth International Conference on Artificial Neural Networks ICANN 99 . (Conf. Publ. No. 470) , Vol. 1 . 97--102 vol.1. https:\/\/doi.org\/10.1049\/cp:19991091 Herbrich Ralf, Thore Graepel, and Klaus Obermayer. 1999. Support vector learning for ordinal regression. In 1999 Ninth International Conference on Artificial Neural Networks ICANN 99. (Conf. Publ. No. 470), Vol. 1. 97--102 vol.1. https:\/\/doi.org\/10.1049\/cp:19991091"},{"key":"e_1_3_2_1_26_1","volume-title":"BPR: Bayesian Personalized Ranking from Implicit Feedback (UAI '09)","author":"Rendle Steffen","year":"2009","unstructured":"Steffen Rendle , Christoph Freudenthaler , Zeno Gantner , and Lars Schmidt-Thieme . 2009 . BPR: Bayesian Personalized Ranking from Implicit Feedback (UAI '09) . AUAI Press , Arlington, Virginia, USA , 452--461. Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback (UAI '09). AUAI Press, Arlington, Virginia, USA, 452--461."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911537"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159732"},{"key":"e_1_3_2_1_29_1","volume-title":"Rethinking Bias-Variance Trade-off for Generalization of Neural Networks. arxiv","author":"Yang Zitong","year":"2002","unstructured":"Zitong Yang , Yaodong Yu , Chong You , Jacob Steinhardt , and Yi Ma. 2020. Rethinking Bias-Variance Trade-off for Generalization of Neural Networks. arxiv : 2002 .11328 [cs.LG] Zitong Yang, Yaodong Yu, Chong You, Jacob Steinhardt, and Yi Ma. 2020. Rethinking Bias-Variance Trade-off for Generalization of Neural Networks. arxiv: 2002.11328 [cs.LG]"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484127"}],"event":{"name":"WSDM '21: The Fourteenth ACM International Conference on Web Search and Data Mining","location":"Virtual Event Israel","acronym":"WSDM '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 14th ACM International Conference on Web Search and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437963.3441772","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3437963.3441772","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:35Z","timestamp":1750193255000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437963.3441772"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":29,"alternative-id":["10.1145\/3437963.3441772","10.1145\/3437963"],"URL":"https:\/\/doi.org\/10.1145\/3437963.3441772","relation":{},"subject":[],"published":{"date-parts":[[2021,3,8]]},"assertion":[{"value":"2021-03-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}