{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:25:13Z","timestamp":1750220713342,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":42,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,20]],"date-time":"2020-04-20T00:00:00Z","timestamp":1587340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,20]]},"DOI":"10.1145\/3366423.3380030","type":"proceedings-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T08:11:44Z","timestamp":1588579904000},"page":"2725-2732","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Stabilizing Neural Search Ranking Models"],"prefix":"10.1145","author":[{"given":"Ruilin","family":"Li","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology & Google LLC"}]},{"given":"Zhen","family":"Qin","sequence":"additional","affiliation":[{"name":"Google LLC"}]},{"given":"Xuanhui","family":"Wang","sequence":"additional","affiliation":[{"name":"Google LLC"}]},{"given":"Suming J.","family":"Chen","sequence":"additional","affiliation":[{"name":"Google LLC"}]},{"given":"Donald","family":"Metzler","sequence":"additional","affiliation":[{"name":"Google LLC"}]}],"member":"320","published-online":{"date-parts":[[2020,4,20]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Tal Ben-Nun and Torsten Hoefler. 2018. Demystifying parallel and distributed deep learning: An in-depth concurrency analysis. arXiv preprint arXiv:1802.09941(2018).  Tal Ben-Nun and Torsten Hoefler. 2018. Demystifying parallel and distributed deep learning: An in-depth concurrency analysis. arXiv preprint arXiv:1802.09941(2018)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159727"},{"key":"e_1_3_2_1_3_1","unstructured":"Eliot Brenner Jun Zhao Aliasgar Kutiyanawala and Zheng Yan. 2018. End-to-End Neural Ranking for eCommerce Product Search: an Application of Task Models and Textual Embeddings.Proc. of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval(2018).  Eliot Brenner Jun Zhao Aliasgar Kutiyanawala and Zheng Yan. 2018. End-to-End Neural Ranking for eCommerce Product Search: an Application of Task Models and Textual Embeddings.Proc. of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval(2018)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341981.3344221"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102363"},{"key":"e_1_3_2_1_6_1","first-page":"23","article-title":"From ranknet to lambdarank to lambdamart: An overview","volume":"11","author":"Burges JC","year":"2010","unstructured":"Christopher\u00a0 JC Burges . 2010 . From ranknet to lambdarank to lambdamart: An overview . Learning 11 , 23 - 581 (2010), 81. Christopher\u00a0JC Burges. 2010. From ranknet to lambdarank to lambdamart: An overview. Learning 11, 23-581 (2010), 81.","journal-title":"Learning"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273513"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806471"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2988450.2988454"},{"volume-title":"Search engines: Information retrieval in practice. Vol.\u00a0520","author":"Croft W\u00a0Bruce","key":"e_1_3_2_1_10_1","unstructured":"W\u00a0Bruce Croft , Donald Metzler , and Trevor Strohman . 2010. Search engines: Information retrieval in practice. Vol.\u00a0520 . Addison-Wesley Reading . W\u00a0Bruce Croft, Donald Metzler, and Trevor Strohman. 2010. Search engines: Information retrieval in practice. Vol.\u00a0520. Addison-Wesley Reading."},{"key":"e_1_3_2_1_11_1","unstructured":"Jeffrey Dean Greg Corrado Rajat Monga Kai Chen Matthieu Devin Mark Mao Andrew Senior Paul Tucker Ke Yang Quoc\u00a0V Le 2012. Large scale distributed deep networks. In Advances in neural information processing systems. 1223\u20131231.  Jeffrey Dean Greg Corrado Rajat Monga Kai Chen Matthieu Devin Mark Mao Andrew Senior Paul Tucker Ke Yang Quoc\u00a0V Le 2012. Large scale distributed deep networks. In Advances in neural information processing systems. 1223\u20131231."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2684822.2685307"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433413"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.13.7.492"},{"key":"e_1_3_2_1_15_1","first-page":"2121","article-title":"Adaptive subgradient methods for online learning and stochastic optimization","author":"Duchi John","year":"2011","unstructured":"John Duchi , Elad Hazan , and Yoram Singer . 2011 . Adaptive subgradient methods for online learning and stochastic optimization . Journal of Machine Learning Research 12 , Jul (2011), 2121 \u2013 2159 . John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research 12, Jul (2011), 2121\u20132159.","journal-title":"Journal of Machine Learning Research 12"},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 13th International Conference on Machine Learning, Vol.\u00a096","author":"Freund Yoav","year":"1996","unstructured":"Yoav Freund , Robert\u00a0 E Schapire , 1996 . Experiments with a new boosting algorithm . In Proceedings of the 13th International Conference on Machine Learning, Vol.\u00a096 . 148\u2013156. Yoav Freund, Robert\u00a0E Schapire, 1996. Experiments with a new boosting algorithm. In Proceedings of the 13th International Conference on Machine Learning, Vol.\u00a096. 148\u2013156."},{"key":"e_1_3_2_1_17_1","unstructured":"Jerome\u00a0H Friedman. 2001. Greedy function approximation: a gradient boosting machine. Annals of statistics(2001) 1189\u20131232.  Jerome\u00a0H Friedman. 2001. Greedy function approximation: a gradient boosting machine. Annals of statistics(2001) 1189\u20131232."},{"key":"e_1_3_2_1_18_1","unstructured":"Jiafeng Guo Yixing Fan Liang Pang Liu Yang Qingyao Ai Hamed Zamani Chen Wu W\u00a0Bruce Croft and Xueqi Cheng. 2019. A deep look into neural ranking models for information retrieval. arXiv preprint arXiv:1903.06902(2019).  Jiafeng Guo Yixing Fan Liang Pang Liu Yang Qingyao Ai Hamed Zamani Chen Wu W\u00a0Bruce Croft and Xueqi Cheng. 2019. A deep look into neural ranking models for information retrieval. arXiv preprint arXiv:1903.06902(2019)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775067"},{"key":"e_1_3_2_1_20_1","first-page":"39","article-title":"Online experimentation at Microsoft","volume":"11","author":"Kohavi Ronny","year":"2009","unstructured":"Ronny Kohavi , Thomas Crook , Roger Longbotham , Brian Frasca , Randy Henne , Juan\u00a0Lavista Ferres , and Tamir Melamed . 2009 . Online experimentation at Microsoft . Data Mining Case Studies 11 (2009), 39 . Ronny Kohavi, Thomas Crook, Roger Longbotham, Brian Frasca, Randy Henne, Juan\u00a0Lavista Ferres, and Tamir Melamed. 2009. Online experimentation at Microsoft. Data Mining Case Studies 11 (2009), 39.","journal-title":"Data Mining Case Studies"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2488217"},{"key":"e_1_3_2_1_22_1","volume-title":"Controlled experiments on the web: survey and practical guide. Data mining and knowledge discovery 18, 1","author":"Kohavi Ron","year":"2009","unstructured":"Ron Kohavi , Roger Longbotham , Dan Sommerfield , and Randal\u00a0 M Henne . 2009. Controlled experiments on the web: survey and practical guide. Data mining and knowledge discovery 18, 1 ( 2009 ), 140\u2013181. Ron Kohavi, Roger Longbotham, Dan Sommerfield, and Randal\u00a0M Henne. 2009. Controlled experiments on the web: survey and practical guide. Data mining and knowledge discovery 18, 1 (2009), 140\u2013181."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:MACH.0000035473.11134.83"},{"key":"e_1_3_2_1_24_1","volume-title":"CA","author":"Kohavi Ronny","year":"2004","unstructured":"Ronny Kohavi and Matt Round . 2004. Front line internet analytics at Amazon. com. Santa Barbara , CA ( 2004 ). Ronny Kohavi and Matt Round. 2004. Front line internet analytics at Amazon. com. Santa Barbara, CA (2004)."},{"volume-title":"Testing statistical hypotheses","author":"Lehmann L","key":"e_1_3_2_1_25_1","unstructured":"Erich\u00a0 L Lehmann and Joseph\u00a0 P Romano . 2006. Testing statistical hypotheses . Springer Science & Business Media . Erich\u00a0L Lehmann and Joseph\u00a0P Romano. 2006. Testing statistical hypotheses. Springer Science & Business Media."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330676"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Tie-Yan Liu 2009. Learning to rank for information retrieval. Foundations and Trends\u00ae in Information Retrieval 3 3(2009) 225\u2013331.  Tie-Yan Liu 2009. Learning to rank for information retrieval. Foundations and Trends\u00ae in Information Retrieval 3 3(2009) 225\u2013331.","DOI":"10.1561\/1500000016"},{"key":"e_1_3_2_1_28_1","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781(2013).  Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781(2013)."},{"key":"e_1_3_2_1_29_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg\u00a0S Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111\u20133119.  Tomas Mikolov Ilya Sutskever Kai Chen Greg\u00a0S Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111\u20133119."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Bhaskar Mitra Nick Craswell 2018. An introduction to neural information retrieval. Foundations and Trends\u00ae in Information Retrieval 13 1(2018) 1\u2013126.  Bhaskar Mitra Nick Craswell 2018. An introduction to neural information retrieval. Foundations and Trends\u00ae in Information Retrieval 13 1(2018) 1\u2013126.","DOI":"10.1561\/1500000061"},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning. 2603\u20132612","author":"Nguyen Quynh","year":"2017","unstructured":"Quynh Nguyen and Matthias Hein . 2017 . The loss surface of deep and wide neural networks . In Proceedings of the 34th International Conference on Machine Learning. 2603\u20132612 . Quynh Nguyen and Matthias Hein. 2017. The loss surface of deep and wide neural networks. In Proceedings of the 34th International Conference on Machine Learning. 2603\u20132612."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-017-9321-y"},{"key":"e_1_3_2_1_34_1","unstructured":"Tomaso Poggio and Qianli Liao. 2017. Theory II: Landscape of the empirical risk in deep learning. Ph.D. Dissertation. Center for Brains Minds and Machines (CBMM) arXiv.  Tomaso Poggio and Qianli Liao. 2017. Theory II: Landscape of the empirical risk in deep learning. Ph.D. Dissertation. Center for Brains Minds and Machines (CBMM) arXiv."},{"key":"e_1_3_2_1_35_1","unstructured":"Rohan Ramanath Gungor Polatkan Liqin Xu Harold Lee Bo Hu and Shan Zhou. 2018. Deploying deep ranking models for search verticals. arXiv preprint arXiv:1806.02281(2018).  Rohan Ramanath Gungor Polatkan Liqin Xu Harold Lee Bo Hu and Shan Zhou. 2018. Deploying deep ranking models for search verticals. arXiv preprint arXiv:1806.02281(2018)."},{"key":"e_1_3_2_1_36_1","volume-title":"Selfieboost: A boosting algorithm for deep learning. arXiv preprint arXiv:1411.3436(2014).","author":"Shalev-Shwartz Shai","year":"2014","unstructured":"Shai Shalev-Shwartz . 2014 . Selfieboost: A boosting algorithm for deep learning. arXiv preprint arXiv:1411.3436(2014). Shai Shalev-Shwartz. 2014. Selfieboost: A boosting algorithm for deep learning. arXiv preprint arXiv:1411.3436(2014)."},{"key":"e_1_3_2_1_37_1","unstructured":"Daniel Soudry and Yair Carmon. 2016. No bad local minima: Data independent training error guarantees for multilayer neural networks. arXiv preprint arXiv:1605.08361(2016).  Daniel Soudry and Yair Carmon. 2016. No bad local minima: Data independent training error guarantees for multilayer neural networks. arXiv preprint arXiv:1605.08361(2016)."},{"key":"e_1_3_2_1_38_1","unstructured":"Daniel Soudry and Elad Hoffer. 2017. Exponentially vanishing sub-optimal local minima in multilayer neural networks. arXiv preprint arXiv:1702.05777(2017).  Daniel Soudry and Elad Hoffer. 2017. Exponentially vanishing sub-optimal local minima in multilayer neural networks. arXiv preprint arXiv:1702.05777(2017)."},{"key":"e_1_3_2_1_39_1","unstructured":"Danny Sullivan. 2016. FAQ: All about the Google RankBrain algorithm. Google\u2019s using a machine learning technology called RankBrain to help deliver its search results. Here\u2019s what\u2019s we know about it.[cited 2018 May 15] Available from: https:\/\/searchengineland. com\/faq-all-about-the-new-google-rankbrain-algorithm-234440(2016).  Danny Sullivan. 2016. FAQ: All about the Google RankBrain algorithm. Google\u2019s using a machine learning technology called RankBrain to help deliver its search results. Here\u2019s what\u2019s we know about it.[cited 2018 May 15] Available from: https:\/\/searchengineland. com\/faq-all-about-the-new-google-rankbrain-algorithm-234440(2016)."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835810"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911537"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159732"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390306"}],"event":{"name":"WWW '20: The Web Conference 2020","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"],"location":"Taipei Taiwan","acronym":"WWW '20"},"container-title":["Proceedings of The Web Conference 2020"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366423.3380030","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3366423.3380030","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:33:16Z","timestamp":1750199596000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366423.3380030"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,20]]},"references-count":42,"alternative-id":["10.1145\/3366423.3380030","10.1145\/3366423"],"URL":"https:\/\/doi.org\/10.1145\/3366423.3380030","relation":{},"subject":[],"published":{"date-parts":[[2020,4,20]]},"assertion":[{"value":"2020-04-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}