{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T16:09:27Z","timestamp":1774541367454,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":31,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,2,2]],"date-time":"2017-02-02T00:00:00Z","timestamp":1485993600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,2,2]]},"DOI":"10.1145\/3018661.3018708","type":"proceedings-article","created":{"date-parts":[[2017,2,2]],"date-time":"2017-02-02T20:09:48Z","timestamp":1486066188000},"page":"651-659","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Learning Sensitive Combinations of A\/B Test Metrics"],"prefix":"10.1145","author":[{"given":"Eugene","family":"Kharitonov","sequence":"first","affiliation":[{"name":"Criteo, Paris, France"}]},{"given":"Alexey","family":"Drutsa","sequence":"additional","affiliation":[{"name":"Yandex, Moscow, Russian Fed."}]},{"given":"Pavel","family":"Serdyukov","sequence":"additional","affiliation":[{"name":"Yandex, Moscow, Russian Fed."}]}],"member":"320","published-online":{"date-parts":[[2017,2,2]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2488218"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609535"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2094072.2094078"},{"key":"e_1_3_2_1_4_1","volume-title":"Technometrics","author":"Clemmensen L.","year":"2012","unstructured":"L. Clemmensen , T. Hastie , D. Witten , and B. Ersb\u00f8ll . Sparse discriminant analysis . Technometrics , 2012 . L. Clemmensen, T. Hastie, D. Witten, and B. Ersb\u00f8ll. Sparse discriminant analysis. Technometrics, 2012."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb050097"},{"key":"e_1_3_2_1_6_1","unstructured":"A. Deng J. Lu and S. Chen. Continuous Monitoring of A\/B Tests without Pain: Optional Stopping in Bayesian Testing. ArXiv e-prints.  A. Deng J. Lu and S. Chen. Continuous Monitoring of A\/B Tests without Pain: Optional Stopping in Bayesian Testing. ArXiv e-prints."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939700"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433413"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741116"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806496"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433418"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-1809.1936.tb02137.x"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02985802"},{"key":"e_1_3_2_1_14_1","volume-title":"Always valid inference: Bringing sequential analysis to A\/B testing. arXiv preprint arXiv:1512.04922","author":"Johari R.","year":"2015","unstructured":"R. Johari , L. Pekelis , and D. J. Walsh . Always valid inference: Bringing sequential analysis to A\/B testing. arXiv preprint arXiv:1512.04922 , 2015 . R. Johari, L. Pekelis, and D. J. Walsh. Always valid inference: Bringing sequential analysis to A\/B testing. arXiv preprint arXiv:1512.04922, 2015."},{"key":"e_1_3_2_1_15_1","volume-title":"SciPy: Open source scientific tools for Python","author":"Jones E.","year":"2001","unstructured":"E. Jones , T. Oliphant , and P. Peterson . SciPy: Open source scientific tools for Python , 2001 --. URL http:\/\/www. scipy. org, 2016. E. Jones, T. Oliphant, and P. Peterson. SciPy: Open source scientific tools for Python, 2001--. URL http:\/\/www. scipy. org, 2016."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806477"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767729"},{"key":"e_1_3_2_1_18_1","volume-title":"Online experimentation at Microsoft. Data Mining Case Studies, page 11","author":"Kohavi R.","year":"2009","unstructured":"R. Kohavi , T. Crook , R. Longbotham , B. Frasca , R. Henne , J. L. Ferres , and T. Melamed . Online experimentation at Microsoft. Data Mining Case Studies, page 11 , 2009 . R. Kohavi, T. Crook, R. Longbotham, B. Frasca, R. Henne, J. L. Ferres, and T. Melamed. Online experimentation at Microsoft. Data Mining Case Studies, page 11, 2009."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339653"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2488217"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623341"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-008-0114-1"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939688"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458092"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000009"},{"key":"e_1_3_2_1_26_1","volume-title":"Fisher discriminant analysis with kernels. Neural networks for signal processing IX, 1(1):1","author":"Scholkopft B.","year":"1999","unstructured":"B. Scholkopft and K.-R. Mullert . Fisher discriminant analysis with kernels. Neural networks for signal processing IX, 1(1):1 , 1999 . B. Scholkopft and K.-R. Mullert. Fisher discriminant analysis with kernels. Neural networks for signal processing IX, 1(1):1, 1999."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767695"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835810"},{"key":"e_1_3_2_1_29_1","first-page":"1","article-title":"Fisher linear discriminant analysis. Technical report, Department of Computer Science","volume":"3","author":"Welling M.","year":"2005","unstructured":"M. Welling . Fisher linear discriminant analysis. Technical report, Department of Computer Science , University of Toronto , 3 : 1 -- 4 , 2005 . M. Welling. Fisher linear discriminant analysis. Technical report, Department of Computer Science, University of Toronto, 3:1--4, 2005.","journal-title":"University of Toronto"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939733"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835534"}],"event":{"name":"WSDM 2017: Tenth ACM International Conference on Web Search and Data Mining","location":"Cambridge United Kingdom","acronym":"WSDM 2017","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the Tenth ACM International Conference on Web Search and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3018661.3018708","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3018661.3018708","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:24:09Z","timestamp":1750220649000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3018661.3018708"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,2,2]]},"references-count":31,"alternative-id":["10.1145\/3018661.3018708","10.1145\/3018661"],"URL":"https:\/\/doi.org\/10.1145\/3018661.3018708","relation":{},"subject":[],"published":{"date-parts":[[2017,2,2]]},"assertion":[{"value":"2017-02-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}