{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:20:42Z","timestamp":1750220442737,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":34,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,8]]},"DOI":"10.1145\/3437963.3441779","type":"proceedings-article","created":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T04:34:28Z","timestamp":1615005268000},"page":"202-210","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["CONQ: CONtinuous Quantile Treatment Effects for Large-Scale Online Controlled Experiments"],"prefix":"10.1145","author":[{"given":"Weinan","family":"Wang","sequence":"first","affiliation":[{"name":"Snap Inc., Santa Monica, CA, USA"}]},{"given":"Xi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Snap Inc., Santa Monica, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,3,8]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177699450"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2567967"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"volume-title":"Statistical decision theory and Bayesian analysis","author":"Berger James O","key":"e_1_3_2_1_4_1","unstructured":"James O Berger . 2013. Statistical decision theory and Bayesian analysis . Springer Science & Business Media . James O Berger. 2013. Statistical decision theory and Bayesian analysis .Springer Science & Business Media."},{"volume-title":"Mathematical methods of statistics","author":"Cram\u00e9r Harald","key":"e_1_3_2_1_5_1","unstructured":"Harald Cram\u00e9r . 1999. Mathematical methods of statistics . Vol. 43 . Princeton university press . Harald Cram\u00e9r. 1999. Mathematical methods of statistics. Vol. 43. Princeton university press."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219919"},{"key":"e_1_3_2_1_7_1","volume-title":"Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. The Annals of Mathematical Statistics","author":"Dvoretzky Aryeh","year":"1956","unstructured":"Aryeh Dvoretzky , Jack Kiefer , and Jacob Wolfowitz . 1956. Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. The Annals of Mathematical Statistics ( 1956 ), 642--669. Aryeh Dvoretzky, Jack Kiefer, and Jacob Wolfowitz. 1956. Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. The Annals of Mathematical Statistics (1956), 642--669."},{"key":"e_1_3_2_1_8_1","volume-title":"Roma Bins, Kay Kirlin IV, and Destiny Carroll.","author":"George EP","year":"2005","unstructured":"EP George , J Stuart Hunter , William Gordon Hunter , Roma Bins, Kay Kirlin IV, and Destiny Carroll. 2005 . Statistics for experimenters: design, innovation, and discovery. Wiley New York . EP George, J Stuart Hunter, William Gordon Hunter, Roma Bins, Kay Kirlin IV, and Destiny Carroll. 2005. Statistics for experimenters: design, innovation, and discovery. Wiley New York."},{"volume-title":"Field experiments: Design, analysis, and interpretation","author":"Gerber Alan S","key":"e_1_3_2_1_9_1","unstructured":"Alan S Gerber and Donald P Green . 2012. Field experiments: Design, analysis, and interpretation . WW Norton . Alan S Gerber and Donald P Green. 2012. Field experiments: Design, analysis, and interpretation .WW Norton."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.1988.10475581"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeconom.2019.02.001"},{"key":"e_1_3_2_1_12_1","volume-title":"Sequential estimation of quantiles with applications to A\/B-testing and best-arm identification. arXiv preprint arXiv:1906.09712","author":"Howard Steven R","year":"2019","unstructured":"Steven R Howard and Aaditya Ramdas . 2019. Sequential estimation of quantiles with applications to A\/B-testing and best-arm identification. arXiv preprint arXiv:1906.09712 ( 2019 ). Steven R Howard and Aaditya Ramdas. 2019. Sequential estimation of quantiles with applications to A\/B-testing and best-arm identification. arXiv preprint arXiv:1906.09712 (2019)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1080\/10618600.2000.10474866","article-title":"Quantile regression via an MM algorithm","volume":"9","author":"Hunter David R","year":"2000","unstructured":"David R Hunter and Kenneth Lange . 2000 . Quantile regression via an MM algorithm . Journal of Computational and Graphical Statistics , Vol. 9 , 1 (2000), 60 -- 77 . David R Hunter and Kenneth Lange. 2000. Quantile regression via an MM algorithm. Journal of Computational and Graphical Statistics, Vol. 9, 1 (2000), 60--77.","journal-title":"Journal of Computational and Graphical Statistics"},{"volume-title":"Causal inference in statistics, social, and biomedical sciences","author":"Imbens Guido W","key":"e_1_3_2_1_14_1","unstructured":"Guido W Imbens and Donald B Rubin . 2015. Causal inference in statistics, social, and biomedical sciences . Cambridge University Press . Guido W Imbens and Donald B Rubin. 2015. Causal inference in statistics, social, and biomedical sciences. Cambridge University Press."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3097992"},{"key":"e_1_3_2_1_16_1","volume-title":"Always valid inference: Bringing sequential analysis to A\/B testing. arXiv preprint arXiv:1512.04922","author":"Johari Ramesh","year":"2015","unstructured":"Ramesh Johari , Leo Pekelis , and David J Walsh . 2015. Always valid inference: Bringing sequential analysis to A\/B testing. arXiv preprint arXiv:1512.04922 ( 2015 ). Ramesh Johari, Leo Pekelis, and David J Walsh. 2015. Always valid inference: Bringing sequential analysis to A\/B testing. arXiv preprint arXiv:1512.04922 (2015)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177698690"},{"key":"e_1_3_2_1_18_1","volume-title":"1970 a. Deviations between the sample quantile process and the sample df. Nonparametric Techniques in Statistical Inference","author":"Kiefer J","year":"1970","unstructured":"J Kiefer . 1970 a. Deviations between the sample quantile process and the sample df. Nonparametric Techniques in Statistical Inference ( 1970 ), 299--319. J Kiefer. 1970 a. Deviations between the sample quantile process and the sample df. Nonparametric Techniques in Statistical Inference (1970), 299--319."},{"key":"e_1_3_2_1_19_1","volume-title":"1970 b. Old and new methods for studying order statistics and sample quantiles. Nonparametric Techniques in Statistical Inference","author":"Kiefer J","year":"1970","unstructured":"J Kiefer . 1970 b. Old and new methods for studying order statistics and sample quantiles. Nonparametric Techniques in Statistical Inference ( 1970 ), 349--357. J Kiefer. 1970 b. Old and new methods for studying order statistics and sample quantiles. Nonparametric Techniques in Statistical Inference (1970), 349--357."},{"key":"e_1_3_2_1_20_1","volume-title":"A scalable bootstrap for massive data. Journal of the Royal Statistical Society: Series B: Statistical Methodology","author":"Kleiner Ariel","year":"2014","unstructured":"Ariel Kleiner , Ameet Talwalkar , Purnamrita Sarkar , and Michael I Jordan . 2014. A scalable bootstrap for massive data. Journal of the Royal Statistical Society: Series B: Statistical Methodology ( 2014 ), 795--816. Ariel Kleiner, Ameet Talwalkar, Purnamrita Sarkar, and Michael I Jordan. 2014. A scalable bootstrap for massive data. Journal of the Royal Statistical Society: Series B: Statistical Methodology (2014), 795--816."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.15.4.143"},{"key":"e_1_3_2_1_22_1","first-page":"39","article-title":"Online experimentation at Microsoft","volume":"11","author":"Kohavi Ronny","year":"2009","unstructured":"Ronny Kohavi , Thomas Crook , and Roger Longbotham . 2009 . Online experimentation at Microsoft . Data Mining Case Studies , Vol. 11 , 2009 (2009), 39 . Ronny Kohavi, Thomas Crook, and Roger Longbotham. 2009. Online experimentation at Microsoft. Data Mining Case Studies, Vol. 11, 2009 (2009), 39.","journal-title":"Data Mining Case Studies"},{"key":"e_1_3_2_1_23_1","volume-title":"Large-Scale Online Experimentation with Quantile Metrics. arXiv preprint arXiv:1903.08762","author":"Liu Min","year":"2019","unstructured":"Min Liu , Xiaohui Sun , Maneesh Varshney , and Ya Xu. 2019. Large-Scale Online Experimentation with Quantile Metrics. arXiv preprint arXiv:1903.08762 ( 2019 ). Min Liu, Xiaohui Sun, Maneesh Varshney, and Ya Xu. 2019. Large-Scale Online Experimentation with Quantile Metrics. arXiv preprint arXiv:1903.08762 (2019)."},{"key":"e_1_3_2_1_24_1","unstructured":"Matthias Lux. [n.d.]. Analyzing Experiment Outcomes: Beyond Average Treatment Effects. ( [n. d.]). Matthias Lux. [n.d.]. Analyzing Experiment Outcomes: Beyond Average Treatment Effects. ( [n. d.])."},{"key":"e_1_3_2_1_25_1","volume-title":"The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. The annals of Probability","author":"Massart Pascal","year":"1990","unstructured":"Pascal Massart . 1990. The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. The annals of Probability ( 1990 ), 1269--1283. Pascal Massart. 1990. The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. The annals of Probability (1990), 1269--1283."},{"volume-title":"Density estimation for statistics and data analysis","author":"Silverman Bernard W","key":"e_1_3_2_1_26_1","unstructured":"Bernard W Silverman . 1986. Density estimation for statistics and data analysis . Vol. 26 . CRC press . Bernard W Silverman. 1986. Density estimation for statistics and data analysis. Vol. 26. CRC press."},{"key":"e_1_3_2_1_27_1","volume-title":"A note on Woodruff confidence intervals for quantiles. Statistics & probability letters","author":"Sitter Randy R","year":"2001","unstructured":"Randy R Sitter and Changbao Wu. 2001. A note on Woodruff confidence intervals for quantiles. Statistics & probability letters , Vol. 52 , 4 ( 2001 ), 353--358. Randy R Sitter and Changbao Wu. 2001. A note on Woodruff confidence intervals for quantiles. Statistics & probability letters, Vol. 52, 4 (2001), 353--358."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835810"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1952.10483443"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1214\/009053605000000291"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939733"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788602"},{"key":"e_1_3_2_1_33_1","unstructured":"Matei Zaharia Mosharaf Chowdhury Michael J Franklin Scott Shenker Ion Stoica etal [n.d.]. Spark: Cluster computing with working sets. ( [n. d.]). Matei Zaharia Mosharaf Chowdhury Michael J Franklin Scott Shenker Ion Stoica et al. [n.d.]. Spark: Cluster computing with working sets. ( [n. d.])."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934664"}],"event":{"name":"WSDM '21: The Fourteenth ACM International Conference on Web Search and Data Mining","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Virtual Event Israel","acronym":"WSDM '21"},"container-title":["Proceedings of the 14th ACM International Conference on Web Search and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437963.3441779","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3437963.3441779","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:35Z","timestamp":1750193255000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437963.3441779"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":34,"alternative-id":["10.1145\/3437963.3441779","10.1145\/3437963"],"URL":"https:\/\/doi.org\/10.1145\/3437963.3441779","relation":{},"subject":[],"published":{"date-parts":[[2021,3,8]]},"assertion":[{"value":"2021-03-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}