{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T10:23:34Z","timestamp":1775471014929,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":36,"publisher":"ACM","license":[{"start":{"date-parts":[[2013,8,11]],"date-time":"2013-08-11T00:00:00Z","timestamp":1376179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2013,8,11]]},"DOI":"10.1145\/2487575.2488215","type":"proceedings-article","created":{"date-parts":[[2013,8,13]],"date-time":"2013-08-13T12:31:21Z","timestamp":1376397081000},"page":"1294-1302","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Predictive model performance"],"prefix":"10.1145","author":[{"given":"Jeonghee","family":"Yi","sequence":"first","affiliation":[{"name":"Microsoft Corp., Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ye","family":"Chen","sequence":"additional","affiliation":[{"name":"Microsoft Corp., Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Li","sequence":"additional","affiliation":[{"name":"Microsoft Corp., Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Swaraj","family":"Sett","sequence":"additional","affiliation":[{"name":"Microsoft Corp., Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tak W.","family":"Yan","sequence":"additional","affiliation":[{"name":"Microsoft Corp., Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2013,8,11]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963464"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214501753168136"},{"issue":"10","key":"e_1_3_2_1_3_1","first-page":"13","article-title":"The use of relative operating characteristic (roc) curves in test performance evaluation","volume":"110","author":"Beck J. R.","year":"1986","unstructured":"J. R. Beck and E.K. Shultz . The use of relative operating characteristic (roc) curves in test performance evaluation . Archive of Pathological Lab Medicine , 110 ( 10 ): 13 -- 20 , Oct. 1986 . J. R. Beck and E.K. Shultz. The use of relative operating characteristic (roc) curves in test performance evaluation. Archive of Pathological Lab Medicine, 110(10):13--20, Oct. 1986.","journal-title":"Archive of Pathological Lab Medicine"},{"key":"e_1_3_2_1_4_1","volume-title":"Loss functions for binary class probability estimation: Structure and applications. technical report","author":"Buja A.","year":"2003","unstructured":"A. Buja , W. Stuetzle , and Y. Shen . Loss functions for binary class probability estimation: Structure and applications. technical report , 2003 . A. Buja, W. Stuetzle, and Y. Shen. Loss functions for binary class probability estimation: Structure and applications. technical report, 2003."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1014052.1014063"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367554"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187980.2188085"},{"key":"e_1_3_2_1_8_1","volume-title":"Proc. of NIPS","author":"Chen Y.","year":"2009","unstructured":"Y. Chen , D. Pavlov , M. Kapralov , and J. F. Canny . Factor modeling for advertisement targeting . In Proc. of NIPS , 2009 . Y. Chen, D. Pavlov, M. Kapralov, and J. F. Canny. Factor modeling for advertisement targeting. In Proc. of NIPS, 2009."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143874"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/347090.347126"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1257\/aer.97.1.242"},{"key":"e_1_3_2_1_12_1","volume-title":"Roc graphs: Notes and practical considerations for data mining researchers","author":"Fawcett T.","year":"2003","unstructured":"T. Fawcett . Roc graphs: Notes and practical considerations for data mining researchers , 2003 . T. Fawcett. Roc graphs: Notes and practical considerations for data mining researchers, 2003."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2008.08.010"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882471.1882479"},{"key":"e_1_3_2_1_15_1","volume-title":"Proc. of the 27th ICML Conference","author":"Graepel T.","year":"2010","unstructured":"T. Graepel , J.Q. Candela , T. Borchert , and R. Herbrich . Web-scale bayesian click-through rate eprediction for sponsored search advertising in microsoft's bing search engine . In Proc. of the 27th ICML Conference , 2010 . T. Graepel, J.Q. Candela, T. Borchert, and R. Herbrich. Web-scale bayesian click-through rate eprediction for sponsored search advertising in microsoft's bing search engine. In Proc. of the 27th ICML Conference, 2010."},{"key":"e_1_3_2_1_16_1","volume-title":"Proc. of SIGIR Workshop on Internet Advertising.","author":"Gupta N.","unstructured":"N. Gupta , U. Khurana , T. Lee , and S. Nawathe . Optimizing display advertisements based on historic user trails . In Proc. of SIGIR Workshop on Internet Advertising. N. Gupta, U. Khurana, T. Lee, and S. Nawathe. Optimizing display advertisements based on historic user trails. In Proc. of SIGIR Workshop on Internet Advertising."},{"key":"e_1_3_2_1_17_1","volume-title":"Applied logistic regression","author":"Hosmer D.W.","year":"2002","unstructured":"D.W. Hosmer and S. Lemeshow . Applied logistic regression . Wiley-Interscience Publication , 2002 . D.W. Hosmer and S. Lemeshow. Applied logistic regression. Wiley-Interscience Publication, 2002."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/345508.345545"},{"key":"e_1_3_2_1_19_1","volume-title":"On information and sufficiency. The annals of Mathematical Statistics, 22(1):79--86","author":"Kullback S.","year":"1951","unstructured":"S. Kullback and R.A. Leibler . On information and sufficiency. The annals of Mathematical Statistics, 22(1):79--86 , 1951 . S. Kullback and R.A. Leibler. On information and sufficiency. The annals of Mathematical Statistics, 22(1):79--86, 1951."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963419"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511800481.030"},{"key":"e_1_3_2_1_22_1","first-page":"1207","volume-title":"Proc. of the 17th ICML Conferende","author":"Langley P.","year":"2000","unstructured":"P. Langley . Crafting papers on machine learning . In Proc. of the 17th ICML Conferende , pages 1207 -- 1212 , 2000 . P. Langley. Crafting papers on machine learning. In Proc. of the 17th ICML Conferende, pages 1207--1212, 2000."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1466-8238.2007.00358.x"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367529"},{"key":"e_1_3_2_1_25_1","first-page":"1","volume-title":"The design of advertising exchanges","author":"McAfee R.","year":"2007","unstructured":"R. McAfee . The design of advertising exchanges . Review of Industrial Organization , pages 1 -- 17 , 2007 . R. McAfee. The design of advertising exchanges. Review of Industrial Organization, pages 1--17, 2007."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1416950.1416952"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1348599.1348603"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2124295.2124332"},{"key":"e_1_3_2_1_29_1","first-page":"445","volume-title":"Proc. of the 15th ICML Conference","author":"Provost F.","year":"1998","unstructured":"F. Provost , T. Fawcett , and R. Kohavi . The case against accuracy estimation for comparing induction algorithms . In Proc. of the 15th ICML Conference , pages 445 -- 453 , 1998 . F. Provost, T. Fawcett, and R. Kohavi. The case against accuracy estimation for comparing induction algorithms. In Proc. of the 15th ICML Conference, pages 445--453, 1998."},{"key":"e_1_3_2_1_30_1","volume-title":"Proc. of the ACM Electronic Commerce Conference","author":"Regelson M.","year":"2007","unstructured":"M. Regelson and D. C. Fain . Predicting click-through rate using keyword clusters . In Proc. of the ACM Electronic Commerce Conference , 2007 . M. Regelson and D. C. Fain. Predicting click-through rate using keyword clusters. In Proc. of the ACM Electronic Commerce Conference, 2007."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242643"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2124295.2124333"},{"key":"e_1_3_2_1_33_1","volume-title":"Measuring the accuracy of diagnostic systems. science, 240(4857):1285--93","author":"Swets John A.","year":"2008","unstructured":"John A. Swets . Measuring the accuracy of diagnostic systems. science, 240(4857):1285--93 , 2008 . John A. Swets. Measuring the accuracy of diagnostic systems. science, 240(4857):1285--93, 2008."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijindorg.2006.10.002"},{"key":"e_1_3_2_1_35_1","volume-title":"Proc. of the TREC Conference","author":"Voorhees E. M.","year":"1999","unstructured":"E. M. Voorhees . The trec-8 question answering track report . In Proc. of the TREC Conference , 1999 . E. M. Voorhees. The trec-8 question answering track report. In Proc. of the TREC Conference, 1999."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2124295.2124355"}],"event":{"name":"KDD' 13: The 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","location":"Chicago Illinois USA","acronym":"KDD' 13","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2487575.2488215","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2487575.2488215","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:39:29Z","timestamp":1750235969000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2487575.2488215"}},"subtitle":["offline and online evaluations"],"short-title":[],"issued":{"date-parts":[[2013,8,11]]},"references-count":36,"alternative-id":["10.1145\/2487575.2488215","10.1145\/2487575"],"URL":"https:\/\/doi.org\/10.1145\/2487575.2488215","relation":{},"subject":[],"published":{"date-parts":[[2013,8,11]]},"assertion":[{"value":"2013-08-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}