{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:12:57Z","timestamp":1750219977440,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T00:00:00Z","timestamp":1691107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,6]]},"DOI":"10.1145\/3580305.3599781","type":"proceedings-article","created":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T18:13:58Z","timestamp":1691172838000},"page":"3877-3888","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Binary Classifier Evaluation on Unlabeled Segments using Inverse Distance Weighting with Distance Learning"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3422-0127","authenticated-orcid":false,"given":"Xu","family":"Chen","sequence":"first","affiliation":[{"name":"Meta, Menlo Park, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0509-4224","authenticated-orcid":false,"given":"Katerina","family":"Marazopoulou","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6903-1043","authenticated-orcid":false,"given":"Wesley","family":"Lee","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8389-1288","authenticated-orcid":false,"given":"Christine","family":"Agarwal","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1045-4267","authenticated-orcid":false,"given":"Jason","family":"Sukumaran","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6492-2488","authenticated-orcid":false,"given":"Aude","family":"Hofleitner","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,8,4]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. JMLR Workshop and Conference Proceedings, 93--100","author":"Agarwal Deepak","year":"2011","unstructured":"Deepak Agarwal , Lihong Li , and Alexander Smola . 2011 . Linear-time estimators for propensity scores . In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. JMLR Workshop and Conference Proceedings, 93--100 . Deepak Agarwal, Lihong Li, and Alexander Smola. 2011. Linear-time estimators for propensity scores. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. JMLR Workshop and Conference Proceedings, 93--100."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_2_1","DOI":"10.1016\/0098-3004(96)00021-0"},{"key":"e_1_3_2_1_3_1","article-title":"Discriminative learning under covariate shift","volume":"10","author":"Bickel Steffen","year":"2009","unstructured":"Steffen Bickel , Michael Br\u00fcckner , and Tobias Scheffer . 2009 . Discriminative learning under covariate shift . Journal of Machine Learning Research , Vol. 10 , 9 (2009). Steffen Bickel, Michael Br\u00fcckner, and Tobias Scheffer. 2009. Discriminative learning under covariate shift. Journal of Machine Learning Research, Vol. 10, 9 (2009).","journal-title":"Journal of Machine Learning Research"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_4_1","DOI":"10.1007\/s10333-012-0319-1"},{"key":"e_1_3_2_1_5_1","volume-title":"Nicholas IM Gould, and Philippe L Toint","author":"Conn Andrew R","year":"2000","unstructured":"Andrew R Conn , Nicholas IM Gould, and Philippe L Toint . 2000 . Trust region methods. SIAM. Andrew R Conn, Nicholas IM Gould, and Philippe L Toint. 2000. Trust region methods. SIAM."},{"volume-title":"Statistics for spatial data","author":"Cressie Noel","unstructured":"Noel Cressie . 2015. Statistics for spatial data . John Wiley & Sons , Chapter 3. Noel Cressie. 2015. Statistics for spatial data. John Wiley & Sons, Chapter 3.","key":"e_1_3_2_1_6_1"},{"unstructured":"Antigone Davis. 2021. How Meta Is Working to Provide Safe Age-Appropriate Experiences for Teens. https:\/\/about.fb.com\/news\/2023\/01\/providing-safe-experiences-for-teens\/.  Antigone Davis. 2021. How Meta Is Working to Provide Safe Age-Appropriate Experiences for Teens. https:\/\/about.fb.com\/news\/2023\/01\/providing-safe-experiences-for-teens\/.","key":"e_1_3_2_1_7_1"},{"unstructured":"Pavni Diwanji. 2021. How Do We Know Someone Is Old Enough to Use Our Apps? https:\/\/about.fb.com\/news\/2021\/07\/age-verification\/.  Pavni Diwanji. 2021. How Do We Know Someone Is Old Enough to Use Our Apps? https:\/\/about.fb.com\/news\/2021\/07\/age-verification\/.","key":"e_1_3_2_1_8_1"},{"unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml  Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml","key":"e_1_3_2_1_9_1"},{"unstructured":"Jeffrey Dunn. 2016. Introducing FBLearner Flow: Facebook's AI backbone. https:\/\/engineering.fb.com\/2016\/05\/09\/core-data\/introducing-fblearner-flow-facebook-s-ai-backbone\/.  Jeffrey Dunn. 2016. Introducing FBLearner Flow: Facebook's AI backbone. https:\/\/engineering.fb.com\/2016\/05\/09\/core-data\/introducing-fblearner-flow-facebook-s-ai-backbone\/.","key":"e_1_3_2_1_10_1"},{"key":"e_1_3_2_1_11_1","volume-title":"The jackknife estimate of variance. The Annals of Statistics","author":"Efron Bradley","year":"1981","unstructured":"Bradley Efron and Charles Stein . 1981. The jackknife estimate of variance. The Annals of Statistics ( 1981 ), 586--596. Bradley Efron and Charles Stein. 1981. The jackknife estimate of variance. The Annals of Statistics (1981), 586--596."},{"key":"e_1_3_2_1_12_1","volume-title":"Multiple regression analysis. Mathematical methods for digital computers","author":"Efroymson Michael Alin","year":"1960","unstructured":"Michael Alin Efroymson . 1960. Multiple regression analysis. Mathematical methods for digital computers ( 1960 ), 191--203. Michael Alin Efroymson. 1960. Multiple regression analysis. Mathematical methods for digital computers (1960), 191--203."},{"unstructured":"Erica Finkle. 2022. Bringing Age Verification to Facebook Dating. https:\/\/about.fb.com\/news\/2022\/12\/facebook-dating-age-verification\/.  Erica Finkle. 2022. Bringing Age Verification to Facebook Dating. https:\/\/about.fb.com\/news\/2022\/12\/facebook-dating-age-verification\/.","key":"e_1_3_2_1_13_1"},{"unstructured":"Erica Finkle Sheng Luo Christine Agarwal and Dave Fryer. 2022. How Meta uses AI to better understand people's ages on our platforms. https:\/\/tech.fb.com\/artificial-intelligence\/2022\/06\/adult-classifier\/.  Erica Finkle Sheng Luo Christine Agarwal and Dave Fryer. 2022. How Meta uses AI to better understand people's ages on our platforms. https:\/\/tech.fb.com\/artificial-intelligence\/2022\/06\/adult-classifier\/.","key":"e_1_3_2_1_14_1"},{"key":"e_1_3_2_1_15_1","volume-title":"Correcting sample selection bias by unlabeled data. Advances in neural information processing systems","author":"Huang Jiayuan","year":"2006","unstructured":"Jiayuan Huang , Arthur Gretton , Karsten Borgwardt , Bernhard Sch\u00f6lkopf , and Alex Smola . 2006. Correcting sample selection bias by unlabeled data. Advances in neural information processing systems , Vol. 19 ( 2006 ). Jiayuan Huang, Arthur Gretton, Karsten Borgwardt, Bernhard Sch\u00f6lkopf, and Alex Smola. 2006. Correcting sample selection bias by unlabeled data. Advances in neural information processing systems, Vol. 19 (2006)."},{"unstructured":"Instagram. 2021. Giving Young People a Safer More Private Experience on Instagram. https:\/\/about.fb.com\/news\/2021\/07\/instagram-safe-and-private-for-young-people\/.  Instagram. 2021. Giving Young People a Safer More Private Experience on Instagram. https:\/\/about.fb.com\/news\/2021\/07\/instagram-safe-and-private-for-young-people\/.","key":"e_1_3_2_1_16_1"},{"unstructured":"Instagram. 2022. Introducing New Ways to Verify Age on Instagram. https:\/\/about.fb.com\/news\/2022\/06\/new-ways-to-verify-age-on-instagram\/.  Instagram. 2022. Introducing New Ways to Verify Age on Instagram. https:\/\/about.fb.com\/news\/2022\/06\/new-ways-to-verify-age-on-instagram\/.","key":"e_1_3_2_1_17_1"},{"unstructured":"Andre G Journel and Charles J Huijbregts. 1976. Mining geostatistics. (1976).  Andre G Journel and Charles J Huijbregts. 1976. Mining geostatistics. (1976).","key":"e_1_3_2_1_18_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_19_1","DOI":"10.1007\/BF02289565"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_20_1","DOI":"10.18637\/jss.v028.i05"},{"unstructured":"Han Liu John Lafferty and Larry Wasserman. 2007. Sparse nonparametric density estimation in high dimensions using the rodeo. In Artificial Intelligence and Statistics. PMLR 283--290.  Han Liu John Lafferty and Larry Wasserman. 2007. Sparse nonparametric density estimation in high dimensions using the rodeo. In Artificial Intelligence and Statistics. PMLR 283--290.","key":"e_1_3_2_1_21_1"},{"key":"e_1_3_2_1_22_1","volume-title":"An adaptive inverse-distance weighting spatial interpolation technique. Computers & geosciences","author":"Lu George Y","year":"2008","unstructured":"George Y Lu and David W Wong . 2008. An adaptive inverse-distance weighting spatial interpolation technique. Computers & geosciences , Vol. 34 , 9 ( 2008 ), 1044--1055. George Y Lu and David W Wong. 2008. An adaptive inverse-distance weighting spatial interpolation technique. Computers & geosciences, Vol. 34, 9 (2008), 1044--1055."},{"unstructured":"Meta. 2022a. Continuing to Create Age-Appropriate Ad Experiences for Teens. https:\/\/about.fb.com\/news\/2023\/01\/age-appropriate-ads-for-teens\/.  Meta. 2022a. Continuing to Create Age-Appropriate Ad Experiences for Teens. https:\/\/about.fb.com\/news\/2023\/01\/age-appropriate-ads-for-teens\/.","key":"e_1_3_2_1_23_1"},{"unstructured":"Meta. 2022b. Protecting Teens and Their Privacy on Facebook and Instagram. https:\/\/about.fb.com\/news\/2022\/11\/protecting-teens-and-their-privacy-on-facebook-and-instagram\/.  Meta. 2022b. Protecting Teens and Their Privacy on Facebook and Instagram. https:\/\/about.fb.com\/news\/2022\/11\/protecting-teens-and-their-privacy-on-facebook-and-instagram\/.","key":"e_1_3_2_1_24_1"},{"unstructured":"Art B Owen. 2013. Monte Carlo theory methods and examples.  Art B Owen. 2013. Monte Carlo theory methods and examples.","key":"e_1_3_2_1_25_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_26_1","DOI":"10.1093\/biomet\/70.1.41"},{"key":"e_1_3_2_1_27_1","volume-title":"Balance: A python package for balancing biased data samples. https:\/\/import-balance.org\/.","author":"Sarig Tal","year":"2023","unstructured":"Tal Sarig , Tal Galili , and Steve Mandala . 2023 . Balance: A python package for balancing biased data samples. https:\/\/import-balance.org\/. Tal Sarig, Tal Galili, and Steve Mandala. 2023. Balance: A python package for balancing biased data samples. https:\/\/import-balance.org\/."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_28_1","DOI":"10.1109\/ICDE.2019.00196"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_29_1","DOI":"10.1145\/800186.810616"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_30_1","DOI":"10.1016\/S0378-3758(00)00115-4"},{"unstructured":"Mike Starr. 2014. Dataswarm. https:\/\/pyvideo.org\/pydata-silicon-valley-2014\/mike-starr-dataswarm.html.  Mike Starr. 2014. Dataswarm. https:\/\/pyvideo.org\/pydata-silicon-valley-2014\/mike-starr-dataswarm.html.","key":"e_1_3_2_1_31_1"},{"volume-title":"Interpolation of spatial data: some theory for kriging","author":"Stein Michael L","unstructured":"Michael L Stein . 1999. Interpolation of spatial data: some theory for kriging . Springer Science & Business Media , Chapter 3. Michael L Stein. 1999. Interpolation of spatial data: some theory for kriging. Springer Science & Business Media, Chapter 3.","key":"e_1_3_2_1_32_1"},{"key":"e_1_3_2_1_33_1","article-title":"a. Covariate shift adaptation by importance weighted cross validation","volume":"8","author":"Sugiyama Masashi","year":"2007","unstructured":"Masashi Sugiyama , Matthias Krauledat , and Klaus-Robert M\u00fcller . 2007 a. Covariate shift adaptation by importance weighted cross validation . Journal of Machine Learning Research , Vol. 8 , 5 (2007). Masashi Sugiyama, Matthias Krauledat, and Klaus-Robert M\u00fcller. 2007 a. Covariate shift adaptation by importance weighted cross validation. Journal of Machine Learning Research, Vol. 8, 5 (2007).","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_34_1","volume-title":"2007 b. Direct importance estimation with model selection and its application to covariate shift adaptation. Advances in neural information processing systems","author":"Sugiyama Masashi","year":"2007","unstructured":"Masashi Sugiyama , Shinichi Nakajima , Hisashi Kashima , Paul Buenau , and Motoaki Kawanabe . 2007 b. Direct importance estimation with model selection and its application to covariate shift adaptation. Advances in neural information processing systems , Vol. 20 ( 2007 ). Masashi Sugiyama, Shinichi Nakajima, Hisashi Kashima, Paul Buenau, and Motoaki Kawanabe. 2007 b. Direct importance estimation with model selection and its application to covariate shift adaptation. Advances in neural information processing systems, Vol. 20 (2007)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_35_1","DOI":"10.14778\/1687553.1687609"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_36_1","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_37_1","DOI":"10.1002\/wics.1461"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_38_1","DOI":"10.1145\/1015330.1015425"}],"event":{"sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"],"acronym":"KDD '23","name":"KDD '23: The 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Long Beach CA USA"},"container-title":["Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580305.3599781","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580305.3599781","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:22Z","timestamp":1750182562000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580305.3599781"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,4]]},"references-count":38,"alternative-id":["10.1145\/3580305.3599781","10.1145\/3580305"],"URL":"https:\/\/doi.org\/10.1145\/3580305.3599781","relation":{},"subject":[],"published":{"date-parts":[[2023,8,4]]},"assertion":[{"value":"2023-08-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}