{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T01:28:25Z","timestamp":1772846905984,"version":"3.50.1"},"reference-count":48,"publisher":"MIT Press","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2013,5]]},"abstract":"<jats:p>Divergence estimators based on direct approximation of density ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution comparison such as outlier detection, transfer learning, and two-sample homogeneity test. However, since density-ratio functions often possess high fluctuation, divergence estimation is a challenging task in practice. In this letter, we use relative divergences for distribution comparison, which involves approximation of relative density ratios. Since relative density ratios are always smoother than corresponding ordinary density ratios, our proposed method is favorable in terms of nonparametric convergence speed. Furthermore, we show that the proposed divergence estimator has asymptotic variance independent of the model complexity under a parametric setup, implying that the proposed estimator hardly overfits even with complex models. Through experiments, we demonstrate the usefulness of the proposedapproach.<\/jats:p>","DOI":"10.1162\/neco_a_00442","type":"journal-article","created":{"date-parts":[[2013,4,2]],"date-time":"2013-04-02T20:13:16Z","timestamp":1364933596000},"page":"1324-1370","source":"Crossref","is-referenced-by-count":99,"title":["Relative Density-Ratio Estimation for Robust Distribution Comparison"],"prefix":"10.1162","volume":"25","author":[{"given":"Makoto","family":"Yamada","sequence":"first","affiliation":[{"name":"NTT Communication Science Laboratories, NTT Corporation, Seika-cho, Kyoto, 619-0237, Japan"}]},{"given":"Taiji","family":"Suzuki","sequence":"additional","affiliation":[{"name":"Department of Mathematical Informatics, University of Tokyo, Bunkyo-ku, Tokyo, 113-8656, Japan"}]},{"given":"Takafumi","family":"Kanamori","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Mathematical Informatics, Nagoya University, Chikusa-ku, Nagoya, Aichi, 464-8601, Japan"}]},{"given":"Hirotaka","family":"Hachiya","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Tokyo Institute of Technology, Meguro-ku, Tokyo, 152-8552, Japan"}]},{"given":"Masashi","family":"Sugiyama","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Tokyo Institute of Technology, Meguro-ku, Tokyo, 152-8552, Japan"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1111\/j.2517-6161.1966.tb00626.x","volume":"28","author":"Ali S. M.","year":"1966","journal-title":"Journal of the Royal Statistical Society, Series B"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1090\/S0002-9947-1950-0051437-7"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24646-6_1"},{"key":"B4","first-page":"79","volume-title":"Proceedings of the 2nd International Forum on Applied Wearable Computing","author":"Bharatula N. B.","year":"2005"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390164"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btl242"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9780262033589.001.0001"},{"key":"B10","first-page":"442","volume-title":"Advances in neural information processing systems 23","author":"Cortes C.","year":"2010"},{"key":"B11","first-page":"229","volume":"2","author":"Csisz\u00e1r I.","year":"1967","journal-title":"Studia Scientiarum Mathematicarum Hungarica"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2553-7"},{"key":"B14","doi-asserted-by":"crossref","first-page":"513","DOI":"10.7551\/mitpress\/7503.003.0069","volume-title":"Advances in neural information processing systems, 19","author":"Gretton A.","year":"2007"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-010-0283-2"},{"key":"B16","first-page":"264","volume-title":"Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics","author":"Jiang J.","year":"2007"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.1998.674423"},{"key":"B18","first-page":"1391","volume":"10","author":"Kanamori T.","year":"2009","journal-title":"Journal of Machine Learning Research"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.20965\/jaciii.2011.p0800"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729694"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2010.2068870"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1080\/14786440009463897"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007618119488"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1515\/9781400873173"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1162\/089976601750264965"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1016\/S0378-3758(00)00115-4"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.2197\/ipsjtcva.3.1"},{"key":"B29","first-page":"536","volume-title":"Proceedings of the Twelfth International Conference on Artificial Intelligence and Statistics (AISTATS2009)","author":"Smola A.","year":"2009"},{"key":"B30","first-page":"1750","volume-title":"Advances in neural information processing systems, 22","author":"Sriperumbudur B.","year":"2009"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1214\/009053606000001226"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.E93.D.2690"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9780262017091.001.0001"},{"key":"B34","first-page":"985","volume":"8","author":"Sugiyama M.","year":"2007","journal-title":"Journal of Machine Learning Research"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1524\/stnd.2005.23.4.249"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.E94.D.1333"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2011.04.003"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1007\/s10463-008-0197-x"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.E93.D.583"},{"key":"B40","first-page":"804","volume-title":"Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS2010)","author":"Suzuki T.","year":"2010"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00062"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-10-S1-S52"},{"key":"B43","volume-title":"Empirical processes in M-estimation","author":"van de Geer S.","year":"2000"},{"key":"B44","volume-title":"Asymptotic statistics","author":"van der Vaart A. W.","year":"2000"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2545-2"},{"key":"B46","volume-title":"Statistical learning theory","author":"Vapnik V. N.","year":"1998"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611970128"},{"key":"B48","first-page":"643","volume-title":"Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI2010)","author":"Yamada M.","year":"2010"},{"key":"B49","volume-title":"Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics","author":"Yamada M.","year":"2011"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00442","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,8]],"date-time":"2024-05-08T07:21:09Z","timestamp":1715152869000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/25\/5\/1324-1370\/7871"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,5]]},"references-count":48,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2013,5]]}},"alternative-id":["10.1162\/NECO_a_00442"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00442","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,5]]}}}