{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T09:29:39Z","timestamp":1751362179331},"reference-count":49,"publisher":"MIT Press - Journals","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p> Recent advances in weakly supervised classification allow us to train a classifier from only positive and unlabeled (PU) data. However, existing PU classification methods typically require an accurate estimate of the class-prior probability, a critical bottleneck particularly for high-dimensional data. This problem has been commonly addressed by applying principal component analysis in advance, but such unsupervised dimension reduction can collapse the underlying class structure. In this letter, we propose a novel representation learning method from PU data based on the information-maximization principle. Our method does not require class-prior estimation and thus can be used as a preprocessing method for PU classification. Through experiments, we demonstrate that our method, combined with deep neural networks, highly improves the accuracy of PU class-prior estimation, leading to state-of-the-art PU classification performance. <\/jats:p>","DOI":"10.1162\/neco_a_01337","type":"journal-article","created":{"date-parts":[[2020,10,20]],"date-time":"2020-10-20T21:25:44Z","timestamp":1603229144000},"page":"244-268","source":"Crossref","is-referenced-by-count":2,"title":["Information-Theoretic Representation Learning for Positive-Unlabeled Classification"],"prefix":"10.1162","volume":"33","author":[{"given":"Tomoya","family":"Sakai","sequence":"first","affiliation":[{"name":"University of Tokyo, Kashiwa, Chiba 277-8561, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gang","family":"Niu","sequence":"additional","affiliation":[{"name":"RIKEN Center for Advanced Intelligence Project, Chuo-ku, Tokyo 103-0027, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masashi","family":"Sugiyama","sequence":"additional","affiliation":[{"name":"RIKEN Center for Advanced Intelligence Project, Chuo-ku, Tokyo 103-0027, Japan, and University of Tokyo, Kashiwa, Chiba 277-8561, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/85.3.549"},{"issue":"4","key":"B3","volume":"34","author":"Bonnans J. F.","year":"1996","journal-title":"SIAM Journal on Control and Optimization"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1137\/S0036144596302644"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511804441"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9780262033589.001.0001"},{"key":"B8","volume-title":"Elements of information theory","author":"Cover T. M.","year":"2006","edition":"2"},{"key":"B9","first-page":"1386","volume-title":"Proceedings of 32nd International Conference on Machine Learning","volume":"37","author":"du Plessis M. C.","year":"2015"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-016-5604-6"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.E97.D.1358"},{"key":"B12","first-page":"2121","volume":"12","author":"Duchi J.","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401920"},{"key":"B14","first-page":"315","volume-title":"Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics","author":"Glorot X.","year":"2011"},{"key":"B15","volume-title":"Deep learning","author":"Goodfellow I.","year":"2016"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7"},{"key":"B17","first-page":"448","volume-title":"Proceedings of the 32nd International Conference on Machine Learning","author":"Ioffe S.","year":"2015"},{"key":"B18","volume-title":"Advances in neural information processing systems","volume":"29","author":"Jain S.","year":"2016"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654889"},{"key":"B20","first-page":"1391","volume":"10","author":"Kanamori T.","year":"2009","journal-title":"Journal of Machine Learning Research"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-011-5266-3"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1016\/S1631-073X(03)00215-2"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.76.026209"},{"key":"B24","volume-title":"Proceedings of the Third International Conference on Learning Representations","author":"Kingma D. P.","year":"2015"},{"key":"B25","first-page":"1674","volume-title":"Advances in neural information processing systems","volume":"30","author":"Kiryo R.","year":"2017"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.066138"},{"key":"B27","first-page":"775","volume-title":"Advances in neural information processing systems","volume":"23","author":"Krause A.","year":"2010"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-377-6.50048-7"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-40992-0_6"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1991.10475035"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2010.2058578"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1109\/2.36"},{"key":"B34","volume-title":"Foundations of machine learning","author":"Mohri M.","year":"2012"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.52.2318"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT.2007.4557517"},{"key":"B37","volume-title":"Proceedings of the 33rd Conference on Uncertainty in Artificial Intelligence","author":"Northcutt C. G.","year":"2017"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1080\/14786440009463897"},{"key":"B39","volume-title":"Proceedings of the 33rd International Conference on Machine Learning","author":"Ramaswamy H. G.","year":"2016"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.E97.D.968"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.3390\/e15010080"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139035613"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1007\/s10463-011-0343-8"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00407"},{"key":"B45","first-page":"1","volume":"52","author":"Suzuki T.","year":"2009","journal-title":"BMC Bioinformatics"},{"key":"B46","first-page":"5","volume-title":"Proceedings of ECML-PKDD2008 Workshop on New Challenges for Feature Selection in Data Mining and Knowledge Discovery","volume":"4","author":"Suzuki T.","year":"2008"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1162\/153244303322753742"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1162\/0899766054323026"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1111\/j.1541-0420.2008.01116.x"},{"key":"B50","author":"Xiao H.","year":"2017","journal-title":"Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms."}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/neco_a_01337","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:43:55Z","timestamp":1615585435000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/33\/1\/244-268\/95659"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1162\/neco_a_01337"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_01337","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]}}}