{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,6,11]],"date-time":"2024-06-11T02:12:29Z","timestamp":1718071949511},"reference-count":45,"publisher":"MIT Press","issue":"10","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2017,10]]},"abstract":"<jats:p>Canonical correlation analysis (CCA) is a useful tool in detecting the latent relationship between two sets of multivariate variables. In theoretical analysis of CCA, a regularization technique is utilized to investigate the consistency of its analysis. This letter addresses the consistency property of CCA from a least squares view. We construct a constrained empirical risk minimization framework of CCA and apply a two-stage randomized Kaczmarz method to solve it. In the first stage, we remove the noise, and in the second stage, we compute the canonical weight vectors. Rigorous theoretical consistency is addressed. The statistical consistency of this novel scenario is extended to the kernel version of it. Moreover, experiments on both synthetic and real-world data sets demonstrate the effectiveness and efficiency of the proposed algorithms.<\/jats:p>","DOI":"10.1162\/neco_a_00996","type":"journal-article","created":{"date-parts":[[2017,8,4]],"date-time":"2017-08-04T17:45:22Z","timestamp":1501868722000},"page":"2825-2859","source":"Crossref","is-referenced-by-count":3,"title":["Constrained ERM Learning of Canonical Correlation Analysis: A Least Squares Perspective"],"prefix":"10.1162","volume":"29","author":[{"given":"Jia","family":"Cai","sequence":"first","affiliation":[{"name":"School of Mathematics and Statistics, Guangdong University of Finance and Economics, Guangzhou, Guangdong, 510320, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongwei","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Science, University of Jinan, Jinan, Shandong, 250022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","volume-title":"Proceedings of the International Meeting of the Psychometric Society","author":"Akaho S.","year":"2001"},{"key":"B2","first-page":"1247","volume":"28","author":"Andrew G.","year":"2013","journal-title":"Proceedings of the 30th International Conference on Machine Learning"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1007\/s11425-011-4245-2"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1007\/s00041-012-9237-2"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.104"},{"key":"B7","author":"Chu D.","year":"2013","journal-title":"Proceedings of International Multiconference of Engineers and Computer Scientists"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511618796"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1090\/S0025-5718-1988-0929546-7"},{"key":"B10","first-page":"1363","volume":"5","author":"De Vito E.","year":"2004","journal-title":"Journal of Machine Learning Research"},{"key":"B11","first-page":"355","volume-title":"Advances in neural information processing systems","volume":"18","author":"Farquhar J.","year":"2005"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2005.10.010"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1117\/12.131447"},{"key":"B14","first-page":"361","volume":"8","author":"Fukumizu K.","year":"2007","journal-title":"Journal of Machine Learning Research"},{"key":"B15","volume-title":"Proceedings of the 33rd Int. Conf. Machine Learning","author":"Ge R.","year":"2016"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-4228-4_3"},{"key":"B17","first-page":"13","author":"Grubinger M.","year":"2006","journal-title":"Proceedings of the International Conference on Language Resources and Evaluation"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-008-5085-3"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-010-5222-7"},{"key":"B20","volume-title":"Proceedings of Medical Image Understanding and Analysis","author":"Hardoon D. R.","year":"2004"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1162\/0899766042321814"},{"key":"B22","volume-title":"Image reconstruction from projections: The fundamentals of computerized tomography","author":"Herman G. T.","year":"1980"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/28.3-4.321"},{"key":"B24","first-page":"335","volume":"35","author":"Kaczmarz S.","year":"1937","journal-title":"Bulletin International de l'Acad\u00e9mie Polonaise des Sciences et des Lettres"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72927-3_8"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/58.3.433"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1142\/S012906570000034X"},{"key":"B28","first-page":"3341","volume":"16","author":"Lin J. H.","year":"2015","journal-title":"Journal of Machine Learning Research"},{"key":"B29","author":"Ma Z.","year":"2015","journal-title":"Proceedings of the 32st Int. Conf. Machine Learning"},{"key":"B30","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-663-01409-6","volume-title":"The mathematics of computerized tomography","author":"Natterer F.","year":"1986"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1007\/s10543-010-0265-5"},{"key":"B32","volume-title":"Learning with kernels: Support vector machines, regularization, optimization, and beyond","author":"Sch\u00f6lkopf B.","year":"2002"},{"key":"B33","first-page":"415","volume-title":"Image recovery: Theory and application","author":"Sezan K. M.","year":"1987"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1090\/S0273-0979-04-01025-0"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1007\/s00041-008-9030-4"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-013-1362-6"},{"key":"B37","first-page":"1449","volume-title":"Advances in neural information processing systems","volume":"15","author":"Vert J. P.","year":"2002"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2006.09.011"},{"key":"B39","first-page":"1473","volume-title":"Advances in neural information processing systems","author":"Vinokourov A.","year":"2002"},{"key":"B40","author":"Wang W. R.","year":"2015","journal-title":"Large-scale approximate kernel canonical correlation analysis"},{"key":"B41","author":"Wilms I.","year":"2015","journal-title":"Robust sparse canonical correlation analysis"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1093\/biostatistics\/kxp008"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btg1045"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2003.813564"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1137\/120889897"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/neco_a_00996","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,31]],"date-time":"2022-07-31T20:25:32Z","timestamp":1659299132000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/29\/10\/2825-2859\/8309"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10]]},"references-count":45,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2017,10]]}},"alternative-id":["10.1162\/neco_a_00996"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00996","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10]]}}}