{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T11:30:24Z","timestamp":1740137424826,"version":"3.37.3"},"reference-count":16,"publisher":"World Scientific Pub Co Pte Ltd","issue":"05","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Wavelets Multiresolut Inf. Process."],"published-print":{"date-parts":[[2018,9]]},"abstract":"<jats:p> Let [Formula: see text] be a data set in [Formula: see text], where [Formula: see text] is the training set and [Formula: see text] is the test one. Many unsupervised learning algorithms based on kernel methods have been developed to provide dimensionality reduction (DR) embedding for a given training set [Formula: see text] ([Formula: see text]) that maps the high-dimensional data [Formula: see text] to its low-dimensional feature representation [Formula: see text]. However, these algorithms do not straightforwardly produce DR of the test set [Formula: see text]. An out-of-sample extension method provides DR of [Formula: see text] using an extension of the existent embedding [Formula: see text], instead of re-computing the DR embedding for the whole set [Formula: see text]. Among various out-of-sample DR extension methods, those based on Nystr\u00f6m approximation are very attractive. Many papers have developed such out-of-extension algorithms and shown their validity by numerical experiments. However, the mathematical theory for the DR extension still need further consideration. Utilizing the reproducing kernel Hilbert space (RKHS) theory, this paper develops a preliminary mathematical analysis on the out-of-sample DR extension operators. It treats an out-of-sample DR extension operator as an extension of the identity on the RKHS defined on [Formula: see text]. Then the Nystr\u00f6m-type DR extension turns out to be an orthogonal projection. In the paper, we also present the conditions for the exact DR extension and give the estimate for the error of the extension. <\/jats:p>","DOI":"10.1142\/s021969131850042x","type":"journal-article","created":{"date-parts":[[2018,4,24]],"date-time":"2018-04-24T04:11:13Z","timestamp":1524543073000},"page":"1850042","source":"Crossref","is-referenced-by-count":1,"title":["Mathematical analysis on out-of-sample extensions"],"prefix":"10.1142","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9386-0242","authenticated-orcid":false,"given":"Jianzhong","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Mathematics and Statistics, Sam Houston State University, TX 77341, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2018,9,11]]},"reference":[{"key":"S021969131850042XBIB002","doi-asserted-by":"publisher","DOI":"10.1090\/S0002-9947-1950-0051437-7"},{"key":"S021969131850042XBIB003","doi-asserted-by":"publisher","DOI":"10.1126\/science.295.5552.7a"},{"key":"S021969131850042XBIB004","doi-asserted-by":"publisher","DOI":"10.1162\/089976603321780317"},{"key":"S021969131850042XBIB005","doi-asserted-by":"publisher","DOI":"10.1515\/9781400874668"},{"key":"S021969131850042XBIB006","first-page":"177","volume-title":"Adv. Neural Inform. Process. Syst.","volume":"16","author":"Bengio Y.","year":"2004"},{"key":"S021969131850042XBIB007","doi-asserted-by":"publisher","DOI":"10.1016\/j.acha.2006.04.006"},{"key":"S021969131850042XBIB009","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1031596100"},{"key":"S021969131850042XBIB010","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-1904-8"},{"key":"S021969131850042XBIB011","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-39351-3"},{"key":"S021969131850042XBIB012","volume-title":"Adv. Neural Inform. Process. Syst.","volume":"14","author":"Ng A.","year":"2001"},{"key":"S021969131850042XBIB013","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2323"},{"key":"S021969131850042XBIB014","doi-asserted-by":"publisher","DOI":"10.1162\/089976698300017467"},{"key":"S021969131850042XBIB016","doi-asserted-by":"publisher","DOI":"10.1109\/34.868688"},{"key":"S021969131850042XBIB018","doi-asserted-by":"publisher","DOI":"10.1016\/j.laa.2012.04.035"},{"volume-title":"Geometric Structure of High-Dimensional Data and Dimensionality Reduction","year":"2012","author":"Wang J. Z.","key":"S021969131850042XBIB019"},{"key":"S021969131850042XBIB020","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827502419154"}],"container-title":["International Journal of Wavelets, Multiresolution and Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S021969131850042X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,6]],"date-time":"2019-08-06T15:05:02Z","timestamp":1565103902000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S021969131850042X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9]]},"references-count":16,"journal-issue":{"issue":"05","published-online":{"date-parts":[[2018,9,11]]},"published-print":{"date-parts":[[2018,9]]}},"alternative-id":["10.1142\/S021969131850042X"],"URL":"https:\/\/doi.org\/10.1142\/s021969131850042x","relation":{},"ISSN":["0219-6913","1793-690X"],"issn-type":[{"type":"print","value":"0219-6913"},{"type":"electronic","value":"1793-690X"}],"subject":[],"published":{"date-parts":[[2018,9]]}}}