{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T04:31:37Z","timestamp":1741753897594,"version":"3.38.0"},"reference-count":32,"publisher":"SAGE Publications","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2020,12,18]]},"abstract":"<jats:p>Irregular features disrupt the desired classification. In this paper, we consider aggressively modifying scales of features in the original space according to the label information to form well-separated clusters in low-dimensional space. The proposed method exploits spectral clustering to derive scaling factors that are used to modify the features. Specifically, we reformulate the Laplacian eigenproblem of the spectral clustering as an eigenproblem of a linear matrix pencil whose eigenvector has the scaling factors. Numerical experiments show that the proposed method outperforms well-established supervised dimensionality reduction methods for toy problems with more samples than features and real-world problems with more features than samples.<\/jats:p>","DOI":"10.3233\/ida-194942","type":"journal-article","created":{"date-parts":[[2020,12,22]],"date-time":"2020-12-22T20:04:47Z","timestamp":1608667487000},"page":"1273-1287","source":"Crossref","is-referenced-by-count":2,"title":["Multiclass spectral feature scaling method for dimensionality reduction"],"prefix":"10.1177","volume":"24","author":[{"given":"Momo","family":"Matsuda","sequence":"first","affiliation":[]},{"given":"Keiichi","family":"Morikuni","sequence":"additional","affiliation":[]},{"given":"Akira","family":"Imakura","sequence":"additional","affiliation":[]},{"given":"Xiucai","family":"Ye","sequence":"additional","affiliation":[]},{"given":"Tetsuya","family":"Sakurai","sequence":"additional","affiliation":[]}],"member":"179","reference":[{"issue":"2","key":"10.3233\/IDA-194942_ref1","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.jneumeth.2006.04.023","article-title":"Spike sorting: Bayesian clustering of non-stationary data","volume":"157","author":"Bar-Hillel","year":"2006","journal-title":"Journal of Neuroscience Methods"},{"issue":"10","key":"10.3233\/IDA-194942_ref2","doi-asserted-by":"crossref","first-page":"2385","DOI":"10.1162\/089976600300014980","article-title":"Generalized discriminant analysis using a kernel approach","volume":"12","author":"Baudat","year":"2000","journal-title":"Journal of Neural Computation"},{"issue":"7","key":"10.3233\/IDA-194942_ref3","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1109\/34.598228","article-title":"Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection","volume":"19","author":"Belhumeur","year":"1997","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"15","key":"10.3233\/IDA-194942_ref5","doi-asserted-by":"crossref","first-page":"2743","DOI":"10.1016\/S0167-8655(03)00117-X","article-title":"Nonparametric discriminant analysis and nearest neighbor classification","volume":"24","author":"Bressan","year":"2003","journal-title":"Pattern Recognition Letters"},{"key":"10.3233\/IDA-194942_ref6","doi-asserted-by":"crossref","unstructured":"D. Cai, X. He and J. Han, Efficient kernel discriminant analysis via spectral regression, in: Seventh IEEE International Conference on Data Mining (ICDM 2007), 2007, pp. 427\u2013432.","DOI":"10.1109\/ICDM.2007.88"},{"key":"10.3233\/IDA-194942_ref7","unstructured":"D. Cai, X. He, K. Zhou, J. Han and H. Bao, Locality sensitive discriminant analysis, in: Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI 2011), 2007, pp. 708\u2013713."},{"issue":"2","key":"10.3233\/IDA-194942_ref9","doi-asserted-by":"crossref","first-page":"298","DOI":"10.21136\/CMJ.1973.101168","article-title":"Algebraic connectivity of graphs","volume":"23","author":"Fiedler","year":"1973","journal-title":"Czechoslovak Mathematical Journal"},{"key":"10.3233\/IDA-194942_ref10","unstructured":"M. Harandi, M. Salzmann and R. Hartley, Joint dimensionality reduction and metric learning: A geometric take, in: Proceedings of the 34th International Conference on Machine Learning, 2017, pp. 1404\u20131413."},{"key":"10.3233\/IDA-194942_ref12","unstructured":"X. He and P. Niyogi, Locality preserving projections, in: Proceedings of the 16th International Conference on Neural Information Processing Systems, 2003, pp. 153\u2013160."},{"issue":"6","key":"10.3233\/IDA-194942_ref13","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1037\/h0071325","article-title":"Analysis of a complex of statistical variables into principal components","volume":"24","author":"Hotelling","year":"1933","journal-title":"Journal of Educational Psychology"},{"issue":"2","key":"10.3233\/IDA-194942_ref14","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1109\/72.991427","article-title":"A comparison of methods for multiclass support vector machines","volume":"13","author":"Hsu","year":"2002","journal-title":"IEEE Transactions on Neural Networks"},{"issue":"1","key":"10.3233\/IDA-194942_ref15","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1137\/14099231X","article-title":"An algorithm for the generalized eigenvalue problem for nonsquare matrix pencils by minimal perturbation approach","volume":"37","author":"Ito","year":"2016","journal-title":"SIAM Journal on Matrix Analysis and Applications"},{"issue":"7","key":"10.3233\/IDA-194942_ref17","doi-asserted-by":"crossref","first-page":"2649","DOI":"10.1021\/cr9800964","article-title":"Computational methods for the analysis of chemical sensor array data from volatile analytes","volume":"100","author":"Jurs","year":"2000","journal-title":"Chemical Reviews"},{"key":"10.3233\/IDA-194942_ref18","doi-asserted-by":"crossref","unstructured":"X. Li, M. Chen, F. Nie and Q. Wang, Locality adaptive discriminant analysis, in: Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI 2017), 2017, pp. 2201\u20132207.","DOI":"10.24963\/ijcai.2017\/306"},{"key":"10.3233\/IDA-194942_ref19","doi-asserted-by":"crossref","unstructured":"M. Matsuda, K. Morikuni and T. Sakurai, Spectral feature scaling method for supervised dimensionality reduction, in: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2018), 2018, pp. 2560\u20132566.","DOI":"10.24963\/ijcai.2018\/355"},{"key":"10.3233\/IDA-194942_ref20","unstructured":"K. Morikuni, Contour integral-type method for eigenproblems of rectangular matrix pencils, in: Book of Abstracts, Annual Meeting 2016 of the Japan Society for Industrial and Applied Mathematics, Kitakyushu, Japan, 2016, pp. 352\u2013353."},{"key":"10.3233\/IDA-194942_ref21","doi-asserted-by":"crossref","unstructured":"Y. Mu, Fixed-rank supervised metric learning on riemannian manifold, in: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16), 2016, pp. 1941\u20131947.","DOI":"10.1609\/aaai.v30i1.10246"},{"key":"10.3233\/IDA-194942_ref22","unstructured":"A.Y. Ng, M.I. Jordan and W. Yair, On spectral clustering: Analysis and an algorithm, in: Advances in Neural Information Processing Systems 14, 2002, pp. 849\u2013856."},{"issue":"8","key":"10.3233\/IDA-194942_ref23","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1109\/34.868688","article-title":"Normalized cuts and image segmentation","volume":"22","author":"Shi","year":"2000","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"6","key":"10.3233\/IDA-194942_ref24","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1016\/j.csi.2005.07.002","article-title":"Wired and wireless intrusion detection system: Classifications, good characteristics and state-of-the-art","volume":"28","author":"Sogh","year":"2006","journal-title":"Computer Standards & Interfaces"},{"key":"10.3233\/IDA-194942_ref25","first-page":"583","article-title":"Cluster ensembles \u2013 a knowledge reuse framework for combining multiple partitions","volume":"3","author":"Strehl","year":"2002","journal-title":"Journal of Machine Learning Research"},{"key":"10.3233\/IDA-194942_ref26","doi-asserted-by":"crossref","unstructured":"M. Sugiyama, Local Fisher discriminant analysis for supervised dimensionality reduction, in: Proceedings of the 23rd International Conference on Machine Learning, 2006, pp. 905\u2013912.","DOI":"10.1145\/1143844.1143958"},{"key":"10.3233\/IDA-194942_ref27","first-page":"1027","article-title":"Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis","volume":"8","author":"Sugiyama","year":"2007","journal-title":"Journal of Machine Learning Research"},{"issue":"2","key":"10.3233\/IDA-194942_ref28","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/j.ajog.2006.07.001","article-title":"Analysis of microarray experiments of gene expression profiling","volume":"195","author":"Tarca","year":"2006","journal-title":"American Journal of Obstetrics and Gynecology"},{"issue":"4","key":"10.3233\/IDA-194942_ref29","doi-asserted-by":"crossref","first-page":"507","DOI":"10.5465\/amr.1979.4498309","article-title":"Social network analysis for organizations","volume":"4","author":"Tichy","year":"1979","journal-title":"Academy of Management Review"},{"key":"10.3233\/IDA-194942_ref30","first-page":"2579","article-title":"Visualizing high-dimensional data using t-SNE","volume":"9","author":"van der Maaten","year":"2008","journal-title":"Journal of Machine Learning Research"},{"issue":"11","key":"10.3233\/IDA-194942_ref31","doi-asserted-by":"crossref","first-page":"2077","DOI":"10.1109\/LGRS.2017.2751559","article-title":"Locality adaptive discriminant analysis for spectral-spatial classification of hyperspectral images","volume":"14","author":"Wang","year":"2017","journal-title":"IEEE Geoscience and Remote Sensing Letters"},{"key":"10.3233\/IDA-194942_ref32","first-page":"207","article-title":"Distance metric learning for large margin nearest neighbor classification","volume":"10","author":"Weinberger","year":"2009","journal-title":"Journal of Machine Learning Research"},{"key":"10.3233\/IDA-194942_ref33","unstructured":"X. Ye, K. Ji and T. Sakurai, Spectral clustering and discriminant analysis for unsupervised feature selection, in: Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, 2016, pp.\u00a0563\u2013568."},{"key":"10.3233\/IDA-194942_ref34","doi-asserted-by":"crossref","unstructured":"X. Ye, H. Li, T. Sakurai and Z. Liu, Large scale spectral clustering using sparse representation based on hubness, in: Proceeding of the IEEE International Conference on Cloud and Big Data Computing, 2018, pp. 1731\u20131737.","DOI":"10.1109\/SmartWorld.2018.00293"},{"issue":"4","key":"10.3233\/IDA-194942_ref35","doi-asserted-by":"crossref","first-page":"751","DOI":"10.3233\/IDA-173436","article-title":"Spectral clustering with adaptive similarity measure in Kernel space","volume":"22","author":"Ye","year":"2018","journal-title":"Intelligent Data Analysis"},{"key":"10.3233\/IDA-194942_ref36","unstructured":"L. Zelnik-Manor and P. Perona, Self-tuning spectral clustering, in: Proceedings of Advances in Neural Information Processing Systems 17, 2005, pp. 1601\u20131608."}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-194942","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,11]],"date-time":"2025-03-11T10:05:37Z","timestamp":1741687537000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-194942"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,18]]},"references-count":32,"journal-issue":{"issue":"6"},"URL":"https:\/\/doi.org\/10.3233\/ida-194942","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"type":"print","value":"1088-467X"},{"type":"electronic","value":"1571-4128"}],"subject":[],"published":{"date-parts":[[2020,12,18]]}}}