{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T12:45:57Z","timestamp":1790945157405,"version":"4.1.0"},"reference-count":64,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM Rev."],"published-print":{"date-parts":[[2008,1]]},"abstract":"<jats:p>Recently many scientific and engineering applications have involved the challenging task of analyzing large amounts of unsorted high-dimensional data that have very complicated structures. From both geometric and statistical points of view, such unsorted data are considered mixed as different parts of the data have significantly different structures which cannot be described by a single model. In this paper we propose to use subspace arrangements\u2014a union of multiple subspaces\u2014for modeling mixed data: each subspace in the arrangement is used to model just a homogeneous subset of the data. Thus, multiple subspaces together can capture the heterogeneous structures within the data set. In this paper, we give a comprehensive introduction to a new approach for the estimation of subspace arrangements. This is known as generalized principal component analysis (GPCA). In particular, we provide a comprehensive summary of important algebraic properties and statistical facts that are crucial for making the inference of subspace arrangements both efficient and robust, even when the given data are corrupted by noise or contaminated with outliers. This new method in many ways improves and generalizes extant methods for modeling or clustering mixed data. There have been successful applications of this new method to many real-world problems in computer vision, image processing, and system identification. In this paper, we will examine several of those representative applications. This paper is intended to be expository in nature. However, in order that this may serve as a more complete reference for both theoreticians and practitioners, we take the liberty of filling in several gaps between the theory and the practice in the existing literature.<\/jats:p>","DOI":"10.1137\/060655523","type":"journal-article","created":{"date-parts":[[2008,8,5]],"date-time":"2008-08-05T18:02:36Z","timestamp":1217959356000},"page":"413-458","source":"Crossref","is-referenced-by-count":179,"title":["Estimation of Subspace Arrangements with Applications in Modeling and Segmenting Mixed Data"],"prefix":"10.1137","volume":"50","author":[{"given":"Yi","family":"Ma","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Allen Y.","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harm","family":"Derksen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Fossum","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2008,8,5]]},"reference":[{"key":"R1","first-page":"716","volume":"16","author":"Akaike H.","year":"1977","journal-title":"IEEE Trans. Automat. Control","ISSN":"https:\/\/id.crossref.org\/issn\/0018-9286","issn-type":"print"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1016\/0031-3203(81)90009-1"},{"key":"R3","unstructured":"V. Barnett and T. Lewis,\n                      Outliers in Statistical Data\n                      , 2nd ed., John Wiley & Sons, New York, 1983."},{"key":"R4","first-page":"145","volume":"3","author":"Bickel P.","year":"1976","journal-title":"Scand. J. Statist.","ISSN":"https:\/\/id.crossref.org\/issn\/0303-6898","issn-type":"print"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.1090\/S0025-5718-1973-0348991-3"},{"key":"R6","doi-asserted-by":"crossref","unstructured":"A. Bj\u00f6rner,\n                      Subspace arrangements\n                      , in First European Congress of Mathematics (Paris, 1992), Vol. I, Progr. Math. 119, Birkh\u00e4user, Basel, 1994, pp. 321\u2013370.","DOI":"10.1007\/978-3-0348-9110-3_10"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1112\/S0024610705006356"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.2307\/2347160"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.2307\/2346896"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008000628999"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/72.3.627"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"R13","unstructured":"H. Derksen,\n                      Hilbert Series of Subspace Arrangements\n                      , preprint, arXiv.org, 2005; available online from http:\/\/arxiv.org\/abs\/math\/0510584."},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.1007\/s003650010032"},{"key":"R15","unstructured":"D. Donoho,\n                      For Most Large Underdetermined Systems of Linear Equations, the Minimal $l^1$-norm Near-Solution Approximates the Sparsest Near-Solution\n                      , Technical report, Stanford University, Stanford, CA, 2004."},{"key":"R16","unstructured":"D. Donoho,\n                      For Most Large Underdetermined Systems of Linear Equations the Minimal $l^1$-norm Solution Is Also the Sparsest Solution\n                      , Technical report, Stanford University, Stanford, CA, 2004."},{"key":"R17","unstructured":"D. Donoho,\n                      Neighborly Polytopes and Sparsest Solution of Underdetermined Linear Equations\n                      , Technical report, Stanford University, Stanford, CA, 2004."},{"key":"R18","doi-asserted-by":"crossref","unstructured":"D. Eisenbud,\n                      Commutative Algebra with a View Toward Algebraic Geometry\n                      , Springer-Verlag, New York, 1995.","DOI":"10.1007\/978-1-4612-5350-1"},{"key":"R19","unstructured":"T. Ferguson,\n                      On the rejection of outliers\n                      , in Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability I, University of California Press, 1961, pp. 253\u2013287."},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1145\/358669.358692"},{"key":"R21","first-page":"768","volume":"21","author":"Forgy E.","year":"1965","journal-title":"Biometrics","ISSN":"https:\/\/id.crossref.org\/issn\/0006-341X","issn-type":"print"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.2307\/2528963"},{"key":"R23","unstructured":"F. Hampel, E. Ronchetti, P. Rousseeuw, and W. Stahel,\n                      Robust statistics: The approach based on influence functions\n                      , John Wiley & Sons, New York, 1986."},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1198\/016214501753168398"},{"key":"R25","doi-asserted-by":"crossref","unstructured":"J. Ho, M. Yang, J. Lim, K. Lee, and D. Kriegman,\n                      Clustering appearances of objects under varying illumination conditions\n                      , in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition I, 2003, pp. 11\u201318.","DOI":"10.1109\/CVPR.2003.1211332"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"W. Hong, J. Wright, K. Huang, and Y. Ma,\n                      A multi-scale hybrid linear model for lossy image representation\n                      , in Proceedings of the IEEE International Conference on Computer Vision I, 2005, pp. 764\u2013771.","DOI":"10.1109\/ICCV.2005.12"},{"key":"R27","doi-asserted-by":"crossref","unstructured":"K. Huang, A. Wagner, and Y. Ma,\n                      Identification of hybrid linear time-invariant systems via subspace embedding and segmentation\n                      , in Proceedings of the IEEE Conference on Decision and Control 3, 2004, pp. 3227\u20133234.","DOI":"10.1109\/CDC.2004.1428971"},{"key":"R28","doi-asserted-by":"crossref","unstructured":"P. Huber,\n                      Robust Statistics\n                      , John Wiley & Sons, New York, 1981.","DOI":"10.1002\/0471725250"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.1071\/BT9660127"},{"key":"R30","unstructured":"I. Jolliffe,\n                      Principal Component Analysis\n                      , 2nd ed., Springer-Verlag, New York, 2002."},{"key":"R31","unstructured":"K. Kanatani,\n                      Model selection for geometric inference\n                      , in Proceedings of Asian Conference on Computer Vision, 2002, pp. xxi\u2013xxxii."},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.1142\/S0219467802000585"},{"key":"R33","unstructured":"S. Lang,\n                      Algebra\n                      , Springer-Verlag, New York, 2002."},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1982.1056489"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1085"},{"key":"R36","doi-asserted-by":"crossref","unstructured":"Y. Ma and R. Vidal,\n                      A closed form solution to the identification of hybrid ARX models via the identification of algebraic varieties\n                      , in Proceedings of the International Conference on Hybrid Systems Computation and Control, 2005, pp. 449\u2013465.","DOI":"10.1007\/978-3-540-31954-2_29"},{"key":"R37","unstructured":"J. MacQueen,\n                      Some methods for classification and analysis of multivariate observations\n                      , in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, University of California Press, 1967, pp. 281\u2013297."},{"key":"R38","first-page":"661","volume":"15","author":"Mallows C.","year":"1973","journal-title":"Technometrics","ISSN":"https:\/\/id.crossref.org\/issn\/0040-1706","issn-type":"print"},{"key":"R39","unstructured":"G. McLachlan and T. Krishnan,\n                      The EM Algorithm and Extensions\n                      , John Wiley & Sons, New York, 1997."},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.1038\/381607a0"},{"key":"R41","doi-asserted-by":"crossref","unstructured":"P. Orlik,\n                      Introduction to Arrangements\n                      , CBMS Regional Conf. Ser.  Math. 72, AMS, Providence, RI, 1989.","DOI":"10.1090\/cbms\/072"},{"key":"R42","doi-asserted-by":"crossref","unstructured":"S. Rao, A. Yang, A. Wagner, and Y. Ma,\n                      Segmentation of hybrid motions via hybrid quadratic surface analysis\n                      , in Proceedings of IEEE International Conference on Computer Vision, 2005, pp. 2\u20139.","DOI":"10.1109\/ICCV.2005.214"},{"key":"R43","doi-asserted-by":"publisher","DOI":"10.1016\/0005-1098(78)90005-5"},{"key":"R44","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1984.10477105"},{"key":"R45","doi-asserted-by":"crossref","unstructured":"P. Rousseeuw and A. Leroy,\n                      Robust regression and outlier detection\n                      , John Wiley & Sons, New York, 1987.","DOI":"10.1002\/0471725382"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2323"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.1016\/0146-664X(82)90101-0"},{"key":"R48","unstructured":"K. Schindler and D. Suter,\n                      Two-view multibody structure-and-motion with outliers\n                      , in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2005, pp. 643\u2013648."},{"key":"R49","doi-asserted-by":"publisher","DOI":"10.1137\/S0036144598345802"},{"key":"R50","first-page":"1095","volume":"86","author":"Sugaya Y.","year":"2003","journal-title":"IEICE Trans. Inform. Systems","ISSN":"https:\/\/id.crossref.org\/issn\/0916-8532","issn-type":"print"},{"key":"R51","first-page":"1935","volume":"87","author":"Sugaya Y.","year":"2004","journal-title":"IEICE Trans. Inform. Systems","ISSN":"https:\/\/id.crossref.org\/issn\/0916-8532","issn-type":"print"},{"key":"R52","doi-asserted-by":"publisher","DOI":"10.1109\/34.103273"},{"key":"R53","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2319"},{"key":"R54","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.72"},{"key":"R55","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.1998.0224"},{"key":"R56","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1182098"},{"key":"R57","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007927408552"},{"key":"R58","doi-asserted-by":"crossref","unstructured":"V. Vapnik,\n                      The Nature of Statistical Learning Theory\n                      , Springer-Verlag, New York, 1995.","DOI":"10.1007\/978-1-4757-2440-0"},{"key":"R59","doi-asserted-by":"crossref","unstructured":"R. Vidal and Y. Ma,\n                      A unified algebraic approach to 2-D and 3-D motion segmentation\n                      , in Proceedings of European Conference on Computer Vision, 2004, pp. 1\u201315.","DOI":"10.1007\/978-3-540-24670-1_1"},{"key":"R60","doi-asserted-by":"crossref","unstructured":"R. Vidal, Y. Ma, and J. Piazzi,\n                      A new GPCA algorithm for clustering subspaces by fitting, differentiating and dividing polynomials\n                      , in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2004, pp. 510\u2013517.","DOI":"10.1109\/CVPR.2004.1315075"},{"key":"R61","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.13"},{"key":"R62","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/11.2.185"},{"key":"R63","unstructured":"A. Yang,\n                      Estimation of Subspace Arrangements: Its Algebra and Statistics\n                      , Ph.D. thesis, University of Illinois at Urbana-Champaign, 2006."},{"key":"R64","doi-asserted-by":"crossref","unstructured":"A. Yang, S. Rao, and Y. Ma,\n                      Robust statistical estimation and segmentation of multiple subspaces\n                      , in Workshop on 25 years of RANSAC, IEEE International Conference on Computer Vision and Pattern Recognition, 2006, p. 99.","DOI":"10.1109\/CVPRW.2006.178"}],"container-title":["SIAM Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/060655523","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T13:29:43Z","timestamp":1787232583000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/060655523"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,1]]},"references-count":64,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2008,1]]}},"alternative-id":["10.1137\/060655523"],"URL":"https:\/\/doi.org\/10.1137\/060655523","relation":{},"ISSN":["0036-1445","1095-7200"],"issn-type":[{"value":"0036-1445","type":"print"},{"value":"1095-7200","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,1]]}}}