{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T06:06:07Z","timestamp":1791439567576,"version":"4.3.3"},"reference-count":66,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"3","funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1613861"],"award-info":[{"award-number":["DMS-1613861"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1907977"],"award-info":[{"award-number":["DMS-1907977"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1912654"],"award-info":[{"award-number":["DMS-1912654"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM Journal on Mathematics of Data Science"],"published-print":{"date-parts":[[2020,1]]},"abstract":"<jats:p>In this paper, we provide some analysis on the asymptotic escape of strict saddles in manifold optimization using the projected gradient descent algorithm (PGD). One of our main contributions is that we extend the current analysis to include nonisolated and possibly continuous saddle sets with complicated geometry. We prove that the PGD is able to escape strict critical submanifolds under certain conditions on the geometry and the distribution of the saddle point sets. We also show that the PGD may fail to escape strict saddles under weaker assumptions even if the saddle point set has zero measure. We apply this saddle analysis to the phase retrieval problem on the low-rank matrix manifold, prove that there are only a finite number of saddles, and that in a specific region, they are strict saddles with high probability. We also show the potential application of our analysis for a broader range of manifold optimization problems.<\/jats:p>","DOI":"10.1137\/19m129437x","type":"journal-article","created":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T14:12:01Z","timestamp":1600870321000},"page":"840-871","source":"Crossref","is-referenced-by-count":2,"title":["Analysis of Asymptotic Escape of Strict Saddle Sets in Manifold Optimization"],"prefix":"10.1137","volume":"2","author":[{"given":"Thomas Y.","family":"Hou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenzhen","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5794-2387","authenticated-orcid":true,"given":"Ziyun","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2020,9,23]]},"reference":[{"key":"atypb1","doi-asserted-by":"crossref","unstructured":"P.A. Absil and K. A. Gallivan,\n                      Joint diagonalization on the oblique manifold for independent component analysis\n                      , in Proceedings of the 2006 IEEE International Conference on Acoustics Speech and Signal Processing, Vol. 5, IEEE, Washington, DC, 2006, pp. V-V.","DOI":"10.1109\/ICASSP.2006.1661433"},{"key":"atypb2","first-page":"361","author":"Absil P.-A.","year":"2013","journal-title":"New York"},{"key":"atypb3","doi-asserted-by":"crossref","first-page":"3997","DOI":"10.1090\/S0002-9947-10-05073-7","volume":"362","author":"Banyaga A.","year":"2010","journal-title":"Trans. Amer. Math. Soc."},{"key":"atypb4","doi-asserted-by":"crossref","unstructured":"A. Banyaga and D. Hurtubise,\n                      Lectures on Morse Homology\n                      , Texts Math. Sci. 29, Springer, Dordrecht, The Netherlands, 2004.","DOI":"10.1007\/978-1-4020-2696-6"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1137\/11083109X"},{"key":"atypb6","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.acha.2013.10.001","volume":"37","author":"Cai J.-F.","year":"2014","journal-title":"Appl. Comput. Harmon. Anal."},{"key":"atypb7","unstructured":"J.F. Cai and K. Wei,\n                      Solving Systems of Phaseless Equations via Riemannian Optimization with Optimal Sampling Complexity\n                      , preprint,https:\/\/arxiv.org\/abs\/1809.02773, 2018."},{"key":"atypb8","doi-asserted-by":"crossref","first-page":"5239","DOI":"10.1109\/TSP.2019.2937282","volume":"67","author":"Chi Y.","year":"2019","journal-title":"IEEE Trans. Signal Process."},{"key":"atypb9","unstructured":"R. Cohen,\n                      Topics in Morse Theory\n                      , Department of Mathematics, Stanford University, Stanford, CA, 1991."},{"key":"atypb10","unstructured":"C. Criscitiello and N. Boumal,\n                      Efficiently escaping saddle points on manifolds\n                      , in Advances in Neural Information Processing Systems, NeurIPS, San Diego, CA, 2019, pp. 5985-5995."},{"key":"atypb11","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.laa.2015.04.015","volume":"481","author":"Da Silva C.","year":"2015","journal-title":"Linear Algebra Appl."},{"key":"atypb12","unstructured":"S. S. Du, C. Jin, J. D. Lee, M. I. Jordan, A. Singh, and B. Poczos,\n                      Gradient descent can take exponential time to escape saddle points\n                      , in Advances in Neural Information Processing Systems, NeurIPS, San Diego, CA, 2017, pp. 1067-1077."},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479895290954"},{"key":"atypb14","unstructured":"S. Fattahi and S. Sojoudi,\n                      Exact Guarantees on the Absence of Spurious Local Minima for Non-negative Robust Principal Component Analysis\n                      , preprint,https:\/\/arxiv.org\/abs\/1812.11466v1, 2018."},{"key":"atypb15","doi-asserted-by":"crossref","first-page":"2758","DOI":"10.1364\/AO.21.002758","volume":"21","author":"Fienup J. R.","year":"1982","journal-title":"Appl. Optics"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1137\/0717046"},{"key":"atypb17","first-page":"797","author":"Ge R.","year":"2015","journal-title":"PMLR"},{"key":"atypb18","unstructured":"R. Ge, J. D. Lee, and T. Ma,\n                      Matrix completion has no spurious local minimum\n                      , in Advances in Neural Information Processing Systems, NeurIPS, San Diego, CA, 2016, pp. 2973-2981."},{"key":"atypb19","first-page":"237","volume":"35","author":"Gerchberg R. W.","year":"1972","journal-title":"Optik"},{"key":"atypb20","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1016\/j.laa.2006.11.024","volume":"422","author":"Grubi\u0161i\u0107 I.","year":"2007","journal-title":"Linear Algebra Appl."},{"key":"atypb21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0024-3795(93)00070-G","volume":"215","author":"Helmke U.","year":"1995","journal-title":"Linear Algebra Appl."},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1137\/18M1230463"},{"key":"atypb23","first-page":"1480","author":"Ho J.","year":"2013","journal-title":"GA"},{"key":"atypb24","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1007\/s00211-011-0419-7","volume":"120","author":"Holtz S.","year":"2012","journal-title":"Numer. Math."},{"key":"atypb25","unstructured":"R. Hosseini and S. Sra,\n                      Matrix manifold optimization for Gaussian mixtures\n                      , in Advances in Neural Information Processing Systems, NeurIPS, San Diego, CA, 2015, pp. 910-918."},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1137\/18M1180827"},{"key":"atypb27","unstructured":"T. Y. Hou, Z. Li, and Z. Zhang,\n                      Fast Global Convergence for Low-rank Matrix Recovery via Riemannian Gradient Descent with Random Initialization\n                      , arxiv preprint, in preparation, 2020."},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1137\/17M1151390"},{"key":"atypb29","unstructured":"K. Jaganathan, Y. C. Eldar, and B. Hassibi,\n                      Phase Retrieval: An Overview of Recent Developments\n                      , preprint,https:\/\/arxiv.org\/abs\/1510.07713, 2015."},{"key":"atypb30","first-page":"1724","volume":"70","author":"Jin C.","year":"2017","journal-title":"PMLR"},{"key":"atypb31","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1109\/TSP.2012.2226167","volume":"61","author":"Kaneko T.","year":"2012","journal-title":"IEEE Trans. Signal Process."},{"key":"atypb32","first-page":"1012","volume":"48","author":"Kasai H.","year":"2016","journal-title":"PMLR"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1137\/050639703"},{"key":"atypb34","doi-asserted-by":"crossref","first-page":"064304","DOI":"10.1103\/PhysRevB.88.064304","volume":"88","author":"Kolodrubetz M.","year":"2013","journal-title":"Phys. Rev. B"},{"key":"atypb35","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1007\/s10543-013-0455-z","volume":"54","author":"Kressner D.","year":"2014","journal-title":"BIT"},{"key":"atypb36","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1098\/rspa.1931.0019","volume":"130","author":"Kronig R. D. L.","year":"1931","journal-title":"Proc. Roy. Soc. London Ser. A"},{"key":"atypb37","unstructured":"J. D. Lee, I. Panageas, G. Piliouras, M. Simchowitz, M. I. Jordan, and B. Recht,\n                      First-Order Methods Almost Always Avoid Saddle Points\n                      , preprint,https:\/\/arxiv.org\/abs\/1710.07406, 2017."},{"key":"atypb38","unstructured":"J. D. Lee, M. Simchowitz, M. I. Jordan, and B. Recht,\n                      Gradient Descent Converges to Minimizers\n                      , preprint,https:\/\/arxiv.org\/abs\/1602.04915, 2016."},{"key":"atypb39","first-page":"33","volume":"9","author":"Li T.-Y.","year":"1987","journal-title":"Mathematical Intelligencer"},{"key":"atypb40","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1007\/s41884-018-0015-3","volume":"1","author":"Li W.","year":"2018","journal-title":"Inform. Geom."},{"key":"atypb41","doi-asserted-by":"crossref","first-page":"3242","DOI":"10.1109\/TIT.2019.2956922","volume":"66","author":"Li Z.","year":"2020","journal-title":"IEEE Trans. Inform. Theory"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1137\/140976546"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1137\/16M1058686"},{"key":"atypb44","doi-asserted-by":"crossref","first-page":"18368","DOI":"10.1073\/pnas.1318679110","volume":"110","author":"Ozoli\u0146\u0161 V.","year":"2013","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"atypb45","unstructured":"I. Panageas and G. Piliouras,\n                      Gradient Descent Only Converges to Minimizers: Non-Isolated Critical Points and Invariant Regions\n                      , preprint,https:\/\/arxiv.org\/abs\/1605.00405, 2016."},{"key":"atypb46","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.cviu.2008.09.003","volume":"113","author":"Peyr\u00e9 G.","year":"2009","journal-title":"Comput. Vis. Image Understanding"},{"key":"atypb47","doi-asserted-by":"crossref","unstructured":"L. Pitaevskii and S. Stringari,\n                      Bose-Einstein Condensation and Superfluidity\n                      , Internat. Ser. Monogr. Phys. 164, Oxford University Press, Oxford, UK, 2016.","DOI":"10.1093\/acprof:oso\/9780198758884.001.0001"},{"key":"atypb48","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/BF02193559","volume":"76","author":"Provost J.","year":"1980","journal-title":"Comm. Math. Phys."},{"key":"atypb49","unstructured":"W. Rudin,\n                      Principles of Mathematical Analysis\n                      , 2nd ed., McGraw-Hill, New York, 1964."},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1137\/140957822"},{"key":"atypb51","first-page":"429","volume":"13","author":"Shalit U.","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"atypb52","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/MSP.2014.2352673","volume":"32","author":"Shechtman Y.","year":"2015","journal-title":"IEEE Signal Process. Mag."},{"key":"atypb53","first-page":"5730","author":"Shi L.","year":"2020","journal-title":"Washington, DC"},{"key":"atypb54","doi-asserted-by":"crossref","unstructured":"M. Shub,\n                      Global Stability of Dynamical Systems\n                      , Springer, New York, 1987.","DOI":"10.1007\/978-1-4757-1947-5"},{"key":"atypb55","first-page":"113","volume":"3","author":"Smith S. T.","year":"1994","journal-title":"Fields Inst. Commun."},{"key":"atypb56","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1109\/TIT.2016.2632162","volume":"63","author":"Sun J.","year":"2016","journal-title":"IEEE Trans. Inform. Theory"},{"key":"atypb57","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1007\/s10208-017-9365-9","volume":"18","author":"Sun J.","year":"2018","journal-title":"Found. Comput. Math."},{"key":"atypb58","unstructured":"Y. Sun, N. Flammarion, and M. Fazel,\n                      Escaping from saddle points on Riemannian manifolds\n                      , in Advances in Neural Information Processing Systems, NeurIPS, San Diego, CA, 2019, pp. 7274-7284."},{"key":"atypb59","first-page":"1","author":"Turaga P.","year":"2008","journal-title":"Washington, DC"},{"key":"atypb60","doi-asserted-by":"crossref","unstructured":"P. K. Turaga and A. Srivastava,\n                      Riemannian Computing in Computer Vision\n                      , Springer, New York, 2016.","DOI":"10.1007\/978-3-319-22957-7"},{"key":"atypb61","doi-asserted-by":"publisher","DOI":"10.1137\/110845768"},{"key":"atypb62","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.neunet.2013.11.009","volume":"51","author":"Wang J. J.-Y.","year":"2014","journal-title":"Neural Networks"},{"key":"atypb63","doi-asserted-by":"publisher","DOI":"10.1137\/15M1050525"},{"key":"atypb64","unstructured":"K. Ye, K. S.W. Wong, and L.H. Lim,\n                      Optimization on Flag Manifolds\n                      , preprint,https:\/\/arxiv.org\/abs\/1907.00949, 2019."},{"key":"atypb65","doi-asserted-by":"crossref","first-page":"100603","DOI":"10.1103\/PhysRevLett.99.100603","volume":"99","author":"Zanardi P.","year":"2007","journal-title":"Phys. Rev. Lett."},{"key":"atypb66","doi-asserted-by":"crossref","first-page":"3474","DOI":"10.1109\/TIP.2019.2961429","volume":"29","author":"Zeng J.","year":"2020","journal-title":"IEEE Trans. Image Process."}],"container-title":["SIAM Journal on Mathematics of Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/19M129437X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T15:38:26Z","timestamp":1787326706000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/19M129437X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1]]},"references-count":66,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,1]]}},"alternative-id":["10.1137\/19M129437X"],"URL":"https:\/\/doi.org\/10.1137\/19m129437x","relation":{},"ISSN":["2577-0187"],"issn-type":[{"value":"2577-0187","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1]]}}}